Cost should be summed over the units, but averaged across batches. Taking the mean blindly results in larger than necessary learning rates.