Mercurial > pylearn
view pylearn/gd/README.txt @ 1498:0f326860210e
Merged
author | Olivier Delalleau <delallea@iro> |
---|---|
date | Thu, 01 Sep 2011 13:35:15 -0400 |
parents | 78a09cdd449b |
children |
line wrap: on
line source
see __init__.py TODO: - add an sgd with annealed learning rate (the annealing schedule is implemented via shared variables and an update schedule Wishlist: - sgd - momentum - annealing schedule - conjugate methods - l-bfgs - hessian free - tonga - smth by nick schraudolff (sp?) Theano needs lazy if for these to be efficient Early stopping heuristics as update expressions too?