Mercurial > pylearn
view pylearn/gd/README.txt @ 1524:9d21919e2332
autopep8
author | Frederic Bastien <nouiz@nouiz.org> |
---|---|
date | Fri, 02 Nov 2012 13:02:18 -0400 |
parents | 78a09cdd449b |
children |
line wrap: on
line source
see __init__.py TODO: - add an sgd with annealed learning rate (the annealing schedule is implemented via shared variables and an update schedule Wishlist: - sgd - momentum - annealing schedule - conjugate methods - l-bfgs - hessian free - tonga - smth by nick schraudolff (sp?) Theano needs lazy if for these to be efficient Early stopping heuristics as update expressions too?