Mercurial > pylearn

view pylearn/gd/README.txt @ 1516:57feab73c783

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Remove :api: role, do not generate epydoc by default
author Pascal Lamblin <lamblinp@iro.umontreal.ca>
date Mon, 05 Mar 2012 17:35:15 -0500
parents 78a09cdd449b
children
line wrap: on
line source


see __init__.py


TODO: - add an sgd with annealed learning rate (the annealing schedule is implemented via
shared variables and an update schedule

Wishlist:
    - sgd 
    - momentum
    - annealing schedule
    - conjugate methods
    - l-bfgs
    - hessian free
    - tonga
    - smth by nick schraudolff (sp?)

Theano needs lazy if for these to be efficient


Early stopping heuristics as update expressions too?