Mercurial > pylearn

view pylearn/gd/README.txt @ 1501:55534951dd91

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Clean up import and remove deprecation warning.
author Frederic Bastien <nouiz@nouiz.org>
date Fri, 09 Sep 2011 10:53:46 -0400
parents 78a09cdd449b
children
line wrap: on
line source


see __init__.py


TODO: - add an sgd with annealed learning rate (the annealing schedule is implemented via
shared variables and an update schedule

Wishlist:
    - sgd 
    - momentum
    - annealing schedule
    - conjugate methods
    - l-bfgs
    - hessian free
    - tonga
    - smth by nick schraudolff (sp?)

Theano needs lazy if for these to be efficient


Early stopping heuristics as update expressions too?