Mercurial > pylearn

changeset 1268:78a09cdd449b

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
added some wishlist items for gd module
author James Bergstra <bergstrj@iro.umontreal.ca>
date Fri, 03 Sep 2010 12:35:49 -0400
parents 075c193afd1b
children c24c98da5615
files pylearn/gd/README.txt
diffstat 1 files changed, 19 insertions(+), 0 deletions(-) [+]
line wrap: on
line diff
--- a/pylearn/gd/README.txt	Fri Sep 03 12:35:10 2010 -0400
+++ b/pylearn/gd/README.txt	Fri Sep 03 12:35:49 2010 -0400
@@ -1,2 +1,21 @@
 
 see __init__.py
+
+
+TODO: - add an sgd with annealed learning rate (the annealing schedule is implemented via
+shared variables and an update schedule
+
+Wishlist:
+    - sgd 
+    - momentum
+    - annealing schedule
+    - conjugate methods
+    - l-bfgs
+    - hessian free
+    - tonga
+    - smth by nick schraudolff (sp?)
+
+Theano needs lazy if for these to be efficient
+
+
+Early stopping heuristics as update expressions too?