# HG changeset patch # User Olivier Delalleau # Date 1283820118 14400 # Node ID 0ddb5f637ce35808116df4699b793b189519e1bd # Parent c6a74b24330b98776ce9d2fca0cb0b46188f1904# Parent a1b6ccd5b6dc026aa5b2a716295775fed6902745 Merged diff -r c6a74b24330b -r 0ddb5f637ce3 doc/v2_planning/committees.txt --- a/doc/v2_planning/committees.txt Mon Sep 06 20:41:51 2010 -0400 +++ b/doc/v2_planning/committees.txt Mon Sep 06 20:41:58 2010 -0400 @@ -2,11 +2,11 @@ * Existing Python ML libraries investigation: GD, DWF, IG, DE * Dataset interface: DE, OB, OD, AB, PV -* Learners: AB, PL, GM, IG, RP +* Learners: AB, PL, GM, IG, RP, NB * Optimization: JB, PL, OD * Inference/sampling: JB, GD, AC * Job management, analysis, metrics, costs, visualization: GD, FS, PL, XM -* Formulas/tags: FB, NB, RP, AC, OB +* Formulas/tags: FB, RP, AC, OB * Coding style: DE, OD, DWF, FB Issues to be tackled in the future: diff -r c6a74b24330b -r 0ddb5f637ce3 doc/v2_planning/optimization.txt --- a/doc/v2_planning/optimization.txt Mon Sep 06 20:41:51 2010 -0400 +++ b/doc/v2_planning/optimization.txt Mon Sep 06 20:41:58 2010 -0400 @@ -30,8 +30,12 @@ - sgd with annealing schedule - TONGA - James Marten's Hessian-free + - Conjugate gradients, batch and (large) mini-batch [that is also what Marten's thing does] Do we need anything to make batch algos work better with Pylearn things? - - conjugate methods? - - L-BFGS? + - conjugate methods? yes + - L-BFGS? maybe, when needed + + + diff -r c6a74b24330b -r 0ddb5f637ce3 doc/v2_planning/sampler.txt --- a/doc/v2_planning/sampler.txt Mon Sep 06 20:41:51 2010 -0400 +++ b/doc/v2_planning/sampler.txt Mon Sep 06 20:41:58 2010 -0400 @@ -1,3 +1,6 @@ + +Inference / Sampling committee: JB, GD, AC + OVERVIEW ======== @@ -36,4 +39,12 @@ * Annealing * Parallel Tempering, Tempered Transitions, Simulated Tempering * Nested Sampling (?) -* Hamiltonian Monte Carlo +* Hamiltonian Monte Carlo --> or is it Hybrid Monte Carlo? + +3. USAGE PATTERNS +================= + +* MCMC methods have a usage pattern that is quite different from the kind of univariate sampling methods +needed for nice-and-easy parametric families. + +