# HG changeset patch # User Frederic Bastien # Date 1294782190 18000 # Node ID 702a933794f79e11ad10cd6187558d64c001e442 # Parent 310e22d7e44b8323948b6b5fb41810b582049697 small format change. diff -r 310e22d7e44b -r 702a933794f7 doc/v2_planning/datalearn_pytables.txt --- a/doc/v2_planning/datalearn_pytables.txt Mon Jan 10 14:55:39 2011 -0500 +++ b/doc/v2_planning/datalearn_pytables.txt Tue Jan 11 16:43:10 2011 -0500 @@ -11,30 +11,38 @@ Here is the ticket that I plan to do. They are in order. --1) Fix ift6266 script to load PNIST data (DONE) -0) Put PNIST in PyTable format -1) example with PyTable data in python -2) basic filter in the dataset in python -3) example with PyTable output in python -?) put stats in the pytables to don't read the file each time to normalize - Maybe we will try another mechanism. But I will start with this one as it seam simple to do. -4) example with PyTable data in theano -5) basic filter in the dataset in theano -6) example with PyTable output in theano -7) plan a way to store the output temporarily(delete it and store locally) + - Fix ift6266 script to load PNIST data (DONE) + - Put PNIST in PyTable format + - example with PyTable data in python + - basic filter in the dataset in python + - example with PyTable output in python + - ? put stats in the pytables to don't read the file each time to normalize + Maybe we will try another mechanism. But I will start with this one as it seam simple to do. + - example with PyTable data in theano + - basic filter in the dataset in theano + - example with PyTable output in theano + - plan a way to store the output temporarily(delete it and store locally) The 1,2,3 are their to verify that PyTable can do what we want! Here is the current plan. -- Make a PyTableVariable -- Make a PyTableSubtensor op(or reuse the current one) to allow take a -slice on the new variable -- Allow scan to work with this new PyTableVariable in input -- Allow scan to work with this new PyTableVariable in output + - Make a PyTableVariable + - Make a PyTableSubtensor op(or reuse the current one) to allow take a + slice on the new variable + - Allow scan to work with this new PyTableVariable in input + - Allow scan to work with this new PyTableVariable in output At first no inplace op. So no view_map and destory_map won't work. The way I see it is as an interface to a file inside theano. No direct modification allowed first. -#clone OD repo -git clone git@github.com:nouiz/pylearn.git Pylearn.nouiz -#create a local branch that track the remote branch -git checkout -b variants origin/pytables +Getting the code +---------------- + +- clone FB repo: + + .. code-block:: bash + git clone git@github.com:nouiz/pylearn.git Pylearn.nouiz + +- create a local branch that track the remote branch + + .. code-block:: bash + git checkout -b variants origin/pytables