Mercurial > pylearn
annotate _test_dataset.py @ 6:d5738b79089a
Removed MinibatchIterator and instead made minibatch_size a field of all DataSets,
so that they can all iterate over minibatches, optionally.
| author | bengioy@bengiomac.local |
|---|---|
| date | Mon, 24 Mar 2008 09:04:06 -0400 |
| parents | f7dcfb5f9d5b |
| children | 6f8f338686db |
| rev | line source |
|---|---|
| 4 | 1 from dataset import * |
| 2 from math import * | |
| 3 import unittest | |
| 4 | |
| 5 def _sum_all(a): | |
| 6 s=a | |
| 7 while isinstance(s,numpy.ndarray): | |
| 8 s=sum(s) | |
| 9 return s | |
| 10 | |
| 11 class T_arraydataset(unittest.TestCase): | |
| 12 def setUp(self): | |
| 13 numpy.random.seed(123456) | |
| 14 | |
| 15 def test0(self): | |
|
6
d5738b79089a
Removed MinibatchIterator and instead made minibatch_size a field of all DataSets,
bengioy@bengiomac.local
parents:
4
diff
changeset
|
16 a=ArrayDataSet(data=numpy.random.rand(8,3),fields={"x":slice(2),"y":slice(1,3)},minibatch_size=1) |
| 4 | 17 s=0 |
| 18 for example in a: | |
| 19 s+=_sum_all(example.x) | |
| 20 print s | |
| 21 self.failUnless(abs(s-11.4674133)<1e-6) | |
|
6
d5738b79089a
Removed MinibatchIterator and instead made minibatch_size a field of all DataSets,
bengioy@bengiomac.local
parents:
4
diff
changeset
|
22 a.minibatch_size=2 |
|
d5738b79089a
Removed MinibatchIterator and instead made minibatch_size a field of all DataSets,
bengioy@bengiomac.local
parents:
4
diff
changeset
|
23 for mb in a: |
|
d5738b79089a
Removed MinibatchIterator and instead made minibatch_size a field of all DataSets,
bengioy@bengiomac.local
parents:
4
diff
changeset
|
24 print mb |
|
d5738b79089a
Removed MinibatchIterator and instead made minibatch_size a field of all DataSets,
bengioy@bengiomac.local
parents:
4
diff
changeset
|
25 |
| 4 | 26 |
| 27 if __name__ == '__main__': | |
| 28 unittest.main() | |
| 29 |