Mercurial > pylearn

annotate sandbox/simple_autoassociator/graph.py @ 524:317a052f9b14

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
better main, allow to debug in a debugger.
author Frederic Bastien <bastienf@iro.umontreal.ca>
date Fri, 14 Nov 2008 16:46:03 -0500
parents 8849eba55520
children
rev   line source
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
1 """
386
a474341861fa Added a simple AA
Joseph Turian <turian@gmail.com>
parents: 384
diff changeset
2 Theano graph for a simple autoassociator.
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
3 @todo: Make nearly everything private.
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
4 """
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
5
383
344d1f874af7 Small fix
Joseph Turian <turian@gmail.com>
parents: 382
diff changeset
6 from pylearn.nnet_ops import sigmoid, binary_crossentropy
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
7 from theano import tensor as t
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
8 from theano.tensor import dot
416
8849eba55520 Can now do minibatch update
Joseph Turian <turian@iro.umontreal.ca>
parents: 411
diff changeset
9 x = t.dmatrix()
386
a474341861fa Added a simple AA
Joseph Turian <turian@gmail.com>
parents: 384
diff changeset
10 w1 = t.dmatrix()
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
11 b1 = t.dvector()
386
a474341861fa Added a simple AA
Joseph Turian <turian@gmail.com>
parents: 384
diff changeset
12 w2 = t.dmatrix()
a474341861fa Added a simple AA
Joseph Turian <turian@gmail.com>
parents: 384
diff changeset
13 b2 = t.dvector()
a474341861fa Added a simple AA
Joseph Turian <turian@gmail.com>
parents: 384
diff changeset
14 h = sigmoid(dot(x, w1) + b1)
a474341861fa Added a simple AA
Joseph Turian <turian@gmail.com>
parents: 384
diff changeset
15 y = sigmoid(dot(h, w2) + b2)
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
16
388
98ca97cc9910 Debugging simple AA
Joseph Turian <turian@gmail.com>
parents: 386
diff changeset
17 loss_unsummed = binary_crossentropy(y, x)
98ca97cc9910 Debugging simple AA
Joseph Turian <turian@gmail.com>
parents: 386
diff changeset
18 loss = t.sum(loss_unsummed)
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
19
411
faffaae0d2f9 Autoassociator now seems to work
Joseph Turian <turian@iro.umontreal.ca>
parents: 404
diff changeset
20 (gw1, gb1, gw2, gb2) = t.grad(loss, [w1, b1, w2, b2])
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
21
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
22 import theano.compile
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
23
386
a474341861fa Added a simple AA
Joseph Turian <turian@gmail.com>
parents: 384
diff changeset
24 inputs = [x, w1, b1, w2, b2]
411
faffaae0d2f9 Autoassociator now seems to work
Joseph Turian <turian@iro.umontreal.ca>
parents: 404
diff changeset
25 outputs = [y, h, loss, gw1, gb1, gw2, gb2]
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
26 trainfn = theano.compile.function(inputs, outputs)