annotate sandbox/rbm/globals.py @ 403:273e5c03003e

Making linear_regression more robust
author Yoshua Bengio <bengioy@iro.umontreal.ca>
date Wed, 09 Jul 2008 17:55:46 -0400
parents ffdd2c199f2a
children 8cc11ac97087
rev   line source
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
1 """
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
2 Global variables.
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
3 """
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
4
402
ffdd2c199f2a * Added momentum.
Joseph Turian <turian@gmail.com>
parents: 401
diff changeset
5 INPUT_DIMENSION = 10
388
98ca97cc9910 Debugging simple AA
Joseph Turian <turian@gmail.com>
parents: 386
diff changeset
6 #INPUT_DIMENSION = 100
402
ffdd2c199f2a * Added momentum.
Joseph Turian <turian@gmail.com>
parents: 401
diff changeset
7 #HIDDEN_DIMENSION = 100
ffdd2c199f2a * Added momentum.
Joseph Turian <turian@gmail.com>
parents: 401
diff changeset
8 HIDDEN_DIMENSION = 10
398
6e55ccb7e2bf Better output
Joseph Turian <turian@gmail.com>
parents: 396
diff changeset
9 #HIDDEN_DIMENSION = 6
392
e2cb8d489908 More debugging
Joseph Turian <turian@gmail.com>
parents: 389
diff changeset
10 LEARNING_RATE = 0.1
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
11 LR = LEARNING_RATE
402
ffdd2c199f2a * Added momentum.
Joseph Turian <turian@gmail.com>
parents: 401
diff changeset
12 #MOMENTUM = 0.9
ffdd2c199f2a * Added momentum.
Joseph Turian <turian@gmail.com>
parents: 401
diff changeset
13 MOMENTUM = 0
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
14 SEED = 666