annotate sandbox/sparse_random_autoassociator/globals.py @ 395:70019965f888

Basic, broken RBM implementation
author Joseph Turian <turian@gmail.com>
date Tue, 08 Jul 2008 20:14:21 -0400
parents 36baeb7125a4
children
rev   line source
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
1 """
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
2 Global variables.
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
3 """
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
4
381
e4473d9697d7 Added xent loss
Joseph Turian <turian@gmail.com>
parents: 370
diff changeset
5 INPUT_DIMENSION = 1000
386
a474341861fa Added a simple AA
Joseph Turian <turian@gmail.com>
parents: 381
diff changeset
6 HIDDEN_DIMENSION = 20
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
7 LEARNING_RATE = 0.1
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
8 LR = LEARNING_RATE
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
9 SEED = 666
381
e4473d9697d7 Added xent loss
Joseph Turian <turian@gmail.com>
parents: 370
diff changeset
10 ZERO_SAMPLE_SIZE = 50
e4473d9697d7 Added xent loss
Joseph Turian <turian@gmail.com>
parents: 370
diff changeset
11 #ZERO_SAMPLE_SIZE = 250
e4473d9697d7 Added xent loss
Joseph Turian <turian@gmail.com>
parents: 370
diff changeset
12 MARGIN = 0.25
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
13 #MARGIN = 0.0