annotate sparse_random_autoassociator/globals.py @ 381:e4473d9697d7

Added xent loss
author Joseph Turian <turian@gmail.com>
date Tue, 08 Jul 2008 01:57:33 -0400
parents a1bbcde6b456
children a474341861fa
rev   line source
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
1 """
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
2 Global variables.
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
3 """
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
4
381
e4473d9697d7 Added xent loss
Joseph Turian <turian@gmail.com>
parents: 370
diff changeset
5 INPUT_DIMENSION = 1000
e4473d9697d7 Added xent loss
Joseph Turian <turian@gmail.com>
parents: 370
diff changeset
6 HIDDEN_DIMENSION = 100
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
7 LEARNING_RATE = 0.1
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
8 LR = LEARNING_RATE
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
9 SEED = 666
381
e4473d9697d7 Added xent loss
Joseph Turian <turian@gmail.com>
parents: 370
diff changeset
10 ZERO_SAMPLE_SIZE = 50
e4473d9697d7 Added xent loss
Joseph Turian <turian@gmail.com>
parents: 370
diff changeset
11 #ZERO_SAMPLE_SIZE = 250
e4473d9697d7 Added xent loss
Joseph Turian <turian@gmail.com>
parents: 370
diff changeset
12 MARGIN = 0.25
370
a1bbcde6b456 Moved sparse_random_autoassociator from my repository
Joseph Turian <turian@gmail.com>
parents:
diff changeset
13 #MARGIN = 0.0