Mercurial > pylearn

comparison pylearn/datasets/utlc.py @ 1477:48efafaaf7fb

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Add function for loading the transfer labels of utlc
author Pascal Lamblin <lamblinp@iro.umontreal.ca>
date Sat, 21 May 2011 01:03:10 -0400
parents 2aa80f5b5bbc
children
comparison
equal deleted inserted replaced
1476:8c10bda4bb5f 1477:48efafaaf7fb
108 valid /= v 108 valid /= v
109 test /= v 109 test /= v
110 else: 110 else:
111 raise Exception("This dataset don't have its normalization defined") 111 raise Exception("This dataset don't have its normalization defined")
112 if transfer: 112 if transfer:
113 transfer = load_filetensor(os.path.join(config.data_root(),"UTLC","filetensor",name+"_transfer.ft")) 113 transfer = load_ndarray_transfer(name)
114 return train, valid, test, transfer 114 return train, valid, test, transfer
115 else: 115 else:
116 return train, valid, test 116 return train, valid, test
117 117
118 def load_sparse_dataset(name, normalize=True, transfer=False, 118 def load_sparse_dataset(name, normalize=True, transfer=False,
177 transfer = load_filetensor(os.path.join(config.data_root(),"UTLC","filetensor",name+"_transfer.ft")) 177 transfer = load_filetensor(os.path.join(config.data_root(),"UTLC","filetensor",name+"_transfer.ft"))
178 return train, valid, test, transfer 178 return train, valid, test, transfer
179 else: 179 else:
180 return train, valid, test 180 return train, valid, test
181 181
182 def load_ndarray_transfer(name):
183 """
184 Load the transfer labels for the training set of data set `name`.
185
186 It will be returned in ndarray format.
187 """
188 assert name in ['avicenna','harry','rita','sylvester','terry','ule']
189 transfer = load_filetensor(os.path.join(config.data_root(), 'UTLC',
190 'filetensor', name+'_transfer.ft'))
191 return transfer
192
182 def load_ndarray_label(name): 193 def load_ndarray_label(name):
183 """ Load the train,valid,test data for the dataset `name` 194 """ Load the train,valid,test data for the dataset `name`
184 and return it in ndarray format. 195 and return it in ndarray format.
185 196
186 This is only available for the toy dataset ule. 197 This is only available for the toy dataset ule.