Mercurial > ift6266

annotate scripts/launch_generate100.py @ 160:68160fd149fe

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Simple script to doctest all modules beneath ift6266. This ecxcludes scripts since most of the files launch computations when imported and some even start a lot of jobs on the cluster (This happened to me when testing).
author Arnaud Bergeron <abergeron@gmail.com>
date Thu, 25 Feb 2010 17:27:49 -0500
parents 221799d79188
children fd1b5237e49e
rev   line source
136
4a78c9b83fee Added script to launch the ~108 data generation jobs with dbidispatch
boulanni <nicolas_boulanger@hotmail.com>
parents:
diff changeset
1 #!/usr/bin/env python
4a78c9b83fee Added script to launch the ~108 data generation jobs with dbidispatch
boulanni <nicolas_boulanger@hotmail.com>
parents:
diff changeset
2
4a78c9b83fee Added script to launch the ~108 data generation jobs with dbidispatch
boulanni <nicolas_boulanger@hotmail.com>
parents:
diff changeset
3 import os
4a78c9b83fee Added script to launch the ~108 data generation jobs with dbidispatch
boulanni <nicolas_boulanger@hotmail.com>
parents:
diff changeset
4 dir1 = "/data/lisa/data/ift6266h10/"
4a78c9b83fee Added script to launch the ~108 data generation jobs with dbidispatch
boulanni <nicolas_boulanger@hotmail.com>
parents:
diff changeset
5
4a78c9b83fee Added script to launch the ~108 data generation jobs with dbidispatch
boulanni <nicolas_boulanger@hotmail.com>
parents:
diff changeset
6 for i,s in enumerate(['valid','test']):
157
221799d79188 Ajouté seed 100 à 207 aux ensembles de données générés
boulanni <nicolas_boulanger@hotmail.com>
parents: 136
diff changeset
7 for j,c in enumerate([0.3,0.5,0.7,1]):
136
4a78c9b83fee Added script to launch the ~108 data generation jobs with dbidispatch
boulanni <nicolas_boulanger@hotmail.com>
parents:
diff changeset
8 l = str(c).replace('.','')
157
221799d79188 Ajouté seed 100 à 207 aux ensembles de données générés
boulanni <nicolas_boulanger@hotmail.com>
parents: 136
diff changeset
9 os.system("dbidispatch --condor --os=fc9 --machine=brams0c.iro.umontreal.ca ./run_pipeline.sh -o %sdata/P%s_%s_data.ft -p %sdata/P%s_%s_params -x %sdata/P%s_%s_labels.ft -f %s%s_data.ft -l %s%s_labels.ft -c %socr_%s_data.ft -d %socr_%s_labels.ft -m 0.3 -z 0.1 -a 0.1 -b 0.25 -g 0.25 -s %d -y %d" % (dir1, l, s, dir1, l, s, dir1, l, s, dir1, s, dir1, s, dir1, s, dir1, s, [20000,80000][i], 200+i*4+j))
136
4a78c9b83fee Added script to launch the ~108 data generation jobs with dbidispatch
boulanni <nicolas_boulanger@hotmail.com>
parents:
diff changeset
10
4a78c9b83fee Added script to launch the ~108 data generation jobs with dbidispatch
boulanni <nicolas_boulanger@hotmail.com>
parents:
diff changeset
11 for i in range(100):
157
221799d79188 Ajouté seed 100 à 207 aux ensembles de données générés
boulanni <nicolas_boulanger@hotmail.com>
parents: 136
diff changeset
12 os.system("dbidispatch --condor --os=fc9 --machine=brams0c.iro.umontreal.ca ./run_pipeline.sh -o %sdata/P07_train%d_data.ft -p %sdata/P07_train%d_params -x %sdata/P07_train%d_labels.ft -f %strain_data.ft -l %strain_labels.ft -c %socr_train_data.ft -d %socr_train_labels.ft -m 0.7 -z 0.1 -a 0.1 -b 0.25 -g 0.25 -s 819200 -y %d" % (dir1, i, dir1, i, dir1, i, dir1, dir1, dir1, dir1, 100+i))