Mercurial > ift6266

comparison writeup/ReviewsAISTATS.html @ 612:21d53fd07f6e

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
reviews AISTATS
author Yoshua Bengio <bengioy@iro.umontreal.ca>
date Mon, 20 Dec 2010 11:54:35 -0500
parents
children
comparison
equal deleted inserted replaced
611:5081206fe45b 612:21d53fd07f6e
1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
2 <!-- saved from url=(0096)https://cmt.research.microsoft.com/AIS2011/Protected/Author/ViewReviewsForPaper.aspx?paperId=126 -->
3 <html xmlns="http://www.w3.org/1999/xhtml"><head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8"><title>
4 Reviews For Paper
5 </title>
6 <style>
7 #header
8 {
9 width: 100%;
10 font-size: small;
11 background-color:#F7F7F7;
12 }
13 .printThemeText
14 {
15 font-size:small;
16 }
17 .printThemeTable td
18 {
19 vertical-align:top;
20 }
21 .printThemeGrid th
22 {
23 color:white;
24 background:#5D7B9D;
25 font-weight:bold;
26 }
27 .printThemeGrid
28 {
29 border-collapse:collapse;
30 }
31 .printThemeGrid td, .printThemeGrid th
32 {
33 border:solid 1px #D6D3CE;
34 padding:4px 4px 4px 4px;
35 }
36 .printThemeGrid .row
37 {
38 background-color:#F7F6F3;
39 color:#333333;
40 vertical-align:top;
41 }
42 .printThemeGrid .altrow
43 {
44 background-color:White;
45 color:#284775;
46 vertical-align:top;
47 }
48 .cellprompt
49 {
50 font-weight:bold;
51 white-space:nowrap;
52 width:100px;
53 }
54 .paperHeader
55 {
56 background-color:#dee3e7;
57 margin:5px 5px 15px 0px;
58 width:99%;
59 font-family:Verdana;
60 font-size:medium;
61 font-weight:bold;
62 }
63 .sectionHeader
64 {
65 background-color:#dee3e7;
66 padding:5px 5px 5px 0px;
67 width:99%;
68 text-decoration:underline;
69 font-family:Verdana;
70 font-size:small;
71 font-weight:bold;
72 }
73 .underlineheader
74 {
75 text-decoration:underline;
76 font-weight:bold;
77 padding:5px 0px;
78 }
79 .response
80 {
81 padding:5px 0px;
82 }
83 .reviewerlabel
84 {
85 padding-right:20px;
86 }
87 .pageTitle
88 {
89 background-color:#dee3e7;
90 padding:5px 5px 5px 5px;
91 margin-top:10px;
92 width:99%;
93 font-family:Verdana;
94 font-size:medium;
95 font-weight:bold;
96 }
97 .submissionDetailsView
98 {
99 }
100 .submissionDetailsView tr
101 {
102 vertical-align:top;
103 }
104 .submissionDetailsView td.prompt
105 {
106 font-weight:bold;
107 }
108 .submissionDetailsView tr.sectionSeparator
109 {
110
111 }
112 .submissionDetailsView tr.sectionSeparator td
113 {
114 background-color:#dee3e7;
115 padding:5px 5px 5px 5px;
116 font-family:Verdana;
117 font-size:small;
118 font-weight:bold;
119 color:Navy;
120 }
121 </style>
122 </head>
123 <body>
124 <form name="aspnetForm" method="post" action="./ReviewsAISTATS_files/ReviewsAISTATS.html" id="aspnetForm">
125 <div>
126 <input type="hidden" name="__VIEWSTATE" id="__VIEWSTATE" value="/wEPDwUKMTAxNDM4ODU3Ng9kFgJmD2QWAgIDD2QWAmYPZBYCAgUPDxYCHgdWaXNpYmxlZ2QWBgIBD2QWAmYPZBYEAgMPDxYCHgRUZXh0BQMxMjZkZAIFDw8WAh8BBTxEZWVwIExlYXJuZXJzIEJlbmVmaXQgTW9yZSBmcm9tIE91dC1vZi1EaXN0cmlidXRpb24gRXhhbXBsZXNkZAIDDw8WAh8AaGRkAgUPFgIeC18hSXRlbUNvdW50AgIWBGYPZBYGAgMPZBYCZg8VARNBc3NpZ25lZF9SZXZpZXdlcl8yZAIHDzwrAA0BAA8WBB4LXyFEYXRhQm91bmRnHwICB2QWAmYPZBYQAgEPZBYEZg8PFgIfAQWBAk92ZXJhbGwgcmF0aW5nOiBwbGVhc2Ugc3ludGhlc2l6ZSB5b3VyIGFuc3dlcnMgdG8gb3RoZXIgcXVlc3Rpb25zIGludG8gYW4gb3ZlcmFsbCByZWNvbW1lbmRhdGlvbi4gIFBsZWFzZSB0YWtlIGludG8gYWNjb3VudCB0cmFkZW9mZnMgKGFuIGluY3JlYXNlIGluIG9uZSBtZWFzdXJlIG1heSBjb21wZW5zYXRlIGZvciBhIGRlY3JlYXNlIGluIGFub3RoZXIpLCBhbmQgZGVzY3JpYmUgdGhlIHRyYWRlb2ZmcyBpbiB0aGUgZGV0YWlsZWQgY29tbWVudHMuZGQCAQ9kFgJmDxUBFEdvb2Q6IHN1Z2dlc3QgYWNjZXB0ZAICD2QWBGYPDxYCHwEFTFRlY2huaWNhbCBxdWFsaXR5OiBpcyBhbGwgaW5jbHVkZWQgbWF0ZXJpYWwgcHJlc2VudGVkIGNsZWFybHkgYW5kIGNvcnJlY3RseT9kZAIBD2QWAmYPFQEER29vZGQCAw9kFgRmDw8WAh8BBWdPcmlnaW5hbGl0eTogaG93IG11Y2ggbmV3IHdvcmsgaXMgcmVwcmVzZW50ZWQgaW4gdGhpcyBwYXBlciwgYmV5b25kIHByZXZpb3VzIGNvbmZlcmVuY2Uvam91cm5hbCBwYXBlcnM/ZGQCAQ9kFgJmDxUBGFN1YnN0YW50aWFsIG5ldyBtYXRlcmlhbGQCBA9kFgRmDw8WAh8BBYMBSW50ZXJlc3QgYW5kIHNpZ25pZmljYW5jZTogd291bGQgdGhlIHBhcGVyJ3MgZ29hbCwgaWYgY29tcGxldGVseSBzb2x2ZWQsIHJlcHJlc2VudCBhIHN1YnN0YW50aWFsIGFkdmFuY2UgZm9yIHRoZSBBSVNUQVRTIGNvbW11bml0eT9kZAIBD2QWAmYPFQELU2lnbmlmaWNhbnRkAgUPZBYEZg8PFgIfAQV1VGhvcm91Z2huZXNzOiB0byB3aGF0IGRlZ3JlZSBkb2VzIHRoZSBwYXBlciBzdXBwb3J0IGl0cyBjb25jbHVzaW9ucyB0aHJvdWdoIGV4cGVyaW1lbnRhbCBjb21wYXJpc29ucywgdGhlb3JlbXMsIGV0Yy4/ZGQCAQ9kFgJmDxUBCFRob3JvdWdoZAIGD2QWBGYPDxYCHwEFfUNyZWF0aXZpdHk6IHRvIHdoYXQgZGVncmVlIGRvZXMgdGhlIHBhcGVyIHJlcHJlc2VudCBhIG5vdmVsIHdheSBvZiBzZXR0aW5nIHVwIGEgcHJvYmxlbSBvciBhbiB1bnVzdWFsIGFwcHJvYWNoIHRvIHNvbHZpbmcgaXQ/ZGQCAQ9kFgJmDxUBMk1vc3QgY29udGVudCByZXByZXNlbnRzIGFwcGxpY2F0aW9uIG9mIGtub3duIGlkZWFzZAIHD2QWBGYPDxYCHwEFEURldGFpbGVkIENvbW1lbnRzZGQCAQ9kFgJmDxUBighUaGlzIHBhcGVyIHNob3dzIHRoYXQgZGVlcCBuZXR3b3JrcyBiZW5lZml0IG1vcmUgZnJvbSBvdXQtb2YtZGlzdHJpYnV0aW9uIGV4YW1wbGVzIHRoYW4gc2hhbGxvd2VyIGFyY2hpdGVjdHVyZXMgb24gYSBsYXJnZSBzY2FsZSBjaGFyYWN0ZXIgcmVjb2duaXRpb24gZXhwZXJpbWVudC4gQSB0aG9yb3VnaCBlbXBpcmljYWwgdmFsaWRhdGlvbiBzaG93cyB0aGF0IGRlZXAgbmV0cyBwcm9kdWNlIGJldHRlciBkaXNjcmltaW5hdGlvbiAodGhhbiBzaGFsbG93ZXIgbmV0cykgd2hlbiB0cmFpbmVkIHdpdGggZGlzdG9ydGVkIGNoYXJhY3RlcnMgYW5kIHdoZW4gdHJhaW5lZCBvbiBtdWx0aXBsZSB0YXNrcy4gDTxiciAvPkFsdGhvdWdoIHRoZSBtZXRob2RzIHVzZWQgYXJlIGFscmVhZHkgd2VsbCBlc3RhYmxpc2hlZCBpbiB0aGUgY29tbXVuaXR5LCB0aGVzZSByZXN1bHRzIGFyZSBzaWduaWZpY2FudCBhbmQgcHJvdmlkZSBuZXcgaW5zaWdodHMgb24gdGhlIHJlcHJlc2VudGF0aW9uYWwgcG93ZXIgb2YgdGhpcyBjbGFzcyBvZiBtZXRob2RzLg08YnIgLz4NPGJyIC8+U3VnZ2VzdGlvbnM6DTxiciAvPi0gaXQgd291bGQgYmUgaW50ZXJlc3RpbmcgdG8gY29tcGFyZSB0aGUgZGVlcCBhcmNoaXRlY3R1cmUgYW5kIHRoZSBzaGFsbG93IGFyY2hpdGVjdHVyZSBmb3IgYSBnaXZlbiBjYXBhY2l0eSBvZiB0aGUgbW9kZWwgKGkuZS4gdXNlIHdpZGVyIHNoYWxsb3cgbmV0KQ08YnIgLz4tIHNpbmNlIHRoZSBhdXRob3JzIHVzZSBkZW5vaXNpbmcgYXV0b2VuY29kZXJzIHRvIHByZS10cmFpbiBkZWVwIG5ldHdvcmtzLCB0aGV5IGNvdWxkIGNvbnNpZGVyIHRvIHVzZSBkaXN0b3J0ZWQgY2hhcmFjdGVycyBhcyBub2lzeSBpbnB1dHMgaW5zdGVhZCBvZiBhcnRpZmljaWFsbHkgc2V0IHRvIDAgc29tZSBpbnB1dHMuIFRoaXMgbWlnaHQgaGVscCBsZWFybmluZyBtb3JlIHJlcHJlc2VudGF0aW9ucyB0aGF0IGFyZSBtb3JlIHJvYnVzdCB0byBkaXN0b3J0aW9ucyB0aGF0IGFyZSBhY3R1YWxseSB1c2VmdWwgZm9yIGRpc2NyaW1pbmF0aW9uLmQCCA8PFgIfAGhkZAIIDxUBAGQCAQ9kFgYCAw9kFgJmDxUBE0Fzc2lnbmVkX1Jldmlld2VyXzNkAgcPPCsADQEADxYEHwNnHwICB2QWAmYPZBYQAgEPZBYEZg8PFgIfAQWBAk92ZXJhbGwgcmF0aW5nOiBwbGVhc2Ugc3ludGhlc2l6ZSB5b3VyIGFuc3dlcnMgdG8gb3RoZXIgcXVlc3Rpb25zIGludG8gYW4gb3ZlcmFsbCByZWNvbW1lbmRhdGlvbi4gIFBsZWFzZSB0YWtlIGludG8gYWNjb3VudCB0cmFkZW9mZnMgKGFuIGluY3JlYXNlIGluIG9uZSBtZWFzdXJlIG1heSBjb21wZW5zYXRlIGZvciBhIGRlY3JlYXNlIGluIGFub3RoZXIpLCBhbmQgZGVzY3JpYmUgdGhlIHRyYWRlb2ZmcyBpbiB0aGUgZGV0YWlsZWQgY29tbWVudHMuZGQCAQ9kFgJmDxUBGVZlcnkgZ29vZDogc3VnZ2VzdCBhY2NlcHRkAgIPZBYEZg8PFgIfAQVMVGVjaG5pY2FsIHF1YWxpdHk6IGlzIGFsbCBpbmNsdWRlZCBtYXRlcmlhbCBwcmVzZW50ZWQgY2xlYXJseSBhbmQgY29ycmVjdGx5P2RkAgEPZBYCZg8VAQlWZXJ5IGdvb2RkAgMPZBYEZg8PFgIfAQVnT3JpZ2luYWxpdHk6IGhvdyBtdWNoIG5ldyB3b3JrIGlzIHJlcHJlc2VudGVkIGluIHRoaXMgcGFwZXIsIGJleW9uZCBwcmV2aW91cyBjb25mZXJlbmNlL2pvdXJuYWwgcGFwZXJzP2RkAgEPZBYCZg8VARhTdWJzdGFudGlhbCBuZXcgbWF0ZXJpYWxkAgQPZBYEZg8PFgIfAQWDAUludGVyZXN0IGFuZCBzaWduaWZpY2FuY2U6IHdvdWxkIHRoZSBwYXBlcidzIGdvYWwsIGlmIGNvbXBsZXRlbHkgc29sdmVkLCByZXByZXNlbnQgYSBzdWJzdGFudGlhbCBhZHZhbmNlIGZvciB0aGUgQUlTVEFUUyBjb21tdW5pdHk/ZGQCAQ9kFgJmDxUBC1NpZ25pZmljYW50ZAIFD2QWBGYPDxYCHwEFdVRob3JvdWdobmVzczogdG8gd2hhdCBkZWdyZWUgZG9lcyB0aGUgcGFwZXIgc3VwcG9ydCBpdHMgY29uY2x1c2lvbnMgdGhyb3VnaCBleHBlcmltZW50YWwgY29tcGFyaXNvbnMsIHRoZW9yZW1zLCBldGMuP2RkAgEPZBYCZg8VAQhUaG9yb3VnaGQCBg9kFgRmDw8WAh8BBX1DcmVhdGl2aXR5OiB0byB3aGF0IGRlZ3JlZSBkb2VzIHRoZSBwYXBlciByZXByZXNlbnQgYSBub3ZlbCB3YXkgb2Ygc2V0dGluZyB1cCBhIHByb2JsZW0gb3IgYW4gdW51c3VhbCBhcHByb2FjaCB0byBzb2x2aW5nIGl0P2RkAgEPZBYCZg8VAShNb3N0IGNvbnRlbnQgcmVwcmVzZW50cyBub3ZlbCBhcHByb2FjaGVzZAIHD2QWBGYPDxYCHwEFEURldGFpbGVkIENvbW1lbnRzZGQCAQ9kFgJmDxUB3xVUaGlzIHBhcGVyIGNsYWltcyB0aGF0IHVzaW5nIG91dC1vZi1kaXN0cmlidXRpb24gZXhhbXBsZXMgY2FuIGJlIG1vcmUgaGVscGZ1bCBpbiB0cmFpbmluZyBkZWVwIGFyY2hpdGVjdHVyZXMgdGhhbiBzaGFsbG93IGFyY2hpdGVjdHVyZXMuIEluIG9yZGVyIHRvIHRlc3QgdGhpcyBoeXBvdGhlc2lzLCB0aGUgcGFwZXIgZGV2ZWxvcHMgZXh0ZW5zaXZlIHRyYW5zZm9ybWF0aW9ucyBmb3IgaW1hZ2UgcGF0Y2hlcyAoaS5lLiwgaW1hZ2VzIG9mIGhhbmR3cml0dGVuIGNoYXJhY3RlcnMpIHRvIGdlbmVyYXRlIGEgbGFyZ2Utc2NhbGUgZGF0YXNldCBvZiBwZXJ0dXJiZWQgaW1hZ2VzLiBUaGVzZSBvdXQtb2YtZGlzdHJpYnV0aW9uIGV4YW1wbGVzIGFyZSB0cmFpbmVkIHVzaW5nIE1MUHMgYW5kIHN0YWNrZWQgZGVub2lzaW5nIGF1dG8tZW5jb2RlcnMgKFNEQXMpLiBJbiB0aGUgZXhwZXJpbWVudHMsIHRoZSBwYXBlciBzaG93cyB0aGF0IFNEQXMgb3V0cGVyZm9ybSBNTFBzLCBhY2hpZXZpbmcgaHVtYW4tbGV2ZWwgcGVyZm9ybWFuY2UgZm9yIE5JU1QgZGF0YXNldC4gVGhlIHBhcGVyIGFsc28gcHJvdmlkZXMgdHdvIGludGVyZXN0aW5nIGV4cGVyaW1lbnRzIHNob3dpbmcgdGhhdDogKDEpIFNEQXMgY2FuIGJlbmVmaXQgZnJvbSB0cmFpbmluZyBwZXJ0dXJiZWQgZGF0YSwgZXZlbiB3aGVuIHRlc3Rpbmcgb24gY2xlYW4gZGF0YTsgKDIpIFNEQXMgY2FuIHNpZ25pZmljYW50bHkgYmVuZWZpdCBmcm9tIG11bHRpLXRhc2sgbGVhcm5pbmcuDTxiciAvPg08YnIgLz4NPGJyIC8+UXVlc3Rpb25zLCBjb21tZW50cywgYW5kIHN1Z2dlc3Rpb25zOg08YnIgLz4xLiBSZWdhcmRpbmcgdGhlIGh1bWFuIGxhYmVsaW5nLCBJIGhhdmUgc29tZSBjb25jZXJucyBhYm91dCBsYWJlbGluZyBub2lzZS9iaWFzZXMgZHVlIHRvIEFNVC4gSG93IHdlcmUgdGhlIGFub21hbGllcyBpbiBsYWJlbGluZyBvciBvdXRsaWVycyBjb250cm9sbGVkPyBXYXMgdGhlcmUgYW55IHByb2NlZHVyZSB0byBtaW5pbWl6ZSBsYWJlbGluZyBub2lzZS9iaWFzZXMgb3IgdG8gZW5zdXJlIHRoYXQgaHVtYW4gbGFiZWxlcnMgdHJpZWQgdGhlaXIgYmVzdCAoZS5nLiwgZmlsdGVyaW5nIG91dCByYW5kb20gZ3Vlc3NlcyBvciBlbmNvdXJhZ2luZyB0aGUgbGFiZWxlcnMgdG8gY29uc2lkZXIgYWxsIHBvc3NpYmlsaXRpZXMgY2FyZWZ1bGx5IGJlZm9yZSBwcm92aWRpbmcgcHJlbWF0dXJlIGd1ZXNzZXMpPyBGb3IgZXhhbXBsZSwgbXVsdGktc3RhZ2UgcXVlc3Rpb25uYWlyZXMgKGUuZy4sIGFza2luZyAiY2hhcmFjdGVycy9kaWdpdHMiLCAidXBwZXJjYXNlL2xvd2VyY2FzZSIsIHRoZW4gY2hvb3Npbmcgb25lIG91dCBvZiAxMCBkaWdpdHMsIG9yIDI2IGNoYXJhY3RlcnMpIG1pZ2h0IHNpZ25pZmljYW50bHkgcmVkdWNlIGxhYmVsaW5nIG5vaXNlL2JpYXNlcywgcmF0aGVyIHRoYW4gc2hvd2luZyA2MiBjYW5kaWRhdGUgYW5zd2VycyBzaW11bHRhbmVvdXNseS4NPGJyIC8+DTxiciAvPjIuIEl0IHNlZW1zIHRoYXQgdGhlIHBhcGVyIGZpeGVkIHRoZSBudW1iZXIgb2YgaGlkZGVuIGxheWVycyBhcyB0aHJlZS4gRGVzcGl0ZSBnb29kIHBlcmZvcm1hbmNlIG9mIHRoZSBwcm9wb3NlZCBhcmNoaXRlY3R1cmUsIGl0IGlzIHNvbWV3aGF0IHVuY2xlYXIgd2hldGhlciB0aGUgYmVuZWZpdCBjb21lcyBtYWlubHkgZnJvbSBkZWVwIGFyY2hpdGVjdHVyZSBvciB0aGUgdXNlIG9mIGRlbm9pc2luZyBhdXRvLWVuY29kZXJzLg08YnIgLz4NPGJyIC8+VGhlcmVmb3JlLCBpdCB3aWxsIGJlIG1vcmUgaW50ZXJlc3RpbmcgdG8gc2VlIHRoZSBlZmZlY3Qgb2YgdGhlIG51bWJlciBvZiBsYXllcnMgYW5kIG90aGVyIHByZS10cmFpbmluZyBtZXRob2RzIChlLmcuLCBSQk1zIG9yIGF1dG8tZW5jb2RlcnMpLiBUaGlzIGV4cGVyaW1lbnQgd2lsbCBjbGFyaWZ5IHdoZXJlIHRoZSBiZW5lZml0IGNvbWVzIGZyb20gKGkuZS4sIGRlZXAgYXJjaGl0ZWN0dXJlIHZzLiBwcmUtdHJhaW5pbmcgbW9kdWxlcykgYW5kIHByb3ZpZGUgbW9yZSBpbnNpZ2h0cyBhYm91dCB0aGUgcmVzdWx0cy4NPGJyIC8+DTxiciAvPjMuIFRoZSBwYXBlciBicmllZmx5IG1lbnRpb25lZCBhYm91dCB0aGUgdXNlIG9mIGxpYlNWTSwgYnV0IGl0IHdpbGwgYmUgdXNlZnVsIHRvIGNvbXBhcmUgYWdhaW5zdCB0aGUgcmVzdWx0cyB1c2luZyBvbmxpbmUgU1ZNIChlLmcuLCBQRUdBU09TKS4NPGJyIC8+DTxiciAvPjQuIFRoZSBwYXBlciBhbHNvIHRhbGtzIGFib3V0IHRoZSBlZmZlY3Qgb2YgbGFyZ2UgbGFiZWxlZCBkYXRhIGluIHNlbGYtdGF1Z2h0IGxlYXJuaW5nIHNldHRpbmcuIFRvIHN0cmVuZ3RoZW4gdGhlIGNsYWltLCBpdCB3aWxsIGJlIGhlbHBmdWwgdG8gc2hvdyB0aGUgdGVzdCBhY2N1cmFjeSBhcyBhIGZ1bmN0aW9uIG9mIG51bWJlciBvZiBsYWJlbGVkIGV4YW1wbGVzLg08YnIgLz4NPGJyIC8+T3ZlcmFsbCwgdGhlIHBhcGVyIGlzIGNsZWFybHkgd3JpdHRlbiwgYW5kIGl0IHByb3ZpZGVzIGludGVyZXN0aW5nIGV4cGVyaW1lbnRzIG9uIGxhcmdlIHNjYWxlIGRhdGFzZXRzLCBhZGRyZXNzaW5nIGEgbnVtYmVyIG9mIGludGVyZXN0aW5nIHF1ZXN0aW9ucyByZWxhdGVkIHRvIGRlZXAgbGVhcm5pbmcgYW5kIG11bHRpLXRhc2sgbGVhcm5pbmcuIEZ1cnRoZXJtb3JlLCB0aGlzIHdvcmsgY2FuIHByb3ZpZGUgYSBuZXcgbGFyZ2Ugc2NhbGUgYmVuY2htYXJrIGRhdGFzZXQgKGJleW9uZCBNTklTVCkgZm9yIGRlZXAgbGVhcm5pbmcgYW5kIG1hY2hpbmUgbGVhcm5pbmcgcmVzZWFyY2guDTxiciAvPmQCCA8PFgIfAGhkZAIIDxUBAGQYAgUfY3RsMDAkY3BoJGd2UmV2aWV3cyRjdGwwMSRjdGwwMA88KwAKAQgCAWQFH2N0bDAwJGNwaCRndlJldmlld3MkY3RsMDAkY3RsMDAPPCsACgEIAgFkh0ly6l5rRpe9mdRnffXYAZKa1+8=">
127 </div>
128
129 <table id="header">
130 <tbody><tr>
131 <td><img src="./ReviewsAISTATS_files/conferencelogo.gif"></td>
132 <td width="100%"><a href="http://www.aistats.org/">AI &amp; Statistics 2011 </a><br><b>Fourteenth International Conference on Artificial Intelligence and Statistics </b><br>April 11-13, 2011<br>Ft. Lauderdale, FL<br>USA</td>
133 </tr>
134 </tbody></table>
135 <table id="content"><tbody><tr><td class="contentBorder">&nbsp;</td><td class="contentContainer">
136 <span id="ctl00_cph_Label4" style="font-size:Small;font-weight:bold;">Reviews For Paper</span>
137 <span id="ctl00_cph_lblErrorMessage" class="error" style="font-size:Small;"></span>
138 <div id="ctl00_cph_pnlReviews">
139
140 <span style="font-size:Small;">
141 <table class="nicetable2" style="text-align:left; width: 100%;">
142
143 <tbody><tr>
144 <td width="100px"><b>Paper ID</b></td>
145 <td><span id="ctl00_cph_infoSubmission_lblPaperId" style="font-size:Small;">126</span></td>
146 </tr>
147 <tr>
148 <td><b>Title</b></td>
149 <td><span id="ctl00_cph_infoSubmission_lblPaperTitle" style="font-size:Small;">Deep Learners Benefit More from Out-of-Distribution Examples</span></td>
150 </tr>
151
152
153
154
155
156 </tbody></table></span>
157
158
159 <hr>
160 <table>
161 <tbody><tr>
162 <td>
163 <span id="ctl00_cph_gvReviews_ctl00_Label2" style="font-size:Small;font-weight:bold;">Masked Reviewer ID:</span>
164 </td>
165 <td>
166 <span id="ctl00_cph_gvReviews_ctl00_Label1" style="font-size:Small;">Assigned_Reviewer_2</span>
167 </td>
168 </tr>
169 <tr>
170 <td>
171 <span id="ctl00_cph_gvReviews_ctl00_Label3" style="font-size:Small;font-weight:bold;">Review:</span>
172 </td>
173 <td>
174 </td>
175 </tr>
176 </tbody></table>
177 <div>
178 <table cellspacing="0" cellpadding="4" rules="all" border="1" style="color:#333333;border-width:1px;border-style:None;font-family:Verdana;font-size:Small;border-collapse:collapse;">
179 <tbody><tr style="color:White;background-color:#5D7B9D;font-weight:bold;">
180 <th scope="col">Question</th><th scope="col">&nbsp;</th>
181 </tr><tr style="color:#333333;background-color:#F7F6F3;">
182 <td style="width:20%;">Overall rating: please synthesize your answers to other questions into an overall recommendation. Please take into account tradeoffs (an increase in one measure may compensate for a decrease in another), and describe the tradeoffs in the detailed comments.</td><td style="width:80%;">
183 Good: suggest accept
184 </td>
185 </tr><tr style="color:#284775;background-color:White;">
186 <td style="width:20%;">Technical quality: is all included material presented clearly and correctly?</td><td style="width:80%;">
187 Good
188 </td>
189 </tr><tr style="color:#333333;background-color:#F7F6F3;">
190 <td style="width:20%;">Originality: how much new work is represented in this paper, beyond previous conference/journal papers?</td><td style="width:80%;">
191 Substantial new material
192 </td>
193 </tr><tr style="color:#284775;background-color:White;">
194 <td style="width:20%;">Interest and significance: would the paper's goal, if completely solved, represent a substantial advance for the AISTATS community?</td><td style="width:80%;">
195 Significant
196 </td>
197 </tr><tr style="color:#333333;background-color:#F7F6F3;">
198 <td style="width:20%;">Thoroughness: to what degree does the paper support its conclusions through experimental comparisons, theorems, etc.?</td><td style="width:80%;">
199 Thorough
200 </td>
201 </tr><tr style="color:#284775;background-color:White;">
202 <td style="width:20%;">Creativity: to what degree does the paper represent a novel way of setting up a problem or an unusual approach to solving it?</td><td style="width:80%;">
203 Most content represents application of known ideas
204 </td>
205 </tr><tr style="color:#333333;background-color:#F7F6F3;">
206 <td style="width:20%;">Detailed Comments</td><td style="width:80%;">
207 This paper shows that deep networks benefit more from out-of-distribution examples than shallower architectures on a large scale character recognition experiment. A thorough empirical validation shows that deep nets produce better discrimination (than shallower nets) when trained with distorted characters and when trained on multiple tasks.
208 <br>Although the methods used are already well established in the community, these results are significant and provide new insights on the representational power of this class of methods.
209 <br>
210 <br>Suggestions:
211 <br>- it would be interesting to compare the deep architecture and the shallow architecture for a given capacity of the model (i.e. use wider shallow net)
212 <br>- since the authors use denoising autoencoders to pre-train deep networks, they could consider to use distorted characters as noisy inputs instead of artificially set to 0 some inputs. This might help learning more representations that are more robust to distortions that are actually useful for discrimination.
213 </td>
214 </tr>
215 </tbody></table>
216 </div>
217
218
219 <hr>
220 <table>
221 <tbody><tr>
222 <td>
223 <span id="ctl00_cph_gvReviews_ctl01_Label2" style="font-size:Small;font-weight:bold;">Masked Reviewer ID:</span>
224 </td>
225 <td>
226 <span id="ctl00_cph_gvReviews_ctl01_Label1" style="font-size:Small;">Assigned_Reviewer_3</span>
227 </td>
228 </tr>
229 <tr>
230 <td>
231 <span id="ctl00_cph_gvReviews_ctl01_Label3" style="font-size:Small;font-weight:bold;">Review:</span>
232 </td>
233 <td>
234 </td>
235 </tr>
236 </tbody></table>
237 <div>
238 <table cellspacing="0" cellpadding="4" rules="all" border="1" style="color:#333333;border-width:1px;border-style:None;font-family:Verdana;font-size:Small;border-collapse:collapse;">
239 <tbody><tr style="color:White;background-color:#5D7B9D;font-weight:bold;">
240 <th scope="col">Question</th><th scope="col">&nbsp;</th>
241 </tr><tr style="color:#333333;background-color:#F7F6F3;">
242 <td style="width:20%;">Overall rating: please synthesize your answers to other questions into an overall recommendation. Please take into account tradeoffs (an increase in one measure may compensate for a decrease in another), and describe the tradeoffs in the detailed comments.</td><td style="width:80%;">
243 Very good: suggest accept
244 </td>
245 </tr><tr style="color:#284775;background-color:White;">
246 <td style="width:20%;">Technical quality: is all included material presented clearly and correctly?</td><td style="width:80%;">
247 Very good
248 </td>
249 </tr><tr style="color:#333333;background-color:#F7F6F3;">
250 <td style="width:20%;">Originality: how much new work is represented in this paper, beyond previous conference/journal papers?</td><td style="width:80%;">
251 Substantial new material
252 </td>
253 </tr><tr style="color:#284775;background-color:White;">
254 <td style="width:20%;">Interest and significance: would the paper's goal, if completely solved, represent a substantial advance for the AISTATS community?</td><td style="width:80%;">
255 Significant
256 </td>
257 </tr><tr style="color:#333333;background-color:#F7F6F3;">
258 <td style="width:20%;">Thoroughness: to what degree does the paper support its conclusions through experimental comparisons, theorems, etc.?</td><td style="width:80%;">
259 Thorough
260 </td>
261 </tr><tr style="color:#284775;background-color:White;">
262 <td style="width:20%;">Creativity: to what degree does the paper represent a novel way of setting up a problem or an unusual approach to solving it?</td><td style="width:80%;">
263 Most content represents novel approaches
264 </td>
265 </tr><tr style="color:#333333;background-color:#F7F6F3;">
266 <td style="width:20%;">Detailed Comments</td><td style="width:80%;">
267 This paper claims that using out-of-distribution examples can be more helpful in training deep architectures than shallow architectures. In order to test this hypothesis, the paper develops extensive transformations for image patches (i.e., images of handwritten characters) to generate a large-scale dataset of perturbed images. These out-of-distribution examples are trained using MLPs and stacked denoising auto-encoders (SDAs). In the experiments, the paper shows that SDAs outperform MLPs, achieving human-level performance for NIST dataset. The paper also provides two interesting experiments showing that: (1) SDAs can benefit from training perturbed data, even when testing on clean data; (2) SDAs can significantly benefit from multi-task learning.
268 <br>
269 <br>
270 <br>Questions, comments, and suggestions:
271 <br>1. Regarding the human labeling, I have some concerns about labeling noise/biases due to AMT. How were the anomalies in labeling or outliers controlled? Was there any procedure to minimize labeling noise/biases or to ensure that human labelers tried their best (e.g., filtering out random guesses or encouraging the labelers to consider all possibilities carefully before providing premature guesses)? For example, multi-stage questionnaires (e.g., asking "characters/digits", "uppercase/lowercase", then choosing one out of 10 digits, or 26 characters) might significantly reduce labeling noise/biases, rather than showing 62 candidate answers simultaneously.
272 <br>
273 <br>2. It seems that the paper fixed the number of hidden layers as three. Despite good performance of the proposed architecture, it is somewhat unclear whether the benefit comes mainly from deep architecture or the use of denoising auto-encoders.
274 <br>
275 <br>Therefore, it will be more interesting to see the effect of the number of layers and other pre-training methods (e.g., RBMs or auto-encoders). This experiment will clarify where the benefit comes from (i.e., deep architecture vs. pre-training modules) and provide more insights about the results.
276 <br>
277 <br>3. The paper briefly mentioned about the use of libSVM, but it will be useful to compare against the results using online SVM (e.g., PEGASOS).
278 <br>
279 <br>4. The paper also talks about the effect of large labeled data in self-taught learning setting. To strengthen the claim, it will be helpful to show the test accuracy as a function of number of labeled examples.
280 <br>
281 <br>Overall, the paper is clearly written, and it provides interesting experiments on large scale datasets, addressing a number of interesting questions related to deep learning and multi-task learning. Furthermore, this work can provide a new large scale benchmark dataset (beyond MNIST) for deep learning and machine learning research.
282 <br>
283 </td>
284 </tr>
285 </tbody></table>
286 </div>
287
288
289 <br>
290 <br>
291
292 </div>
293 </td><td class="contentBorder">&nbsp;</td></tr></tbody></table>
294 </form>
295
296
297 </body></html>