|
612
|
1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
|
|
|
2 <!-- saved from url=(0096)https://cmt.research.microsoft.com/AIS2011/Protected/Author/ViewReviewsForPaper.aspx?paperId=126 -->
|
|
|
3 <html xmlns="http://www.w3.org/1999/xhtml"><head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8"><title>
|
|
|
4 Reviews For Paper
|
|
|
5 </title>
|
|
|
6 <style>
|
|
|
7 #header
|
|
|
8 {
|
|
|
9 width: 100%;
|
|
|
10 font-size: small;
|
|
|
11 background-color:#F7F7F7;
|
|
|
12 }
|
|
|
13 .printThemeText
|
|
|
14 {
|
|
|
15 font-size:small;
|
|
|
16 }
|
|
|
17 .printThemeTable td
|
|
|
18 {
|
|
|
19 vertical-align:top;
|
|
|
20 }
|
|
|
21 .printThemeGrid th
|
|
|
22 {
|
|
|
23 color:white;
|
|
|
24 background:#5D7B9D;
|
|
|
25 font-weight:bold;
|
|
|
26 }
|
|
|
27 .printThemeGrid
|
|
|
28 {
|
|
|
29 border-collapse:collapse;
|
|
|
30 }
|
|
|
31 .printThemeGrid td, .printThemeGrid th
|
|
|
32 {
|
|
|
33 border:solid 1px #D6D3CE;
|
|
|
34 padding:4px 4px 4px 4px;
|
|
|
35 }
|
|
|
36 .printThemeGrid .row
|
|
|
37 {
|
|
|
38 background-color:#F7F6F3;
|
|
|
39 color:#333333;
|
|
|
40 vertical-align:top;
|
|
|
41 }
|
|
|
42 .printThemeGrid .altrow
|
|
|
43 {
|
|
|
44 background-color:White;
|
|
|
45 color:#284775;
|
|
|
46 vertical-align:top;
|
|
|
47 }
|
|
|
48 .cellprompt
|
|
|
49 {
|
|
|
50 font-weight:bold;
|
|
|
51 white-space:nowrap;
|
|
|
52 width:100px;
|
|
|
53 }
|
|
|
54 .paperHeader
|
|
|
55 {
|
|
|
56 background-color:#dee3e7;
|
|
|
57 margin:5px 5px 15px 0px;
|
|
|
58 width:99%;
|
|
|
59 font-family:Verdana;
|
|
|
60 font-size:medium;
|
|
|
61 font-weight:bold;
|
|
|
62 }
|
|
|
63 .sectionHeader
|
|
|
64 {
|
|
|
65 background-color:#dee3e7;
|
|
|
66 padding:5px 5px 5px 0px;
|
|
|
67 width:99%;
|
|
|
68 text-decoration:underline;
|
|
|
69 font-family:Verdana;
|
|
|
70 font-size:small;
|
|
|
71 font-weight:bold;
|
|
|
72 }
|
|
|
73 .underlineheader
|
|
|
74 {
|
|
|
75 text-decoration:underline;
|
|
|
76 font-weight:bold;
|
|
|
77 padding:5px 0px;
|
|
|
78 }
|
|
|
79 .response
|
|
|
80 {
|
|
|
81 padding:5px 0px;
|
|
|
82 }
|
|
|
83 .reviewerlabel
|
|
|
84 {
|
|
|
85 padding-right:20px;
|
|
|
86 }
|
|
|
87 .pageTitle
|
|
|
88 {
|
|
|
89 background-color:#dee3e7;
|
|
|
90 padding:5px 5px 5px 5px;
|
|
|
91 margin-top:10px;
|
|
|
92 width:99%;
|
|
|
93 font-family:Verdana;
|
|
|
94 font-size:medium;
|
|
|
95 font-weight:bold;
|
|
|
96 }
|
|
|
97 .submissionDetailsView
|
|
|
98 {
|
|
|
99 }
|
|
|
100 .submissionDetailsView tr
|
|
|
101 {
|
|
|
102 vertical-align:top;
|
|
|
103 }
|
|
|
104 .submissionDetailsView td.prompt
|
|
|
105 {
|
|
|
106 font-weight:bold;
|
|
|
107 }
|
|
|
108 .submissionDetailsView tr.sectionSeparator
|
|
|
109 {
|
|
|
110
|
|
|
111 }
|
|
|
112 .submissionDetailsView tr.sectionSeparator td
|
|
|
113 {
|
|
|
114 background-color:#dee3e7;
|
|
|
115 padding:5px 5px 5px 5px;
|
|
|
116 font-family:Verdana;
|
|
|
117 font-size:small;
|
|
|
118 font-weight:bold;
|
|
|
119 color:Navy;
|
|
|
120 }
|
|
|
121 </style>
|
|
|
122 </head>
|
|
|
123 <body>
|
|
|
124 <form name="aspnetForm" method="post" action="./ReviewsAISTATS_files/ReviewsAISTATS.html" id="aspnetForm">
|
|
|
125 <div>
|
|
|
126 <input type="hidden" name="__VIEWSTATE" id="__VIEWSTATE" value="/wEPDwUKMTAxNDM4ODU3Ng9kFgJmD2QWAgIDD2QWAmYPZBYCAgUPDxYCHgdWaXNpYmxlZ2QWBgIBD2QWAmYPZBYEAgMPDxYCHgRUZXh0BQMxMjZkZAIFDw8WAh8BBTxEZWVwIExlYXJuZXJzIEJlbmVmaXQgTW9yZSBmcm9tIE91dC1vZi1EaXN0cmlidXRpb24gRXhhbXBsZXNkZAIDDw8WAh8AaGRkAgUPFgIeC18hSXRlbUNvdW50AgIWBGYPZBYGAgMPZBYCZg8VARNBc3NpZ25lZF9SZXZpZXdlcl8yZAIHDzwrAA0BAA8WBB4LXyFEYXRhQm91bmRnHwICB2QWAmYPZBYQAgEPZBYEZg8PFgIfAQWBAk92ZXJhbGwgcmF0aW5nOiBwbGVhc2Ugc3ludGhlc2l6ZSB5b3VyIGFuc3dlcnMgdG8gb3RoZXIgcXVlc3Rpb25zIGludG8gYW4gb3ZlcmFsbCByZWNvbW1lbmRhdGlvbi4gIFBsZWFzZSB0YWtlIGludG8gYWNjb3VudCB0cmFkZW9mZnMgKGFuIGluY3JlYXNlIGluIG9uZSBtZWFzdXJlIG1heSBjb21wZW5zYXRlIGZvciBhIGRlY3JlYXNlIGluIGFub3RoZXIpLCBhbmQgZGVzY3JpYmUgdGhlIHRyYWRlb2ZmcyBpbiB0aGUgZGV0YWlsZWQgY29tbWVudHMuZGQCAQ9kFgJmDxUBFEdvb2Q6IHN1Z2dlc3QgYWNjZXB0ZAICD2QWBGYPDxYCHwEFTFRlY2huaWNhbCBxdWFsaXR5OiBpcyBhbGwgaW5jbHVkZWQgbWF0ZXJpYWwgcHJlc2VudGVkIGNsZWFybHkgYW5kIGNvcnJlY3RseT9kZAIBD2QWAmYPFQEER29vZGQCAw9kFgRmDw8WAh8BBWdPcmlnaW5hbGl0eTogaG93IG11Y2ggbmV3IHdvcmsgaXMgcmVwcmVzZW50ZWQgaW4gdGhpcyBwYXBlciwgYmV5b25kIHByZXZpb3VzIGNvbmZlcmVuY2Uvam91cm5hbCBwYXBlcnM/ZGQCAQ9kFgJmDxUBGFN1YnN0YW50aWFsIG5ldyBtYXRlcmlhbGQCBA9kFgRmDw8WAh8BBYMBSW50ZXJlc3QgYW5kIHNpZ25pZmljYW5jZTogd291bGQgdGhlIHBhcGVyJ3MgZ29hbCwgaWYgY29tcGxldGVseSBzb2x2ZWQsIHJlcHJlc2VudCBhIHN1YnN0YW50aWFsIGFkdmFuY2UgZm9yIHRoZSBBSVNUQVRTIGNvbW11bml0eT9kZAIBD2QWAmYPFQELU2lnbmlmaWNhbnRkAgUPZBYEZg8PFgIfAQV1VGhvcm91Z2huZXNzOiB0byB3aGF0IGRlZ3JlZSBkb2VzIHRoZSBwYXBlciBzdXBwb3J0IGl0cyBjb25jbHVzaW9ucyB0aHJvdWdoIGV4cGVyaW1lbnRhbCBjb21wYXJpc29ucywgdGhlb3JlbXMsIGV0Yy4/ZGQCAQ9kFgJmDxUBCFRob3JvdWdoZAIGD2QWBGYPDxYCHwEFfUNyZWF0aXZpdHk6IHRvIHdoYXQgZGVncmVlIGRvZXMgdGhlIHBhcGVyIHJlcHJlc2VudCBhIG5vdmVsIHdheSBvZiBzZXR0aW5nIHVwIGEgcHJvYmxlbSBvciBhbiB1bnVzdWFsIGFwcHJvYWNoIHRvIHNvbHZpbmcgaXQ/ZGQCAQ9kFgJmDxUBMk1vc3QgY29udGVudCByZXByZXNlbnRzIGFwcGxpY2F0aW9uIG9mIGtub3duIGlkZWFzZAIHD2QWBGYPDxYCHwEFEURldGFpbGVkIENvbW1lbnRzZGQCAQ9kFgJmDxUBighUaGlzIHBhcGVyIHNob3dzIHRoYXQgZGVlcCBuZXR3b3JrcyBiZW5lZml0IG1vcmUgZnJvbSBvdXQtb2YtZGlzdHJpYnV0aW9uIGV4YW1wbGVzIHRoYW4gc2hhbGxvd2VyIGFyY2hpdGVjdHVyZXMgb24gYSBsYXJnZSBzY2FsZSBjaGFyYWN0ZXIgcmVjb2duaXRpb24gZXhwZXJpbWVudC4gQSB0aG9yb3VnaCBlbXBpcmljYWwgdmFsaWRhdGlvbiBzaG93cyB0aGF0IGRlZXAgbmV0cyBwcm9kdWNlIGJldHRlciBkaXNjcmltaW5hdGlvbiAodGhhbiBzaGFsbG93ZXIgbmV0cykgd2hlbiB0cmFpbmVkIHdpdGggZGlzdG9ydGVkIGNoYXJhY3RlcnMgYW5kIHdoZW4gdHJhaW5lZCBvbiBtdWx0aXBsZSB0YXNrcy4gDTxiciAvPkFsdGhvdWdoIHRoZSBtZXRob2RzIHVzZWQgYXJlIGFscmVhZHkgd2VsbCBlc3RhYmxpc2hlZCBpbiB0aGUgY29tbXVuaXR5LCB0aGVzZSByZXN1bHRzIGFyZSBzaWduaWZpY2FudCBhbmQgcHJvdmlkZSBuZXcgaW5zaWdodHMgb24gdGhlIHJlcHJlc2VudGF0aW9uYWwgcG93ZXIgb2YgdGhpcyBjbGFzcyBvZiBtZXRob2RzLg08YnIgLz4NPGJyIC8+U3VnZ2VzdGlvbnM6DTxiciAvPi0gaXQgd291bGQgYmUgaW50ZXJlc3RpbmcgdG8gY29tcGFyZSB0aGUgZGVlcCBhcmNoaXRlY3R1cmUgYW5kIHRoZSBzaGFsbG93IGFyY2hpdGVjdHVyZSBmb3IgYSBnaXZlbiBjYXBhY2l0eSBvZiB0aGUgbW9kZWwgKGkuZS4gdXNlIHdpZGVyIHNoYWxsb3cgbmV0KQ08YnIgLz4tIHNpbmNlIHRoZSBhdXRob3JzIHVzZSBkZW5vaXNpbmcgYXV0b2VuY29kZXJzIHRvIHByZS10cmFpbiBkZWVwIG5ldHdvcmtzLCB0aGV5IGNvdWxkIGNvbnNpZGVyIHRvIHVzZSBkaXN0b3J0ZWQgY2hhcmFjdGVycyBhcyBub2lzeSBpbnB1dHMgaW5zdGVhZCBvZiBhcnRpZmljaWFsbHkgc2V0IHRvIDAgc29tZSBpbnB1dHMuIFRoaXMgbWlnaHQgaGVscCBsZWFybmluZyBtb3JlIHJlcHJlc2VudGF0aW9ucyB0aGF0IGFyZSBtb3JlIHJvYnVzdCB0byBkaXN0b3J0aW9ucyB0aGF0IGFyZSBhY3R1YWxseSB1c2VmdWwgZm9yIGRpc2NyaW1pbmF0aW9uLmQCCA8PFgIfAGhkZAIIDxUBAGQCAQ9kFgYCAw9kFgJmDxUBE0Fzc2lnbmVkX1Jldmlld2VyXzNkAgcPPCsADQEADxYEHwNnHwICB2QWAmYPZBYQAgEPZBYEZg8PFgIfAQWBAk92ZXJhbGwgcmF0aW5nOiBwbGVhc2Ugc3ludGhlc2l6ZSB5b3VyIGFuc3dlcnMgdG8gb3RoZXIgcXVlc3Rpb25zIGludG8gYW4gb3ZlcmFsbCByZWNvbW1lbmRhdGlvbi4gIFBsZWFzZSB0YWtlIGludG8gYWNjb3VudCB0cmFkZW9mZnMgKGFuIGluY3JlYXNlIGluIG9uZSBtZWFzdXJlIG1heSBjb21wZW5zYXRlIGZvciBhIGRlY3JlYXNlIGluIGFub3RoZXIpLCBhbmQgZGVzY3JpYmUgdGhlIHRyYWRlb2ZmcyBpbiB0aGUgZGV0YWlsZWQgY29tbWVudHMuZGQCAQ9kFgJmDxUBGVZlcnkgZ29vZDogc3VnZ2VzdCBhY2NlcHRkAgIPZBYEZg8PFgIfAQVMVGVjaG5pY2FsIHF1YWxpdHk6IGlzIGFsbCBpbmNsdWRlZCBtYXRlcmlhbCBwcmVzZW50ZWQgY2xlYXJseSBhbmQgY29ycmVjdGx5P2RkAgEPZBYCZg8VAQlWZXJ5IGdvb2RkAgMPZBYEZg8PFgIfAQVnT3JpZ2luYWxpdHk6IGhvdyBtdWNoIG5ldyB3b3JrIGlzIHJlcHJlc2VudGVkIGluIHRoaXMgcGFwZXIsIGJleW9uZCBwcmV2aW91cyBjb25mZXJlbmNlL2pvdXJuYWwgcGFwZXJzP2RkAgEPZBYCZg8VARhTdWJzdGFudGlhbCBuZXcgbWF0ZXJpYWxkAgQPZBYEZg8PFgIfAQWDAUludGVyZXN0IGFuZCBzaWduaWZpY2FuY2U6IHdvdWxkIHRoZSBwYXBlcidzIGdvYWwsIGlmIGNvbXBsZXRlbHkgc29sdmVkLCByZXByZXNlbnQgYSBzdWJzdGFudGlhbCBhZHZhbmNlIGZvciB0aGUgQUlTVEFUUyBjb21tdW5pdHk/ZGQCAQ9kFgJmDxUBC1NpZ25pZmljYW50ZAIFD2QWBGYPDxYCHwEFdVRob3JvdWdobmVzczogdG8gd2hhdCBkZWdyZWUgZG9lcyB0aGUgcGFwZXIgc3VwcG9ydCBpdHMgY29uY2x1c2lvbnMgdGhyb3VnaCBleHBlcmltZW50YWwgY29tcGFyaXNvbnMsIHRoZW9yZW1zLCBldGMuP2RkAgEPZBYCZg8VAQhUaG9yb3VnaGQCBg9kFgRmDw8WAh8BBX1DcmVhdGl2aXR5OiB0byB3aGF0IGRlZ3JlZSBkb2VzIHRoZSBwYXBlciByZXByZXNlbnQgYSBub3ZlbCB3YXkgb2Ygc2V0dGluZyB1cCBhIHByb2JsZW0gb3IgYW4gdW51c3VhbCBhcHByb2FjaCB0byBzb2x2aW5nIGl0P2RkAgEPZBYCZg8VAShNb3N0IGNvbnRlbnQgcmVwcmVzZW50cyBub3ZlbCBhcHByb2FjaGVzZAIHD2QWBGYPDxYCHwEFEURldGFpbGVkIENvbW1lbnRzZGQCAQ9kFgJmDxUB3xVUaGlzIHBhcGVyIGNsYWltcyB0aGF0IHVzaW5nIG91dC1vZi1kaXN0cmlidXRpb24gZXhhbXBsZXMgY2FuIGJlIG1vcmUgaGVscGZ1bCBpbiB0cmFpbmluZyBkZWVwIGFyY2hpdGVjdHVyZXMgdGhhbiBzaGFsbG93IGFyY2hpdGVjdHVyZXMuIEluIG9yZGVyIHRvIHRlc3QgdGhpcyBoeXBvdGhlc2lzLCB0aGUgcGFwZXIgZGV2ZWxvcHMgZXh0ZW5zaXZlIHRyYW5zZm9ybWF0aW9ucyBmb3IgaW1hZ2UgcGF0Y2hlcyAoaS5lLiwgaW1hZ2VzIG9mIGhhbmR3cml0dGVuIGNoYXJhY3RlcnMpIHRvIGdlbmVyYXRlIGEgbGFyZ2Utc2NhbGUgZGF0YXNldCBvZiBwZXJ0dXJiZWQgaW1hZ2VzLiBUaGVzZSBvdXQtb2YtZGlzdHJpYnV0aW9uIGV4YW1wbGVzIGFyZSB0cmFpbmVkIHVzaW5nIE1MUHMgYW5kIHN0YWNrZWQgZGVub2lzaW5nIGF1dG8tZW5jb2RlcnMgKFNEQXMpLiBJbiB0aGUgZXhwZXJpbWVudHMsIHRoZSBwYXBlciBzaG93cyB0aGF0IFNEQXMgb3V0cGVyZm9ybSBNTFBzLCBhY2hpZXZpbmcgaHVtYW4tbGV2ZWwgcGVyZm9ybWFuY2UgZm9yIE5JU1QgZGF0YXNldC4gVGhlIHBhcGVyIGFsc28gcHJvdmlkZXMgdHdvIGludGVyZXN0aW5nIGV4cGVyaW1lbnRzIHNob3dpbmcgdGhhdDogKDEpIFNEQXMgY2FuIGJlbmVmaXQgZnJvbSB0cmFpbmluZyBwZXJ0dXJiZWQgZGF0YSwgZXZlbiB3aGVuIHRlc3Rpbmcgb24gY2xlYW4gZGF0YTsgKDIpIFNEQXMgY2FuIHNpZ25pZmljYW50bHkgYmVuZWZpdCBmcm9tIG11bHRpLXRhc2sgbGVhcm5pbmcuDTxiciAvPg08YnIgLz4NPGJyIC8+UXVlc3Rpb25zLCBjb21tZW50cywgYW5kIHN1Z2dlc3Rpb25zOg08YnIgLz4xLiBSZWdhcmRpbmcgdGhlIGh1bWFuIGxhYmVsaW5nLCBJIGhhdmUgc29tZSBjb25jZXJucyBhYm91dCBsYWJlbGluZyBub2lzZS9iaWFzZXMgZHVlIHRvIEFNVC4gSG93IHdlcmUgdGhlIGFub21hbGllcyBpbiBsYWJlbGluZyBvciBvdXRsaWVycyBjb250cm9sbGVkPyBXYXMgdGhlcmUgYW55IHByb2NlZHVyZSB0byBtaW5pbWl6ZSBsYWJlbGluZyBub2lzZS9iaWFzZXMgb3IgdG8gZW5zdXJlIHRoYXQgaHVtYW4gbGFiZWxlcnMgdHJpZWQgdGhlaXIgYmVzdCAoZS5nLiwgZmlsdGVyaW5nIG91dCByYW5kb20gZ3Vlc3NlcyBvciBlbmNvdXJhZ2luZyB0aGUgbGFiZWxlcnMgdG8gY29uc2lkZXIgYWxsIHBvc3NpYmlsaXRpZXMgY2FyZWZ1bGx5IGJlZm9yZSBwcm92aWRpbmcgcHJlbWF0dXJlIGd1ZXNzZXMpPyBGb3IgZXhhbXBsZSwgbXVsdGktc3RhZ2UgcXVlc3Rpb25uYWlyZXMgKGUuZy4sIGFza2luZyAiY2hhcmFjdGVycy9kaWdpdHMiLCAidXBwZXJjYXNlL2xvd2VyY2FzZSIsIHRoZW4gY2hvb3Npbmcgb25lIG91dCBvZiAxMCBkaWdpdHMsIG9yIDI2IGNoYXJhY3RlcnMpIG1pZ2h0IHNpZ25pZmljYW50bHkgcmVkdWNlIGxhYmVsaW5nIG5vaXNlL2JpYXNlcywgcmF0aGVyIHRoYW4gc2hvd2luZyA2MiBjYW5kaWRhdGUgYW5zd2VycyBzaW11bHRhbmVvdXNseS4NPGJyIC8+DTxiciAvPjIuIEl0IHNlZW1zIHRoYXQgdGhlIHBhcGVyIGZpeGVkIHRoZSBudW1iZXIgb2YgaGlkZGVuIGxheWVycyBhcyB0aHJlZS4gRGVzcGl0ZSBnb29kIHBlcmZvcm1hbmNlIG9mIHRoZSBwcm9wb3NlZCBhcmNoaXRlY3R1cmUsIGl0IGlzIHNvbWV3aGF0IHVuY2xlYXIgd2hldGhlciB0aGUgYmVuZWZpdCBjb21lcyBtYWlubHkgZnJvbSBkZWVwIGFyY2hpdGVjdHVyZSBvciB0aGUgdXNlIG9mIGRlbm9pc2luZyBhdXRvLWVuY29kZXJzLg08YnIgLz4NPGJyIC8+VGhlcmVmb3JlLCBpdCB3aWxsIGJlIG1vcmUgaW50ZXJlc3RpbmcgdG8gc2VlIHRoZSBlZmZlY3Qgb2YgdGhlIG51bWJlciBvZiBsYXllcnMgYW5kIG90aGVyIHByZS10cmFpbmluZyBtZXRob2RzIChlLmcuLCBSQk1zIG9yIGF1dG8tZW5jb2RlcnMpLiBUaGlzIGV4cGVyaW1lbnQgd2lsbCBjbGFyaWZ5IHdoZXJlIHRoZSBiZW5lZml0IGNvbWVzIGZyb20gKGkuZS4sIGRlZXAgYXJjaGl0ZWN0dXJlIHZzLiBwcmUtdHJhaW5pbmcgbW9kdWxlcykgYW5kIHByb3ZpZGUgbW9yZSBpbnNpZ2h0cyBhYm91dCB0aGUgcmVzdWx0cy4NPGJyIC8+DTxiciAvPjMuIFRoZSBwYXBlciBicmllZmx5IG1lbnRpb25lZCBhYm91dCB0aGUgdXNlIG9mIGxpYlNWTSwgYnV0IGl0IHdpbGwgYmUgdXNlZnVsIHRvIGNvbXBhcmUgYWdhaW5zdCB0aGUgcmVzdWx0cyB1c2luZyBvbmxpbmUgU1ZNIChlLmcuLCBQRUdBU09TKS4NPGJyIC8+DTxiciAvPjQuIFRoZSBwYXBlciBhbHNvIHRhbGtzIGFib3V0IHRoZSBlZmZlY3Qgb2YgbGFyZ2UgbGFiZWxlZCBkYXRhIGluIHNlbGYtdGF1Z2h0IGxlYXJuaW5nIHNldHRpbmcuIFRvIHN0cmVuZ3RoZW4gdGhlIGNsYWltLCBpdCB3aWxsIGJlIGhlbHBmdWwgdG8gc2hvdyB0aGUgdGVzdCBhY2N1cmFjeSBhcyBhIGZ1bmN0aW9uIG9mIG51bWJlciBvZiBsYWJlbGVkIGV4YW1wbGVzLg08YnIgLz4NPGJyIC8+T3ZlcmFsbCwgdGhlIHBhcGVyIGlzIGNsZWFybHkgd3JpdHRlbiwgYW5kIGl0IHByb3ZpZGVzIGludGVyZXN0aW5nIGV4cGVyaW1lbnRzIG9uIGxhcmdlIHNjYWxlIGRhdGFzZXRzLCBhZGRyZXNzaW5nIGEgbnVtYmVyIG9mIGludGVyZXN0aW5nIHF1ZXN0aW9ucyByZWxhdGVkIHRvIGRlZXAgbGVhcm5pbmcgYW5kIG11bHRpLXRhc2sgbGVhcm5pbmcuIEZ1cnRoZXJtb3JlLCB0aGlzIHdvcmsgY2FuIHByb3ZpZGUgYSBuZXcgbGFyZ2Ugc2NhbGUgYmVuY2htYXJrIGRhdGFzZXQgKGJleW9uZCBNTklTVCkgZm9yIGRlZXAgbGVhcm5pbmcgYW5kIG1hY2hpbmUgbGVhcm5pbmcgcmVzZWFyY2guDTxiciAvPmQCCA8PFgIfAGhkZAIIDxUBAGQYAgUfY3RsMDAkY3BoJGd2UmV2aWV3cyRjdGwwMSRjdGwwMA88KwAKAQgCAWQFH2N0bDAwJGNwaCRndlJldmlld3MkY3RsMDAkY3RsMDAPPCsACgEIAgFkh0ly6l5rRpe9mdRnffXYAZKa1+8=">
|
|
|
127 </div>
|
|
|
128
|
|
|
129 <table id="header">
|
|
|
130 <tbody><tr>
|
|
|
131 <td><img src="./ReviewsAISTATS_files/conferencelogo.gif"></td>
|
|
|
132 <td width="100%"><a href="http://www.aistats.org/">AI & Statistics 2011 </a><br><b>Fourteenth International Conference on Artificial Intelligence and Statistics </b><br>April 11-13, 2011<br>Ft. Lauderdale, FL<br>USA</td>
|
|
|
133 </tr>
|
|
|
134 </tbody></table>
|
|
|
135 <table id="content"><tbody><tr><td class="contentBorder"> </td><td class="contentContainer">
|
|
|
136 <span id="ctl00_cph_Label4" style="font-size:Small;font-weight:bold;">Reviews For Paper</span>
|
|
|
137 <span id="ctl00_cph_lblErrorMessage" class="error" style="font-size:Small;"></span>
|
|
|
138 <div id="ctl00_cph_pnlReviews">
|
|
|
139
|
|
|
140 <span style="font-size:Small;">
|
|
|
141 <table class="nicetable2" style="text-align:left; width: 100%;">
|
|
|
142
|
|
|
143 <tbody><tr>
|
|
|
144 <td width="100px"><b>Paper ID</b></td>
|
|
|
145 <td><span id="ctl00_cph_infoSubmission_lblPaperId" style="font-size:Small;">126</span></td>
|
|
|
146 </tr>
|
|
|
147 <tr>
|
|
|
148 <td><b>Title</b></td>
|
|
|
149 <td><span id="ctl00_cph_infoSubmission_lblPaperTitle" style="font-size:Small;">Deep Learners Benefit More from Out-of-Distribution Examples</span></td>
|
|
|
150 </tr>
|
|
|
151
|
|
|
152
|
|
|
153
|
|
|
154
|
|
|
155
|
|
|
156 </tbody></table></span>
|
|
|
157
|
|
|
158
|
|
|
159 <hr>
|
|
|
160 <table>
|
|
|
161 <tbody><tr>
|
|
|
162 <td>
|
|
|
163 <span id="ctl00_cph_gvReviews_ctl00_Label2" style="font-size:Small;font-weight:bold;">Masked Reviewer ID:</span>
|
|
|
164 </td>
|
|
|
165 <td>
|
|
|
166 <span id="ctl00_cph_gvReviews_ctl00_Label1" style="font-size:Small;">Assigned_Reviewer_2</span>
|
|
|
167 </td>
|
|
|
168 </tr>
|
|
|
169 <tr>
|
|
|
170 <td>
|
|
|
171 <span id="ctl00_cph_gvReviews_ctl00_Label3" style="font-size:Small;font-weight:bold;">Review:</span>
|
|
|
172 </td>
|
|
|
173 <td>
|
|
|
174 </td>
|
|
|
175 </tr>
|
|
|
176 </tbody></table>
|
|
|
177 <div>
|
|
|
178 <table cellspacing="0" cellpadding="4" rules="all" border="1" style="color:#333333;border-width:1px;border-style:None;font-family:Verdana;font-size:Small;border-collapse:collapse;">
|
|
|
179 <tbody><tr style="color:White;background-color:#5D7B9D;font-weight:bold;">
|
|
|
180 <th scope="col">Question</th><th scope="col"> </th>
|
|
|
181 </tr><tr style="color:#333333;background-color:#F7F6F3;">
|
|
|
182 <td style="width:20%;">Overall rating: please synthesize your answers to other questions into an overall recommendation. Please take into account tradeoffs (an increase in one measure may compensate for a decrease in another), and describe the tradeoffs in the detailed comments.</td><td style="width:80%;">
|
|
|
183 Good: suggest accept
|
|
|
184 </td>
|
|
|
185 </tr><tr style="color:#284775;background-color:White;">
|
|
|
186 <td style="width:20%;">Technical quality: is all included material presented clearly and correctly?</td><td style="width:80%;">
|
|
|
187 Good
|
|
|
188 </td>
|
|
|
189 </tr><tr style="color:#333333;background-color:#F7F6F3;">
|
|
|
190 <td style="width:20%;">Originality: how much new work is represented in this paper, beyond previous conference/journal papers?</td><td style="width:80%;">
|
|
|
191 Substantial new material
|
|
|
192 </td>
|
|
|
193 </tr><tr style="color:#284775;background-color:White;">
|
|
|
194 <td style="width:20%;">Interest and significance: would the paper's goal, if completely solved, represent a substantial advance for the AISTATS community?</td><td style="width:80%;">
|
|
|
195 Significant
|
|
|
196 </td>
|
|
|
197 </tr><tr style="color:#333333;background-color:#F7F6F3;">
|
|
|
198 <td style="width:20%;">Thoroughness: to what degree does the paper support its conclusions through experimental comparisons, theorems, etc.?</td><td style="width:80%;">
|
|
|
199 Thorough
|
|
|
200 </td>
|
|
|
201 </tr><tr style="color:#284775;background-color:White;">
|
|
|
202 <td style="width:20%;">Creativity: to what degree does the paper represent a novel way of setting up a problem or an unusual approach to solving it?</td><td style="width:80%;">
|
|
|
203 Most content represents application of known ideas
|
|
|
204 </td>
|
|
|
205 </tr><tr style="color:#333333;background-color:#F7F6F3;">
|
|
|
206 <td style="width:20%;">Detailed Comments</td><td style="width:80%;">
|
|
|
207 This paper shows that deep networks benefit more from out-of-distribution examples than shallower architectures on a large scale character recognition experiment. A thorough empirical validation shows that deep nets produce better discrimination (than shallower nets) when trained with distorted characters and when trained on multiple tasks.
|
|
|
208 <br>Although the methods used are already well established in the community, these results are significant and provide new insights on the representational power of this class of methods.
|
|
|
209 <br>
|
|
|
210 <br>Suggestions:
|
|
|
211 <br>- it would be interesting to compare the deep architecture and the shallow architecture for a given capacity of the model (i.e. use wider shallow net)
|
|
|
212 <br>- since the authors use denoising autoencoders to pre-train deep networks, they could consider to use distorted characters as noisy inputs instead of artificially set to 0 some inputs. This might help learning more representations that are more robust to distortions that are actually useful for discrimination.
|
|
|
213 </td>
|
|
|
214 </tr>
|
|
|
215 </tbody></table>
|
|
|
216 </div>
|
|
|
217
|
|
|
218
|
|
|
219 <hr>
|
|
|
220 <table>
|
|
|
221 <tbody><tr>
|
|
|
222 <td>
|
|
|
223 <span id="ctl00_cph_gvReviews_ctl01_Label2" style="font-size:Small;font-weight:bold;">Masked Reviewer ID:</span>
|
|
|
224 </td>
|
|
|
225 <td>
|
|
|
226 <span id="ctl00_cph_gvReviews_ctl01_Label1" style="font-size:Small;">Assigned_Reviewer_3</span>
|
|
|
227 </td>
|
|
|
228 </tr>
|
|
|
229 <tr>
|
|
|
230 <td>
|
|
|
231 <span id="ctl00_cph_gvReviews_ctl01_Label3" style="font-size:Small;font-weight:bold;">Review:</span>
|
|
|
232 </td>
|
|
|
233 <td>
|
|
|
234 </td>
|
|
|
235 </tr>
|
|
|
236 </tbody></table>
|
|
|
237 <div>
|
|
|
238 <table cellspacing="0" cellpadding="4" rules="all" border="1" style="color:#333333;border-width:1px;border-style:None;font-family:Verdana;font-size:Small;border-collapse:collapse;">
|
|
|
239 <tbody><tr style="color:White;background-color:#5D7B9D;font-weight:bold;">
|
|
|
240 <th scope="col">Question</th><th scope="col"> </th>
|
|
|
241 </tr><tr style="color:#333333;background-color:#F7F6F3;">
|
|
|
242 <td style="width:20%;">Overall rating: please synthesize your answers to other questions into an overall recommendation. Please take into account tradeoffs (an increase in one measure may compensate for a decrease in another), and describe the tradeoffs in the detailed comments.</td><td style="width:80%;">
|
|
|
243 Very good: suggest accept
|
|
|
244 </td>
|
|
|
245 </tr><tr style="color:#284775;background-color:White;">
|
|
|
246 <td style="width:20%;">Technical quality: is all included material presented clearly and correctly?</td><td style="width:80%;">
|
|
|
247 Very good
|
|
|
248 </td>
|
|
|
249 </tr><tr style="color:#333333;background-color:#F7F6F3;">
|
|
|
250 <td style="width:20%;">Originality: how much new work is represented in this paper, beyond previous conference/journal papers?</td><td style="width:80%;">
|
|
|
251 Substantial new material
|
|
|
252 </td>
|
|
|
253 </tr><tr style="color:#284775;background-color:White;">
|
|
|
254 <td style="width:20%;">Interest and significance: would the paper's goal, if completely solved, represent a substantial advance for the AISTATS community?</td><td style="width:80%;">
|
|
|
255 Significant
|
|
|
256 </td>
|
|
|
257 </tr><tr style="color:#333333;background-color:#F7F6F3;">
|
|
|
258 <td style="width:20%;">Thoroughness: to what degree does the paper support its conclusions through experimental comparisons, theorems, etc.?</td><td style="width:80%;">
|
|
|
259 Thorough
|
|
|
260 </td>
|
|
|
261 </tr><tr style="color:#284775;background-color:White;">
|
|
|
262 <td style="width:20%;">Creativity: to what degree does the paper represent a novel way of setting up a problem or an unusual approach to solving it?</td><td style="width:80%;">
|
|
|
263 Most content represents novel approaches
|
|
|
264 </td>
|
|
|
265 </tr><tr style="color:#333333;background-color:#F7F6F3;">
|
|
|
266 <td style="width:20%;">Detailed Comments</td><td style="width:80%;">
|
|
|
267 This paper claims that using out-of-distribution examples can be more helpful in training deep architectures than shallow architectures. In order to test this hypothesis, the paper develops extensive transformations for image patches (i.e., images of handwritten characters) to generate a large-scale dataset of perturbed images. These out-of-distribution examples are trained using MLPs and stacked denoising auto-encoders (SDAs). In the experiments, the paper shows that SDAs outperform MLPs, achieving human-level performance for NIST dataset. The paper also provides two interesting experiments showing that: (1) SDAs can benefit from training perturbed data, even when testing on clean data; (2) SDAs can significantly benefit from multi-task learning.
|
|
|
268 <br>
|
|
|
269 <br>
|
|
|
270 <br>Questions, comments, and suggestions:
|
|
|
271 <br>1. Regarding the human labeling, I have some concerns about labeling noise/biases due to AMT. How were the anomalies in labeling or outliers controlled? Was there any procedure to minimize labeling noise/biases or to ensure that human labelers tried their best (e.g., filtering out random guesses or encouraging the labelers to consider all possibilities carefully before providing premature guesses)? For example, multi-stage questionnaires (e.g., asking "characters/digits", "uppercase/lowercase", then choosing one out of 10 digits, or 26 characters) might significantly reduce labeling noise/biases, rather than showing 62 candidate answers simultaneously.
|
|
|
272 <br>
|
|
|
273 <br>2. It seems that the paper fixed the number of hidden layers as three. Despite good performance of the proposed architecture, it is somewhat unclear whether the benefit comes mainly from deep architecture or the use of denoising auto-encoders.
|
|
|
274 <br>
|
|
|
275 <br>Therefore, it will be more interesting to see the effect of the number of layers and other pre-training methods (e.g., RBMs or auto-encoders). This experiment will clarify where the benefit comes from (i.e., deep architecture vs. pre-training modules) and provide more insights about the results.
|
|
|
276 <br>
|
|
|
277 <br>3. The paper briefly mentioned about the use of libSVM, but it will be useful to compare against the results using online SVM (e.g., PEGASOS).
|
|
|
278 <br>
|
|
|
279 <br>4. The paper also talks about the effect of large labeled data in self-taught learning setting. To strengthen the claim, it will be helpful to show the test accuracy as a function of number of labeled examples.
|
|
|
280 <br>
|
|
|
281 <br>Overall, the paper is clearly written, and it provides interesting experiments on large scale datasets, addressing a number of interesting questions related to deep learning and multi-task learning. Furthermore, this work can provide a new large scale benchmark dataset (beyond MNIST) for deep learning and machine learning research.
|
|
|
282 <br>
|
|
|
283 </td>
|
|
|
284 </tr>
|
|
|
285 </tbody></table>
|
|
|
286 </div>
|
|
|
287
|
|
|
288
|
|
|
289 <br>
|
|
|
290 <br>
|
|
|
291
|
|
|
292 </div>
|
|
|
293 </td><td class="contentBorder"> </td></tr></tbody></table>
|
|
|
294 </form>
|
|
|
295
|
|
|
296
|
|
|
297 </body></html> |
