changeset 1055:bc3f7834db83

added a comment/question about Type
author Yoshua Bengio <bengioy@iro.umontreal.ca>
date Wed, 08 Sep 2010 20:45:17 -0400
parents a474fabd1f37
children 19033ef1636d baf1988db557 b4ccf6b43f27
files doc/v2_planning/learner.txt
diffstat 1 files changed, 12 insertions(+), 0 deletions(-) [+]
line wrap: on
line diff
--- a/doc/v2_planning/learner.txt	Wed Sep 08 16:20:20 2010 -0400
+++ b/doc/v2_planning/learner.txt	Wed Sep 08 20:45:17 2010 -0400
@@ -270,6 +270,18 @@
 
 Comments
 ~~~~~~~~
+
+YB asks: it seems to me that what we really need from "Type" is not just
+testing that a value is legal, but more practically a function that specifies the
+prior distribution for the hyper-parameter, i.e., how to sample from it,
+and possibly some representation of it that could be used to infer
+a posterior (such as an unnormalized log-density or log-probability).
+Having the min and max and default limits us to the uniform distribution,
+which may not always be appropriate. For example sometimes we'd like 
+Gaussian (-infty to infty) or Exponential (0 to infty) or Poisson (non-negative integers).
+For that reason, I think that "Type" is not a very good name.
+How about "Prior" or "Density" or something like that?
+
 OD asks: (I hope it's ok to leave comments even though I'm not in committee... I'm
 interested to see how the learner interface is shaping up so I'll be keeping
 an eye on this file)