view doc/v2_planning/dataset.txt @ 1008:a5886b394bda

Updating with talking points from Sept. 2 discussion
author Dumitru Erhan <dumitru.erhan@gmail.com>
date Fri, 03 Sep 2010 10:01:02 -0400
parents f82093bf4405
children fb6cae14fd07
line wrap: on
line source

Discussion of Function Specification for Dataset Types
======================================================

Some talking points from the September 2 meeting:

 * Datasets as views/tasks (Pascal Vincent's idea): our dataset specification
 needs to be flexible enough to accommodate different (sub)tasks and views of
 the same underlying data.
 * Datasets as probability distributions from which one can sample.
 * Our specification should allow transparent handling of infinite datasets (or
 simply datasets which cannot fit in memory)
 * GPU/buffering issues.

Commiteee: DE, OB, OD, AB, PV