[cweb-CVS] bigdata/src/java/com/bigdata/gom clusterIndices.txt, 1.1, 1.2

[Bryan T. <tho...@us...>]

Update of /cvsroot/cweb/bigdata/src/java/com/bigdata/gom
In directory sc8-pr-cvs4.sourceforge.net:/tmp/cvs-serv25521/src/java/com/bigdata/gom

Modified Files:
	clusterIndices.txt 
Log Message:
Removed generated JNI header files, adding their names to .cvsignore.
Removed old TODO.txt, migrating still relevant items to various Java source files.


Index: clusterIndices.txt
===================================================================
RCS file: /cvsroot/cweb/bigdata/src/java/com/bigdata/gom/clusterIndices.txt,v
retrieving revision 1.1
retrieving revision 1.2
diff -C2 -d -r1.1 -r1.2
*** clusterIndices.txt	22 Mar 2007 15:04:16 -0000	1.1
--- clusterIndices.txt	16 Apr 2007 10:35:28 -0000	1.2
***************
*** 1,2 ****
--- 1,22 ----
+ x. Support distributed link sets so that we can efficiently parallize
+    link set scans across multiple segments and leverage bigtable row
+    scans to scan link sets in parallel. Link set jump tables need to
+    identify the head/tail/count of each segment in the database in
+    which there are members for that link set.  A distributed link set
+    partitions the link set into a link set generic objects (one per
+    segment), each of which maintains the link set members for that
+    segment.  A two level iterator can scan the top-level link set and
+    assign the nexted link sets to workers in a thread pool.  With 20
+    workers, you can scan 20 segments in parallel.  When workers become
+    free they are assigned to the next nexted link set.  All of this
+    should be more or less transparent.  Some declarative options can
+    be placed on the top-level link set indicating the degree of
+    scatter that is desired and a data distribution policy.  Iterators
+    of the top level link set will transparently traverse the nexted
+    link sets.  If the iterator is written to perform an operation in
+    place then we do not even need to send objects or data back to the
+    client that requested the iterator.
+ 
+ x. Support schema constraints on link sets and generic objects in GOM.
  
  @todo Clustered indices.  A clustered index is where the rows are