[cweb-CVS] bigdata-rdf/src/java/com/bigdata/rdf/rio BulkLoaderBuffer.java, 1.8, 1.9

[Bryan T. <tho...@us...>]

Update of /cvsroot/cweb/bigdata-rdf/src/java/com/bigdata/rdf/rio
In directory sc8-pr-cvs4.sourceforge.net:/tmp/cvs-serv24672/src/java/com/bigdata/rdf/rio

Modified Files:
	BulkLoaderBuffer.java 
Log Message:
Modified the IndexSegmentBuilder to use the new TemporaryStore and removed the fullyBuffer boolean option since data will be automatically buffered out to 100M and the spill over onto disk.

Index: BulkLoaderBuffer.java
===================================================================
RCS file: /cvsroot/cweb/bigdata-rdf/src/java/com/bigdata/rdf/rio/BulkLoaderBuffer.java,v
retrieving revision 1.8
retrieving revision 1.9
diff -C2 -d -r1.8 -r1.9
*** BulkLoaderBuffer.java	9 Feb 2007 21:19:25 -0000	1.8
--- BulkLoaderBuffer.java	15 Feb 2007 22:01:25 -0000	1.9
***************
*** 93,112 ****
      
      /**
-      * When true, the {@link IndexSegment}s will be built in memory rather than
-      * using disk to buffer the nodes.
-      * 
-      * @todo try modifying the {@link NodeSerializer} to use a
-      *       {@link ByteArrayOutputStream} and see if that is any faster the the
-      *       {@link ByteBufferOutputStream}. Be sure to undo the hack in
-      *       {@link KeyBufferSerializer}.
-      * 
-      * @todo fully buffered is now marginally faster, but the disk buffer
-      *       version winds up writing the leaves on disk and then transfering
-      *       them to another disk file. fix that and then compare performance
-      *       again.
-      */
-     boolean fullyBuffer = true;
-     
-     /**
       * @todo experiment with and without checksum computation.
       */
--- 93,96 ----
***************
*** 173,177 ****
                  new TermIdIterator(this), branchingFactor,
                  TermIdSerializer.INSTANCE,
!                 fullyBuffer, useChecksum, recordCompressor,
                  errorRate);
  
--- 157,161 ----
                  new TermIdIterator(this), branchingFactor,
                  TermIdSerializer.INSTANCE,
!                 useChecksum, recordCompressor,
                  errorRate);
  
***************
*** 205,209 ****
                  branchingFactor,
                  RdfValueSerializer.INSTANCE,
!                 fullyBuffer, useChecksum, recordCompressor,
                  errorRate);
  
--- 189,193 ----
                  branchingFactor,
                  RdfValueSerializer.INSTANCE,
!                 useChecksum, recordCompressor,
                  errorRate);
  
***************
*** 230,234 ****
                  branchingFactor,
                  StatementSerializer.INSTANCE,
!                 fullyBuffer, useChecksum, recordCompressor,
                  errorRate);
          
--- 214,218 ----
                  branchingFactor,
                  StatementSerializer.INSTANCE,
!                 useChecksum, recordCompressor,
                  errorRate);