Update of /cvsroot/cweb/bigdata-rdf/src/java/com/bigdata/rdf/rio
In directory sc8-pr-cvs4.sourceforge.net:/tmp/cvs-serv24672/src/java/com/bigdata/rdf/rio
Modified Files:
BulkLoaderBuffer.java
Log Message:
Modified the IndexSegmentBuilder to use the new TemporaryStore and removed the fullyBuffer boolean option since data will be automatically buffered out to 100M and the spill over onto disk.
Index: BulkLoaderBuffer.java
===================================================================
RCS file: /cvsroot/cweb/bigdata-rdf/src/java/com/bigdata/rdf/rio/BulkLoaderBuffer.java,v
retrieving revision 1.8
retrieving revision 1.9
diff -C2 -d -r1.8 -r1.9
*** BulkLoaderBuffer.java 9 Feb 2007 21:19:25 -0000 1.8
--- BulkLoaderBuffer.java 15 Feb 2007 22:01:25 -0000 1.9
***************
*** 93,112 ****
/**
- * When true, the {@link IndexSegment}s will be built in memory rather than
- * using disk to buffer the nodes.
- *
- * @todo try modifying the {@link NodeSerializer} to use a
- * {@link ByteArrayOutputStream} and see if that is any faster the the
- * {@link ByteBufferOutputStream}. Be sure to undo the hack in
- * {@link KeyBufferSerializer}.
- *
- * @todo fully buffered is now marginally faster, but the disk buffer
- * version winds up writing the leaves on disk and then transfering
- * them to another disk file. fix that and then compare performance
- * again.
- */
- boolean fullyBuffer = true;
-
- /**
* @todo experiment with and without checksum computation.
*/
--- 93,96 ----
***************
*** 173,177 ****
new TermIdIterator(this), branchingFactor,
TermIdSerializer.INSTANCE,
! fullyBuffer, useChecksum, recordCompressor,
errorRate);
--- 157,161 ----
new TermIdIterator(this), branchingFactor,
TermIdSerializer.INSTANCE,
! useChecksum, recordCompressor,
errorRate);
***************
*** 205,209 ****
branchingFactor,
RdfValueSerializer.INSTANCE,
! fullyBuffer, useChecksum, recordCompressor,
errorRate);
--- 189,193 ----
branchingFactor,
RdfValueSerializer.INSTANCE,
! useChecksum, recordCompressor,
errorRate);
***************
*** 230,234 ****
branchingFactor,
StatementSerializer.INSTANCE,
! fullyBuffer, useChecksum, recordCompressor,
errorRate);
--- 214,218 ----
branchingFactor,
StatementSerializer.INSTANCE,
! useChecksum, recordCompressor,
errorRate);
|
