Re: [Bigdata-developers] Fastest way to load data via Bulk Data Load

[Edgar Rodriguez-D. <ed...@sy...>]

A correction here on the data size, it’s not 180G - it’s 18G of a gzip trig file exported by blazegraph; number of triples is correct.

> On May 31, 2016, at 10:42 AM, Edgar Rodriguez-Diaz <ed...@sy...> wrote:
> 
> Hi,
> 
> I’ve been trying to use the DataLoader tool for bulk loading a very large file into blazegraph (~180G with ~4 billion triples) with and empty journal file, but I’m noticing a performance degradation on the rate of triples/s loaded. It started at around 55K and after 200 M triples the rate is around 32K, the rate keeps going down consistently.
> What is the configuration to get the best performance out of the bulk load into blazegraph?
> 
> Thanks.
> 
> - Edgar