Re: [Bigdata-developers] Trying to import Wikidata

[Rune S. <rs...@un...>]

Hi list

It seems the problem was somehow related to a two drive configuration on my machine. The primary drive where the blazegraph service was located had very limited space. The data drive had plenty but I guess some data also is written to primary drive. Running in a single drive configuration seems to resolved the problem.

Regards,
Rune

> Den 28. nov. 2017 kl. 14.01 skrev Rune Stilling <rs...@un...>:
> 
> Hi list
> 
> I’m trying to import wikidata into a graphdb EC2-instance. But the import stops with an exception
> 
>> Caused by: java.io.IOException: No space left on device
> 
> 
> There seems to be plenty of space left though:
> 
>> $ df -h
>> Filesystem Size Used Avail Use% Mounted on
>> devtmpfs 7.9G 68K 7.9G 1% /dev
>> tmpfs 7.9G 0 7.9G 0% /dev/shm
>> /dev/xvda1 493G 23G 470G 5% /
>> /dev/xvdb1 1008G 382G 585G 40% /data
> 
> 
> The blazegraph.jnl file is located in the /data folder.
> 
> What could be the problem?
> 
> Regards,
> Rune Stilling
> at com.bigdata.btree.AbstractBTree.writeNodeRecursiveConcurrent(AbstractBTree.java:4131)
> at com.bigdata.btree.AbstractBTree.writeNodeRecursive(AbstractBTree.java:3844)
> at com.bigdata.btree.DefaultEvictionListener.doEviction(DefaultEvictionListener.java:139)
> at com.bigdata.btree.DefaultEvictionListener.evicted(DefaultEvictionListener.java:75)
> at com.bigdata.btree.DefaultEvictionListener.evicted(DefaultEvictionListener.java:37)
> at com.bigdata.cache.HardReferenceQueue.evict(HardReferenceQueue.java:226)
> at com.bigdata.cache.HardReferenceQueue.beforeOffer(HardReferenceQueue.java:199)
> at com.bigdata.cache.RingBuffer.add(RingBuffer.java:159)
> at com.bigdata.cache.HardReferenceQueue.add(HardReferenceQueue.java:176)
> at com.bigdata.btree.AbstractBTree.doTouch(AbstractBTree.java:3766)
> at com.bigdata.btree.AbstractBTree.doSyncTouch(AbstractBTree.java:3722)
> at com.bigdata.btree.AbstractBTree.touch(AbstractBTree.java:3685)
> at com.bigdata.btree.AbstractNode.<init>(AbstractNode.java:298)
> at com.bigdata.btree.Leaf.<init>(Leaf.java:348)
> at com.bigdata.btree.BTree$NodeFactory.allocLeaf(BTree.java:1936)
> at com.bigdata.btree.NodeSerializer.wrap(NodeSerializer.java:411)
> at com.bigdata.btree.AbstractBTree.readNodeOrLeaf(AbstractBTree.java:4584)
> at com.bigdata.btree.Node._getChild(Node.java:2746)
> at com.bigdata.btree.AbstractBTree$1.compute(AbstractBTree.java:377)
> at com.bigdata.btree.AbstractBTree$1.compute(AbstractBTree.java:360)
> at com.bigdata.util.concurrent.Memoizer$1.call(Memoizer.java:77)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at com.bigdata.util.concurrent.Memoizer.compute(Memoizer.java:92)
> at com.bigdata.btree.AbstractBTree.loadChild(AbstractBTree.java:546)
> at com.bigdata.btree.Node.getChild(Node.java:2644)
> at com.bigdata.btree.Node.lookup(Node.java:938)
> at com.bigdata.btree.Node.lookup(Node.java:940)
> at com.bigdata.btree.Node.lookup(Node.java:940)
> at com.bigdata.btree.Node.lookup(Node.java:940)
> at com.bigdata.btree.Node.lookup(Node.java:940)
> at com.bigdata.btree.Node.lookup(Node.java:940)
> at com.bigdata.btree.Node.lookup(Node.java:940)
> at com.bigdata.btree.AbstractBTree.lookup(AbstractBTree.java:2455)
> at com.bigdata.btree.AbstractBTree.lookup(AbstractBTree.java:2383)
> at com.bigdata.rdf.spo.SPOIndexWriteProc.applyOnce(SPOIndexWriteProc.java:232)
> at com.bigdata.btree.proc.AbstractKeyArrayIndexProcedure.apply(AbstractKeyArrayIndexProcedure.java:381)
> at com.bigdata.btree.UnisolatedReadWriteIndex.submit(UnisolatedReadWriteIndex.java:723)
> at com.bigdata.rdf.spo.SPOIndexWriter.call(SPOIndexWriter.java:363)
> at com.bigdata.rdf.spo.SPOIndexWriter.call(SPOIndexWriter.java:68)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1152)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:622)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: java.io.IOException: No space left on device
> at sun.nio.ch.FileDispatcherImpl.pwrite0(Native Method)
> at sun.nio.ch.FileDispatcherImpl.pwrite(FileDispatcherImpl.java:66)
> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:89)
> at sun.nio.ch.IOUtil.write(IOUtil.java:51)
> at sun.nio.ch.FileChannelImpl.writeInternal(FileChannelImpl.java:771)
> at sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:756)
> at com.bigdata.io.FileChannelUtility.writeAll(FileChannelUtility.java:610)
> at com.bigdata.io.FileChannelUtility.writeAll(FileChannelUtility.java:509)
> at com.bigdata.journal.DiskOnlyStrategy.writeOnDisk(DiskOnlyStrategy.java:2287)