Re: [Virtuoso-users] Inserting large quantities of text via SPARQL

[Hugh W. <hwi...@op...>]

Hi Vishesh,

It would be of interest to have a test case of an insertion that is crashing the Virtuoso server such that we can attempt a recreation, are you able to provide this ?

Also, what versions of Virtuoso is in use, please provide the output of running the command:

	virtuoso-t -?

Is the data being inserted in the form of datasets (or can they be produced as such) or are these just ad-hoc data insertions being performed ? If they are in the form of datasets then you can use the Virtuoso RDF Bulk Loader to insert them into the database, see:

	http://virtuoso.openlinksw.com/dataspace/dav/wiki/Main/VirtBulkRDFLoader

Best Regards
Hugh Williams
Professional Services
OpenLink Software, Inc.      //              http://www.openlinksw.com/
Weblog   -- http://www.openlinksw.com/blogs/
LinkedIn -- http://www.linkedin.com/company/openlink-software/
Twitter  -- http://twitter.com/OpenLink
Google+  -- http://plus.google.com/100570109519069333827/
Facebook -- http://www.facebook.com/OpenLinkSoftware
Universal Data Access, Integration, and Management Technology Providers

On 24 Dec 2012, at 12:11, Vishesh Handa wrote:

> Hey everyone
> 
> We need to insert a large quantity of text under a certain property in virtuoso. The triple looks something like this -
> 
> <nepomuk:/res/A.> nie:plainTextContent " ... text ..."
> 
> where "... text ... " can be quite large. I have cases where it is over 100mb. In those cases it does not make sense to use the conventional sparul insert statement. In fact, sending such a large insert statement even causes virtuoso to crash.
> 
> One option that I discovered, was using bif:concat, but that is slow and creates a new triple instead of updating the current one -
> 
> sparql insert into <nepomuk:/ctx/G> { <nepomuk:/res/A> nie:plainTextContent `bif:concat( ?pt, ".. part of the text..." )` . } where { <nepomuk:/res/A> nie:plainTextContent ?pt . }
> 
> Is there a better way to stream in a large quantity of text?
> 
> -- 
> Vishesh Handa
> ------------------------------------------------------------------------------
> LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
> Remotely access PCs and mobile devices and provide instant support
> Improve your efficiency, and focus on delivering more value-add services
> Discover what IT Professionals Know. Rescue delivers
> http://p.sf.net/sfu/logmein_12329d2d_______________________________________________
> Virtuoso-users mailing list
> Vir...@li...
> https://lists.sourceforge.net/lists/listinfo/virtuoso-users