Re: [dotNetRDF-Support] reading owl into a virtuoso triple store

[Rob V. <rv...@do...>]

This suggests that the batch size is too high resulting in larger messages
than Virtuoso can cope with.  Try turning down the batch size to something
smaller

Rob

From:  "Bahador(reza)? OFOGHI" <br_...@ya...>
Reply-To:  "Bahador(reza)? OFOGHI" <br_...@ya...>
Date:  Thursday, August 1, 2013 11:47 PM
To:  Rob Vesse <rv...@do...>
Cc:  dotNetRDF User Help and Support
<dot...@li...>
Subject:  SPAM-HIGH:  Re: [dotNetRDF-Support] reading owl into a virtuoso
triple store

> Thanks Rob,
>  
> Now I have these lines:
>  
> VirtuosoManager virtuoso = new
> VisrtuosoManager("jdbc:virtuoso://localhost:1111", "dba", "dba");
> VDS.RDF.Parsing.Handlers.WriteToStoreHandler _handler = new
> VDS.RDF.Parsing.Handlers.WriteToStoreHandler(virtuoso, myGraphUri, 100000);
> FileLoader.Load(_handler, myRdfFile);
>  
> This works find again with a smal file (~5MB); however, on my other larger
> files (one ~100MB and the other one ~900MB), I get this error after a few
> seconds:
>  
>  
> An existing connection was forcibly closed by the remote host
>  
>  
> and when I look at virtuoso's log file, I have:
> ... Malformed data received from IP [127.0.0.1] : Box length too large.
> Disconnecting the client
>  
>  
>  
> I have 8 GB of RAM and set the number of buffers accordingly in the
> virtuoso.ini file.
>  
> Any ideas? Is this a virtuoso's problem or the dotNetRDF problem or am I
> missing anything?
>  
> thanks,
>  
>  
> Bahador(reza)? OFOGHI, PhD
> Major: Information Technology
> 
>   
>  
>  
>  
>    From: Rob Vesse <rv...@do...>
>  To: Bahador(reza)? OFOGHI <br_...@ya...>
> Cc: dotNetRDF User Help and Support <dot...@li...>
>  Sent: Friday, 2 August 2013 3:12 AM
>  Subject: Re: [dotNetRDF-Support] reading owl into a virtuoso triple store
>   
>  
> 
> Yes, use the Handlers API [1], specifically you want to use the
> WriteToStoreHandler [2].  You may need to play with the batch size to get good
> performance since the default is pretty low (1000), you may want to use
> something more in the 10-50,000 range
> 
> Also bear in mind that if your data has a lot of blank nodes you'll still need
> a lot of memory because blank node containing triples have to be stored up and
> written in one single batch at the end to ensure blank nodes are correctly
> stored.
> 
> Rob
> 
> [1] https://bitbucket.org/dotnetrdf/dotnetrdf/wiki/UserGuide/Handlers%20API
> [2] 
> http://www.dotnetrdf.org/api/index.asp?Topic=VDS.RDF.Parsing.Handlers.WriteToS
> toreHandler
> 
> 
> From:  "Bahador(reza)? OFOGHI" <br_...@ya...>
> Reply-To:  "Bahador(reza)? OFOGHI" <br_...@ya...>
> Date:  Wednesday, July 31, 2013 4:35 PM
> To:  Rob Vesse <rv...@do...>, dotNetRDF User Help and Support
> <dot...@li...>
> Subject:  SPAM-HIGH:  Re: [dotNetRDF-Support] reading owl into a virtuoso
> triple store
> 
>> Thanks, I have now installed an instance of Vicrtuoso and I am able to put
>> small OWL files into a triplestore. However, the main owl file I am working
>> on is of the size +750MB and I am getting out of memory exceptions to load
>> the file into the graph before trying to save it on this line
>> FileLoader.Load(g, "myFile.owl");
>>  
>> Is there any way to bypass loading this huge file into memory before pushing
>> it into a triplestore?
>>  
>> thank you again.
>>  
>> 
>>   
>>  
>>  
>>  
>>    From: Rob Vesse <rv...@do...>
>>  To: Bahador(reza)? OFOGHI <br_...@ya...>; dotNetRDF User Help and
>> Support <dot...@li...>
>>  Sent: Thursday, 1 August 2013 5:55 AM
>>  Subject: Re: [dotNetRDF-Support] reading owl into a virtuoso triple store
>>   
>>  
>> 
>> The request for a path to VirtuosoManager.cs is the debugger trying to break
>> into the source code but being unable to locate it on your machine and can be
>> safely ignored.
>> 
>> The error that you are getting indicates that Virtuoso is not running, you
>> need to actually have an instance of Virtuoso installed and running on your
>> machine.
>> 
>> Virtuoso is a 3rd party product so you should follow their instructions to
>> download, install, configure and run Virtuoso appropriately
>> 
>> Rob
>> 
>> From:  "Bahador(reza)? OFOGHI" <br_...@ya...>
>> Reply-To:  "Bahador(reza)? OFOGHI" <br_...@ya...>, dotNetRDF User Help
>> and Support <dot...@li...>
>> Date:  Tuesday, July 30, 2013 6:56 PM
>> To:  "dot...@li..."
>> <dot...@li...>
>> Subject:  [dotNetRDF-Support] reading owl into a virtuoso triple store
>> 
>>> Hi,
>>>  
>>> I have just started working with virtuoso. I am simply trying to read an OWL
>>> file into a virtuoso triple store using the following few lines of code:
>>>  
>>> Graph g = new Graph();
>>> FileLoader.Load(g, "myFile.owl");
>>> virtuoso.SaveGraph(g);
>>> First time I ran the code I was asked for a path to VirtuosoManager.cs file
>>> which I just cancelled! But then, I get the error "No connection could be
>>> made because the target machine actively refused it 127.0.0.1:1111"
>>> everytime I run the code. I wonder what I need to do to get this to run
>>> correctly and put the OWL file into a virtuoso triple store?
>>>  
>>> thanks,
>>> bo
>>> ----------------------------------------------------------------------------
>>> -- Get your SQL database under version control now! Version control is
>>> standard for application code, but databases havent caught up. So what steps
>>> can you take to put your SQL databases under version control? Why should you
>>> start doing it? Read more to find out.
>>> http://pubads.g.doubleclick.net/gampad/clk?id=49501711&iu=/4140/ostg.clktrk_
>>> ______________________________________________ dotNetRDF-Support mailing
>>> list 
>>> dot...@li...https://lists.sourceforge.net/lists/l
>>> istinfo/dotnetrdf-support
>> 
>> 
>>  
>>  
>>   
> 
> 
>  
>  
>