Re: [SMW-devel] The future of the SMW query stores

[Yury K. <kat...@gm...>]

I suppose that Mongo have been chosen because of its scalability, right?
-----
Yury Katkov, WikiVote



On Wed, Oct 16, 2013 at 5:20 AM, david mason
<vid...@zo...> wrote:
>
> May I suggest that ElasticSearch is considered instead of MongoDB.
>
> ElasticSearch is the index engine of the new MediaWiki Search, so end users
> won't need to set up and support multiple data stores. Like MongoDB it is a
> document store that natively uses JSON, and is really easy to set up and run
> (a .deb is available). It's super easy to work with and since it's based on
> Lucene incredibly powerful for many operations. I've used both Mongo and ES
> and definitely prefer the latter.
>
> They each have their strengths, MongoDB is more of a key value store, ES is
> more of a search server (though I'd assert it could do the KV stuff adding
> very useful search operations and no additional infrastructure if using MW
> search), in either case this seems like it would be a big win in terms of
> better structured, more accessible data!
>
> David
>
>
> On 15 October 2013 20:08, Jeroen De Dauw <jer...@gm...> wrote:
>>
>> Hey,
>>
>> The last release introduced SQLStore3, a partial rewrite of SQLStore2,
>> improving on the performance of its predecessor. That is not the end of the
>> story for the SMW query stores though.
>>
>> This email was prompted by work MWJames is doing in supporting MongoDB \o/
>> https://gerrit.wikimedia.org/r/#/c/88534/
>>
>> For a while now, there have been two items on our Roadmap about utilizing
>> new libraries I created for the Wikidata project, that are both based on,
>> and usable by, SMW components.
>>
>> *
>> https://semantic-mediawiki.org/wiki/Roadmap#Make_use_of_DataValues_library
>> * https://semantic-mediawiki.org/wiki/Roadmap#Make_use_of_Ask_library
>>
>> There now is a third such component, which might enable us to get a nice
>> improvement to our SQLStore without all to much effort. I described this
>> here:
>>
>> https://semantic-mediawiki.org/wiki/Wikibase_QueryEngine
>>
>> This is still quite far off, assuming no one else jumps on it, given that
>> it requires the earlier two items to be finished first. Feedback on the idea
>> is however welcome. And awareness of these preliminary plans, or rather
>> possibilities (I'm not committed to doing this at this point), is good for
>> those doing or planning to do something related to the SMW storage
>> infrastructure.
>>
>> Cheers
>>
>> --
>> Jeroen De Dauw
>> http://www.bn2vs.com
>> Don't panic. Don't be evil. ~=[,,_,,]:3
>> --
>>
>>
>> ------------------------------------------------------------------------------
>> October Webinars: Code for Performance
>> Free Intel webinars can help you accelerate application performance.
>> Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most
>> from
>> the latest Intel processors and coprocessors. See abstracts and register >
>>
>> http://pubads.g.doubleclick.net/gampad/clk?id=60135031&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Semediawiki-devel mailing list
>> Sem...@li...
>> https://lists.sourceforge.net/lists/listinfo/semediawiki-devel
>>
>
>
> ------------------------------------------------------------------------------
> October Webinars: Code for Performance
> Free Intel webinars can help you accelerate application performance.
> Explore tips for MPI, OpenMP, advanced profiling, and more. Get the most
> from
> the latest Intel processors and coprocessors. See abstracts and register >
> http://pubads.g.doubleclick.net/gampad/clk?id=60135031&iu=/4140/ostg.clktrk
> _______________________________________________
> Semediawiki-devel mailing list
> Sem...@li...
> https://lists.sourceforge.net/lists/listinfo/semediawiki-devel
>