[Rdfapi-php-interest] Fw: SPARQL test suite and implementation report

[Chris B. <ch...@bi...>]

Hi Christian,

the W3C DAWG is asking us for running their new SPARQL test suite against 
the RAP SPARQL engine in order produce an implementation report for 
advancing SPARQL to a W3C Propoposed Recommendation.

As you have implemented the new SPARQL engine for RAP 0.9.5 would it be 
possible that you run these tests against the engine and report the results 
to the DAWG and RAP mailing lists?

This would be a great help for showcasing the quality of the engine and for 
helping DAWG to finally get the SPARQL spec out.

Cheers

Chris

--
Chris Bizer
Freie Universität Berlin
+49 30 838 54057
ch...@bi...
www.bizer.de
----- Original Message ----- 
From: "Lee Feigenbaum" <le...@th...>
To: <ch...@bi...>
Sent: Sunday, July 29, 2007 12:48 AM
Subject: SPARQL test suite and implementation report


> Hi Chris,
>
> I'm sending you this note with reference to your work both on RAP and also 
> on D2R (I'll probably send one to Richard as well), though I'm not sure 
> how easily / possible it would be to run the SPARQL tests via D2R (and not 
> sure whether that tests anything beyond the ARQ engine that it's built on 
> top of?).
>
> The DAWG has been working over the past few months to create a
> relatively thorough and accurate set of test suites for the SPARQL query
> language specification. We're working to produce an implementation
> report for SPARQL as in order to satisfy one of the DAWG's
> criteria for advancing SPARQL to W3C Propoposed Recommendation.
>
> We're not yet finished adding tests, but we have a lot of tests approved
> and the structure and vocabularies used within the test suite and
> results have matured to a point of stability such that we're beginning
> to ask the owners of SPARQL implementations to take a look at the test
> suite.
>
> Here's the relevant information:
>
> A README describes the vocabularies used to describe and structure the
> DAWG tests in manifest files:
>   http://www.w3.org/2001/sw/DataAccess/tests/README.html
>
> An overview page provides a human-readable description of the approved
> tests:
>   http://www.w3.org/2001/sw/DataAccess/tests/r2
>
> We also have a document showing how to use the EARL vocabulary to report
> results of running tests against your implementation. (EARL is an RDF
> schema for reporting test results produced by the W3C Evaluation and
> Repair Tools working group.)
>   http://www.w3.org/2001/sw/DataAccess/tests/earl
>
> While we'd appreciate it if you could report results in this EARL
> format, we'd be glad to receive implementation reports in other formats
> as well.
>
> What we'd like from you: In order that we can manage expectations in
> generating our implementation report, it would be great if you could let
> me know whether you think you'll be able to contribute results, and, if
> so, how long you expect to need to produce the results. (We're aiming to
> complete the test suite by early August and hoping to produce an
> implementation report by the middle of September.) [We'll be sending out
> a further email once the test suite is finished, so that we can begin
> collecting complete results.]
>
> Please direct questions about the test suite to
> pub...@w3..., a mailing list with a public archive.
> Test results can be sent to that same list or else directly to me (but
> please indicate that the Working Group can use your results).
>
> thanks,
> Lee
> on behalf of the DAWG
>
> PS. We've collected lists of SPARQL implementations from word-of-mouth
> and from the ESW wiki: http://esw.w3.org/topic/SparqlImplementations If
> you know of any other implementations that we might not have on our
> list, we'd love to learn of them.
>
> PPS. Note that the old overview page[1] is still in place, but the tests
> listed there are not part of the approved DAWG test suite (though many
> have been copied over and approved).
>
> [1] http://www.w3.org/2001/sw/DataAccess/tests/
>
>
>
>