dotnetrdf-develop

[dotNetRDF-Develop] TeamCity build

[Tomasz P. <tom...@gm...>]

Hi Rob, Kal

I have been able to force TeamCity to build dotNetRDF with relatively
minimal changes. Please refer to my fork [1]. I have switched from
MSTest to NUnit and done some minor changes to csproj files. There is
also a proposal to change the integration tests to come out
inconclusive instead of failed when test config is missing...

Most noteworthy is the latest commit in the 'WP7 Hack' branch.
Unfortunately I found out the hard way that Windows Phone SDK 7.1 is
not only unsuppported on Windows Server 2008 R2, it is completely
uninstallable! The only working solution I found was to stuff 14 MB of
WP7 SDK files and build targets and have the WindowsPhone project use
them instead of the defaults. This way the whole solution builds fine
from sln file using msbuild.

You can have a look at the project here: http://ci.t-code.pl (guest
login enabled)

Regarding your eariler emails, I think that version numbering should
be moved from solution to TeamCity completely. This way we can
flexibly control that number and pass it between build
steps/configurations.

Next step will be to build and publish nuget packages. Satisfying
dependencies between packages will have to be done in some kind of
nuspec patching step to modify the <dependency> tags. Hence why we
need to control the version withing the CI server.

I will write more when the TC configuration is more complete

Tom

[1]: https://bitbucket.org/tpluscode/dotnetrdf-teamcity

Re: [dotNetRDF-Develop] TeamCity build

[Rob V. <rv...@do...>]

Tom

You can install WP7 tools on Windows Server 2008 because I used to build
releases on my Server 2008 machine when I was at the University of
Southampton

See http://blogs.msdn.com/b/astebner/archive/2010/05/02/10005980.aspx
which details the steps necessary, basically you have to extract the
installer and modify a config file

Rob

On 4/16/13 1:30 PM, "Tomasz Pluskiewicz" <tom...@gm...>
wrote:

>Hi Rob, Kal
>
>I have been able to force TeamCity to build dotNetRDF with relatively
>minimal changes. Please refer to my fork [1]. I have switched from
>MSTest to NUnit and done some minor changes to csproj files. There is
>also a proposal to change the integration tests to come out
>inconclusive instead of failed when test config is missing...
>
>Most noteworthy is the latest commit in the 'WP7 Hack' branch.
>Unfortunately I found out the hard way that Windows Phone SDK 7.1 is
>not only unsuppported on Windows Server 2008 R2, it is completely
>uninstallable! The only working solution I found was to stuff 14 MB of
>WP7 SDK files and build targets and have the WindowsPhone project use
>them instead of the defaults. This way the whole solution builds fine
>from sln file using msbuild.
>
>You can have a look at the project here: http://ci.t-code.pl (guest
>login enabled)
>
>Regarding your eariler emails, I think that version numbering should
>be moved from solution to TeamCity completely. This way we can
>flexibly control that number and pass it between build
>steps/configurations.
>
>Next step will be to build and publish nuget packages. Satisfying
>dependencies between packages will have to be done in some kind of
>nuspec patching step to modify the <dependency> tags. Hence why we
>need to control the version withing the CI server.
>
>I will write more when the TC configuration is more complete
>
>Tom
>
>[1]: https://bitbucket.org/tpluscode/dotnetrdf-teamcity
>
>--------------------------------------------------------------------------
>----
>Precog is a next-generation analytics platform capable of advanced
>analytics on semi-structured data. The platform includes APIs for building
>apps and a phenomenal toolset for data science. Developers can use
>our toolset for easy data analysis & visualization. Get a free account!
>http://www2.precog.com/precogplatform/slashdotnewsletter
>_______________________________________________
>dotNetRDF-develop mailing list
>dot...@li...
>https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop

Re: [dotNetRDF-Develop] TeamCity build

[Tomasz P. <tom...@gm...>]

Rob

I did try that. Still, it fails on installing Windows Phone Emulator
x64. The error is something with VMM service, which I don't have and
couldn't find a way to install.

However on second thought if I was able to put the WP7 files in repo I
should be able to copy them where they belong without installing and I
hope it will work too.

Tom

On Wed, Apr 17, 2013 at 12:24 AM, Rob Vesse <rv...@do...> wrote:
> Tom
>
> You can install WP7 tools on Windows Server 2008 because I used to build
> releases on my Server 2008 machine when I was at the University of
> Southampton
>
> See http://blogs.msdn.com/b/astebner/archive/2010/05/02/10005980.aspx
> which details the steps necessary, basically you have to extract the
> installer and modify a config file
>
> Rob
>
> On 4/16/13 1:30 PM, "Tomasz Pluskiewicz" <tom...@gm...>
> wrote:
>
>>Hi Rob, Kal
>>
>>I have been able to force TeamCity to build dotNetRDF with relatively
>>minimal changes. Please refer to my fork [1]. I have switched from
>>MSTest to NUnit and done some minor changes to csproj files. There is
>>also a proposal to change the integration tests to come out
>>inconclusive instead of failed when test config is missing...
>>
>>Most noteworthy is the latest commit in the 'WP7 Hack' branch.
>>Unfortunately I found out the hard way that Windows Phone SDK 7.1 is
>>not only unsuppported on Windows Server 2008 R2, it is completely
>>uninstallable! The only working solution I found was to stuff 14 MB of
>>WP7 SDK files and build targets and have the WindowsPhone project use
>>them instead of the defaults. This way the whole solution builds fine
>>from sln file using msbuild.
>>
>>You can have a look at the project here: http://ci.t-code.pl (guest
>>login enabled)
>>
>>Regarding your eariler emails, I think that version numbering should
>>be moved from solution to TeamCity completely. This way we can
>>flexibly control that number and pass it between build
>>steps/configurations.
>>
>>Next step will be to build and publish nuget packages. Satisfying
>>dependencies between packages will have to be done in some kind of
>>nuspec patching step to modify the <dependency> tags. Hence why we
>>need to control the version withing the CI server.
>>
>>I will write more when the TC configuration is more complete
>>
>>Tom
>>
>>[1]: https://bitbucket.org/tpluscode/dotnetrdf-teamcity
>>
>>--------------------------------------------------------------------------
>>----
>>Precog is a next-generation analytics platform capable of advanced
>>analytics on semi-structured data. The platform includes APIs for building
>>apps and a phenomenal toolset for data science. Developers can use
>>our toolset for easy data analysis & visualization. Get a free account!
>>http://www2.precog.com/precogplatform/slashdotnewsletter
>>_______________________________________________
>>dotNetRDF-develop mailing list
>>dot...@li...
>>https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>
>
>
>
>
> ------------------------------------------------------------------------------
> Precog is a next-generation analytics platform capable of advanced
> analytics on semi-structured data. The platform includes APIs for building
> apps and a phenomenal toolset for data science. Developers can use
> our toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> _______________________________________________
> dotNetRDF-develop mailing list
> dot...@li...
> https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop

Re: [dotNetRDF-Develop] TeamCity build

[Khalil A. <ka...@ne...>]

Its probably Hyper-V that is causing the failure. If you are installing on
to a machine that doesn't meet the requirements for Hyper-V then the
emulator won't install. I think you are probably stuck with having to put
the files somewhere - either in the repo or in some location external to
the repo that is then configured in the build process.

K


On Wed, Apr 17, 2013 at 7:27 AM, Tomasz Pluskiewicz <
tom...@gm...> wrote:

> Rob
>
> I did try that. Still, it fails on installing Windows Phone Emulator
> x64. The error is something with VMM service, which I don't have and
> couldn't find a way to install.
>
> However on second thought if I was able to put the WP7 files in repo I
> should be able to copy them where they belong without installing and I
> hope it will work too.
>
> Tom
>
> On Wed, Apr 17, 2013 at 12:24 AM, Rob Vesse <rv...@do...> wrote:
> > Tom
> >
> > You can install WP7 tools on Windows Server 2008 because I used to build
> > releases on my Server 2008 machine when I was at the University of
> > Southampton
> >
> > See http://blogs.msdn.com/b/astebner/archive/2010/05/02/10005980.aspx
> > which details the steps necessary, basically you have to extract the
> > installer and modify a config file
> >
> > Rob
> >
> > On 4/16/13 1:30 PM, "Tomasz Pluskiewicz" <tom...@gm...>
> > wrote:
> >
> >>Hi Rob, Kal
> >>
> >>I have been able to force TeamCity to build dotNetRDF with relatively
> >>minimal changes. Please refer to my fork [1]. I have switched from
> >>MSTest to NUnit and done some minor changes to csproj files. There is
> >>also a proposal to change the integration tests to come out
> >>inconclusive instead of failed when test config is missing...
> >>
> >>Most noteworthy is the latest commit in the 'WP7 Hack' branch.
> >>Unfortunately I found out the hard way that Windows Phone SDK 7.1 is
> >>not only unsuppported on Windows Server 2008 R2, it is completely
> >>uninstallable! The only working solution I found was to stuff 14 MB of
> >>WP7 SDK files and build targets and have the WindowsPhone project use
> >>them instead of the defaults. This way the whole solution builds fine
> >>from sln file using msbuild.
> >>
> >>You can have a look at the project here: http://ci.t-code.pl (guest
> >>login enabled)
> >>
> >>Regarding your eariler emails, I think that version numbering should
> >>be moved from solution to TeamCity completely. This way we can
> >>flexibly control that number and pass it between build
> >>steps/configurations.
> >>
> >>Next step will be to build and publish nuget packages. Satisfying
> >>dependencies between packages will have to be done in some kind of
> >>nuspec patching step to modify the <dependency> tags. Hence why we
> >>need to control the version withing the CI server.
> >>
> >>I will write more when the TC configuration is more complete
> >>
> >>Tom
> >>
> >>[1]: https://bitbucket.org/tpluscode/dotnetrdf-teamcity
> >>
>
> >>--------------------------------------------------------------------------
> >>----
> >>Precog is a next-generation analytics platform capable of advanced
> >>analytics on semi-structured data. The platform includes APIs for
> building
> >>apps and a phenomenal toolset for data science. Developers can use
> >>our toolset for easy data analysis & visualization. Get a free account!
> >>http://www2.precog.com/precogplatform/slashdotnewsletter
> >>_______________________________________________
> >>dotNetRDF-develop mailing list
> >>dot...@li...
> >>https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
> >
> >
> >
> >
> >
> >
> ------------------------------------------------------------------------------
> > Precog is a next-generation analytics platform capable of advanced
> > analytics on semi-structured data. The platform includes APIs for
> building
> > apps and a phenomenal toolset for data science. Developers can use
> > our toolset for easy data analysis & visualization. Get a free account!
> > http://www2.precog.com/precogplatform/slashdotnewsletter
> > _______________________________________________
> > dotNetRDF-develop mailing list
> > dot...@li...
> > https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>
>
> ------------------------------------------------------------------------------
> Precog is a next-generation analytics platform capable of advanced
> analytics on semi-structured data. The platform includes APIs for building
> apps and a phenomenal toolset for data science. Developers can use
> our toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> _______________________________________________
> dotNetRDF-develop mailing list
> dot...@li...
> https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>



-- 
Kal Ahmed
Director, Networked Planet Limited
e: kal...@ne...
w: www.networkedplanet.com

Re: [dotNetRDF-Develop] TeamCity build

[Tomasz P. <tom...@gm...>]

Hi again

I have been struggling to put those file somewhere on the system and
fool msbuild to use them but it didn't seem to work.

I settled for a compromise, which is keeping the files in a separate
repo [1], which is fetched on top of the main files and the Phone
csproj is patched as needed. Now all builds fine and we won't need to
pollute the solution.

Tom

[1]: https://bitbucket.org/dotnetrdf/wp7hack

On Wed, Apr 17, 2013 at 10:36 AM, Khalil Ahmed <ka...@ne...> wrote:
> Its probably Hyper-V that is causing the failure. If you are installing on
> to a machine that doesn't meet the requirements for Hyper-V then the
> emulator won't install. I think you are probably stuck with having to put
> the files somewhere - either in the repo or in some location external to the
> repo that is then configured in the build process.
>
> K
>
>
> On Wed, Apr 17, 2013 at 7:27 AM, Tomasz Pluskiewicz
> <tom...@gm...> wrote:
>>
>> Rob
>>
>> I did try that. Still, it fails on installing Windows Phone Emulator
>> x64. The error is something with VMM service, which I don't have and
>> couldn't find a way to install.
>>
>> However on second thought if I was able to put the WP7 files in repo I
>> should be able to copy them where they belong without installing and I
>> hope it will work too.
>>
>> Tom
>>
>> On Wed, Apr 17, 2013 at 12:24 AM, Rob Vesse <rv...@do...> wrote:
>> > Tom
>> >
>> > You can install WP7 tools on Windows Server 2008 because I used to build
>> > releases on my Server 2008 machine when I was at the University of
>> > Southampton
>> >
>> > See http://blogs.msdn.com/b/astebner/archive/2010/05/02/10005980.aspx
>> > which details the steps necessary, basically you have to extract the
>> > installer and modify a config file
>> >
>> > Rob
>> >
>> > On 4/16/13 1:30 PM, "Tomasz Pluskiewicz" <tom...@gm...>
>> > wrote:
>> >
>> >>Hi Rob, Kal
>> >>
>> >>I have been able to force TeamCity to build dotNetRDF with relatively
>> >>minimal changes. Please refer to my fork [1]. I have switched from
>> >>MSTest to NUnit and done some minor changes to csproj files. There is
>> >>also a proposal to change the integration tests to come out
>> >>inconclusive instead of failed when test config is missing...
>> >>
>> >>Most noteworthy is the latest commit in the 'WP7 Hack' branch.
>> >>Unfortunately I found out the hard way that Windows Phone SDK 7.1 is
>> >>not only unsuppported on Windows Server 2008 R2, it is completely
>> >>uninstallable! The only working solution I found was to stuff 14 MB of
>> >>WP7 SDK files and build targets and have the WindowsPhone project use
>> >>them instead of the defaults. This way the whole solution builds fine
>> >>from sln file using msbuild.
>> >>
>> >>You can have a look at the project here: http://ci.t-code.pl (guest
>> >>login enabled)
>> >>
>> >>Regarding your eariler emails, I think that version numbering should
>> >>be moved from solution to TeamCity completely. This way we can
>> >>flexibly control that number and pass it between build
>> >>steps/configurations.
>> >>
>> >>Next step will be to build and publish nuget packages. Satisfying
>> >>dependencies between packages will have to be done in some kind of
>> >>nuspec patching step to modify the <dependency> tags. Hence why we
>> >>need to control the version withing the CI server.
>> >>
>> >>I will write more when the TC configuration is more complete
>> >>
>> >>Tom
>> >>
>> >>[1]: https://bitbucket.org/tpluscode/dotnetrdf-teamcity
>> >>
>>
>> >> >>--------------------------------------------------------------------------
>> >>----
>> >>Precog is a next-generation analytics platform capable of advanced
>> >>analytics on semi-structured data. The platform includes APIs for
>> >> building
>> >>apps and a phenomenal toolset for data science. Developers can use
>> >>our toolset for easy data analysis & visualization. Get a free account!
>> >>http://www2.precog.com/precogplatform/slashdotnewsletter
>> >>_______________________________________________
>> >>dotNetRDF-develop mailing list
>> >>dot...@li...
>> >>https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>> >
>> >
>> >
>> >
>> >
>> >
>> > ------------------------------------------------------------------------------
>> > Precog is a next-generation analytics platform capable of advanced
>> > analytics on semi-structured data. The platform includes APIs for
>> > building
>> > apps and a phenomenal toolset for data science. Developers can use
>> > our toolset for easy data analysis & visualization. Get a free account!
>> > http://www2.precog.com/precogplatform/slashdotnewsletter
>> > _______________________________________________
>> > dotNetRDF-develop mailing list
>> > dot...@li...
>> > https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>>
>>
>> ------------------------------------------------------------------------------
>> Precog is a next-generation analytics platform capable of advanced
>> analytics on semi-structured data. The platform includes APIs for building
>> apps and a phenomenal toolset for data science. Developers can use
>> our toolset for easy data analysis & visualization. Get a free account!
>> http://www2.precog.com/precogplatform/slashdotnewsletter
>> _______________________________________________
>> dotNetRDF-develop mailing list
>> dot...@li...
>> https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>
>
>
>
> --
> Kal Ahmed
> Director, Networked Planet Limited
> e: kal...@ne...
> w: www.networkedplanet.com
>
> ------------------------------------------------------------------------------
> Precog is a next-generation analytics platform capable of advanced
> analytics on semi-structured data. The platform includes APIs for building
> apps and a phenomenal toolset for data science. Developers can use
> our toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> _______________________________________________
> dotNetRDF-develop mailing list
> dot...@li...
> https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>

Re: [dotNetRDF-Develop] TeamCity build

[Tomasz P. <tom...@gm...>]

Hi guys

Here's an update on my work setting up TeamCity. I've got all the
changes done do that the project builds and tests are run [1], and I'm
creating NuGet packages as discussed earlier [2, 3]. Mercurial
automatically triggers builds. When a build is successful and all
tests pass, NuGet packages are created. The packages are named as
discussed earlier and. What remains is to add automatic publishing for
prerelease builds and manual for stable builds. I also think that the
tags should be created in the repository only when a package is
released publicly on NuGet. Otherwise I don't think it should be done.

Rob, please tell me what important steps I might have missed in
TeamCity that you would have done with the dotnetrdf.build script.

Also there is a number of further issues:
1. MSBuild can't build vdproj setup packages. I may have to install
Visual Studio after all.
2. None of the tests, which require the UnitTestConfig.propertie file
are currently run.
3. I have noticed that some tests aren't independent from outside
world, like the recently failed
SparqlDatasetDefaultGraphManagementWithUpdate tests, which failed
because dotnetrdf.org returned HTTP code 503. I think we should work
on making these tests as self-sustaining as possible
4. Other thatn that some tests still fail, and these should be
corrected before TeamCity will produce any NuGet package at all
5. I would like to merge my changes to default branch. Please review
the changes in my fork [4].

Thanks,
Tom

[1]: http://ci.t-code.pl/viewType.html?buildTypeId=bt2
[2]: http://ci.t-code.pl/viewType.html?buildTypeId=bt4
[3]: http://ci.t-code.pl/viewType.html?buildTypeId=bt5
[4]: https://bitbucket.org/tpluscode/dotnetrdf-teamcity

On Thu, Apr 18, 2013 at 10:45 PM, Tomasz Pluskiewicz
<tom...@gm...> wrote:
> Hi again
>
> I have been struggling to put those file somewhere on the system and
> fool msbuild to use them but it didn't seem to work.
>
> I settled for a compromise, which is keeping the files in a separate
> repo [1], which is fetched on top of the main files and the Phone
> csproj is patched as needed. Now all builds fine and we won't need to
> pollute the solution.
>
> Tom
>
> [1]: https://bitbucket.org/dotnetrdf/wp7hack
>
> On Wed, Apr 17, 2013 at 10:36 AM, Khalil Ahmed <ka...@ne...> wrote:
>> Its probably Hyper-V that is causing the failure. If you are installing on
>> to a machine that doesn't meet the requirements for Hyper-V then the
>> emulator won't install. I think you are probably stuck with having to put
>> the files somewhere - either in the repo or in some location external to the
>> repo that is then configured in the build process.
>>
>> K
>>
>>
>> On Wed, Apr 17, 2013 at 7:27 AM, Tomasz Pluskiewicz
>> <tom...@gm...> wrote:
>>>
>>> Rob
>>>
>>> I did try that. Still, it fails on installing Windows Phone Emulator
>>> x64. The error is something with VMM service, which I don't have and
>>> couldn't find a way to install.
>>>
>>> However on second thought if I was able to put the WP7 files in repo I
>>> should be able to copy them where they belong without installing and I
>>> hope it will work too.
>>>
>>> Tom
>>>
>>> On Wed, Apr 17, 2013 at 12:24 AM, Rob Vesse <rv...@do...> wrote:
>>> > Tom
>>> >
>>> > You can install WP7 tools on Windows Server 2008 because I used to build
>>> > releases on my Server 2008 machine when I was at the University of
>>> > Southampton
>>> >
>>> > See http://blogs.msdn.com/b/astebner/archive/2010/05/02/10005980.aspx
>>> > which details the steps necessary, basically you have to extract the
>>> > installer and modify a config file
>>> >
>>> > Rob
>>> >
>>> > On 4/16/13 1:30 PM, "Tomasz Pluskiewicz" <tom...@gm...>
>>> > wrote:
>>> >
>>> >>Hi Rob, Kal
>>> >>
>>> >>I have been able to force TeamCity to build dotNetRDF with relatively
>>> >>minimal changes. Please refer to my fork [1]. I have switched from
>>> >>MSTest to NUnit and done some minor changes to csproj files. There is
>>> >>also a proposal to change the integration tests to come out
>>> >>inconclusive instead of failed when test config is missing...
>>> >>
>>> >>Most noteworthy is the latest commit in the 'WP7 Hack' branch.
>>> >>Unfortunately I found out the hard way that Windows Phone SDK 7.1 is
>>> >>not only unsuppported on Windows Server 2008 R2, it is completely
>>> >>uninstallable! The only working solution I found was to stuff 14 MB of
>>> >>WP7 SDK files and build targets and have the WindowsPhone project use
>>> >>them instead of the defaults. This way the whole solution builds fine
>>> >>from sln file using msbuild.
>>> >>
>>> >>You can have a look at the project here: http://ci.t-code.pl (guest
>>> >>login enabled)
>>> >>
>>> >>Regarding your eariler emails, I think that version numbering should
>>> >>be moved from solution to TeamCity completely. This way we can
>>> >>flexibly control that number and pass it between build
>>> >>steps/configurations.
>>> >>
>>> >>Next step will be to build and publish nuget packages. Satisfying
>>> >>dependencies between packages will have to be done in some kind of
>>> >>nuspec patching step to modify the <dependency> tags. Hence why we
>>> >>need to control the version withing the CI server.
>>> >>
>>> >>I will write more when the TC configuration is more complete
>>> >>
>>> >>Tom
>>> >>
>>> >>[1]: https://bitbucket.org/tpluscode/dotnetrdf-teamcity
>>> >>
>>>
>>> >> >>--------------------------------------------------------------------------
>>> >>----
>>> >>Precog is a next-generation analytics platform capable of advanced
>>> >>analytics on semi-structured data. The platform includes APIs for
>>> >> building
>>> >>apps and a phenomenal toolset for data science. Developers can use
>>> >>our toolset for easy data analysis & visualization. Get a free account!
>>> >>http://www2.precog.com/precogplatform/slashdotnewsletter
>>> >>_______________________________________________
>>> >>dotNetRDF-develop mailing list
>>> >>dot...@li...
>>> >>https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>>> >
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > ------------------------------------------------------------------------------
>>> > Precog is a next-generation analytics platform capable of advanced
>>> > analytics on semi-structured data. The platform includes APIs for
>>> > building
>>> > apps and a phenomenal toolset for data science. Developers can use
>>> > our toolset for easy data analysis & visualization. Get a free account!
>>> > http://www2.precog.com/precogplatform/slashdotnewsletter
>>> > _______________________________________________
>>> > dotNetRDF-develop mailing list
>>> > dot...@li...
>>> > https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Precog is a next-generation analytics platform capable of advanced
>>> analytics on semi-structured data. The platform includes APIs for building
>>> apps and a phenomenal toolset for data science. Developers can use
>>> our toolset for easy data analysis & visualization. Get a free account!
>>> http://www2.precog.com/precogplatform/slashdotnewsletter
>>> _______________________________________________
>>> dotNetRDF-develop mailing list
>>> dot...@li...
>>> https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>>
>>
>>
>>
>> --
>> Kal Ahmed
>> Director, Networked Planet Limited
>> e: kal...@ne...
>> w: www.networkedplanet.com
>>
>> ------------------------------------------------------------------------------
>> Precog is a next-generation analytics platform capable of advanced
>> analytics on semi-structured data. The platform includes APIs for building
>> apps and a phenomenal toolset for data science. Developers can use
>> our toolset for easy data analysis & visualization. Get a free account!
>> http://www2.precog.com/precogplatform/slashdotnewsletter
>> _______________________________________________
>> dotNetRDF-develop mailing list
>> dot...@li...
>> https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>>

Re: [dotNetRDF-Develop] TeamCity build

[Rob V. <rv...@do...>]

Hey

I have looked over the TeamCity stuff in part but haven't had chance to
fully digest it yet.  I am thinking of making this one of my main goals
for 1.0.1.

As I said in my previous email I think I am now ready to push out 1.0.0 so
I will try and do that at the end of the week after running some final
regression testing.

Other comments are inline:

On 4/21/13 8:53 AM, "Tomasz Pluskiewicz" <tom...@gm...>
wrote:

>Hi guys
>
>Here's an update on my work setting up TeamCity. I've got all the
>changes done do that the project builds and tests are run [1], and I'm
>creating NuGet packages as discussed earlier [2, 3]. Mercurial
>automatically triggers builds. When a build is successful and all
>tests pass, NuGet packages are created. The packages are named as
>discussed earlier and. What remains is to add automatic publishing for
>prerelease builds and manual for stable builds.

What you have so far looks great :)

>I also think that the
>tags should be created in the repository only when a package is
>released publicly on NuGet. Otherwise I don't think it should be done.

Yes I agree, it makes sense only to add a tag when we actually push up a
package

>
>Rob, please tell me what important steps I might have missed in
>TeamCity that you would have done with the dotnetrdf.build script.

Depends if we want to build other artifacts such as the Toolkit in which
case we might want to run the NAnt targets that package those up into ZIP
files and FTP those up to the website.  Not sure how valuable that is to
users though, having regular nightly builds of the libraries easily
available should be the main priority.

>
>Also there is a number of further issues:
>1. MSBuild can't build vdproj setup packages. I may have to install
>Visual Studio after all.

Depends whether we want to build and publish everything through TeamCity
or use it primarily for CI of the libraries?

>2. None of the tests, which require the UnitTestConfig.propertie file
>are currently run.

We should probably discuss separately how much resources the CI machine
has and which triple stores we could reasonably run on there, a couple
which are easy to install and relatively resource lightweight are Fuseki
and Sesame.  Also if we can fire up IIS express so we can run the tests
that test our ASP.Net support that would be valuable.

>3. I have noticed that some tests aren't independent from outside
>world, like the recently failed
>SparqlDatasetDefaultGraphManagementWithUpdate tests, which failed
>because dotnetrdf.org returned HTTP code 503. I think we should work
>on making these tests as self-sustaining as possible

Yes we should continue to try and make tests as self-contained as
possible, I've been trying to do this more and more as I run tests and
find those that fail intermittently or depend on outside resources which
aren't currently using the UnitTestConfig.properties mechanism to control
their runs.

>4. Other thatn that some tests still fail, and these should be
>corrected before TeamCity will produce any NuGet package at all

Some of the test failures appear to relate to things around my recent
Turtle support improvements and have been fixed in default.  I think some
of the MIME types failing tests are down to a Culture issue -
https://bitbucket.org/dotnetrdf/dotnetrdf/src/c001ef5734fa6b4e9e6bc9c4b8da0
92c1fc9e29d/Libraries/core/net40/Core/MimeTypeDefinition.cs?at=default#cl-8
60 uses Double.TryParse() but doesn't specify invariant culture.

Otherwise there is only 1 I see there that I know fails intermittently
(the query timeout one) so not sure why the others fail in your TeamCity
environment and not in my own environment.

>5. I would like to merge my changes to default branch. Please review
>the changes in my fork [4].

I will start trying to do this next week, I will do this myself manually
if that is OK because it will be useful for me to refresh my NUnit
knowledge by converting over any remaining tests that need conversion.

Rob

>
>Thanks,
>Tom
>
>[1]: http://ci.t-code.pl/viewType.html?buildTypeId=bt2
>[2]: http://ci.t-code.pl/viewType.html?buildTypeId=bt4
>[3]: http://ci.t-code.pl/viewType.html?buildTypeId=bt5
>[4]: https://bitbucket.org/tpluscode/dotnetrdf-teamcity
>
>On Thu, Apr 18, 2013 at 10:45 PM, Tomasz Pluskiewicz
><tom...@gm...> wrote:
>> Hi again
>>
>> I have been struggling to put those file somewhere on the system and
>> fool msbuild to use them but it didn't seem to work.
>>
>> I settled for a compromise, which is keeping the files in a separate
>> repo [1], which is fetched on top of the main files and the Phone
>> csproj is patched as needed. Now all builds fine and we won't need to
>> pollute the solution.
>>
>> Tom
>>
>> [1]: https://bitbucket.org/dotnetrdf/wp7hack
>>
>> On Wed, Apr 17, 2013 at 10:36 AM, Khalil Ahmed
>><ka...@ne...> wrote:
>>> Its probably Hyper-V that is causing the failure. If you are
>>>installing on
>>> to a machine that doesn't meet the requirements for Hyper-V then the
>>> emulator won't install. I think you are probably stuck with having to
>>>put
>>> the files somewhere - either in the repo or in some location external
>>>to the
>>> repo that is then configured in the build process.
>>>
>>> K
>>>
>>>
>>> On Wed, Apr 17, 2013 at 7:27 AM, Tomasz Pluskiewicz
>>> <tom...@gm...> wrote:
>>>>
>>>> Rob
>>>>
>>>> I did try that. Still, it fails on installing Windows Phone Emulator
>>>> x64. The error is something with VMM service, which I don't have and
>>>> couldn't find a way to install.
>>>>
>>>> However on second thought if I was able to put the WP7 files in repo I
>>>> should be able to copy them where they belong without installing and I
>>>> hope it will work too.
>>>>
>>>> Tom
>>>>
>>>> On Wed, Apr 17, 2013 at 12:24 AM, Rob Vesse <rv...@do...>
>>>>wrote:
>>>> > Tom
>>>> >
>>>> > You can install WP7 tools on Windows Server 2008 because I used to
>>>>build
>>>> > releases on my Server 2008 machine when I was at the University of
>>>> > Southampton
>>>> >
>>>> > See 
>>>>http://blogs.msdn.com/b/astebner/archive/2010/05/02/10005980.aspx
>>>> > which details the steps necessary, basically you have to extract the
>>>> > installer and modify a config file
>>>> >
>>>> > Rob
>>>> >
>>>> > On 4/16/13 1:30 PM, "Tomasz Pluskiewicz"
>>>><tom...@gm...>
>>>> > wrote:
>>>> >
>>>> >>Hi Rob, Kal
>>>> >>
>>>> >>I have been able to force TeamCity to build dotNetRDF with
>>>>relatively
>>>> >>minimal changes. Please refer to my fork [1]. I have switched from
>>>> >>MSTest to NUnit and done some minor changes to csproj files. There
>>>>is
>>>> >>also a proposal to change the integration tests to come out
>>>> >>inconclusive instead of failed when test config is missing...
>>>> >>
>>>> >>Most noteworthy is the latest commit in the 'WP7 Hack' branch.
>>>> >>Unfortunately I found out the hard way that Windows Phone SDK 7.1 is
>>>> >>not only unsuppported on Windows Server 2008 R2, it is completely
>>>> >>uninstallable! The only working solution I found was to stuff 14 MB
>>>>of
>>>> >>WP7 SDK files and build targets and have the WindowsPhone project
>>>>use
>>>> >>them instead of the defaults. This way the whole solution builds
>>>>fine
>>>> >>from sln file using msbuild.
>>>> >>
>>>> >>You can have a look at the project here: http://ci.t-code.pl (guest
>>>> >>login enabled)
>>>> >>
>>>> >>Regarding your eariler emails, I think that version numbering should
>>>> >>be moved from solution to TeamCity completely. This way we can
>>>> >>flexibly control that number and pass it between build
>>>> >>steps/configurations.
>>>> >>
>>>> >>Next step will be to build and publish nuget packages. Satisfying
>>>> >>dependencies between packages will have to be done in some kind of
>>>> >>nuspec patching step to modify the <dependency> tags. Hence why we
>>>> >>need to control the version withing the CI server.
>>>> >>
>>>> >>I will write more when the TC configuration is more complete
>>>> >>
>>>> >>Tom
>>>> >>
>>>> >>[1]: https://bitbucket.org/tpluscode/dotnetrdf-teamcity
>>>> >>
>>>>
>>>> >> 
>>>>>>---------------------------------------------------------------------
>>>>>>-----
>>>> >>----
>>>> >>Precog is a next-generation analytics platform capable of advanced
>>>> >>analytics on semi-structured data. The platform includes APIs for
>>>> >> building
>>>> >>apps and a phenomenal toolset for data science. Developers can use
>>>> >>our toolset for easy data analysis & visualization. Get a free
>>>>account!
>>>> >>http://www2.precog.com/precogplatform/slashdotnewsletter
>>>> >>_______________________________________________
>>>> >>dotNetRDF-develop mailing list
>>>> >>dot...@li...
>>>> >>https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > 
>>>>-----------------------------------------------------------------------
>>>>-------
>>>> > Precog is a next-generation analytics platform capable of advanced
>>>> > analytics on semi-structured data. The platform includes APIs for
>>>> > building
>>>> > apps and a phenomenal toolset for data science. Developers can use
>>>> > our toolset for easy data analysis & visualization. Get a free
>>>>account!
>>>> > http://www2.precog.com/precogplatform/slashdotnewsletter
>>>> > _______________________________________________
>>>> > dotNetRDF-develop mailing list
>>>> > dot...@li...
>>>> > https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>>>>
>>>>
>>>> 
>>>>-----------------------------------------------------------------------
>>>>-------
>>>> Precog is a next-generation analytics platform capable of advanced
>>>> analytics on semi-structured data. The platform includes APIs for
>>>>building
>>>> apps and a phenomenal toolset for data science. Developers can use
>>>> our toolset for easy data analysis & visualization. Get a free
>>>>account!
>>>> http://www2.precog.com/precogplatform/slashdotnewsletter
>>>> _______________________________________________
>>>> dotNetRDF-develop mailing list
>>>> dot...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>>>
>>>
>>>
>>>
>>> --
>>> Kal Ahmed
>>> Director, Networked Planet Limited
>>> e: kal...@ne...
>>> w: www.networkedplanet.com
>>>
>>> 
>>>------------------------------------------------------------------------
>>>------
>>> Precog is a next-generation analytics platform capable of advanced
>>> analytics on semi-structured data. The platform includes APIs for
>>>building
>>> apps and a phenomenal toolset for data science. Developers can use
>>> our toolset for easy data analysis & visualization. Get a free account!
>>> http://www2.precog.com/precogplatform/slashdotnewsletter
>>> _______________________________________________
>>> dotNetRDF-develop mailing list
>>> dot...@li...
>>> https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop
>>>
>
>--------------------------------------------------------------------------
>----
>Precog is a next-generation analytics platform capable of advanced
>analytics on semi-structured data. The platform includes APIs for building
>apps and a phenomenal toolset for data science. Developers can use
>our toolset for easy data analysis & visualization. Get a free account!
>http://www2.precog.com/precogplatform/slashdotnewsletter
>_______________________________________________
>dotNetRDF-develop mailing list
>dot...@li...
>https://lists.sourceforge.net/lists/listinfo/dotnetrdf-develop