Re: [sdcc-devel] pic regression tests

[Borut R. <bor...@si...>]

Raphael,

thank you for the explanation.

I was just afraid that you are considering/using the src/regression as 
the "main" pic regtest suite.

I don't mind to keep it in SVN, as long as we know it's purpose.

And Maarten, I agree with you too.


Borut


Maarten Brock wrote:
> Raphael, Borut,
>
> I can fully agree with Raphael. If the src/regression 
> tests help to develop the pic ports that's fine. But we 
> must not consider them the regression test suite against 
> which a stable version is checked.
>
> Maarten
>
>   
>> Hi Borut,
>>
>>     
>>> In order to avoid confusion I propose to make the suite at 
>>> src/regression obsolete and remove it some when in the future.
>>>       
>> I use the simpler testsuite for reference just because it is simpler to 
>> have individual files compiled and run. I have not dug too deep into the 
>> official testsuite, but that one seems to be rather well-suited if 
>> assuming that all tests pass. As for the PIC16 target, I get nigh on 100 
>> failures, which does not help a lot and rather obfuscates the problems 
>> than pointing them out. More seriously, I guess changing the regression 
>> test while hunting bugs is not as straight forward as with the simpler 
>> suite. If I am not mistaken, the official suite generates the source 
>> files from a template according to some text replacement schemes 
>> embedded in the sources, which is great for generating huge amounts of 
>> test cases and checking a lot of type combinations, but in my eyes is 
>> the wrong approach to improving the PIC ports.
>>
>>     
>>> Please let me know your opinion.
>>>       
>> I would opt to keep the two regression test suites until the PIC ports 
>> are sufficiently complete/stable to make proper use of the official 
>> regression test suite.
>>
>> Alternatively, I could setup a local copy of the testsuite so that we 
>> can remove it from the svn repository in order not to confuse our user 
>> base. This, however, somehow goes against the spirit of sharing the 
>> code/results/tools used in development...
>>
>> Let's see how the PIC ports progress. Maybe we can plan removal of the 
>> suite for the 2.8.0 release?
>>
>> Regards,
>> Raphael
>>
>> -------------------------------------------------------------------------
>> This SF.net email is sponsored by DB2 Express
>> Download DB2 Express C - the FREE version of DB2 express and take
>> control of your XML. No limits. Just data. Click to get it now.
>> http://sourceforge.net/powerbar/db2/
>> _______________________________________________
>> sdcc-devel mailing list
>> sdc...@li...
>> https://lists.sourceforge.net/lists/listinfo/sdcc-devel
>>
>>     
>
>
>
> -------------------------------------------------------------------------
> This SF.net email is sponsored by DB2 Express
> Download DB2 Express C - the FREE version of DB2 express and take
> control of your XML. No limits. Just data. Click to get it now.
> http://sourceforge.net/powerbar/db2/
> _______________________________________________
> sdcc-devel mailing list
> sdc...@li...
> https://lists.sourceforge.net/lists/listinfo/sdcc-devel
>
>