Re: [Miase-discuss] MIASE paper - reproducibility

[Jonathan C. <jon...@co...>]

On 12/05/09 07:37, Dagmar Köhn wrote:
> Hi James,
>
> that is why we put "within a 'reasonable' level of tolerance" in the 
> paper - meaning the reproduction of a stochastic result would be called 
> successful even if the actual result numbers do not map 1:1, but the 
> result does comply with the original experiment within a tolerance of 
> whatever-limit...
> So, I suppose with "different" Stefan does not mean "not identical" but 
> rather "not within a certain deviation for the case of stochastic 
> simulation".
>
> Dagmar
>
> (still the question is how precise to be when defining the accepted 
> deviation)
>   
Presumably this would vary on a case-by-case basis, and we should
require authors to specify the tolerance they expect for their results?

Jonathan


> James Lawson wrote:
>   
>> Hi Stefan et al.
>>
>> If I may just make a short point here, I have to disagree with Stefan.
>>
>> It seems that stochastic simulations would be within the scope that 
>> we'd like MIASE to cover (and I think I recall this being discussed in 
>> Auckland.) If we were describing a stochastic simulation, a particular 
>> simulation experiment described in a MIASE compliant format would need 
>> to be allowed to have different results between iterations of the 
>> simulation.
>>
>> This is just one example, but I am sure there are others that would be 
>> relevant to us.
>>
>> Kind regards,
>> James
>>     
>>> I agree with Nicolas that we should ask for reproducibility. Repeating
>>> a simulation is insufficient. If a simulation experiment which is
>>> described in a MIASE compliant format is allowed to have different
>>> results we have not specified anything at least in my opinion. If the
>>> result is not reproducible something is wrong with the initial
>>> experiment, the second experiment or the MIASE compliant description.
>>> Either of the 3 cases can be resolved through further investigation,
>>> which is the normal scientific process.
>>>
>>> Thanks,
>>> Stefan
>>>  
>>>   
>>>       
>> ------------------------------------------------------------------------------
>> The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your
>> production scanning environment may not be a perfect world - but thanks to
>> Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700
>> Series Scanner you'll get full speed at 300 dpi even with all image 
>> processing features enabled. http://p.sf.net/sfu/kodak-com
>> ------------------------------------------------------------------------
>>
>> _______________________________________________
>> Miase-discuss mailing list
>> Mia...@li...
>> https://lists.sourceforge.net/lists/listinfo/miase-discuss
>>   
>>     
>
>
> ------------------------------------------------------------------------------
> The NEW KODAK i700 Series Scanners deliver under ANY circumstances! Your
> production scanning environment may not be a perfect world - but thanks to
> Kodak, there's a perfect scanner to get the job done! With the NEW KODAK i700
> Series Scanner you'll get full speed at 300 dpi even with all image 
> processing features enabled. http://p.sf.net/sfu/kodak-com
> _______________________________________________
> Miase-discuss mailing list
> Mia...@li...
> https://lists.sourceforge.net/lists/listinfo/miase-discuss
>