Re: [Dataspace-sabul] AMD64 Question.

[Steven M. C. <sc...@or...>]

On Tue, 24 Feb 2004, Yunhong Gu wrote:
> 
> Hi, Steven,
> 
> Thanks for the information, it is detailed enough for me to trace the 
> error.
> 
> For the "File size limit exceeded" error, it seems that the OS you are 
> using on unet1 does not support file size exceeding 2^31. UDT support 
> 64-bit file size and we have tested it to tranfser a 100GB file. (At 
> least the new version works fine with this, see below.)

That would be odd:

[scarter@unet1 scarter]$ ls -l
total 36885892
-rw-rw-r--  1 scarter scarter 10485760000 Feb 19 15:47 10g_foo
-rw-rw-r--  1 scarter scarter  5242880000 Feb 22 22:14 5g_datafile
-rw-rw-r--  1 scarter scarter  2147483647 Feb 24 18:03 5g_foo
-rw-rw-r--  1 scarter scarter 13239889920 Feb 19 15:42 datafile

5g_foo is the file that was aborted.  There is a 10g and 13g file in that 
same directory.  The OS had no problem with those.

Tsunami transfered a 10g file with no problems :)

> For the MTU error, it needs to be set at both side, and UDT will choose a 
> smaller value at the connection set up phase; so the appclient side also 
> needs to set UDT_MTU as 9000, otherwise 1500, the smaller value, will 
> still be used.

It now uses 9000 byte packets (I see 9014 on the wire as opposed to 1514),
but the transfer rate goes from ~830Mb/s to ~395Mb/s.

> For the file corruption error, it may be caused by a bug in UDT that we 
> already fixed. You can find a new version of UDT release (v1.2) at
> sourceforge.net/projects/dataspace.

I need to do a test from an IA32 machine to another IA32 machine to rule 
that out.

> The project of lambdaftp from which you download UDT is obsoleted, please 
> go to the dataspace project webpage to look for new release of UDT in 
> future.

My notes were wrong on that.  I am using version 1.2.

Thanks,

Steven.

-- 
sc...@or...
Oak Ridge National Laboratory