[Embl-databank] GridFTP/UDT is fast, free data transport at GridFTP.Bio-Mirror.net

Don Gilbert via embl-db%40net.bio.net (by gilbertd from net.bio.net)
Tue Aug 17 11:49:30 EST 2010

Dear Bio-data Movers,

GridFTP with UDT, from the Globus project, speeds long distance
file transfer by 4 to 10 times over standard FTP. The commercial
Aspera UDP software that NCBI and EBI use may be better in
value, but is way out of my price range.

I've been testing GridFTP for use with Bio-mirror.net, to sites in
USA, and China Bio-mirror (hoping to add Australia, etc).
This looks like a good idea for biology data transfer. GridFTP is
well developed for a science informatics project. 

Here are some docs on this GridFTP server for Bio-mirror data

This is early in testing stage. There are basic documents at this
web page, and I've more testing to do with it, but it seems to be
working well.   

If you may be interested in testing this, especially those outside
North America, please contact me or follow directions above and
let me know how it works for you.

-- Don Gilbert

   GridFTP TCP and UDT times for 113 GB transfer 
   from gridftp.bio-mirror.net/pub/biomirror/blast/ (Indiana USA)

       Ping  Time(min)  TCP/  Distance
Site    RTT  TCP   UDT  UDT    Km      Network Route
ORNL    25   361   120   3   1200  In. - Chi. - Nashv., Tennesee - ORNL
              5.3  16              MB/s
TACC    37   616   120   5   2000  In. - Chi. - Houston, Texas - TACC
              3.1  16              MB/s
CSTNET 274  3722*  304  12  12000  In. - Internet2 - Korea - Beijing, China
              0.5   6.3            MB/s; *est. from partial TCP w/ failures
  Transfer times (minutes), and below speed in Megabytes/second,
  for TCP and UDT, and the TCP/UDT ratio.
  NCSA, Purdue, ORNL, TACC, SDSC are Teragrid.org sites in USA.  
  RTT is network distance as average round trip ping time in ms.

See also http://www.mcs.anl.gov/~kettimut/publications/PFLDNeT09.pdf
   UDT as an Alternative Transport Protocol for GridFTP
   John Bresnahan, Michael Link, Rajkumar Kettimuthu, and Ian Foster 
   Mathematics and Computer Science Division, Argonne National Laboratory 

-- d.gilbert--bioinformatics--indiana-u--bloomington-in-47405
-- gilbertd from indiana.edu--http://marmot.bio.indiana.edu/

More information about the Embl-db mailing list

Send comments to us at biosci-help [At] net.bio.net