Dear Bio-data Movers,
GridFTP with UDT, from the Globus project, speeds long distance
file transfer by 4 to 10 times over standard FTP. The commercial
Aspera UDP software that NCBI and EBI use may be better in
value, but is way out of my price range.
I've been testing GridFTP for use with Bio-mirror.net, to sites in
USA, and China Bio-mirror (hoping to add Australia, etc).
This looks like a good idea for biology data transfer. GridFTP is
well developed for a science informatics project.
Here are some docs on this GridFTP server for Bio-mirror data
http://gridftp.bio-mirror.net/biomirror/
This is early in testing stage. There are basic documents at this
web page, and I've more testing to do with it, but it seems to be
working well.
If you may be interested in testing this, especially those outside
North America, please contact me or follow directions above and
let me know how it works for you.
-- Don Gilbert
GridFTP TCP and UDT times for 113 GB transfer
from gridftp.bio-mirror.net/pub/biomirror/blast/ (Indiana USA)
Ping Time(min) TCP/ Distance
Site RTT TCP UDT UDT Km Network Route
--------------------------------------------------------------
ORNL 25 361 120 3 1200 In. - Chi. - Nashv., Tennesee - ORNL
5.3 16 MB/s
TACC 37 616 120 5 2000 In. - Chi. - Houston, Texas - TACC
3.1 16 MB/s
CSTNET 274 3722* 304 12 12000 In. - Internet2 - Korea - Beijing, China
0.5 6.3 MB/s; *est. from partial TCP w/ failures
--------------------------------------------------------------
Transfer times (minutes), and below speed in Megabytes/second,
for TCP and UDT, and the TCP/UDT ratio.
NCSA, Purdue, ORNL, TACC, SDSC are Teragrid.org sites in USA.
RTT is network distance as average round trip ping time in ms.
See also http://www.mcs.anl.gov/~kettimut/publications/PFLDNeT09.pdf
UDT as an Alternative Transport Protocol for GridFTP
John Bresnahan, Michael Link, Rajkumar Kettimuthu, and Ian Foster
Mathematics and Computer Science Division, Argonne National Laboratory
-- d.gilbert--bioinformatics--indiana-u--bloomington-in-47405
-- gilbertd from indiana.edu--http://marmot.bio.indiana.edu/
