Quantcast
Channel: StudioSysAdmins Message Board
Viewing all articles
Browse latest Browse all 3749

gridFTP

$
0
0
gridFTP
posted by Greg Whynott on Feb. 15, 2017, 11:10 p.m. (1 day ago)
Thought this was worth sharing, at a geek level.

Black line is from server to DMZ VM, red line is from DMZ VM to Korea.

The VM is on a large array and the server is a HPC node with a single 7200 RPM drive, working on a job at the same time. Likely the bottle neck here is the drive/system itself, but still, its amusing it took less time to transfer the file to the other side of earth.


side note, if you have to compress large files or sets, check out pigz if you are not aware of it. will use every core, even on single files. it splits the file into chunks equal to the core count and works on them in parallel. Its so fast..






take good care,

_g


Thread Tags:
  discuss-at-studiosysadmins 

0 Responses   0 Plus One's   0 Comments  
 
Thought this was worth sharing, at a geek level.

Black line is from server to DMZ VM, red line is from DMZ VM to Korea.

The VM is on a large array and the server is a HPC node with a single 7200 RPM drive, working on a job at the same time. Likely the bottle neck here is the drive/system itself, but still, its amusing it took less time to transfer the file to the other side of earth.


side note, if you have to compress large files or sets, check out pigz if you are not aware of it. will use every core, even on single files. it splits the file into chunks equal to the core count and works on them in parallel. Its so fast..






take good care,

_g



Viewing all articles
Browse latest Browse all 3749

Trending Articles