SIGN-IN

Webinar "Using parallel I/O in SHARCNET" - 12:00pm

Date Wednesday January 15 2014
Time 12:00 - 13:00
Location Online
Contact syam@sharcnet.ca
URL http://vidyo.computecanada.ca/flex.html?roomdirect.html&key=Pr1GiEI51kFi
You are NOT registered for this event. Register.

Topic: “Using parallel I/O in SHARCNET

Speaker: Alex Razoumov, SHARCNET


With big datasets, disk I/O on large parallel systems can pose a significant bottleneck compared to the rest of your code’s workflow. Parallel filesystems have been optimized to support large efficient I/O simultaneously by multiple users on multiple nodes, however, contrary to popular thinking, they do not provide “supercomputing” disk performance. In this introductory webinar I will talk about the basics of parallel filesystems, techniques to optimize your storage, as well as various methods to organize parallel disk I/O. Due to the lack of time, I will not go into the details of all possible methods, but will give several examples of parallel I/O using MPI-IO (part of MPI2), and then will briefly talk about the strengths and limitations of most popular higher-level parallel I/O libraries (HDF5, NetCDF, and ADIOS).


Need help attending a webinar? See the SHARCNET Help Wiki.