Webinar "Using parallel I/O in SHARCNET" - 12:00pm
Date | Wednesday January 15 2014 |
---|---|
Time | 12:00 - 13:00 |
Location | Online |
Contact | syam@sharcnet.ca |
URL | http://vidyo.computecanada.ca/flex.html?roomdirect.html&key=Pr1GiEI51kFi |
You are NOT registered for this event. Register. | |
Topic: “Using parallel I/O in SHARCNET” Speaker: Alex Razoumov, SHARCNET With big datasets, disk I/O on large parallel systems can pose a significant bottleneck compared to the rest of your code’s workflow. Parallel filesystems have been optimized to support large efficient I/O simultaneously by multiple users on multiple nodes, however, contrary to popular thinking, they do not provide “supercomputing” disk performance. In this introductory webinar I will talk about the basics of parallel filesystems, techniques to optimize your storage, as well as various methods to organize parallel disk I/O. Due to the lack of time, I will not go into the details of all possible methods, but will give several examples of parallel I/O using MPI-IO (part of MPI2), and then will briefly talk about the strengths and limitations of most popular higher-level parallel I/O libraries (HDF5, NetCDF, and ADIOS). Need help attending a webinar? See the SHARCNET Help Wiki. |