Abstract
The demand for parallel I/O performance continues to grow. However, modelling and generating parallel I/O work-loads are challenging for several reasons including the large number of processes, I/O request dependencies and workload scalability. In this paper, we propose the PIONEER, a complete solution to Parallel I/O workload characterization and gEnERation. The core of PIONEER is a proposed generic workload path, which is essentially an abstract and dense representation of the parallel I/O patterns for all processes in a High Performance Computing (HPC) application. The generic workload path can be built via exploring the inter-processes correlations, I/O dependencies as well as file open session properties. We demonstrate the effectiveness of PIONEER by faithfully generating synthetic workloads for two popular HPC benchmarks and one real HPC application.
| Original language | English (US) |
|---|---|
| Title of host publication | Proceedings - 2015 IEEE/ACM 15th International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015 |
| Publisher | Institute of Electrical and Electronics Engineers Inc. |
| Pages | 111-120 |
| Number of pages | 10 |
| ISBN (Electronic) | 9781479980062 |
| DOIs | |
| State | Published - Jul 7 2015 |
| Event | 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015 - Shenzhen, China Duration: May 4 2015 → May 7 2015 |
Publication series
| Name | Proceedings - 2015 IEEE/ACM 15th International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015 |
|---|
Other
| Other | 15th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, CCGrid 2015 |
|---|---|
| Country/Territory | China |
| City | Shenzhen |
| Period | 5/4/15 → 5/7/15 |
Bibliographical note
Publisher Copyright:© 2015 IEEE.
Keywords
- Parallel IO
- Workload characterization