Open Access. Powered by Scholars. Published by Universities.®

Digital Commons Network

Open Access. Powered by Scholars. Published by Universities.®

Computer Sciences

PDF

Wayne State University Dissertations

Theses/Dissertations

2012

Hard Disks, High-Performance Computing, MPI/IO, Parallel File Systems

Articles 1 - 1 of 1

Full-Text Articles in Entire DC Network

Rethinking The Design And Implementation Of The I/O Software Stack For High-Performance Computing, Xuechen Zhang Jan 2012

Rethinking The Design And Implementation Of The I/O Software Stack For High-Performance Computing, Xuechen Zhang

Wayne State University Dissertations

Current I/O stack for high-performance computing is composed of multiple software layers in order to hide users from complexity of I/O performance optimization. However, the design and implementation of a specific layer is usually carried out separately with limited consideration of its impact on other layers, which could result in suboptimal I/O performance because data access locality is weakened, if not lost, on hard disk, a widely used storage medium in high-end storage systems.

In this dissertation, we experimentally demonstrated such issues in four different layers, including operating system process management layer and MPI-IO middleware layer on compute server side, …