Physical Sciences and Mathematics Commons^™

A Study Of Client-Based Caching For Parallel I/O, Bradley Settlemyer

All Dissertations

The trend in parallel computing toward large-scale cluster computers running thousands of cooperating processes per application has led to an I/O bottleneck that has only gotten more severe as the the number of processing cores per CPU has increased. Current parallel file systems are able to provide high bandwidth file access for large contiguous file region accesses; however, applications repeatedly accessing small file regions on unaligned file region boundaries continue to experience poor I/O throughput due to the high overhead associated with accessing parallel file system data.
In this dissertation we demonstrate how client-side file data caching can improve parallel …