Open Access. Powered by Scholars. Published by Universities.®

Computer Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Electronic Theses and Dissertations

2010

Data-intensive computing

Articles 1 - 1 of 1

Full-Text Articles in Computer Engineering

Improving Performance And Programmer Productivity For I/O-Intensive High Performance Computing Applications, Saba Sehrish Jan 2010

Improving Performance And Programmer Productivity For I/O-Intensive High Performance Computing Applications, Saba Sehrish

Electronic Theses and Dissertations

Due to the explosive growth in the size of scientific data sets, data-intensive computing is an emerging trend in computational science. HPC applications are generating and processing large amount of data ranging from terabytes (TB) to petabytes (PB). This new trend of growth in data for HPC applications has imposed challenges as to what is an appropriate parallel programming framework to efficiently process large data sets. In this work, we study the applicability of two programming models (MPI/MPI-IO and MapReduce) to a variety of I/O-intensive HPC applications ranging from simulations to analytics. We identify several performance and programmer productivity related …