Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 1 of 1
Full-Text Articles in Engineering
Fim: Performance Prediction For Parallel Computation In Iterative Data Processing Applications, Janki Bhimani, Ningfang Mi, Miriam Leeser, Zhengyu Yang
Fim: Performance Prediction For Parallel Computation In Iterative Data Processing Applications, Janki Bhimani, Ningfang Mi, Miriam Leeser, Zhengyu Yang
Zhengyu Yang
Predicting performance of an application running on high performance computing (HPC) platforms in a cloud environment is increasingly becoming important because of its influence on development time and resource management. However, predicting the performance with respect to parallel processes is complex for iterative, multi-stage applications. This research proposes a performance approximation approach FiM to model the computing performance of iterative, multi-stage applications running on a master-compute framework. FiM consists of two key components that are coupled with each other: 1) Stochastic Markov Model to capture non-deterministic runtime that often depends on parallel resources, e.g., number of processes. 2) Machine Learning …