Physical Sciences and Mathematics Commons^™

A Global Communication Optimization Technique Based On Data-Flow Analysis And Linear Algebra, Mahmut Kandemir, P. Banerjee, Alok Choudhary, J. Ramanujam

Electrical Engineering and Computer Science - All Scholarship

Reducing communication overhead is extremely important in distributed-memory message-passing architectures. In this paper, we present a technique to improve communication that considers data access patterns of the entire program. Our approach is based on a combination of traditional data-flow analysis and a linear algebra framework, and works on structured programs with conditional statements and nested loops but without arbitrary goto statements. The distinctive features of the solution are the accuracy in keeping communication set information, support for general alignments and distributions including block-cyclic distributions and the ability to simulate some of the previous approaches with suitable modifications. We also show …