Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 1 of 1
Full-Text Articles in Engineering
Distributed Deep Learning Optimization Of Heat Equation Inverse Problem Solvers, Zhuowei Wang, Le Yang, Haoran Lin, Genping Zhao, Zixuan Liu, Xiaoyu Song
Distributed Deep Learning Optimization Of Heat Equation Inverse Problem Solvers, Zhuowei Wang, Le Yang, Haoran Lin, Genping Zhao, Zixuan Liu, Xiaoyu Song
Electrical and Computer Engineering Faculty Publications and Presentations
The inversion problem of partial differential equation plays a crucial role in cyber-physical systems applications. This paper presents a novel deep learning optimization approach to constructing a solver of heat equation inversion. To improve the computational efficiency in large-scale industrial applications, data and model parallelisms are incorporated on a platform of multiple GPUs. The advanced Ring-AllReduce architecture is harnessed to achieve an acceleration ratio of 3.46. Then a new multi-GPUs distributed optimization method GradReduce is proposed based on Ring-AllReduce architecture. This method optimizes the original data communication mechanism based on mechanical time and frequency by introducing the gradient transmission scheme …