Analyzing the impact of data movement on GPU computations

Daniel K. Price; John R. Humphrey; Kyle E. Spagnoli; Aaron L. Paolini

doi:10.1117/12.852632

Translator Disclaimer

30 April 2010 Analyzing the impact of data movement on GPU computations

Daniel K. Price; John R. Humphrey; Kyle E. Spagnoli; Aaron L. Paolini

Author Affiliations +

Proceedings Volume 7705, Modeling and Simulation for Defense Systems and Applications V; 77050D (2010) https://doi.org/10.1117/12.852632
Event: SPIE Defense, Security, and Sensing, 2010, Orlando, Florida, United States

Abstract

Recently, GPU computing has taken the scientific computing landscape by storm, fueled by the attractive nature of the massively parallel arithmetic hardware. When porting their code, researchers rely on a set of best practices that have been developed over the few years that general purpose GPU computing has been employed. This paper challenges a widely held belief that transfers to and from the GPU device must be minimized to achieve the best speedups over existing codes by presenting a case study on CULA, our library for dense linear algebra computation on GPU. Among the topics to be discussed include the relationship between computation and transfer time for both synchronous and asynchronous transfers, as well as the impact that data allocations have on memory performance and overall solution time.

Citation Download Citation

Daniel K. Price, John R. Humphrey, Kyle E. Spagnoli, and Aaron L. Paolini "Analyzing the impact of data movement on GPU computations", Proc. SPIE 7705, Modeling and Simulation for Defense Systems and Applications V, 77050D (30 April 2010); https://doi.org/10.1117/12.852632

ACCESS THE FULL ARTICLE