SuperNeurons: Dynamic GPU Memory Management for Training Deep Neural Networks

Wang, LN; Ye, JM; Zhao, YY; Wu, W; Li, A; Song, SL; Xu, ZL; Kraska, T

Wang, LN (reprint author), Brown Univ, Providence, RI 02912 USA.

ACM SIGPLAN NOTICES, 2018; 53 (1): 41

Abstract

Going deeper and wider in neural architectures improves their accuracy, while the limited GPU DRAM places an undesired restriction on the network desi......

Full Text Link