POSTER: Layrub: Layer-centric GPU memory reuse and data migration in extreme-scale deep learning systems

Liu, B; Jiang, WB; Jin, H; Shi, XH; Ma, Y

Jiang, WB (reprint author), Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Serv Comp Technol & Syst Lab, Cluster & Grid Comp Lab, Wuhan 430074, Hubei, Peoples R China.

ACM SIGPLAN NOTICES, 2018; 53 (1): 405

Abstract

Growing accuracy and robustness of Deep Neural Networks (DNN) models are accompanied by growing model capacity (going deeper or wider). However, high ......

Full Text Link