Stepwise Masking: A Masking Strategy Based on Stepwise Regression for Pre-training

Pan, J; Ren, SX; Rao, DZ; Zhao, ZX; Xue, WS

Ren, SX (通讯作者),Tiangong Univ, Sch Software, Tianjin, Peoples R China.

NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2022, PT II, 2022; 13552 (): 131