Blog(1)

• Pretrained Bidirectional Distillation for Machine Translation

  Initializing parameters by a pretrained masked language model (LM) [1] is a knowledge transfer method widely applied to natural language processing tasks. Following its success, pretrained neural machine translation (NMT) models have attracted more and more research interest [2,3,4,5].

Research Areas(0)

Publications(0)

News(0)

Others(0)