GLM: General Language Model Pretraining with Autoregressive Blank Infilling

Du, Zhengxiao; Qian, Yujie; Liu, Xiao; Ding, Ming; Qiu, Jiezhong; Yang, Zhilin; Tang, Jie

doi:10.18653/v1/2022.acl-long.26

Public

GLM: General Language Model Pretraining with Autoregressive Blank Infilling

Published in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) • Jan 1, 2022

Authors:

Zhengxiao Du

Yujie Qian

Xiao Liu

Abstract

Zhengxiao Du, Yujie Qian, Xiao Liu, Ming Ding, Jiezhong Qiu, Zhilin Yang, Jie Tang. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2022.

Subject

Autoregressive model

Blank

Natural language processing

Research Assistant

AI chat, annotations, notes & similar papers

Finding related papers...

Discussions

(0)

No comments yet

Be the first to share your thoughts!