A Unified Understanding of Deep NLP Models for Text Classification by Li, Zhen, Wang, Xiting, Yang, Weikai, Wu, Jing, Zhang, Zhengyan, Liu, Zhiyuan, Sun, Maosong, Zhang, Hui, Liu, Shixia

Get full text

Prompt Tuning for Discriminative Pre-trained Language Models by Yao, Yuan, Bowen, Dong, Zhang, Ao, Zhang, Zhengyan, Xie, Ruobing, Liu, Zhiyuan, Lin, Leyu, Sun, Maosong, Wang, Jianyong

Get full text

Plug-and-Play Document Modules for Pre-trained Models by Xiao, Chaojun, Zhang, Zhengyan, Xu, Han, Chi-Min, Chan, Lin, Yankai, Liu, Zhiyuan, Li, Xiangyang, Li, Zhonghua, Cao, Zhao, Sun, Maosong

Get full text

Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning by Si, Chenglei, Zhang, Zhengyan, Fanchao Qi, Liu, Zhiyuan, Wang, Yasheng, Liu, Qun, Sun, Maosong

Get full text

Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger by Fanchao Qi, Mukai, Li, Chen, Yangyi, Zhang, Zhengyan, Liu, Zhiyuan, Wang, Yasheng, Sun, Maosong

Get full text

Configurable Foundation Models: Building LLMs from a Modular Perspective by Xiao, Chaojun, Zhang, Zhengyan, Song, Chenyang, Jiang, Dazhi, Yao, Feng, Xu, Han, Wang, Xiaozhi, Wang, Shuo, Huang, Yufei, Lin, Guanyu, Chen, Yingfa, Zhao, Weilin, Tu, Yuge, Zhong, Zexuan, Zhang, Ao, Si, Chenglei, Khai Hao Moo, Zhao, Chenyang, Chen, Huimin, Lin, Yankai, Liu, Zhiyuan, Shang, Jingbo, Sun, Maosong

Get full text

KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation by Wang, Xiaozhi, Gao, Tianyu, Zhu, Zhaocheng, Zhang, Zhengyan, Liu, Zhiyuan, Li, Juanzi, Tang, Jian

Get full text

Graph Neural Networks: A Review of Methods and Applications by Zhou, Jie, Cui, Ganqu, Hu, Shengding, Zhang, Zhengyan, Cheng, Yang, Liu, Zhiyuan, Wang, Lifeng, Li, Changcheng, Sun, Maosong

Get full text

Knowledge Inheritance for Pre-trained Language Models by Qin, Yujia, Lin, Yankai, Yi, Jing, Zhang, Jiajie, Xu, Han, Zhang, Zhengyan, Su, Yusheng, Liu, Zhiyuan, Li, Peng, Sun, Maosong, Zhou, Jie

Get full text

Adversarial Language Games for Advanced Natural Language Intelligence by Yao, Yuan, Zhong, Haoxi, Zhang, Zhengyan, Xu, Han, Wang, Xiaozhi, Xiao, Chaojun, Zeng, Guoyang, Liu, Zhiyuan, Sun, Maosong

Get full text

ERNIE: Enhanced Language Representation with Informative Entities by Zhang, Zhengyan, Xu, Han, Liu, Zhiyuan, Jiang, Xin, Sun, Maosong, Liu, Qun

Get full text

COSINE: Compressive Network Embedding on Large-scale Information Networks by Zhang, Zhengyan, Cheng, Yang, Liu, Zhiyuan, Sun, Maosong, Fang, Zhichong, Zhang, Bo, Lin, Leyu

Get full text

A Unified Framework for Community Detection and Network Representation Learning by Tu, Cunchao, Zeng, Xiangkai, Wang, Hao, Zhang, Zhengyan, Liu, Zhiyuan, Sun, Maosong, Zhang, Bo, Lin, Leyu

Get full text

CPM-2: Large-scale Cost-effective Pre-trained Language Models by Zhang, Zhengyan, Gu, Yuxian, Xu, Han, Chen, Shengqi, Xiao, Chaojun, Sun, Zhenbo, Yao, Yuan, Fanchao Qi, Guan, Jian, Pei Ke, Cai, Yanzheng, Zeng, Guoyang, Tan, Zhixing, Liu, Zhiyuan, Huang, Minlie, Han, Wentao, Liu, Yang, Zhu, Xiaoyan, Sun, Maosong

Get full text

CUGE: A Chinese Language Understanding and Generation Evaluation Benchmark by Yao, Yuan, Dong, Qingxiu, Guan, Jian, Cao, Boxi, Zhang, Zhengyan, Xiao, Chaojun, Wang, Xiaozhi, Fanchao Qi, Bao, Junwei, Nie, Jinran, Zeng, Zheni, Gu, Yuxian, Zhou, Kun, Huang, Xuancheng, Li, Wenhao, Ren, Shuhuai, Lu, Jinliang, Xu, Chengqiang, Wang, Huadong, Zeng, Guoyang, Zhou, Zile, Zhang, Jiajun, Li, Juanzi, Huang, Minlie, Yan, Rui, He, Xiaodong, Wan, Xiaojun, Zhao, Xin, Xu, Sun, Liu, Yang, Liu, Zhiyuan, Han, Xianpei, Yang, Erhong, Sui, Zhifang, Sun, Maosong

Get full text

Pre-Trained Models: Past, Present and Future by Xu, Han, Zhang, Zhengyan, Ding, Ning, Gu, Yuxian, Liu, Xiao, Huo, Yuqi, Qiu, Jiezhong, Yao, Yuan, Zhang, Ao, Zhang, Liang, Han, Wentao, Huang, Minlie, Qin, Jin, Lan, Yanyan, Liu, Yang, Liu, Zhiyuan, Lu, Zhiwu, Qiu, Xipeng, Song, Ruihua, Tang, Jie, Ji-Rong, Wen, Yuan, Jinhui, Wayne Xin Zhao, Zhu, Jun

Get full text

A Roadmap for Big Model by Sha Yuan, Zhao, Hanyu, Zhao, Shuai, Leng, Jiahong, Liang, Yangxiao, Wang, Xiaozhi, Yu, Jifan, Lv, Xin, Zhou, Shao, He, Jiaao, Lin, Yankai, Xu, Han, Liu, Zhenghao, Ding, Ning, Rao, Yongming, Gao, Yizhao, Zhang, Liang, Ding, Ming, Fang, Cong, Wang, Yisen, Long, Mingsheng, Zhang, Jing, Dong, Yinpeng, Pang, Tianyu, Cui, Peng, Huang, Lingxiao, Zheng, Liang, Shen, Huawei, Zhang, Hui, Zhang, Quanshi, Dong, Qingxiu, Tan, Zhixing, Wang, Mingxuan, Wang, Shuo, Long, Zhou, Li, Haoran, Bao, Junwei, Pan, Yingwei, Zhang, Weinan, Zhou, Yu, Yan, Rui, Shi, Chence, Xu, Minghao, Zhang, Zuobai, Wang, Guoqiang, Pan, Xiang, Li, Mengjie, Chu, Xiaoyu, Yao, Zijun, Zhu, Fangwei, Cao, Shulin, Xue, Weicheng, Ma, Zixuan, Zhang, Zhengyan, Hu, Shengding, Qin, Yujia, Xiao, Chaojun, Zeng, Zheni, Cui, Ganqu, Chen, Weize, Zhao, Weilin, Yao, Yuan, Li, Peng, Zheng, Wenzhao, Zhao, Wenliang, Wang, Ziyi, Zhang, Borui, Nanyi Fei, Hu, Anwen, Ling, Zenan, Li, Haoyang, Cao, Boxi, Han, Xianpei, Zhan, Weidong, Chang, Baobao, Sun, Hao, Deng, Jiawen, Zheng, Chujie, Li, Juanzi, Hou, Lei, Cao, Xigang, Zhai, Jidong, Liu, Zhiyuan, Sun, Maosong, Lu, Jiwen, Lu, Zhiwu, Qin, Jin, Song, Ruihua, Ji-Rong, Wen, Lin, Zhouchen, Wang, Liwei, Su, Hang, Zhu, Jun, Sui, Zhifang, Zhang, Jiajun, Liu, Yang, He, Xiaodong, Huang, Minlie, Tang, Jian, Tang, Jie

Get full text

Isolation and characterization of a novel mouse erythroid differentiation-denucleation related gene (MEDDF) by Zhang, Zhengyan, Liu, Shiguang, Zhang, Jingbo, Xue, Shepu

Get full text

An experimental study of the effect of ionic liquids on the low temperature oxidation of coal by Zhang, Weiqing, Jiang, Shuguang, Wang, kai, Wu, Zhengyan, Shao, Hao

Get full text

CPM: A Large-scale Generative Chinese Pre-trained Language Model by Zhang, Zhengyan, Xu, Han, Zhou, Hao, Pei Ke, Gu, Yuxian, Ye, Deming, Qin, Yujia, Su, Yusheng, Ji, Haozhe, Guan, Jian, Fanchao Qi, Wang, Xiaozhi, Zheng, Yanan, Zeng, Guoyang, Cao, Huanqi, Chen, Shengqi, Li, Daixuan, Sun, Zhenbo, Liu, Zhiyuan, Huang, Minlie, Han, Wentao, Tang, Jie, Li, Juanzi, Zhu, Xiaoyan, Sun, Maosong

Get full text