AcademicGPT: Empowering Academic Research

Large Language Models (LLMs) have demonstrated exceptional capabilities across various natural language processing tasks. Yet, many of these advanced LLMs are tailored for broad, general-purpose applications. In this technical report, we introduce AcademicGPT, designed specifically to empower academ...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2023-11
Main Authors: Shufa Wei, Xu, Xiaolong, Xianbiao Qi, Yin, Xi, Xia, Jun, Ren, Jingyi, Tang, Peijun, Zhong, Yuxiang, Chen, Yihao, Ren, Xiaoqin, Liang, Yuxin, Huang, Liankai, Xie, Kai, Gui, Weikang, Tan, Wei, Sun, Shuanglong, Hu, Yongquan, Liu, Qinxian, Li, Nanjin, Dai, Chihao, Wang, Lihua, Liu, Xiaohui, Zhang, Lei, Xie, Yutao
Format: Article
Language:English
Subjects:
Benchmarks
Empowerment
Large language models
Natural language processing
Training
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Large Language Models (LLMs) have demonstrated exceptional capabilities across various natural language processing tasks. Yet, many of these advanced LLMs are tailored for broad, general-purpose applications. In this technical report, we introduce AcademicGPT, designed specifically to empower academic research. AcademicGPT is a continual training model derived from LLaMA2-70B. Our training corpus mainly consists of academic papers, thesis, content from some academic domain, high-quality Chinese data and others. While it may not be extensive in data scale, AcademicGPT marks our initial venture into a domain-specific GPT tailored for research area. We evaluate AcademicGPT on several established public benchmarks such as MMLU and CEval, as well as on some specialized academic benchmarks like PubMedQA, SCIEval, and our newly-created ComputerScienceQA, to demonstrate its ability from general knowledge ability, to Chinese ability, and to academic ability. Building upon AcademicGPT's foundation model, we also developed several applications catered to the academic area, including General Academic Question Answering, AI-assisted Paper Reading, Paper Review, and AI-assisted Title and Abstract Generation.
ISSN:2331-8422