Review of Deep Learning for Language Modeling

[Purpose/Significance] Deep learning for language modeling is one of the major methods and advanced technologies to enhance language intelligence of machines at present, which has become an indispensable important technical means for automatic processing and analysis of data resources, and intellige...

Full description

Saved in:
Bibliographic Details
Published in:Nongye tushu qingbao xuekan 2023-08, Vol.35 (8), p.4-18
Main Authors: WANG Sili, ZHANG, Ling, YANG, Heng, LIU, Wei
Format: Article
Language:Chinese
Subjects:
deep learning|language model|neural network|pre-trained model|word embedding
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:[Purpose/Significance] Deep learning for language modeling is one of the major methods and advanced technologies to enhance language intelligence of machines at present, which has become an indispensable important technical means for automatic processing and analysis of data resources, and intelligent mining of information and knowledge. However, there are still some difficulties in using deep learning for language modeling for technology development and application service in the library and information science (LIS) field. Therefore, this study systematically reviews and reveals the research progress, technical principles, and development methods of deep learning for language modeling, with the aim at providing reliable theoretical basis and feasible methodological paths for the deep understanding and application of deep learning for language modeling for librarians and fellow practitioners. [Method/Process] The data used in this study were collected from the WOS core database, CNKI literature database, arX
ISSN:1002-1248
DOI:10.13998/j.cnki.issn1002-1248.23-0251