CRIE: An automated analyzer for Chinese texts

• Published in: Behavior research methods 2016-12, Vol.48 (4), p.1238-1251
• Main Authors: Sung, Yao-Ting, Chang, Tao-Hsing, Lin, Wei-Chun, Hsieh, Kuan-Sheng, Chang, Kuo-En
• Format: Article
• Language: English
• Subjects: Artificial intelligence; Asian Continental Ancestry Group; Automatic text analysis; Behavioral Science and Psychology; Chinese languages; Cognitive Psychology; Comprehension; Feature extraction; Humans; Linguistics; Psychology; Software
• ISSN: 1554-3528; 1554-3528
• DOI: 10.3758/s13428-015-0649-1

Textual analysis has been applied to various fields, such as discourse analysis, corpus studies, text leveling, and automated essay evaluation. Several tools have been developed for analyzing texts written in alphabetic languages such as English and Spanish. However, currently there is no tool available for analyzing Chinese-language texts. This article introduces a tool for the automated analysis of simplified and traditional Chinese texts, called the Chinese Readability Index Explorer (CRIE). Composed of four subsystems and incorporating 82 multilevel linguistic features, CRIE is able to conduct the major tasks of segmentation, syntactic parsing, and feature extraction. Furthermore, the integration of linguistic features with machine learning models enables CRIE to provide leveling and diagnostic information for texts in language arts, texts for learning Chinese as a foreign language, and texts with domain knowledge. The usage and validation of the functions provided by CRIE are also introduced.