An Application of Automatic Text Revision for Power Defect Log

There are a large number of unstructured texts without data cleaning in the field of electric power. It is expensive to rely on manual ways to process the large amount of text data. In order to reduce the workload of data cleaning, we propose an intelligent method of automatic revision of power defe...

Full description

Saved in:
Bibliographic Details
Published in:Journal of physics. Conference series 2021-01, Vol.1757 (1), p.12027
Main Authors: Li, Hao, Deng, Feng, Lu, Jixiang, Zhang, Tao, Li, Hong
Format: Article
Language:English
Subjects:
Cleaning
data cleaning
Data processing
Electric equipment
Entity Recognition
Natural Language Processing
Physics
Recognition
Revisions
text revision
Unstructured data
Workload
Workloads
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:There are a large number of unstructured texts without data cleaning in the field of electric power. It is expensive to rely on manual ways to process the large amount of text data. In order to reduce the workload of data cleaning, we propose an intelligent method of automatic revision of power defect logs in this paper by adopting natural language processing technologies. We utilize entity recognition technology to recognize electrical equipment words on the text and utilize word similarity calculation to find out words with similar meaning in the standard vocabulary, which is the main process to revise Abnormal text. With the outstanding performance of entity recognition, the workload of data cleaning is reduced approximately 70% through our proposed method, which greatly improves the efficiency of unstructured data processing.
ISSN:1742-6588
1742-6596
DOI:10.1088/1742-6596/1757/1/012027