Automated Generation of Chinese Text-Image Summaries Using Deep Learning Techniques

In the era of the internet, an abundance of Chinese text-image content is continuously produced, necessitating effective automated technologies for processing and summarizing these materials. Automated generation of Chinese text-image summaries facilitates rapid comprehension of key information, the...

Full description

Saved in:
Bibliographic Details
Published in:Traitement du signal 2023-12, Vol.40 (6), p.2835-2843
Main Authors: Xu, Meiling, Rahman, Hayati Abd, Li, Feng
Format: Article
Language:English
Subjects:
Automation
Data mining
Deep learning
Image enhancement
Image quality
Image segmentation
Information processing
Information retrieval
Methods
Natural language processing
R&D
Research & development
Semantics
Speech recognition
Summaries
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In the era of the internet, an abundance of Chinese text-image content is continuously produced, necessitating effective automated technologies for processing and summarizing these materials. Automated generation of Chinese text-image summaries facilitates rapid comprehension of key information, thereby enhancing the efficiency of information consumption. Due to the unique characteristics of the Chinese language, traditional automatic summarization techniques are inadequately transferable, prompting the development of text-image summary generation technologies tailored to Chinese features. Research indicates that while existing natural language processing and deep learning techniques have made strides in text summarization, deficiencies remain in the deep semantic mining and integration of text-image content. This study primarily focuses on two aspects: Firstly, a generative approach based on an enhanced MaliGAN model, employing deep learning models to improve text generation quality. Secondly, a retrieval-based approach, utilizing cross-modal similarity retrieval to extract text information most relevant to the image content, guiding summary generation. Additionally, this study innovatively proposes a model architecture comprising segmentation, cross-modal retrieval, and adaptive fusion strategy modules, significantly augmenting the accuracy and reliability of text-image summary generation.
ISSN:0765-0019
1958-5608
DOI:10.18280/ts.400644