Unsupervised Video Summarization Based on An Encoder-Decoder Architecture

The purpose of video summarization is to facilitate large-scale video browsing. Video summarization is a short and concise synopsis of original video. It usually composed of a set of representative video frames from the original video. This paper solves the problem of unsupervised video summarizatio...

Full description

Saved in:
Bibliographic Details
Published in:Journal of physics. Conference series 2022-04, Vol.2258 (1), p.12067
Main Authors: Li, Xin, Li, QiLin, Yin, Dawei, Zhang, Lijun, Peng, Dezhong
Format: Article
Language:English
Subjects:
Coders
Encoders-Decoders
Frames (data processing)
Physics
Video data
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The purpose of video summarization is to facilitate large-scale video browsing. Video summarization is a short and concise synopsis of original video. It usually composed of a set of representative video frames from the original video. This paper solves the problem of unsupervised video summarization by developing a Video Summarization Network (VSN) to summarize videos, which is formulated as selecting a sparse subset of video frames that best represents the input video. VSN predicts a probability for each video frame, which indicates the possibility of a frame being selected, and then takes actions to select frames according to the probability distribution to form a video summary. We designed a novel loss function which takes into account the diversity and representativeness of the generated summarization without labels or user interaction.
ISSN:1742-6588
1742-6596
DOI:10.1088/1742-6596/2258/1/012067