Advanced news video parsing via visual characteristics of anchorperson scenes

• Published in: Telecommunication systems 2013-11, Vol.54 (3), p.247-263
• Main Authors: Dong, Yuan, Qin, Gang, Xiao, Guorui, Lian, Shiguo, Chang, Xiaofu
• Format: Article
• Language: English
• Subjects: Analysis; Artificial Intelligence; Business and Management; Channels; Computer Communication Networks; Digital video; Feature extraction; Image processing systems; IT in Business; Methods; Multimedia; Probability Theory and Stochastic Processes; Studies; Telecommunications systems; Television news
• ISSN: 1018-4864; 1572-9451
• DOI: 10.1007/s11235-013-9731-0

In this paper, we present an advanced news video parsing system via exploring the visual characteristics of anchorperson scenes, which aims to provide personalized news services over Internet or mobile platforms. As the anchorperson shots serve as the root shots for constructing news video, the addressed system firstly performs anchorperson detection which divides the news into several segments. Due to the manipulation of multi-features and post-processing, our method of anchorperson detection can even be efficiently applied to news video whose anchorperson scenes are most challenging and complicated. Usually, the segments produced from anchorperson detection are regarded as news stories. However, an observation in our database proves this is not true because of the existing of interview scenes. These interview scenes are showed in the form that interviewer (anchorperson) and interviewee recursively appear. Thus, a technique called interview clustering based on face similarity is carried out to merge these interview segments. Another novel aspect of our system is entity summarization of interview scenes. We adopt it in the system at final. The effectiveness and robustness of the proposed system are demonstrated by the evaluation on 19 hours of news programs from 6 different TV Channels.