Cross-Modal Analysis of Audio-Visual Film Montage

A stylistic device frequently employed by filmmakers is the synchronous montage (composition) of audio and visual elements. Synchronous montage helps to increase tension and tempo in a scene and highlights important events in the story. Sequences with synchronous montage usually contain rich semanti...

Full description

Saved in:
Bibliographic Details
Main Authors: Zeppelzauer, M., Mitrovic, D., Breiteneder, C.
Format: Conference Proceeding
Language:English
Subjects:
Correlation
Estimation
Feature extraction
Humans
Motion pictures
Semantics
Visualization
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:A stylistic device frequently employed by filmmakers is the synchronous montage (composition) of audio and visual elements. Synchronous montage helps to increase tension and tempo in a scene and highlights important events in the story. Sequences with synchronous montage usually contain rich semantics which is relevant for understanding a movie. This property is currently not exploited in automated indexing, annotation, and summarization of movies. We propose a cross-modal approach that extracts sequences from a movie with synchronous audio-visual montage. Experiments confirm that the extracted sequences have high semantic relevance. Consequently, they represent a useful basis for different high-level movie abstraction tasks such as automated movie annotation and movie summarization.
ISSN:1095-2055
2637-9430
DOI:10.1109/ICCCN.2011.6005782