Video personalization and summarization system for usage environment

• Published in: Journal of visual communication and image representation 2004-09, Vol.15 (3), p.370-392
• Main Authors: Tseng, Belle L., Lin, Ching-Yung, Smith, John R.
• Format: Article
• Language: English
• Subjects: Adaptation; Annotation; Digital item adaptation; MPEG-21; MPEG-7; Rich media description; Rights expression; Summarization; Usage environment; Video personalization
• ISSN: 1047-3203; 1095-9076
• DOI: 10.1016/j.jvcir.2004.04.011

A video personalization and summarization system is designed and implemented incorporating usage environment to dynamically generate a personalized video summary. The personalization system adopts the three-tier server–middleware–client architecture in order to select, adapt, and deliver rich media content to the user. The server stores the content sources along with their corresponding MPEG-7 metadata descriptions. Our semantic metadata is provided through the use of the VideoAnnEx MPEG-7 Video Annotation Tool. When the user initiates a request for content, the client communicates the MPEG-21 usage environment description along with the user query to the middleware. The middleware is powered by the personalization engine and the content adaptation engine. Our personalization engine includes the VideoSue Summarization on Usage Environment engine that selects the optimal set of desired contents according to user preferences. Afterwards, the adaptation engine performs the required transformations and compositions of the selected contents for the specific usage environment using our VideoEd Editing and Composition Tool. Finally, two personalization and summarization systems are demonstrated for the IBM Websphere Portal Server and for pervasive PDA devices.