Fuzzy rule-based reasoning approach for event detection and annotation of broadcast soccer video

• Published in: Applied soft computing 2013-02, Vol.13 (2), p.846-866
• Main Authors: Hosseini, Monireh-Sadat, Eftekhari-Moghadam, Amir-Masoud
• Format: Article
• Language: English
• Subjects: Data mining; Decision tree; Event detection; Fuzzy rule-based reasoning; Soccer video annotation; Video summarization
• ISSN: 1568-4946; 1872-9681
• DOI: 10.1016/j.asoc.2012.10.007

[Display omitted] ► The proposed flexible fuzzy system is able to tackle clips exclude regular patterns in their feature sequences. ► We solve the problem of manual supervision on how each event could be characterized by some special features. ► A set of compact rules are generated by employing a DT approach that decreases the complexity of the system. ► The method is cost effective due to lack of need to complex computations and low time and memory waster. ► Collection of annotated clips could be used for video retrieval, event browsing and video summarization tasks. This paper presents an approach for event detection and annotation of broadcast soccer video. It benefits from the fact that occurrence of some audiovisual features demonstrates remarkable patterns for detection of semantic events. However, the goal of this paper is to propose a flexible system that can be able to be used with minimum reliance on predefined sequences of features and domain knowledge derivative structures. To achieve this goal, we design a fuzzy rule-based reasoning system as a classifier which adopts statistical information from a set of audiovisual features as its crisp input values and produces semantic concepts corresponding to the occurred events. A set of tuples is created by discretization and fuzzification of continuous feature vectors derived from the training data. We extract the hidden knowledge among the tuples and correlation between the features and related events by constructing a decision tree (DT). A set of fuzzy rules is generated by traversing each path from root toward leaf nodes of constructed DT. These rules are inserted in fuzzy rule base of designed fuzzy system and employed by fuzzy inference engine to perform decision-making process and predict the occurred events in input video. Experimental results conducted on a large set of broadcast soccer videos demonstrate the effectiveness of the proposed approach.