Analysis of multi-agent activity using petri nets

• Published in: Pattern recognition 2010-04, Vol.43 (4), p.1491-1501
• Main Authors: Perše, Matej, Kristan, Matej, Perš, Janez, Mušič, Gašper, Vučkovič, Goran, Kovačič, Stanislav
• Format: Article
• Language: English
• Subjects: Activity recognition and evaluation; Applied sciences; Basketball analysis; Exact sciences and technology; Information, signal and communications theory; Multi-agent activity analysis; Pattern recognition; Signal processing; Telecommunications and information theory; Trajectories
• ISSN: 0031-3203; 1873-5142
• DOI: 10.1016/j.patcog.2009.11.011

This paper presents the use of place/transition petri nets (PNs) for the recognition and evaluation of complex multi-agent activities. The PNs were built automatically from the activity templates that are routinely used by experts to encode domain-specific knowledge. The PNs were built in such a way that they encoded the complex temporal relations between the individual activity actions. We extended the original PN formalism to handle the propagation of evidence using net tokens. The evaluation of the spatial and temporal properties of the actions was carried out using trajectory-based action detectors and probabilistic models of the action durations. The presented approach was evaluated using several examples of real basketball activities. The obtained experimental results suggest that this approach can be used to determine the type of activity that a team has performed as well as the stage at which the activity ended.