Video Action Understanding

Many believe that the successes of deep learning on image understanding problems can be replicated in the realm of video understanding. However, due to the scale and temporal nature of video, the span of video understanding problems and the set of proposed deep learning solutions is arguably wider a...

Full description

Saved in:
Bibliographic Details
Published in:IEEE access 2021, Vol.9, p.134611-134637
Main Authors: Hutchinson, Matthew S., Gadepally, Vijay N.
Format: Article
Language:English
Subjects:
Action detection
action localization
action prediction
action proposal
action recognition
action understanding
Data models
Deep learning
Measurement
Proposals
Spatiotemporal phenomena
Task analysis
Taxonomy
Tutorials
Video data
video understanding
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Many believe that the successes of deep learning on image understanding problems can be replicated in the realm of video understanding. However, due to the scale and temporal nature of video, the span of video understanding problems and the set of proposed deep learning solutions is arguably wider and more diverse than those of their 2D image siblings. Finding, identifying, and predicting actions are a few of the most salient tasks in this emerging and rapidly evolving field. With a pedagogical emphasis, this tutorial introduces and systematizes fundamental topics, basic concepts, and notable examples in supervised video action understanding. Specifically, we clarify a taxonomy of action problems, catalog and highlight video datasets, describe common video data preparation methods, present the building blocks of state-of-the-art deep learning model architectures, and formalize domain-specific metrics to baseline proposed solutions. This tutorial is intended to be accessible to a general computer science audience and assumes a conceptual understanding of supervised learning.
ISSN:2169-3536
2169-3536
DOI:10.1109/ACCESS.2021.3115476