Action recognition for the robotics and manufacturing automation using 3-D binary micro-block difference

Vision-based control systems play an important role in modern robotics systems. An important task in implementing such a system is developing an effective algorithm for recognizing human actions and the working environment and the design of intuitive gesture commands. This paper proposes an action r...

Full description

Saved in:
Bibliographic Details
Published in:International journal of advanced manufacturing technology 2021-12, Vol.117 (7-8), p.2319-2330
Main Authors: Voronin, Viacheslav, Zhdanova, Marina, Semenishchev, Evgenii, Zelenskii, Aleksander, Cen, Yigang, Agaian, Sos
Format: Article
Language:English
Subjects:
Activity recognition
Algorithms
Automation
CAE) and Design
Computer-Aided Engineering (CAD
Engineering
Industrial and Production Engineering
Industrial robots
Manufacturing engineering
Mechanical Engineering
Media Management
Original Article
Robotics
Working conditions
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Vision-based control systems play an important role in modern robotics systems. An important task in implementing such a system is developing an effective algorithm for recognizing human actions and the working environment and the design of intuitive gesture commands. This paper proposes an action recognition algorithm for robotics and manufacturing automation. The key contributions are (1) fusion of multimodal information obtained by depth sensors and cameras of the visible range, (2) modified Gabor-based and 3-D binary-based descriptor using micro-block difference, (3) efficient skeleton-based descriptor, and (4) recognition algorithm using the combined descriptor. The proposed binary micro-block difference representation of 3-D patches from video with a complex background in several scales and orientations leads to an informative description of the scene action. The experimental results showed the effectiveness of the proposed algorithm on datasets.
ISSN:0268-3768
1433-3015
DOI:10.1007/s00170-021-07613-2