Research on Discrete Semantics in Continuous Hand Joint Movement Based on Perception and Expression

Continuous movements of the hand contain discrete expressions of meaning, forming a variety of semantic gestures. For example, it is generally considered that the bending of the finger includes three semantic states of bending, half bending, and straightening. However, there is still no research on...

Full description

Saved in:
Bibliographic Details
Published in:Sensors (Basel, Switzerland) Switzerland), 2021-05, Vol.21 (11), p.3735
Main Authors: Jia, Lesong, Zhou, Xiaozhou, Qin, Hao, Bai, Ruidong, Wang, Liuqing, Xue, Chengqi
Format: Article
Language:English
Subjects:
Bending
Boundaries
Classification
Cognition & reasoning
Communication
Design
discreteness of cognition
Fingers & toes
Gesture recognition
Gestures
Hand
hand gesture
Hand Joints
human mirroring mechanism
Leap Motion
Movement
Perception
Range of motion
Segmentation
semantic cognition
Semantics
Sign language
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Continuous movements of the hand contain discrete expressions of meaning, forming a variety of semantic gestures. For example, it is generally considered that the bending of the finger includes three semantic states of bending, half bending, and straightening. However, there is still no research on the number of semantic states that can be conveyed by each movement primitive of the hand, especially the interval of each semantic state and the representative movement angle. To clarify these issues, we conducted experiments of perception and expression. Experiments 1 and 2 focused on perceivable semantic levels and boundaries of different motion primitive units from the perspective of visual semantic perception. Experiment 3 verified and optimized the segmentation results obtained above and further determined the typical motion values of each semantic state. Furthermore, in Experiment 4, the empirical application of the above semantic state segmentation was illustrated by using Leap Motion as an example. We ended up with the discrete gesture semantic expression space both in the real world and Leap Motion Digital World, containing the clearly defined number of semantic states of each hand motion primitive unit and boundaries and typical motion angle values of each state. Construction of this quantitative semantic expression will play a role in guiding and advancing research in the fields of gesture coding, gesture recognition, and gesture design.
ISSN:1424-8220
1424-8220
DOI:10.3390/s21113735