HapMotion: motion-to-tactile framework with wearable haptic devices for immersive VR performance experience

We present a novel haptic rendering framework that translates the performer’s motions into wearable vibrotactile feedback for an immersive virtual reality (VR) performance experience. Here, we employ a rendering pipeline that extracts meaningful vibrotactile parameters including intensity and locati...

Full description

Saved in:
Bibliographic Details
Published in:Virtual reality : the journal of the Virtual Reality Society 2024-03, Vol.28 (1), p.13, Article 13
Main Authors: Jung, Kyungeun, Kim, Sangpil, Oh, Seungjae, Yoon, Sang Ho
Format: Article
Language:English
Subjects:
Acoustics
Artificial Intelligence
Audiences
Computer Graphics
Computer Science
Feedback
Haptic interfaces
Haptics
Image Processing and Computer Vision
Immersive virtual reality
Localization
Multimedia
Original Article
Parameters
Rendering
Researchers
Torso
User Interfaces and Human Computer Interaction
Virtual reality
Wearable technology
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We present a novel haptic rendering framework that translates the performer’s motions into wearable vibrotactile feedback for an immersive virtual reality (VR) performance experience. Here, we employ a rendering pipeline that extracts meaningful vibrotactile parameters including intensity and location. We compute these parameters from the performer’s upper-body movements which play a significant role in a dance performance. Therefore, we customize a haptic vest and sleeves to support vibrotactile feedback on the frontal and back parts of the torso and shoulders as well. To capture essential movements from the VR performance, we propose a method called motion salient triangle (MST). MST utilizes key skeleton joints’ movements to compute the associated haptic parameters. Our method supports translating both choreographic and communicative motions into vibrotactile feedback. Through a series of user studies, we validate the user preference for our method compared to the conventional motion-to-tactile and audio-to-tactile methods.
ISSN:1359-4338
1434-9957
DOI:10.1007/s10055-023-00910-z