Implementation and evaluation of wearable sensor devices for recording and detecting conversational interaction

We have developed a wearable device that records the activities of human-human and human-artifact interactions. The device records personal and social everyday-life experiences in multiple modalities such as voice and visible scene, using microphone and camera to imitate human perceptibility. These...

Full description

Saved in:
Bibliographic Details
Main Authors: Ito, S., Iwasawa, S., Tsuchikawa, M., Sumi, Y., Mase, K., Katagiri, Y., Kogure, K., Hagita, N.
Format: Conference Proceeding
Language:English
Subjects:
Cameras
Human computer interaction
Infrared detectors
Infrared image sensors
Intelligent robots
Laboratories
Layout
Light emitting diodes
Protocols
Wearable sensors
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We have developed a wearable device that records the activities of human-human and human-artifact interactions. The device records personal and social everyday-life experiences in multiple modalities such as voice and visible scene, using microphone and camera to imitate human perceptibility. These sensors are used to record the perceived experiences continuously as well as to detect and index interactions from nonverbal behaviors. We employ an infrared LED ID tag system to detect the interactions in terms of the ID and its relative positions of the objects in the visual field of the camera. In this paper, we propose the "Interaction Scope" which is defined as the range of relative human/object positions that have a high probability of occurring in conversational interactions. We confirm that the interaction scope exists and can represent the interactions naturally through the analysis of experimental conversational sessions. We also demonstrate that our tag system can be effectively used as a sensor that detects and measures the proposed interaction scope.
ISSN:1550-4816
2376-8541
DOI:10.1109/ISWC.2005.27