Twinkle: Interacting with physical surfaces using handheld projector

We propose a novel interface called Twinkle for interacting with an arbitrary physical surface using a handheld projector and a camera. When a user flashes a projection light on an object, the projected images react as if the user touched the object with the light. The handheld device recognizes the...

Full description

Saved in:
Bibliographic Details
Main Authors: Yoshida, Takumi, Hirobe, Yuki, Nii, Hideaki, Kawakami, Naoki, Tachi, Susumu
Format: Conference Proceeding
Language:English
Subjects:
Acceleration
Acoustic sensors
and virtual realities
augmented
Cameras
Detection algorithms
Displays
H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems-Artificial
Handheld computers
Image processing
Image recognition
Image sensors
Prototypes
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We propose a novel interface called Twinkle for interacting with an arbitrary physical surface using a handheld projector and a camera. When a user flashes a projection light on an object, the projected images react as if the user touched the object with the light. The handheld device recognizes the features of the physical environment and displays images and sounds that are generated in real-time according to the user's motion and collisions of projected images with objects. We realize this system by using several image-processing techniques and a collision detection algorithm. We also use an acceleration sensor to compensate for the image processing. In this paper, we explain the principle of interacting with a physical surface. Then, we describe the implementation of the prototype system and some application examples.
ISSN:1087-8270
2375-5326
DOI:10.1109/VR.2010.5444809