GestUI: A Model-driven Method and Tool for Including Gesture-based Interaction in User Interfaces

Among the technological advances in touch-based devices, gesture-based interaction have become a prevalent feature in many application domains. Information systems are starting to explore this type of interaction. As a result, gesture specifications are now being hard-coded by developers at the sour...

Full description

Saved in:
Bibliographic Details
Published in:Complex systems informatics and modeling quarterly 2016-04 (6), p.73-92
Main Authors: Parra, Otto, España, Sergio, Pastor, Oscar
Format: Article
Language:English
Subjects:
gesture-based interaction
gesture-based user interface
information systems
Model-driven architecture
multi-stroke gestures
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Among the technological advances in touch-based devices, gesture-based interaction have become a prevalent feature in many application domains. Information systems are starting to explore this type of interaction. As a result, gesture specifications are now being hard-coded by developers at the source code level that hinders their reusability and portability. Similarly, defining new gestures that reflect user requirements is a complex process. This paper describes a model-driven approach to include gesture-based interaction in desktop information systems. It incorporates a tool prototype that captures user-sketched multi-stroke gestures and transforms them into a model by automatically generating the gesture catalogue for gesture-based interaction technologies and gesture-based user interface source codes. We demonstrated our approach in several applications ranging from case tools to form-based information systems.
ISSN:2255-9922
2255-9922
DOI:10.7250/csimq.2016-6.05