Augmented songbook: an augmented reality educational application for raising music awareness

This paper presents the development of an Augmented Reality mobile application which aims at sensibilizing young children to abstract concepts of music. Such concepts are, for instance, the musical notation or the idea of rhythm. Recent studies in Augmented Reality for education suggest that such te...

Full description

Saved in:
Bibliographic Details
Published in:Multimedia tools and applications 2018-06, Vol.77 (11), p.13773-13798
Main Authors: Rusiñol, Marçal, Chazalon, Joseph, Diaz-Chito, Katerine
Format: Article
Language:English
Subjects:
Applications programs
Augmented reality
Children
Computer Communication Networks
Computer Science
Computing time
Data Structures and Information Theory
Image acquisition
Image Processing
Mobile computing
Multimedia Information Systems
Music
Special Purpose and Application-Based Systems
Virtual reality
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper presents the development of an Augmented Reality mobile application which aims at sensibilizing young children to abstract concepts of music. Such concepts are, for instance, the musical notation or the idea of rhythm. Recent studies in Augmented Reality for education suggest that such technologies have multiple benefits for students, including younger ones. As mobile document image acquisition and processing gains maturity on mobile platforms, we explore how it is possible to build a markerless and real-time application to augment the physical documents with didactic animations and interactive virtual content. Given a standard image processing pipeline, we compare the performance of different local descriptors at two key stages of the process. Results suggest alternatives to the SIFT local descriptors, regarding result quality and computational efficiency, both for document model identification and perspective transform estimation. All experiments are performed on an original and public dataset we introduce here.
ISSN:1380-7501
1573-7721
DOI:10.1007/s11042-017-4991-4