Enabling Self-Practice of Digital Audio–Tactile Maps for Visually Impaired People by Large Language Models

Digital audio–tactile maps (DATMs) on touchscreen devices provide valuable opportunities for people who are visually impaired (PVIs) to explore the spatial environment for engaging in travel activities. Existing solutions for DATMs usually require extensive training for the PVIs to understand the fe...

Full description

Saved in:
Bibliographic Details
Published in:Electronics (Basel) 2024-06, Vol.13 (12), p.2395
Main Authors: Tran, Chanh Minh, Bach, Nguyen Gia, Tan, Phan Xuan, Kamioka, Eiji, Kanamaru, Manami
Format: Article
Language:English
Subjects:
Analysis
Audio equipment
Computational linguistics
Digital mapping
Experiments
Feedback
Haptics
Interactive computer systems
Language
Language processing
Large language models
Natural language
Natural language interfaces
People with disabilities
Smartphones
Touch screens
Training
Vibration
Visual impairment
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Digital audio–tactile maps (DATMs) on touchscreen devices provide valuable opportunities for people who are visually impaired (PVIs) to explore the spatial environment for engaging in travel activities. Existing solutions for DATMs usually require extensive training for the PVIs to understand the feedback mechanism. Due to the shortage of human resources for training specialists, as well as PVIs’ desire for frequent practice to maintain their usage skills, it has become challenging to widely adopt DATMs in real life. This paper discusses the use of large language models (LLMs) to provide a verbal evaluation of the PVIs’ perception, which is crucial for the independent practice of DATM usage. A smartphone-based prototype providing DATMs of simple floor plans was developed for a preliminary investigation. The evaluation results have proven that the interaction with the LLM could help the participants better understand the DATMs’ content and could vividly replicate them by drawings.
ISSN:2079-9292
2079-9292
DOI:10.3390/electronics13122395