Knowledge driven indoor object‐goal navigation aid for visually impaired people

Aiming to help improve quality of life of the visually impaired people, this paper presents a novel wearable aid in the shape of a helmet for helping them find objects in indoor scenes. An object‐goal navigation system based on a wearable device is developed, which consists of four modules: object r...

Full description

Saved in:
Bibliographic Details
Published in:Cognitive computation and systems 2022-12, Vol.4 (4), p.329-339
Main Authors: Hou, Xuan, Zhao, Huailin, Wang, Chenxu, Liu, Huaping
Format: Article
Language:English
Subjects:
artificial intelligence
Cameras
cognitive systems
computer vision
Datasets
Decision making
Image retrieval
Knowledge management
Logic programming
Quality of life
robot learning
robot perception
Robotics
robots
Sensors
Visual impairment
wearable robots
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Aiming to help improve quality of life of the visually impaired people, this paper presents a novel wearable aid in the shape of a helmet for helping them find objects in indoor scenes. An object‐goal navigation system based on a wearable device is developed, which consists of four modules: object relation prior knowledge (ORPK), perception, decision and feedback. To make the aid also work well in unfamiliar environment, ORPK is used for sub‐goal inference to help the user find the target goal. And a method that learns the ORPK from unlabelled images by utilising a scene graph and knowledge graph is proposed. The effectiveness of the aid is demonstrated in real world experiments.
ISSN:2517-7567
1873-9601
2517-7567
1873-961X
DOI:10.1049/ccs2.12061