A review of sensory interactions between autonomous vehicles and drivers

• Published in: Journal of systems architecture 2023-08, Vol.141, p.102932, Article 102932
• Main Authors: Lu, Jiayi, Peng, Zhaoxia, Yang, Shichun, Ma, Yuan, Wang, Rui, Pang, Zhaowen, Feng, Xinjie, Chen, Yuyi, Cao, Yaoguang
• Format: Article
• Language: English
• Subjects: Architecture; Autonomous vehicles; Human–machine interactions; Sensory
• ISSN: 1383-7621; 1873-6165
• DOI: 10.1016/j.sysarc.2023.102932

Nowadays, human-oriented has already become the direction of the development of the intelligent vehicle, among which, the cabin, in constant contact with drivers, is getting more and more attention. Intelligent assisted systems have alleviated the burden on drivers during long journeys and provided a remedy for operational errors. As the trend towards increasingly intelligent vehicles, the issue of human–machine co-driving is receiving attention from scientific researchers. The technologies of human–machine interactions usually contain two parts, the human-to-vehicle and vehicle-to-human. This paper analyzes the potential innovation of human–machine systems from the perspective of human sensing, including visual, auditory, tactile, and olfactory. Based on the review of human–machine technologies, the current intelligentization of vehicles is divided into driver interaction and crew service systems. Then, the structure of a future intelligent interaction system considering multi-sensing is proposed and further discussed. Finally, by analyzing the relationship between the system for human and autonomous systems, a classification of the intelligence level for interaction systems is presented. •A review of sensory technologies inside autonomous vehicles.•Divided human–machine interactions within intelligent vehicles into two parts: human-to-vehicle and vehicle-to-human.•Summarized the current sensory technology and prospects for future technological development based on the vehicle-to-human and human-to-vehicle.•Proposed an advanced human–machine interaction architecture.•Graded the intelligence level of interaction systems in autonomous vehicles.