Smart home for enhanced healthcare: exploring human machine interface oriented digital twin model

• Published in: Multimedia tools and applications 2024-03, Vol.83 (11), p.31297-31315
• Main Authors: Shoukat, Muhammad Usman, Yan, Lirong, Zhang, Jiawen, Cheng, Yu, Raza, Muhammad Umair, Niaz, Ashfaq
• Format: Article
• Language: English
• Subjects: Computer Communication Networks; Computer Science; Control equipment; Control systems; Cyber-physical systems; Data communication; Data mining; Data Structures and Information Theory; Digital twins; Game theory; Interactive control; Internet of Things; Machine learning; Man-machine interfaces; Modelling; Multimedia Information Systems; New technology; Quality control; Remote control; Smart buildings; Special Purpose and Application-Based Systems; Synchronism; Tracking devices; Virtual reality; Washing machines
• ISSN: 1573-7721; 1380-7501; 1573-7721
• DOI: 10.1007/s11042-023-16875-9

Digital twin (DT) and other emerging technologies such as the Internet of Things (IoT), data mining, reinforcement learning, remote intelligent control, and machine learning offer enormous potential for transforming today’s equipment model into intelligent devices. It is one of the key technologies to endorse the virtual and remote intelligent control system for home-devices (HD) in human comfort (disabled/elderly). The relevant research is in the initial stage, and how to realize the DT of home-equipment control has become a vital problem to be solved. This study expounds on the suggestion and application of the DT model and summarizes the research and application progress from the aspect of the home-devices’ DT (HDDT) modeling. This modelling approach is three-staged: in terms of physical entities, virtual entities, and connectivity (data communication). The proposed model utilizes an interactive mechanism for the intelligent control of HD, by integrating DT and virtual simulation technologies to establish a human cyber-physical system (HCPS), specifically addressing the challenges associated with remote-control problems. The HCPS aims to achieve a deep integration and interface between the physical and virtual spaces of smart-device information. Using the game theory approach to create multi-physical entities and DT entities of IoT-based HD like washing machines, lamps, breakers, heaters, kitchen equipment, TV, AC, etc. The next step is to develop high-performance smart devices and build a reasonable sensing network to improve the depth and range of connection. The equipment tracking test showed that the system could control virtual reality synchronization, positional accuracy, and quality control for smart-devices development in HDDT modeling.