Design and implementation of virtual fitting system based on gesture recognition and clothing transfer algorithm

• Published in: Scientific reports 2022-11, Vol.12 (1), p.18356-18356, Article 18356
• Main Authors: Wu, Ying, Liu, Hongbing, Lu, Pengzhen, Zhang, Lihua, Yuan, Fangjian
• Format: Article
• Language: English
• Subjects: 639/166; 639/705; Algorithms; Cameras; Computer Simulation; Gestures; Humanities and Social Sciences; Humans; multidisciplinary; Science; Science (multidisciplinary); User-Computer Interface
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-022-21734-y

Virtual fitting can bring fast and convenient fitting experience for people. The two core problems of virtual fitting system are human–computer interaction and clothing simulation. Interaction is an important factor in determining the fitting experience. The previous virtual fitting products usually use the mouse and keyboard interaction, and users rarely have a good sense of substitution and interaction. While, the method of using multiple cameras to take user images from different angles and then carry out posture recognition has the defect of low recognition accuracy. In view of clothing simulation and human–computer interaction of virtual fitting system, in order to achieve better customer immersion experience, this paper implemented a real-time interactive virtual fitting system based on Microsoft Kinect motion sensing device, and proposed a gesture determination algorithm based on finger recognition and an image transfer algorithm based on skeleton information matching. Using OpenNI development library and multi-threading technology, we have developed a motion-sensing capture module and a complete real-time virtual fitting system, and the system test results show that it has a good user experience.