Affective Recommender System for Pet Social Network

• Published in: Sensors (Basel, Switzerland) Switzerland), 2022-09, Vol.22 (18), p.6759
• Main Authors: Cheng, Wai Khuen, Leong, Wai Chun, Tan, Joi San, Hong, Zeng-Wei, Chen, Yen-Lin
• Format: Article
• Language: English
• Subjects: affective recommendation; Behavior; deep learning; dog barking recognition; Dog owners; Dogs; Emotion recognition; emotion recognition model; Emotions; Households; Internet of Things; Object recognition (Computers); Pattern recognition; pet social network; Recommender systems; Sensors; Smart buildings; Smartphones; Social networks; Technology application; Testing
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s22186759

In this new era, it is no longer impossible to create a smart home environment around the household. Moreover, users are not limited to humans but also include pets such as dogs. Dogs need long-term close companionship with their owners; however, owners may occasionally need to be away from home for extended periods of time and can only monitor their dogs’ behaviors through home security cameras. Some dogs are sensitive and may develop separation anxiety, which can lead to disruptive behavior. Therefore, a novel smart home solution with an affective recommendation module is proposed by developing: (1) an application to predict the behavior of dogs and, (2) a communication platform using smartphones to connect with dog friends from different households. To predict the dogs’ behaviors, the dog emotion recognition and dog barking recognition methods are performed. The ResNet model and the sequential model are implemented to recognize dog emotions and dog barks. The weighted average is proposed to combine the prediction value of dog emotion and dog bark to improve the prediction output. Subsequently, the prediction output is forwarded to a recommendation module to respond to the dogs’ conditions. On the other hand, the Real-Time Messaging Protocol (RTMP) server is implemented as a platform to contact a dog’s friends on a list to interact with each other. Various tests were carried out and the proposed weighted average led to an improvement in the prediction accuracy. Additionally, the proposed communication platform using basic smartphones has successfully established the connection between dog friends.