X3DFast model for classifying dairy cow behaviors based on a two-pathway architecture

• Published in: Scientific reports 2023-11, Vol.13 (1), p.20519-20519, Article 20519
• Main Authors: Bai, Qiang, Gao, Ronghua, Wang, Rong, Li, Qifeng, Yu, Qinyang, Zhao, Chunjiang, Li, Shuqin
• Format: Article
• Language: English
• Subjects: 631/114/1305; 631/1647/2198; Animal Husbandry; Animals; Behavior; Behavior, Animal - physiology; Cattle; Convolution; Dairy cattle; Dairy farms; Dairying - methods; Data collection; Deep learning; Farms; Female; Health problems; Humanities and Social Sciences; Humans; Lactation; Medical treatment; multidisciplinary; Science; Science (multidisciplinary); Temporal variations; Walking
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-023-45211-2

Behavior is one of the important factors reflecting the health status of dairy cows, and when dairy cows encounter health problems, they exhibit different behavioral characteristics. Therefore, identifying dairy cow behavior not only helps in assessing their physiological health and disease treatment but also improves cow welfare, which is very important for the development of animal husbandry. The method of relying on human eyes to observe the behavior of dairy cows has problems such as high labor costs, high labor intensity, and high fatigue rates. Therefore, it is necessary to explore more effective technical means to identify cow behaviors more quickly and accurately and improve the intelligence level of dairy cow farming. Automatic recognition of dairy cow behavior has become a key technology for diagnosing dairy cow diseases, improving farm economic benefits and reducing animal elimination rates. Recently, deep learning for automated dairy cow behavior identification has become a research focus. However, in complex farming environments, dairy cow behaviors are characterized by multiscale features due to large scenes and long data collection distances. Traditional behavior recognition models cannot accurately recognize similar behavior features of dairy cows, such as those with similar visual characteristics, i.e., standing and walking. The behavior recognition method based on 3D convolution solves the problem of small visual feature differences in behavior recognition. However, due to the large number of model parameters, long inference time, and simple data background, it cannot meet the demand for real-time recognition of dairy cow behaviors in complex breeding environments. To address this, we developed an effective yet lightweight model for fast and accurate dairy cow behavior feature learning from video data. We focused on four common behaviors: standing, walking, lying, and mounting. We recorded videos of dairy cow behaviors at a dairy farm containing over one hundred cows using surveillance cameras. A robust model was built using a complex background dataset. We proposed a two-pathway X3DFast model based on spatiotemporal behavior features. The X3D and fast pathways were laterally connected to integrate spatial and temporal features. The X3D pathway extracted spatial features. The fast pathway with R(2 + 1)D convolution decomposed spatiotemporal features and transferred effective spatial features to the X3D pathway. An action model further enh