康熙, 李树东, 张旭东, 刘刚. 基于热红外视频的奶牛跛行运动特征提取与检测[J]. 农业工程学报, 2021, 37(23): 169-178. DOI: 10.11975/j.issn.1002-6819.2021.23.020
    引用本文: 康熙, 李树东, 张旭东, 刘刚. 基于热红外视频的奶牛跛行运动特征提取与检测[J]. 农业工程学报, 2021, 37(23): 169-178. DOI: 10.11975/j.issn.1002-6819.2021.23.020
    Kang Xi, Li Shudong, Zhang Xudong, Liu Gang. Features extraction and detection of cow lameness movement based on thermal infrared videos[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2021, 37(23): 169-178. DOI: 10.11975/j.issn.1002-6819.2021.23.020
    Citation: Kang Xi, Li Shudong, Zhang Xudong, Liu Gang. Features extraction and detection of cow lameness movement based on thermal infrared videos[J]. Transactions of the Chinese Society of Agricultural Engineering (Transactions of the CSAE), 2021, 37(23): 169-178. DOI: 10.11975/j.issn.1002-6819.2021.23.020

    基于热红外视频的奶牛跛行运动特征提取与检测

    Features extraction and detection of cow lameness movement based on thermal infrared videos

    • 摘要: 针对基于可见光视频的奶牛跛行检测系统易受光线、环境变化因素影响的问题,该研究提出了一种基于热红外视频的奶牛跛行运动特征获取与检测的方法。该研究利用深度学习与传统图像处理方法,分别对热红外相机与可见光相机所拍摄的奶牛行走视频进行了奶牛跛行运动特征的提取检测。通过检测结果分析可知,相较于可见光图像,算法对于热红外图像中的奶牛跛行运动特征检测效果更好、准确率更高并且热红外图像可以有效减少光线等外界因素对特征提取的影响,利用深度学习与传统图像处理对运动特征检测的平均精度达到了90.84%与74.26%。研究利用弓背曲率分别针对热红外视频与可见光视频中的行走奶牛进行跛行检测试验,试验结果表明,针对热红外视频中的奶牛跛行检测精度为90.0%,Macro-F1为0.90;针对可见光视频中的奶牛跛行检测精度为83.3%,Macro-F1为0.83。研究表明热红外相机应用于计算机视觉奶牛跛行检测系统可以更好的实现奶牛跛行运动特征获取与跛行检测,有效提高检测准确性与鲁棒性。

       

      Abstract: Lameness is an abnormal gait or stance of an animal, indicating a more severe disorder of the locomotion system. The disturbance in the gait and body has posed a great threat to the welfare, health, and production of dairy cows in the herds. An early observation is typically performed on the sudden change in gait during day-to-day dairy practices. However, the current detection of lameness was widely used in the 2D cow video, particularly susceptible to light and environmental inferences. In this study, a novel approach was proposed to extract the movement features of the lameness cows using thermal infrared video under deep learning and image processing, in order to improve the detection accuracy and robustness against the complex illumination and environmental disturbances. Taking the multiparous lactating Holstein cows as the study objects, the datasets were collected at the Dingyuan farm in Hebei Province of China in September 2020. The gait features of lameness were related to the head, hoof, back, shoulder, and hip of cows. The performances of different target detection were then evaluated on the dataset of locomotion features from the thermal infrared and 2D images of cows walking. The results showed that the average accuracies of deep learning for the detection of cows locomotion features were 90.84%, 86.68%, and 79.68%, respectively, in the thermal infrared, daylight, and daylight images, whereas, those in the traditional image processing were 74.26%, 54.31%, and 48.95%, respectively. The test results demonstrated that the target detection of deep learning and image processing performed better on the thermal infrared images, compared with the 2D images. The thermal infrared images had effectively reduced the influences of external factors, such as the light and background. In addition, a lameness detection test was conducted on the walking cows using the thermal infrared video and 2D video, according to the arched curvature. It was found that the detection accuracies of cow lameness in the thermal infrared and 2D video were 90.0% and 83.3%, respectively, where the values of Macro-F1 were 0.90 and 0.83, respectively. Consequently, a better performance was achieved for the application of thermal infrared cameras in cow lameness detection using computer vision. This finding can provide a new potential strategy for the timely diagnosis and prevention of abnormal gait in cows in the dairy farming industry.

       

    /

    返回文章
    返回