Augmenting cattle tracking efficiency through monocular depth estimation

Dickson, Lewis T. and Davison, Christopher and Michie, Craig and McRobert, Ewan and Atkinson, Robert and Andonovic, Ivan and Ferguson, Holly and Dewhurst, Richard and Briddock, Roger and Brooking, Mark and Pavlovic, Dejan and Marko, Oskar and Crnojevic, Vladimir and Tachtatzis, Christos (2024) Augmenting cattle tracking efficiency through monocular depth estimation. In: IEEE Conference on AgriFood Electronics, 2024-09-26 - 2024-09-28.

[thumbnail of Dickson-etal-CAFE2024-Augmenting-cattle-tracking-efficiency]
Preview
 Text. Filename: Dickson-etal-CAFE2024-Augmenting-cattle-tracking-efficiency.pdf
Accepted Author Manuscript
License: Creative Commons Attribution 4.0 logo
Download (2MB)| Preview

Abstract

We present a method for 3D cattle tracking and inter-camera pose transformation using depth information from monocular depth estimation with deep networks. Camera-based animal monitoring offers a minimally invasive and easily adaptable solution for tracking and welfare monitoring, relying solely on commercial RGB camera systems. However, environmental factors and inter-animal occlusion often hinder tracking efficacy and consistency. To address these challenges, we developed a pipeline to extract 3D point cloud data of individual cows in a straw-bedded calving yard environment, generating quasi-3D bounding boxes (x, y, z, height, width, θ), where θ is the polar angle. We then estimate the camera system extrinsic parameters by minimising the rotation, translation, and scale discrepancies between the apparent motion of animals across different frames of reference. This approach demonstrates a strong agreement between the 3D centroids of tracked animals in motion. Our work advances the development of algorithmic occlusion handling and object handover techniques in multi-camera systems, particularly pertinent to the high-occlusion, low-locomotion scenario of animals within barn environments.

ORCID iDs

Dickson, Lewis T. ORCID logoORCID: https://orcid.org/0000-0002-5200-7525, Davison, Christopher ORCID logoORCID: https://orcid.org/0000-0002-9450-1791, Michie, Craig ORCID logoORCID: https://orcid.org/0000-0001-5132-4572, McRobert, Ewan, Atkinson, Robert ORCID logoORCID: https://orcid.org/0000-0002-6206-2229, Andonovic, Ivan ORCID logoORCID: https://orcid.org/0000-0001-9093-5245, Ferguson, Holly, Dewhurst, Richard, Briddock, Roger, Brooking, Mark, Pavlovic, Dejan, Marko, Oskar, Crnojevic, Vladimir and Tachtatzis, Christos ORCID logoORCID: https://orcid.org/0000-0001-9150-6805;
CORE (COnnecting REpositories)