Towards Estimation of 3D Poses and Shapes of Animals from Oblique Drone Imagery

Wildlife research in both terrestrial and aquatic ecosystems now deploys drone technology for tasks such as monitoring, census counts and habitat analysis. Unlike camera traps, drones offer real-time flexibility for adaptable flight paths and camera views, thus making them ideal for capturing multi-...

Full description

Saved in:
Bibliographic Details
Main Authors: Shukla, Vandita, Morelli, Luca, Remondino, Fabio, Micheli, Andrea, Tuia, Devis, Risse, Benjamin
Format: Conference Proceeding
Language:English
Subjects:
Animal models
Animals
Aquatic ecosystems
Cameras
Image reconstruction
Imagery
Photogrammetry
Pose estimation
Shape
Unmanned aerial vehicles
Wildlife
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Wildlife research in both terrestrial and aquatic ecosystems now deploys drone technology for tasks such as monitoring, census counts and habitat analysis. Unlike camera traps, drones offer real-time flexibility for adaptable flight paths and camera views, thus making them ideal for capturing multi-view data on wildlife like zebras or lions. With recent advancements in animals’ 3D shape & pose estimation, there is an increasing interest in bringing 3D analysis from ground to sky by means of drones. The paper reports some activities of the EU-funded WildDrone project and performs, for the first time, 3D analyses of animals exploiting oblique drone imagery. Using parametric model fitting, we estimate 3D shape and pose of animals from frames of a monocular RGB video. With the goal of appending metric information to parametric animal models using photogrammetric evidence, we propose a pipeline where we perform a point cloud reconstruction of the scene to scale and localize the animal within the 3D scene. Challenges, planned next steps and future directions are also reported.
ISSN:1682-1750
2194-9034
DOI:10.5194/isprs-archives-XLVIII-2-2024-379-2024