Full Text Available
Note: Clicking the button above will open the full text document at the original institutional repository in a new window.
A Low-cost autonomous tracking camera system for 3d marker-less motion capture of animals in the wild
The study of natural movement has long fascinated scientists, engineers and doctors. Today, motion capture research not only aids in medical diagnostics and rehabilitation but also enhances game and movie animations. Additionally, it contributes to the understanding of complex organic motions, infor...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | English English |
| Published: |
Department of Electrical Engineering
2026
|
| Subjects: | |
| Tags: |
No Tags, Be the first to tag this record!
|
| _version_ | 1867613239953588224 |
|---|---|
| access_status_str | Open Access |
| author | Vally, Amaan |
| author2 | Patel, Amir |
| author_browse | Patel, Amir Vally, Amaan |
| author_facet | Patel, Amir Vally, Amaan |
| author_sort | Vally, Amaan |
| collection | Thesis |
| description | The study of natural movement has long fascinated scientists, engineers and doctors. Today, motion capture research not only aids in medical diagnostics and rehabilitation but also enhances game and movie animations. Additionally, it contributes to the understanding of complex organic motions, informing the design of efficient, nature-mimicking robots. A large proportion of the research of human and animal motion capture relies on data captured using directional sensors with a limited field of view, such as RGB (red green blue) or RGB-D (red green blue-depth) cameras. Physical constraints limit the amount of data that can be collected with a single sensor (or set of sensors) since the subject is typically constrained to a specific capture area based on the sensor's field of view (FOV). This study focuses on the development of a camera-based system that can autonomously track a moving animal using rotating cameras to increase the amount of usable data that can be collected. In the pursuit of this objective, two systems were developed and tested. The first system consisted of a set of three cameras fixed to a rigid platform, with a camera on each end and the third midway between them. The platform was fixed to a brush-less DC (Direct Current) motor with the middle camera directly above the motor shaft. The second system consisted of an independent rotating camera fixed to the shaft of a brush-less DC motor. For both systems, the subject's position in the image frame of the camera mounted above the axis of rotation was determined using YOLO (You Only Look Once), a state-of-the-art object detection neural network. An extended Kalman filter (EKF) and full state feedback (FSF) controller were used to control the motor's position to keep the subject in the centre of the camera frame. DeepLabCut (DLC) was used to extract 2D key-points, and then a trajectory optimisation-based 3D pose estimation method called Full Trajectory Estimation (FTE) was used to reconstruct the 3D trajectories of the subject. Quantitative and qualitative experimental results are provided to validate the systems performance. Finally, this study concludes with recommendations for enhancing the system's performance, alongside proposed directions for future research and development in this field. |
| format | Thesis |
| id | oai:open.uct.ac.za:11427/42732 |
| institution | University of Cape Town (South Africa) |
| language | English eng |
| last_indexed | 2026-06-10T12:32:58.612Z |
| license_str | Not specified — see source repository |
| provenance_str_mv | Harvested via OAI-PMH from UCTD — University of Cape Town Open Access Repository |
| publishDate | 2026 |
| publishDateRange | 2026 |
| publishDateSort | 2026 |
| publisher | Department of Electrical Engineering |
| publisherStr | Department of Electrical Engineering |
| record_format | dspace |
| source_str | UCTD — University of Cape Town Open Access Repository |
| spelling | oai:open.uct.ac.za:11427/42732 A Low-cost autonomous tracking camera system for 3d marker-less motion capture of animals in the wild Vally, Amaan Patel, Amir Amayo, Paul electrical engineering The study of natural movement has long fascinated scientists, engineers and doctors. Today, motion capture research not only aids in medical diagnostics and rehabilitation but also enhances game and movie animations. Additionally, it contributes to the understanding of complex organic motions, informing the design of efficient, nature-mimicking robots. A large proportion of the research of human and animal motion capture relies on data captured using directional sensors with a limited field of view, such as RGB (red green blue) or RGB-D (red green blue-depth) cameras. Physical constraints limit the amount of data that can be collected with a single sensor (or set of sensors) since the subject is typically constrained to a specific capture area based on the sensor's field of view (FOV). This study focuses on the development of a camera-based system that can autonomously track a moving animal using rotating cameras to increase the amount of usable data that can be collected. In the pursuit of this objective, two systems were developed and tested. The first system consisted of a set of three cameras fixed to a rigid platform, with a camera on each end and the third midway between them. The platform was fixed to a brush-less DC (Direct Current) motor with the middle camera directly above the motor shaft. The second system consisted of an independent rotating camera fixed to the shaft of a brush-less DC motor. For both systems, the subject's position in the image frame of the camera mounted above the axis of rotation was determined using YOLO (You Only Look Once), a state-of-the-art object detection neural network. An extended Kalman filter (EKF) and full state feedback (FSF) controller were used to control the motor's position to keep the subject in the centre of the camera frame. DeepLabCut (DLC) was used to extract 2D key-points, and then a trajectory optimisation-based 3D pose estimation method called Full Trajectory Estimation (FTE) was used to reconstruct the 3D trajectories of the subject. Quantitative and qualitative experimental results are provided to validate the systems performance. Finally, this study concludes with recommendations for enhancing the system's performance, alongside proposed directions for future research and development in this field. 2026-01-28T11:45:16Z 2026-01-28T11:45:16Z 2025 2026-01-28T11:38:46Z Thesis / Dissertation Masters MSc http://hdl.handle.net/11427/42732 en eng application/pdf Department of Electrical Engineering Faculty of Engineering and the Built Environment University of Cape Town |
| spellingShingle | electrical engineering Vally, Amaan A Low-cost autonomous tracking camera system for 3d marker-less motion capture of animals in the wild |
| thesis_degree_str | Master's |
| title | A Low-cost autonomous tracking camera system for 3d marker-less motion capture of animals in the wild |
| title_full | A Low-cost autonomous tracking camera system for 3d marker-less motion capture of animals in the wild |
| title_fullStr | A Low-cost autonomous tracking camera system for 3d marker-less motion capture of animals in the wild |
| title_full_unstemmed | A Low-cost autonomous tracking camera system for 3d marker-less motion capture of animals in the wild |
| title_short | A Low-cost autonomous tracking camera system for 3d marker-less motion capture of animals in the wild |
| title_sort | low cost autonomous tracking camera system for 3d marker less motion capture of animals in the wild |
| topic | electrical engineering |
| url | http://hdl.handle.net/11427/42732 |
| work_keys_str_mv | AT vallyamaan alowcostautonomoustrackingcamerasystemfor3dmarkerlessmotioncaptureofanimalsinthewild AT vallyamaan lowcostautonomoustrackingcamerasystemfor3dmarkerlessmotioncaptureofanimalsinthewild |