DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Real-Time Texture-based 3D Object Tracking for Advanced Robotic Manipulation

Elsayed, Mariam (2021) Real-Time Texture-based 3D Object Tracking for Advanced Robotic Manipulation. DLR-Interner Bericht. DLR-IB-RM-OP-2021-137. Master's. Technical University of Munich. 75 S.

[img] PDF - Only accessible within DLR


In many applications, the 6 DoF pose of an object is required. This includes roboticapplications, such as in-hand manipulation by an anthropomorphic robot and ap-plications in augmented reality to link the real-world with augmented objects. Forthese purposes, optical tracking has been used due to its low financial cost and flex-ible algorithms. However, it is still a challenge to have a versatile tracker that canprovide accurate pose estimates for objects with different properties. Specifically,applications of in-hand manipulation pose constraints on the tracker, like the com-putational efficiency and the ability to handle possible occlusions. These challengeshave motivated methods that rely on different information, such as edges or objectsilhouette. While these approaches work well for complex objects, they strugglewith objects that have non-distinct shapes and result in pose ambiguities.To minimize this problem, we develop a texture-based tracking modality that con-siders feature points on the object surface to estimate the pose. Each new poseusually depends on the pose estimation from a previous frame, leading to possibleerror accumulation. While this does not greatly impact the performance in manyscenarios, the drift error can be minimized by including a fixed reference of the objectcharacteristics. For this purpose, we additionally develop a framework to generate asparse feature map of a tracked object, which acts as a fixed reference during furthertracking instances. The complete texture-based tracking modality is then combinedwith an existing region-based tracker in a multi-modality framework. This exploitsthe advantages of both methods and results in an accurate, robust tracker. Finally,we perform a threefold evaluation on the RBOT dataset, YCB video dataset, anda self-recorded sequence to assess the performance of the tracker and compare it tothe current state of the art. The results show that the combined tracker deliverssuperior tracking performance to existing methods.

Item URL in elib:https://elib.dlr.de/144277/
Document Type:Monograph (DLR-Interner Bericht, Master's)
Title:Real-Time Texture-based 3D Object Tracking for Advanced Robotic Manipulation
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Date:21 September 2021
Refereed publication:No
Open Access:No
Number of Pages:75
Keywords:6 dof object tracking, feature-based, texture-based
Institution:Technical University of Munich
Department:Department of Electrical and Computer Engineering
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Robotics
DLR - Research area:Raumfahrt
DLR - Program:R RO - Robotics
DLR - Research theme (Project):R - Multisensory World Modelling (RM) [RO]
Location: Oberpfaffenhofen
Institutes and Institutions:Institute of Robotics and Mechatronics (since 2013)
Deposited By: Elsayed, Mariam
Deposited On:07 Oct 2021 09:58
Last Modified:22 Nov 2022 11:56

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.