DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Real-Time In-Hand Object Tracking and Sensor Fusion for Advanced Robotic Manipulation

Stoiber, Manuel (2019) Real-Time In-Hand Object Tracking and Sensor Fusion for Advanced Robotic Manipulation. DLR-Interner Bericht. DLR-IB-RM-OP-2020-7. Master's. Technical University of Munich. 101 S.

[img] PDF - Only accessible within DLR


In recent years, continuous research has led to robotic hands that are perfectly suitable for in-hand manipulation. To execute such tasks and for example move a pen, the pose of the object is required. While a wide range of algorithms is available to track objects visually, most of those methods suffer if large parts of the object are occluded, which is typically the case during in-hand manipulation. To provide a robust pose estimate under such circumstances, it is desirable to fuse vision-based results with additional information from the robot hand, such as joint angles and torques. This, however, requires an estimate of the tracker’s uncertainty, which is typically not provided by state-of-the-art algorithms. In order to address those challenges, this thesis proposes a novel probabilistic tracking framework that not only provides an estimate of the current pose but also of its uncertainty. It employs both an ICP-based modality to incorporate depth information and a region-based modality to utilise contour information from RGB images. For the region-based modality, the current state of the art is significantly extended with the development of a probabilistic model that features ray correspondences and an efficient scale space implementation. Additionally, a novel mathematical proof is derived that shows that the new modality has Gaussian properties. For the resulting multi-modality tracker, a real-time capable implementation is created that considers occlusions using both explicit and implicit information from rendered masks and depth images. The tracker is integrated on the DLR robot system David and incorporated in the existing EKF-based in-hand localisation framework. Finally, a thorough validation in a wide range of experiments is conducted to evaluate all aspects of the tracker’s performance.

Item URL in elib:https://elib.dlr.de/133861/
Document Type:Monograph (DLR-Interner Bericht, Master's)
Title:Real-Time In-Hand Object Tracking and Sensor Fusion for Advanced Robotic Manipulation
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Stoiber, ManuelUNSPECIFIEDhttps://orcid.org/0000-0002-0762-9288UNSPECIFIED
Date:15 May 2019
Refereed publication:No
Open Access:No
Number of Pages:101
Keywords:6DoF object tracking, Gaussian uncertainty estimation, sensor fusion
Institution:Technical University of Munich
Department:Department of Informatics
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Space System Technology
DLR - Research area:Raumfahrt
DLR - Program:R SY - Space System Technology
DLR - Research theme (Project):R - Vorhaben Multisensorielle Weltmodellierung (old)
Location: Oberpfaffenhofen
Institutes and Institutions:Institute of Robotics and Mechatronics (since 2013)
Deposited By: Stoiber, Manuel
Deposited On:08 Dec 2020 14:49
Last Modified:08 Dec 2020 14:49

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.