DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Representation Learning for Robot Keypoint Detection using Prior Kinematic Knowledge

Klüpfel, Leonard (2022) Representation Learning for Robot Keypoint Detection using Prior Kinematic Knowledge. Master's, Technical University of Munich.

[img] PDF


We introduce the Prior Knowledge Robot Keypoint Detection (PK-ROKED) approach for 2D keypoint detection on a robot arm. Our proposed method comprises a Deep Learning network, which learns a representation of keypoints based on prior kinematic knowledge and monocular RGB images. This allows us to provide robust visual feedback for state estimations on a robot arm pose, as this pose can be inaccurate due to imprecise forward kinematics. We incorporate the prior kinematic knowledge about potential keypoint locations into the detection network by concatenating it to the input image. These potential keypoints are derived by forward kinematics, which can be faulty with a bounded error. Hence, this additional information can only indicate and steer the detection algorithm to assumed keypoint locations in image space. Additionally, our approach approximates the uncertainty of a keypoint detection through Monte Carlo Dropout and image moments. To this end, PK-ROKED is trained on the respective synthetic data of a robot arm, which we conduct for two different robot arm models. The resulting performance is evaluated on real-world datasets. We observe our PK-ROKED approach to outperform a baseline network, which we defined for benchmarking. Furthermore, when incorporating our prior knowledge approach into the baseline network we can observe a performance increase compared to without this additional information. To test the robustness of our algorithm, we qualitatively evaluate on challenging data from a space-analogue mission, which demonstrates our approach being potentially deployable in such an environment.

Item URL in elib:https://elib.dlr.de/189082/
Document Type:Thesis (Master's)
Title:Representation Learning for Robot Keypoint Detection using Prior Kinematic Knowledge
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Date:15 September 2022
Journal or Publication Title:Representation Learning for Robot Keypoint Detection using Prior Kinematic Knowledge
Refereed publication:No
Open Access:Yes
Number of Pages:88
Keywords:robot pose correction, deep learning, pose estimation, keypoint detection
Institution:Technical University of Munich
Department:Department of Informatics
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Robotics
DLR - Research area:Raumfahrt
DLR - Program:R RO - Robotics
DLR - Research theme (Project):R - Basic Technologies [RO], R - Planetary Exploration
Location: Oberpfaffenhofen
Institutes and Institutions:Institute of Robotics and Mechatronics (since 2013)
Deposited By: Burkhard, Lukas
Deposited On:17 Oct 2022 15:35
Last Modified:01 Mar 2023 10:37

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.