DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Visual-Inertial RGB-D Mapping for Quadruped Locomotion

Mühlbauer, Maximilian Sebastian (2020) Visual-Inertial RGB-D Mapping for Quadruped Locomotion. DLR-Interner Bericht. DLR-IB-RM-OP-2020-179. Master's. Technische Universität München.

[img] PDF - Only accessible within DLR


Quadruped Locomotion can profit from a local map by determining optimal foot placement locations and planning the foot motion knowing the ground height at foot position. Rapid motion of the robot necessites a robust yet accurate method to estimate odometry able to deal with high amounts of motion blur. In this work, the Realsense D435i RGB-D camera equipped with an IMU (both accelerometer and gyroscope) is used in a dense visual-inertial odometry algorithm to infer the motion. The dense odometry algorithm is based on DVO, it uses depth and intensity information for odometry estimation. It is fused in a tightly-coupled manner in a Gauss-Newton optimization scheme with the preintegrated IMU data. The vision sensor and IMU are calibrated using the algorithm of Rehder et al. Dense visual descriptor learning is being evaluated to relax the brightness constancy assumption and to improve the robustness to motion blur. Different network architectures are trained to output features at different scales. Two approaches for training are being evaluated, one using pixel-wise loss functions and the other using two RGB-D images as input which are then aligned using a differentiable implementation of DVO. The effectiveness of the full algorithm is evaluated on the ETH3D benchmark which contains accurately calibrated and synchronized RGB-D and IMU data. It is shown that the algorithm is in principal suitable for the problem of quadruped locomotion. Its accuracy however highly depends on the environment and the depth sensor quality. Thus, several possible future research directions are proposed to better deal with these deficiencies.

Item URL in elib:https://elib.dlr.de/137809/
Document Type:Monograph (DLR-Interner Bericht, Master's)
Title:Visual-Inertial RGB-D Mapping for Quadruped Locomotion
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Mühlbauer, Maximilian SebastianUNSPECIFIEDhttps://orcid.org/0000-0002-7635-0248UNSPECIFIED
Refereed publication:No
Open Access:No
Keywords:SLAM, Mapping, RGB-D, Quadrupped Locomotion, Robotics
Institution:Technische Universität München
Department:Fakultät für Informatik
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Space System Technology
DLR - Research area:Raumfahrt
DLR - Program:R SY - Space System Technology
DLR - Research theme (Project):R - Vorhaben Multisensorielle Weltmodellierung (old)
Location: Oberpfaffenhofen
Institutes and Institutions:Institute of Robotics and Mechatronics (since 2013) > Perception and Cognition
Deposited By: Sewtz, Marco
Deposited On:24 Nov 2020 17:24
Last Modified:28 Mar 2023 23:57

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.