elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Bridging the Reality-Gap: 6-DoF Pose Estimation of Multiple Cars by a Deep CNN Trained on Synthetic Data

Lorenz, Benjamin (2020) Bridging the Reality-Gap: 6-DoF Pose Estimation of Multiple Cars by a Deep CNN Trained on Synthetic Data. Bachelor's, Humboldt-Universität zu Berlin.

[img] PDF
6MB

Abstract

Precise localization in the form of 6-DoF pose estimation is of great value in traffic scenario research. Convolutional neural networks yield robust, fast, and precise results but need huge amounts of annotated data. Obtaining such data in the real world is tedious and error-prone. In contrast, simulation allows automation of the data generation process by creating unlimited amounts of fully and correctly annotated synthetic data. But due to the lack of realism, networks trained on this data usually do not perform well on real data. Recent works bridged this so-called reality gap with synthetic data of high diversity, utilizing domain randomization and photorealistic synthetic data. The Deep Object Pose Estimation (DOPE) shows convincing results in detecting multiple different household objects for the task of robotic grasping. In the thesis I demonstrate that DOPE can be used for the domain of traffic monitoring, in which multiple objects of the same class, namely cars in traffic, are involved. For this purpose I create the synthetic 6-DoF pose estimation dataset MultiCarPose containing highly diverse scenes and utilize it for training DOPE. This allows me to show, that the domain change from robotic grasping to traffic monitoring is possible, that the trained model is able to perform the transition from synthetic to real data and that the pose of multiple objects of the same class in one image can be estimated.

Item URL in elib:https://elib.dlr.de/139649/
Document Type:Thesis (Bachelor's)
Title:Bridging the Reality-Gap: 6-DoF Pose Estimation of Multiple Cars by a Deep CNN Trained on Synthetic Data
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iD
Lorenz, BenjaminBenjamin.Lorenz (at) dlr.deUNSPECIFIED
Date:14 September 2020
Refereed publication:No
Open Access:Yes
Gold Open Access:No
In SCOPUS:No
In ISI Web of Science:No
Number of Pages:39
Status:Published
Keywords:Pose Estimation, 6-DoF, Machine Learning, Convolutional Neural Network, CNN, Synthetic Data, Reality-Gap, Domain Adaptation,
Institution:Humboldt-Universität zu Berlin
Department:Institut für Informatik
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Transport
HGF - Program Themes:Transport System
DLR - Research area:Transport
DLR - Program:V VS - Verkehrssystem
DLR - Research theme (Project):V - I4Port
Location: Berlin-Adlershof
Institutes and Institutions:Institute of Transportation Systems
Deposited By: Lorenz, Benjamin
Deposited On:17 Dec 2020 21:19
Last Modified:17 Dec 2020 21:19

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.