elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Towards a robust real time 3D reconstruction system for dynamic objects in static scenes

Sattler, Felix (2021) Towards a robust real time 3D reconstruction system for dynamic objects in static scenes. Master's, Westphalian University of Applied Sciences.

[img] PDF - Only accessible within DLR
22MB

Abstract

The surveillance of maritime infrastructures is an important part of maritime security. Especially harbours are highly active traffic zones with many different agents and infrastructures present. Surveillance of such areas therefore requires skilled operators, making fast security-related decisions. Situational awareness of these operators can be improved through the use of 3d reconstruction. It can be used as a tool to compress scene information and provide operators with more spatial and semantic detail about agents requiring less context switching. 3d reconstruction of static scenes has been an active area of research for several decades. Research on dynamic 3d reconstruction is still novel and mostly focused on autonomous navigation where a moving observer is present. In the context of surveillance, where the observer is static and scenes are dynamic, this work can not be readily applied. Furthermore, surveillance of maritime infrastructures often requires remote surveillance locations to cover large outdoor areas from an elevated point-of-view. To reduce system complexity and network bandwidth, 3d reconstruction can be performed using edge computing. However, research on dynamic 3d reconstruction for embedded systems is sparse. This work presents a prototype system that performs dynamic 3d reconstruction of dynamic agents in static scenes using an end-to-end parallel embedded architecture. The system is designed as a modular pipeline with different stages. First, static and dynamic image parts are segmented resulting in image masks for moving targets. Then, depth estimation is performed for the masked, dynamic targets. By removing the static image parts, traditional visual odometry techniques can be used to estimate target motion. This is due to the fact that the inverse ego-motion of the dynamic object can also be used to describe virtual camera around the object. Moving the virtual camera instead of assuming object motion, allows treating dynamic objects as static. Given these assumptions, the resulting color, depth and motion data can now be fused into a volumetric representation using truncated signed distance functions. The resulting reconstructed data can be sent over a network to perform real time rendering on client-side. Using real time 3d reconstructed data can improve situational awareness by aiding scene understanding and simplifying the decision-making context in complex maritime scenarios.

Item URL in elib:https://elib.dlr.de/193060/
Document Type:Thesis (Master's)
Title:Towards a robust real time 3D reconstruction system for dynamic objects in static scenes
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Sattler, FelixUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Date:August 2021
Refereed publication:Yes
Open Access:No
Status:Published
Keywords:situtational awareness, dynamic 3D reconstruction, real time monitoring, maritime safety and security
Institution:Westphalian University of Applied Sciences
Department:Informatics and Communication
HGF - Research field:other
HGF - Program:other
HGF - Program Themes:other
DLR - Research area:Digitalisation
DLR - Program:D DAT - Data
DLR - Research theme (Project):D - Digitaler Atlas 2.0
Location: Bremerhaven
Institutes and Institutions:Institute for the Protection of Maritime Infrastructures > Maritime Security Technologies
Deposited By: Sattler, Felix
Deposited On:09 Jan 2023 14:50
Last Modified:09 Jan 2023 14:50

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.