Durner, Maximilian and Boerdijk, Wout and Fanger, Yunis and Sakagami, Ryo and Risch, David Lennart and Triebel, Rudolph and Wedler, Armin (2023) Autonomous Rock Instance Segmentation for Extra-Terrestrial Robotic Missions. In: 2023 IEEE Aerospace Conference, AERO 2023. IEEE. 2023 IEEE Aerospace Conference, 2023-03-04 - 2023-03-11, Big Sky, USA. doi: 10.1109/AERO55745.2023.10115717. ISBN 978-166549032-0. ISSN 1095-323X.
PDF
49MB |
Official URL: https://ieeexplore.ieee.org/document/10115717
Abstract
The collection and analysis of extra-terrestrial matter are two of the main motivations for space exploration missions. Due to the inherent risks for participating astronauts during space missions, autonomous robotic systems are often consid- ered as a promising alternative. In recent years, many (in- ter)national space missions containing rovers to explore celestial bodies have been launched. Hereby, the communication delay as well as limited bandwidth creates a need for highly self-governed agents that require only infrequent interaction with scientists at a ground station. Such a setting is explored in the ARCHES mis- sion, which seeks to investigate different means of collaboration between scientists and autonomous robots in extra-terrestrial environments. The analog mission focuses a team of hetero- geneous agents (two Lightweight Rover Units and ARDEA, a drone), which together perform various complex tasks under strict communication constraints. In this paper, we highlight three of these tasks that were successfully demonstrated during a one-month test mission on Mt. Etna in Sicily, Italy, which was chosen due to its similarity to the Moon in terms of geological structure. All three tasks have in common, that they leverage an instance segmentation approach deployed on the rovers to detect rocks within camera imagery. The first application is a map- ping scheme that incorporates semantically detected rocks into its environment model to safely navigate to points of interest. Secondly, we present a method for the collection and extraction of in-situ samples with a rover, which uses rock detection to localize relevant candidates to grasp. For the third task, we show the usefulness of stone segmentation to autonomously conduct a spectrometer measurement experiment. We perform a throughout analysis of the presented methods and evaluate our experimental results. The demonstrations on Mt. Etna show that our approaches are well suited for navigation, geological analysis, and sample extraction tasks within autonomous robotic extra-terrestrial missions.
Item URL in elib: | https://elib.dlr.de/195136/ | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Document Type: | Conference or Workshop Item (Speech) | ||||||||||||||||||||||||||||||||
Title: | Autonomous Rock Instance Segmentation for Extra-Terrestrial Robotic Missions | ||||||||||||||||||||||||||||||||
Authors: |
| ||||||||||||||||||||||||||||||||
Date: | 15 May 2023 | ||||||||||||||||||||||||||||||||
Journal or Publication Title: | 2023 IEEE Aerospace Conference, AERO 2023 | ||||||||||||||||||||||||||||||||
Refereed publication: | Yes | ||||||||||||||||||||||||||||||||
Open Access: | Yes | ||||||||||||||||||||||||||||||||
Gold Open Access: | No | ||||||||||||||||||||||||||||||||
In SCOPUS: | Yes | ||||||||||||||||||||||||||||||||
In ISI Web of Science: | Yes | ||||||||||||||||||||||||||||||||
DOI: | 10.1109/AERO55745.2023.10115717 | ||||||||||||||||||||||||||||||||
Publisher: | IEEE | ||||||||||||||||||||||||||||||||
ISSN: | 1095-323X | ||||||||||||||||||||||||||||||||
ISBN: | 978-166549032-0 | ||||||||||||||||||||||||||||||||
Status: | Published | ||||||||||||||||||||||||||||||||
Keywords: | rock, stone, instance segmentation, autonomous manipulation, exploration, moon, analogue mission, stereo | ||||||||||||||||||||||||||||||||
Event Title: | 2023 IEEE Aerospace Conference | ||||||||||||||||||||||||||||||||
Event Location: | Big Sky, USA | ||||||||||||||||||||||||||||||||
Event Type: | international Conference | ||||||||||||||||||||||||||||||||
Event Start Date: | 4 March 2023 | ||||||||||||||||||||||||||||||||
Event End Date: | 11 March 2023 | ||||||||||||||||||||||||||||||||
HGF - Research field: | Aeronautics, Space and Transport | ||||||||||||||||||||||||||||||||
HGF - Program: | Space | ||||||||||||||||||||||||||||||||
HGF - Program Themes: | Robotics | ||||||||||||||||||||||||||||||||
DLR - Research area: | Raumfahrt | ||||||||||||||||||||||||||||||||
DLR - Program: | R RO - Robotics | ||||||||||||||||||||||||||||||||
DLR - Research theme (Project): | R - Multisensory World Modelling (RM) [RO] | ||||||||||||||||||||||||||||||||
Location: | Oberpfaffenhofen | ||||||||||||||||||||||||||||||||
Institutes and Institutions: | Institute of Robotics and Mechatronics (since 2013) Institute of Robotics and Mechatronics (since 2013) > Perception and Cognition Institute of Robotics and Mechatronics (since 2013) > Cognitive Robotics | ||||||||||||||||||||||||||||||||
Deposited By: | Durner, Maximilian | ||||||||||||||||||||||||||||||||
Deposited On: | 16 May 2023 13:39 | ||||||||||||||||||||||||||||||||
Last Modified: | 24 Apr 2024 20:55 |
Repository Staff Only: item control page