Fichtner, Florian Willy and Mandery, Nico and Schwinger, Maximilian and Eberle, Jonas and Nolde, Michael and Riedlinger, Torsten (2021) Scalable Processing Of Copernicus Sentinel satellite Images Using Argo Workflows. Big Data from Space 2021, 2021-05-18 - 2021-05-20, Bukarest, Rumänien. doi: 10.2760/125905. ISBN 978-92-76-37661-3. ISSN 1831-9424.
Full text not available from this repository.
Official URL: https://doi.org/10.2760/125905
Abstract
With the goal of using a pool of resources dynamically for different applications we migrated scientific Earth Observation processors from dedicated Virtual Machines into a centralized cloud. Processing in this environment works using off-the-shelf components like Kubernetes, Docker and Argo Workflows. We were able to benefit from sharing data, tools and infrastructure in between processors. To showcase the new workflow or pipeline by means of an example we use our burnt area monitoring processor based on Sentinel-3 satellite data. A new architecture based on existing components was established, which we plan to extend it in the future.
Item URL in elib: | https://elib.dlr.de/142309/ | ||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Document Type: | Conference or Workshop Item (Speech) | ||||||||||||||||||||||||||||
Title: | Scalable Processing Of Copernicus Sentinel satellite Images Using Argo Workflows | ||||||||||||||||||||||||||||
Authors: |
| ||||||||||||||||||||||||||||
Date: | 18 May 2021 | ||||||||||||||||||||||||||||
Refereed publication: | Yes | ||||||||||||||||||||||||||||
Open Access: | No | ||||||||||||||||||||||||||||
Gold Open Access: | No | ||||||||||||||||||||||||||||
In SCOPUS: | No | ||||||||||||||||||||||||||||
In ISI Web of Science: | No | ||||||||||||||||||||||||||||
DOI: | 10.2760/125905 | ||||||||||||||||||||||||||||
Page Range: | pp. 77-80 | ||||||||||||||||||||||||||||
ISSN: | 1831-9424 | ||||||||||||||||||||||||||||
ISBN: | 978-92-76-37661-3 | ||||||||||||||||||||||||||||
Status: | Published | ||||||||||||||||||||||||||||
Keywords: | Kubernetes, Argo Workflows, Big Data processing, earth observation, burnt area monitoring | ||||||||||||||||||||||||||||
Event Title: | Big Data from Space 2021 | ||||||||||||||||||||||||||||
Event Location: | Bukarest, Rumänien | ||||||||||||||||||||||||||||
Event Type: | international Conference | ||||||||||||||||||||||||||||
Event Start Date: | 18 May 2021 | ||||||||||||||||||||||||||||
Event End Date: | 20 May 2021 | ||||||||||||||||||||||||||||
Organizer: | European Space Agency (ESA), Joint Research Centre (JRC) of the European Commission, European Union Satellite Centre (SatCen) | ||||||||||||||||||||||||||||
HGF - Research field: | Aeronautics, Space and Transport | ||||||||||||||||||||||||||||
HGF - Program: | Space | ||||||||||||||||||||||||||||
HGF - Program Themes: | Earth Observation | ||||||||||||||||||||||||||||
DLR - Research area: | Raumfahrt | ||||||||||||||||||||||||||||
DLR - Program: | R EO - Earth Observation | ||||||||||||||||||||||||||||
DLR - Research theme (Project): | R - Geoproducts and systems, services | ||||||||||||||||||||||||||||
Location: | Oberpfaffenhofen | ||||||||||||||||||||||||||||
Institutes and Institutions: | German Remote Sensing Data Center > Geo Risks and Civil Security German Remote Sensing Data Center > Information Technology German Remote Sensing Data Center > International Ground Segment | ||||||||||||||||||||||||||||
Deposited By: | Fichtner, Florian W. | ||||||||||||||||||||||||||||
Deposited On: | 25 May 2021 10:04 | ||||||||||||||||||||||||||||
Last Modified: | 24 Apr 2024 20:42 |
Repository Staff Only: item control page