elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Scalable Processing Of Copernicus Sentinel satellite Images Using Argo Workflows

Fichtner, Florian Willy and Mandery, Nico and Schwinger, Maximilian and Eberle, Jonas and Nolde, Michael and Riedlinger, Torsten (2021) Scalable Processing Of Copernicus Sentinel satellite Images Using Argo Workflows. Big Data from Space 2021, 2021-05-18 - 2021-05-20, Bukarest, Rumänien. doi: 10.2760/125905. ISBN 978-92-76-37661-3. ISSN 1831-9424.

Full text not available from this repository.

Official URL: https://doi.org/10.2760/125905

Abstract

With the goal of using a pool of resources dynamically for different applications we migrated scientific Earth Observation processors from dedicated Virtual Machines into a centralized cloud. Processing in this environment works using off-the-shelf components like Kubernetes, Docker and Argo Workflows. We were able to benefit from sharing data, tools and infrastructure in between processors. To showcase the new workflow or pipeline by means of an example we use our burnt area monitoring processor based on Sentinel-3 satellite data. A new architecture based on existing components was established, which we plan to extend it in the future.

Item URL in elib:https://elib.dlr.de/142309/
Document Type:Conference or Workshop Item (Speech)
Title:Scalable Processing Of Copernicus Sentinel satellite Images Using Argo Workflows
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Fichtner, Florian WillyUNSPECIFIEDhttps://orcid.org/0000-0003-2122-1163134225806
Mandery, NicoUNSPECIFIEDhttps://orcid.org/0000-0001-8388-3635UNSPECIFIED
Schwinger, MaximilianUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Eberle, JonasUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Nolde, MichaelUNSPECIFIEDhttps://orcid.org/0000-0002-6981-9730UNSPECIFIED
Riedlinger, TorstenUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Date:18 May 2021
Refereed publication:Yes
Open Access:No
Gold Open Access:No
In SCOPUS:No
In ISI Web of Science:No
DOI:10.2760/125905
Page Range:pp. 77-80
ISSN:1831-9424
ISBN:978-92-76-37661-3
Status:Published
Keywords:Kubernetes, Argo Workflows, Big Data processing, earth observation, burnt area monitoring
Event Title:Big Data from Space 2021
Event Location:Bukarest, Rumänien
Event Type:international Conference
Event Start Date:18 May 2021
Event End Date:20 May 2021
Organizer:European Space Agency (ESA), Joint Research Centre (JRC) of the European Commission, European Union Satellite Centre (SatCen)
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Earth Observation
DLR - Research area:Raumfahrt
DLR - Program:R EO - Earth Observation
DLR - Research theme (Project):R - Geoproducts and systems, services
Location: Oberpfaffenhofen
Institutes and Institutions:German Remote Sensing Data Center > Geo Risks and Civil Security
German Remote Sensing Data Center > Information Technology
German Remote Sensing Data Center > International Ground Segment
Deposited By: Fichtner, Florian W.
Deposited On:25 May 2021 10:04
Last Modified:24 Apr 2024 20:42

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.