elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Big data access and processing within the cloud: CODE-DE a non-commercial, operational Earth Observation platform

Schmidt, Michael and Storch, Tobias and Reck, Christoph and Holzwarth, Stefanie and Staudenrausch, Helmut (2019) Big data access and processing within the cloud: CODE-DE a non-commercial, operational Earth Observation platform. ESA Living Planet Symposium, 13.-17. May 2019, Milan, Italy.

Full text not available from this repository.

Abstract

The amount of Earth Observation (EO) data is increasing at an unprecedented rate. The European Copernicus program, in particular with Sentinel-1 and Sentinel-2 imagery in 10 m spatial resolution, is a major data contributor. These large volumes of data require not only sophisticated data storage and access options, but also new big spatial data analysis approaches. The German Copernicus Data and Exploitation Platform (CODE-DE) is an infrastructure for EO data access, on-demand processing and value-added product generation. CODE-DE is operational since March 2017, hosts more than 1.300 registered users with more than 100.000 downloaded data products. The rolling archive host more than 650 TB of data with und 1.2 million data products. The catalogue client provides an enhanced solution to discover, view, and download available products. While a focus is set on data from the Copernicus program are other satellite imagery integrated into the portal. The on-demand processing environment for high-performance cloud processing is operational since November 2017. The algorithms currently available are mainly based on the Sentinel tool box (SNAP) functionality, such as generic band math or dedicated time series algorithms. Processed data can optionally be mosaicked covering larger areas or a time periods. The capacity of the processing environment has been continuously exploited since March 2018 by selected applications, e.g. in the agricultural, maritime or snow and ice context, based on dedicated virtual machines or docker technology. This flexible and free processing approach supports different use cases – allowing developers, processing experts and data experts to work on the platform in support of their own processing scenarios. The CODE-DE data and IT architecture will be explained and implemented user applications presented.

Item URL in elib:https://elib.dlr.de/128320/
Document Type:Conference or Workshop Item (Speech)
Title:Big data access and processing within the cloud: CODE-DE a non-commercial, operational Earth Observation platform
Authors:
AuthorsInstitution or Email of AuthorsAuthors ORCID iD
Schmidt, MichaelMichael.Schmidt (at) dlr.deUNSPECIFIED
Storch, TobiasTobias.Storch (at) dlr.deUNSPECIFIED
Reck, ChristophChristoph.Reck (at) dlr.dehttps://orcid.org/0000-0002-4300-4920
Holzwarth, StefanieStefanie.Holzwarth (at) dlr.dehttps://orcid.org/0000-0001-7364-7006
Staudenrausch, Helmuthelmut.staudenrausch (at) dlr.deUNSPECIFIED
Date:2019
Refereed publication:No
Open Access:No
Gold Open Access:No
In SCOPUS:No
In ISI Web of Science:No
Status:Published
Keywords:Big EO Data; Platforms; Copernicus
Event Title:ESA Living Planet Symposium
Event Location:Milan, Italy
Event Type:international Conference
Event Dates:13.-17. May 2019
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Earth Observation
DLR - Research area:Raumfahrt
DLR - Program:R EO - Erdbeobachtung
DLR - Research theme (Project):R - Remote sensing and geoscience
Location: Bonn-Oberkassel , Oberpfaffenhofen
Institutes and Institutions:Space Administration
Remote Sensing Technology Institute > Photogrammetry and Image Analysis
German Remote Sensing Data Center > Land Surface Dynamics
German Remote Sensing Data Center > Information Technology
Deposited By: Holzwarth, Stefanie
Deposited On:07 Aug 2019 11:16
Last Modified:07 Aug 2019 11:16

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Copyright © 2008-2017 German Aerospace Center (DLR). All rights reserved.