DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Exploiting Big Earth Data from Space – First Experiences with the TimeScan Processing Chain

Esch, Thomas and Üreyen, Soner and Zeidler, Julian and Hirner, Andreas and Asamer, Hubert and Metz-Marconcini, Annekatrin and Tum, Markus and Böttcher, Martin and Kuchař, Štěpán and Svaton, Vaclav and Marconcini, Mattia (2018) Exploiting Big Earth Data from Space – First Experiences with the TimeScan Processing Chain. Big Earth Data, pp. 36-55. Taylor & Francis. DOI: 10.1080/20964471.2018.1433790 ISSN 2096-4471

[img] PDF

Official URL: https://doi.org/10.1080/20964471.2018.1433790


The European Sentinel missions and the latest generation of the United States Landsat satellites provide new opportunities for global environmental monitoring. They acquire imagery at spatial resolutions between 10 and 60 m in a temporal and spatial coverage that could before only be realized on the basis of lower resolution Earth observation data (>250 m). However, images gathered by these modern missions rapidly add up to data volume that can no longer be handled with standard work stations and software solutions. Hence, this contribution introduces the TimeScan concept which combines pre-existing tools to an exemplary modular pipeline for the flexible and scalable processing of massive image data collections on a variety of (private or public) computing clusters. The TimeScan framework covers solutions for data access to arbitrary mission archives (with different data provisioning policies) and data ingestion into a processing environment EO2Data module), mission specific pre-processing of multi-temporal data collections (Data2TimeS module), and the generation of a final TimeScan baseline product (TimeS2Stats module) providing a spectrally and temporally harmonized representation of the observed surfaces. Technically, a TimeScan layer aggregates the information content of hundreds or thousands of single images available for the area and time period of interest (i.e. up to hundreds of TBs or even PBs of data) into a higher level product with significantly reduced volume. In first test, the TimeScan pipeline has been used to process a global coverage of 452,799 multispectral Landsat–8 scenes acquired from 2013 to 2015, a global data-set of 25,550 Envisat ASAR radar images collected 2010–2012, and regional Sentinel–1 and Sentinel–2 collections of ∼1500 images acquired from 2014 to 2016. The resulting TimeScan products have already been successfully used in various studies related to the large-scale monitoring of environmental processes and their temporal dynamics.

Item URL in elib:https://elib.dlr.de/119111/
Document Type:Article
Title:Exploiting Big Earth Data from Space – First Experiences with the TimeScan Processing Chain
AuthorsInstitution or Email of AuthorsAuthors ORCID iD
Esch, ThomasThomas.Esch (at) dlr.deUNSPECIFIED
Üreyen, SonerSoner.Uereyen (at) dlr.deUNSPECIFIED
Zeidler, Julianjulian.zeidler (at) dlr.deUNSPECIFIED
Hirner, AndreasAndreas.Hirner (at) dlr.deUNSPECIFIED
Asamer, HubertHubert.Asamer (at) dlr.deUNSPECIFIED
Metz-Marconcini, AnnekatrinAnnekatrin.Metz-Marconcini (at) dlr.deUNSPECIFIED
Tum, Markusmarkus.tum (at) dlr.deUNSPECIFIED
Böttcher, Martinmartin.boettcher (at) brockmann-consult.deUNSPECIFIED
Kuchař, ŠtěpánIT4Innovations & VSB-Technical University of Ostrava, Czech RepublikUNSPECIFIED
Svaton, Vaclavit4innovations & vsb-technical university of ostrava, czech republikUNSPECIFIED
Marconcini, MattiaMattia.Marconcini (at) dlr.deUNSPECIFIED
Date:February 2018
Journal or Publication Title:Big Earth Data
Refereed publication:Yes
Open Access:Yes
Gold Open Access:Yes
In ISI Web of Science:No
DOI :10.1080/20964471.2018.1433790
Page Range:pp. 36-55
Publisher:Taylor & Francis
Series Name:10.1080/20964471.2018.1433790
Keywords:Earth observation; sentinel; landsat; mass data; high performance processing; information and communication technology; automation
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Earth Observation
DLR - Research area:Raumfahrt
DLR - Program:R EO - Erdbeobachtung
DLR - Research theme (Project):R - Remote sensing and geoscience
Location: Oberpfaffenhofen
Institutes and Institutions:German Remote Sensing Data Center > Land Surface
Deposited By: Esch, Dr.rer.nat. Thomas
Deposited On:28 Feb 2018 09:42
Last Modified:19 Feb 2019 11:04

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Copyright © 2008-2017 German Aerospace Center (DLR). All rights reserved.