Big Data Management in Earth Observation

Abstract

The German Satellite Data Archive (D-SDA) at the German Aerospace Center (DLR) has been managing large volume Earth-observation (EO) data in the context of EO mission payload ground segments (PGSs) for more than two decades. Hardware, data management, processing, user access, long-term preservation, and data exploitation expertise are under one roof and interact closely. Upcoming EO-mission PGSs benefit as much from the comprehensive expertise, close interaction, and integrated infrastructure as do in-house scientific application projects requiring access, processing, and archiving of large-volume EO data. Using a number of examples, we will demonstrate how EO data life cycles benefit from the proximity of data management and application scientists and from the extensive operational experience gathered over time.