The Product Library - A Scalable Long-Term Repository for Earth Observation Products

Abstract

Scalable long-term storage is an emerging challenge for ground system centers faced with an increasing number of earth observation missions, sensors and applications to be supported. Developing and operating new distinct storage systems for each mission is expensive and not in the sense of sustainable data management. An evolving global product catalogue, storage media transparence and scalability with respect to storage capacity and data modelling - these are the key features of multi-mission ground storage systems. The German Remote Sensing Data Center has developed the Data Information and Management System DIMS, a multi-mission ground system that went into operation early 2000 with the Shuttle Radar Topography Mission SRTM and will support multiple upcoming programs and missions such as EUMETSAT Polar System and ESA ENVISAT. DIMS provides ground system services within the framework of earth observation product processing, storage, ordering and delivery. The Product Library, a central component of DIMS, is responsible for the long-term storage and availability of earth observation products. Within the DIMS framework the Product Library serves input and output of processing systems, input for user information systems and is the source for product delivery to end users. The Product Library consists of an extensible product inventory with optimised geo-spatial search capabilities and a product archive using a robot media library with a potential capacity of hundreds of terabytes.