elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Cold Storage Data Archives: More Than Just a Bunch of Tapes

Memishi, Bunjamin and Appuswamy, Raja and Paradies, Marcus (2019) Cold Storage Data Archives: More Than Just a Bunch of Tapes. In: Proceedings of the 15th International Workshop on Data Management on New Hardware, 1:1-1:7. ACM, New York, NY, USA. Proceedings of the 15th International Workshop on Data Management on New Hardware, 01-01 Jul 2019, Amsterdam, Netherlands. DOI: 10.1145/3329785.3329921 ISBN 978-1-4503-6801-8

[img] PDF - Registered users only
590kB

Official URL: http://doi.acm.org/10.1145/3329785.3329921

Abstract

The abundance of available sensor and derived data from large scientific experiments, such as earth observation programs, radio astronomy sky surveys, and high-energy physics already exceeds the storage hardware globally fabricated per year. To that end, cold storage data archives are the---often overlooked---spearheads of modern big data analytics in scientific, data-intensive application domains. While high-performance data analytics has received much attention from the research community, the growing number of problems in designing and deploying cold storage archives has only received very little attention. In this paper, we take the first step towards bridging this gap in knowledge by presenting an analysis of four real-world cold storage archives from three different application domains. In doing so, we highlight (i) workload characteristics that differentiate these archives from traditional, performance-sensitive data analytics, (ii) design trade-offs involved in building cold storage systems for these archives, and (iii) deployment trade-offs with respect to migration to the public cloud. Based on our analysis, we discuss several other important research challenges that need to be addressed by the data management community.

Item URL in elib:https://elib.dlr.de/132577/
Document Type:Conference or Workshop Item (Speech)
Title:Cold Storage Data Archives: More Than Just a Bunch of Tapes
Authors:
AuthorsInstitution or Email of AuthorsAuthors ORCID iD
Memishi, BunjaminBunjamin.Memishi (at) dlr.dehttps://orcid.org/0000-0003-3557-3426
Appuswamy, Rajaraja.appuswamy (at) eurecom.frUNSPECIFIED
Paradies, MarcusMarcus.Paradies (at) dlr.dehttps://orcid.org/0000-0002-5743-6580
Date:1 July 2019
Journal or Publication Title:Proceedings of the 15th International Workshop on Data Management on New Hardware
Refereed publication:Yes
Open Access:No
Gold Open Access:No
In SCOPUS:No
In ISI Web of Science:No
DOI :10.1145/3329785.3329921
Page Range:1:1-1:7
Publisher:ACM
Series Name:DaMoN'19
ISBN:978-1-4503-6801-8
Status:Published
Keywords:cold storage, data archive, tape library
Event Title:Proceedings of the 15th International Workshop on Data Management on New Hardware
Event Location:Amsterdam, Netherlands
Event Type:Workshop
Event Dates:01-01 Jul 2019
Organizer:ACM
HGF - Research field:other
HGF - Program:other
HGF - Program Themes:other
DLR - Research area:no assignment
DLR - Program:no assignment
DLR - Research theme (Project):no assignment, R - no assignment
Location: Jena
Institutes and Institutions:Institute of Data Science
Institute of Data Science > Datamangagement and Analysis
Deposited By: Memishi, Dr. Bunjamin
Deposited On:10 Dec 2019 15:00
Last Modified:10 Dec 2019 15:00

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Copyright © 2008-2017 German Aerospace Center (DLR). All rights reserved.