elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

A Bespoke Workflow Management System for Data-Driven Urgent HPC

Gibb, Gordon and Brown, Nick and Nash, Rupert and Mendes, Miguel and Monedero, Santiago and Diaz Fidalgo, Humberto and Ramirez Cisneros, Joaquin and Cardil, Adrián and Kontak, Max (2020) A Bespoke Workflow Management System for Data-Driven Urgent HPC. In: 2020 IEEE/ACM HPC for Urgent Decision Making (UrgentHPC), pp. 10-20. The Institute of Electrical and Electronics Engineers. 2020 IEEE/ACM HPC for Urgent Decision Making (UrgentHPC), 13. Nov. 2020, Atlanda, USA. doi: 10.1109/UrgentHPC51945.2020.00007. ISBN 978-0-7381-1062-2.

[img] PDF
1MB

Abstract

In this paper we present a workflow management system which permits the kinds of data-driven workflows required by urgent computing, namely where new data is integrated into the workflow as a disaster progresses in order refine the predictions as time goes on. This allows the workflow toadapt to new data at runtime, a capability that most workflow management systems do not possess. The workflow management system was developed for the EU-funded VESTEC project, which aims to fuse HPC with real-time data for supporting urgent decision making. We first describe an example workflow from the VESTEC project, and show why existing workflow technologies do not meet the needs of the project. We then go on to present the design of our Workflow Management System, describe how it is implemented into the VESTEC system, and provide an example of the workflow system in use for a test case.

Item URL in elib:https://elib.dlr.de/138910/
Document Type:Conference or Workshop Item (Speech)
Title:A Bespoke Workflow Management System for Data-Driven Urgent HPC
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iD
Gibb, GordonEPCC, The University of Edinburgh, Bayes Centre, Edinburgh, UKUNSPECIFIED
Brown, NickEPCC, The University of Edinburgh, Bayes Centre, Edinburgh, UKUNSPECIFIED
Nash, RupertEPCC, The University of Edinburgh, Bayes Centre, Edinburgh, UKUNSPECIFIED
Mendes, MiguelTecnosylvaUNSPECIFIED
Monedero, SantiagoTecnosylvaUNSPECIFIED
Diaz Fidalgo, HumbertoTecnosylvaUNSPECIFIED
Ramirez Cisneros, JoaquinTecnosylvaUNSPECIFIED
Cardil, AdriánTecnosylvaUNSPECIFIED
Kontak, MaxMax.Kontak (at) DLR.dehttps://orcid.org/0000-0003-3738-7483
Date:2020
Journal or Publication Title:2020 IEEE/ACM HPC for Urgent Decision Making (UrgentHPC)
Refereed publication:Yes
Open Access:Yes
Gold Open Access:No
In SCOPUS:No
In ISI Web of Science:No
DOI :10.1109/UrgentHPC51945.2020.00007
Page Range:pp. 10-20
Publisher:The Institute of Electrical and Electronics Engineers
ISBN:978-0-7381-1062-2
Status:Published
Keywords:Workflow Management System, Urgent Computing, High-Performance Computing
Event Title:2020 IEEE/ACM HPC for Urgent Decision Making (UrgentHPC)
Event Location:Atlanda, USA
Event Type:Workshop
Event Dates:13. Nov. 2020
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Space System Technology
DLR - Research area:Raumfahrt
DLR - Program:R SY - Space System Technology
DLR - Research theme (Project):R - Vorhaben SISTEC (old)
Location: Köln-Porz
Institutes and Institutions:Institute for Software Technology > High-Performance Computing
Institute for Software Technology
Deposited By: Kontak, Max
Deposited On:07 Dec 2020 10:02
Last Modified:20 Jun 2021 15:54

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Copyright © 2008-2017 German Aerospace Center (DLR). All rights reserved.