elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Supercomputing with MPI meets the Common Workflow Language standards: an experience report

Nash, Rupert and Crusoe, Michael R. and Kontak, Max and Brown, Nick (2020) Supercomputing with MPI meets the Common Workflow Language standards: an experience report. In: 2020 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS), pp. 17-24. The Institute of Electrical and Electronics Engineers. 2020 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS), 11. Nov. 2020, Atlanta, USA. doi: 10.1109/WORKS51914.2020.00008. ISBN 978-0-7381-1040-0.

[img] PDF
234kB

Abstract

Use of standards-based workflows is still somewhat unusual by high-performance computing users. In this paper we describe the experience of using the Common Workflow Language (CWL) standards to describe the execution, in parallel, of MPI-parallelised applications. In particular, we motivate and describe the simple extension to the specification which wasrequired, as well as our implementation of this within the CWLreference runner. We discuss some of the unexpected benefits, such as simple use of HPC-oriented performance measurement tools, and CWL software requirements interfacing with HPC module systems. We close with a request for comment from the community on how these features could be adopted withinversions of the CWL standards.

Item URL in elib:https://elib.dlr.de/138894/
Document Type:Conference or Workshop Item (Speech)
Title:Supercomputing with MPI meets the Common Workflow Language standards: an experience report
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iD
Nash, RupertEPCC, The University of Edinburgh, Bayes Centre, Edinburgh, UKUNSPECIFIED
Crusoe, Michael R.Vrije Universiteit AmsterdamUNSPECIFIED
Kontak, MaxMax.Kontak (at) DLR.dehttps://orcid.org/0000-0003-3738-7483
Brown, NickEPCC, The University of Edinburgh, Bayes Centre, Edinburgh, UKUNSPECIFIED
Date:November 2020
Journal or Publication Title:2020 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS)
Refereed publication:Yes
Open Access:Yes
Gold Open Access:No
In SCOPUS:No
In ISI Web of Science:No
DOI :10.1109/WORKS51914.2020.00008
Page Range:pp. 17-24
Publisher:The Institute of Electrical and Electronics Engineers
ISBN:978-0-7381-1040-0
Status:Published
Keywords:Workflow, MPI, CWL, Supercomputing
Event Title:2020 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS)
Event Location:Atlanta, USA
Event Type:Workshop
Event Dates:11. Nov. 2020
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Space System Technology
DLR - Research area:Raumfahrt
DLR - Program:R SY - Space System Technology
DLR - Research theme (Project):R - Vorhaben SISTEC (old)
Location: Köln-Porz
Institutes and Institutions:Institute for Software Technology > High-Performance Computing
Institute for Software Technology
Deposited By: Kontak, Max
Deposited On:08 Dec 2020 09:09
Last Modified:20 Jun 2021 15:54

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Copyright © 2008-2017 German Aerospace Center (DLR). All rights reserved.