Tell a friend
Print
Nash, Rupert and Crusoe, Michael R. and Kontak, Max and Brown, Nick (2020) Supercomputing with MPI meets the Common Workflow Language standards: an experience report. In: 2020 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS), pp. 17-24. The Institute of Electrical and Electronics Engineers. 2020 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS), 11. Nov. 2020, Atlanta, USA. doi: 10.1109/WORKS51914.2020.00008. ISBN 978-0-7381-1040-0.
![[img]](https://elib.dlr.de/style/images/fileicons/application_pdf.png) |
PDF
234kB |
Abstract
Use of standards-based workflows is still somewhat unusual by high-performance computing users. In this paper we describe the experience of using the Common Workflow Language (CWL) standards to describe the execution, in parallel, of MPI-parallelised applications. In particular, we motivate and describe the simple extension to the specification which wasrequired, as well as our implementation of this within the CWLreference runner. We discuss some of the unexpected benefits, such as simple use of HPC-oriented performance measurement tools, and CWL software requirements interfacing with HPC module systems. We close with a request for comment from the community on how these features could be adopted withinversions of the CWL standards.
| Item URL in elib: | https://elib.dlr.de/138894/ | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Document Type: | Conference or Workshop Item (Speech) | |||||||||||||||
| Title: | Supercomputing with MPI meets the Common Workflow Language standards: an experience report | |||||||||||||||
| Authors: |
| |||||||||||||||
| Date: | November 2020 | |||||||||||||||
| Journal or Publication Title: | 2020 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS) | |||||||||||||||
| Refereed publication: | Yes | |||||||||||||||
| Open Access: | Yes | |||||||||||||||
| Gold Open Access: | No | |||||||||||||||
| In SCOPUS: | No | |||||||||||||||
| In ISI Web of Science: | No | |||||||||||||||
| DOI: | 10.1109/WORKS51914.2020.00008 | |||||||||||||||
| Page Range: | pp. 17-24 | |||||||||||||||
| Publisher: | The Institute of Electrical and Electronics Engineers | |||||||||||||||
| ISBN: | 978-0-7381-1040-0 | |||||||||||||||
| Status: | Published | |||||||||||||||
| Keywords: | Workflow, MPI, CWL, Supercomputing | |||||||||||||||
| Event Title: | 2020 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS) | |||||||||||||||
| Event Location: | Atlanta, USA | |||||||||||||||
| Event Type: | Workshop | |||||||||||||||
| Event Dates: | 11. Nov. 2020 | |||||||||||||||
| HGF - Research field: | Aeronautics, Space and Transport | |||||||||||||||
| HGF - Program: | Space | |||||||||||||||
| HGF - Program Themes: | Space System Technology | |||||||||||||||
| DLR - Research area: | Raumfahrt | |||||||||||||||
| DLR - Program: | R SY - Space System Technology | |||||||||||||||
| DLR - Research theme (Project): | R - Vorhaben SISTEC (old) | |||||||||||||||
| Location: | Köln-Porz | |||||||||||||||
| Institutes and Institutions: | Institute for Software Technology > High-Performance Computing Institute for Software Technology | |||||||||||||||
| Deposited By: | Kontak, Max | |||||||||||||||
| Deposited On: | 08 Dec 2020 09:09 | |||||||||||||||
| Last Modified: | 20 Jun 2021 15:54 |
Repository Staff Only: item control page
