Nash, Rupert und Crusoe, Michael R. und Kontak, Max und Brown, Nick (2020) Supercomputing with MPI meets the Common Workflow Language standards: an experience report. In: 15th IEEE/ACM Workshop on Workflows in Support of Large-Scale Science, WORKS 2020, Seiten 17-24. The Institute of Electrical and Electronics Engineers. 2020 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS), 2020-11-11, Atlanta, USA. doi: 10.1109/WORKS51914.2020.00008. ISBN 978-0-7381-1040-0.
PDF
234kB |
Kurzfassung
Use of standards-based workflows is still somewhat unusual by high-performance computing users. In this paper we describe the experience of using the Common Workflow Language (CWL) standards to describe the execution, in parallel, of MPI-parallelised applications. In particular, we motivate and describe the simple extension to the specification which wasrequired, as well as our implementation of this within the CWLreference runner. We discuss some of the unexpected benefits, such as simple use of HPC-oriented performance measurement tools, and CWL software requirements interfacing with HPC module systems. We close with a request for comment from the community on how these features could be adopted withinversions of the CWL standards.
elib-URL des Eintrags: | https://elib.dlr.de/138894/ | ||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Dokumentart: | Konferenzbeitrag (Vortrag) | ||||||||||||||||||||
Titel: | Supercomputing with MPI meets the Common Workflow Language standards: an experience report | ||||||||||||||||||||
Autoren: |
| ||||||||||||||||||||
Datum: | November 2020 | ||||||||||||||||||||
Erschienen in: | 15th IEEE/ACM Workshop on Workflows in Support of Large-Scale Science, WORKS 2020 | ||||||||||||||||||||
Referierte Publikation: | Ja | ||||||||||||||||||||
Open Access: | Ja | ||||||||||||||||||||
Gold Open Access: | Nein | ||||||||||||||||||||
In SCOPUS: | Ja | ||||||||||||||||||||
In ISI Web of Science: | Ja | ||||||||||||||||||||
DOI: | 10.1109/WORKS51914.2020.00008 | ||||||||||||||||||||
Seitenbereich: | Seiten 17-24 | ||||||||||||||||||||
Verlag: | The Institute of Electrical and Electronics Engineers | ||||||||||||||||||||
ISBN: | 978-0-7381-1040-0 | ||||||||||||||||||||
Status: | veröffentlicht | ||||||||||||||||||||
Stichwörter: | Workflow, MPI, CWL, Supercomputing | ||||||||||||||||||||
Veranstaltungstitel: | 2020 IEEE/ACM Workflows in Support of Large-Scale Science (WORKS) | ||||||||||||||||||||
Veranstaltungsort: | Atlanta, USA | ||||||||||||||||||||
Veranstaltungsart: | Workshop | ||||||||||||||||||||
Veranstaltungsdatum: | 11 November 2020 | ||||||||||||||||||||
HGF - Forschungsbereich: | Luftfahrt, Raumfahrt und Verkehr | ||||||||||||||||||||
HGF - Programm: | Raumfahrt | ||||||||||||||||||||
HGF - Programmthema: | Technik für Raumfahrtsysteme | ||||||||||||||||||||
DLR - Schwerpunkt: | Raumfahrt | ||||||||||||||||||||
DLR - Forschungsgebiet: | R SY - Technik für Raumfahrtsysteme | ||||||||||||||||||||
DLR - Teilgebiet (Projekt, Vorhaben): | R - Vorhaben SISTEC (alt) | ||||||||||||||||||||
Standort: | Köln-Porz | ||||||||||||||||||||
Institute & Einrichtungen: | Institut für Softwaretechnologie > High-Performance Computing Institut für Softwaretechnologie | ||||||||||||||||||||
Hinterlegt von: | Kontak, Max | ||||||||||||||||||||
Hinterlegt am: | 08 Dez 2020 09:09 | ||||||||||||||||||||
Letzte Änderung: | 24 Apr 2024 20:40 |
Nur für Mitarbeiter des Archivs: Kontrollseite des Eintrags