Matura, Gregor und Basermann, Achim und Chen, Fang und Flatken, Markus und Gerndt, Andreas und Hetherington, James und Krüger, Timm und Nash, Rupert (2013) A Pre-Processing Interface for Steering Exascale Simulations by Intermediate Result Analysis through In-Situ Post-Processing. In: Exascale Applications and Software Conference 2013. Exascale Applications and Software Conference 2013, 2013-04-09 - 2013-04-11, Edinburgh, Großbritannien.
MS PowerPoint
226kB |
Offizielle URL: http://www.easc2013.org.uk/sites/default/files/Pdfs/ParallelSession3a/CRESTA_Introduction_to_PPStee.pdf
Kurzfassung
Today's simulations are typically not a single application but cover an entire tool chain. There is a tool for initial data creation, for partitioning this data, for actual solving, for afterward analysis, for visualisation. Each of these tools is separated and so is the data flow. This approach gets unfeasible for an exascale environment. The penalty for every data movement is extreme. A load balance optimised for the solver most likely does not hold true for the complete run time. Compared to tweaking each part, our solution is more disruptive: Merge the tools used and thereby improve overall simulation performance. In this paper, we provide a first step. We combine pre-processing, simulation core and post-processing. We outline our idea of a general pre-processing interface steering the overall simulation and demonstrate its applicability with the sparse geometry lattice-boltzmann code HemeLB, intended for hemodynamic simulations. The tasks of the interface start with partitioning and distributing simulation data. Main aspect is to balance load and communication costs of the entire simulation by using the costs of each simulation part. Measurement of these costs for each simulation cycle makes possible further performance improvement: Data can be redistributed in between cycles in order to achieve a better load balance according to these costs. Additionally, our interface offers the possibility for other easy-to-integrate extensions covering, e.g., an automated mesh refinement or fault tolerance awareness. Finally, we investigate the applicability of our interface within HemeLB. We exploit the integrated partitioning methods and especially consider latest HemeLB-specific in-situ result analysis and visualisation methods.
elib-URL des Eintrags: | https://elib.dlr.de/86136/ | ||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Dokumentart: | Konferenzbeitrag (Vortrag) | ||||||||||||||||||||||||||||||||||||
Titel: | A Pre-Processing Interface for Steering Exascale Simulations by Intermediate Result Analysis through In-Situ Post-Processing | ||||||||||||||||||||||||||||||||||||
Autoren: |
| ||||||||||||||||||||||||||||||||||||
Datum: | 10 April 2013 | ||||||||||||||||||||||||||||||||||||
Erschienen in: | Exascale Applications and Software Conference 2013 | ||||||||||||||||||||||||||||||||||||
Referierte Publikation: | Nein | ||||||||||||||||||||||||||||||||||||
Open Access: | Ja | ||||||||||||||||||||||||||||||||||||
Gold Open Access: | Nein | ||||||||||||||||||||||||||||||||||||
In SCOPUS: | Nein | ||||||||||||||||||||||||||||||||||||
In ISI Web of Science: | Nein | ||||||||||||||||||||||||||||||||||||
Status: | veröffentlicht | ||||||||||||||||||||||||||||||||||||
Stichwörter: | Exascale CRESTA Partitioner PPStee ParMETIS PTScotch Zoltan HemeLB Pre-processing Post-processing In-situ Steering Interface | ||||||||||||||||||||||||||||||||||||
Veranstaltungstitel: | Exascale Applications and Software Conference 2013 | ||||||||||||||||||||||||||||||||||||
Veranstaltungsort: | Edinburgh, Großbritannien | ||||||||||||||||||||||||||||||||||||
Veranstaltungsart: | internationale Konferenz | ||||||||||||||||||||||||||||||||||||
Veranstaltungsbeginn: | 9 April 2013 | ||||||||||||||||||||||||||||||||||||
Veranstaltungsende: | 11 April 2013 | ||||||||||||||||||||||||||||||||||||
Veranstalter : | EPCC | ||||||||||||||||||||||||||||||||||||
HGF - Forschungsbereich: | Luftfahrt, Raumfahrt und Verkehr | ||||||||||||||||||||||||||||||||||||
HGF - Programm: | Raumfahrt | ||||||||||||||||||||||||||||||||||||
HGF - Programmthema: | Technik für Raumfahrtsysteme | ||||||||||||||||||||||||||||||||||||
DLR - Schwerpunkt: | Raumfahrt | ||||||||||||||||||||||||||||||||||||
DLR - Forschungsgebiet: | R SY - Technik für Raumfahrtsysteme | ||||||||||||||||||||||||||||||||||||
DLR - Teilgebiet (Projekt, Vorhaben): | R - Vorhaben SISTEC (alt) | ||||||||||||||||||||||||||||||||||||
Standort: | Köln-Porz | ||||||||||||||||||||||||||||||||||||
Institute & Einrichtungen: | Institut für Simulations- und Softwaretechnik > Verteilte Systeme und Komponentensoftware | ||||||||||||||||||||||||||||||||||||
Hinterlegt von: | Matura, Gregor | ||||||||||||||||||||||||||||||||||||
Hinterlegt am: | 06 Dez 2013 10:30 | ||||||||||||||||||||||||||||||||||||
Letzte Änderung: | 24 Apr 2024 19:52 |
Nur für Mitarbeiter des Archivs: Kontrollseite des Eintrags