elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

A Pre-Processing Interface for Steering Exascale Simulations by Intermediate Result Analysis through In-Situ Post-Processing

Matura, Gregor and Basermann, Achim and Chen, Fang and Flatken, Markus and Gerndt, Andreas and Hetherington, James and Krüger, Timm and Nash, Rupert (2014) A Pre-Processing Interface for Steering Exascale Simulations by Intermediate Result Analysis through In-Situ Post-Processing. Advances in Engineering Software. Elsevier. ISSN 0965-9978. (Submitted)

[img] PDF
245kB

Official URL: http://www.elsevier.com/locate/advengsoft

Abstract

Today's simulations are typically not a single application but cover an entire tool chain. There is a tool for initial data creation, for partitioning this data, for actual solving, for afterwards analysis, for visualisation. Each of these tools is separated and so is the data ow. This approach gets unfeasible for an exascale environment. The penalty for every data movement is extreme. A load balance optimised for the solver most likely does not hold true for the complete run time. Compared to tweaking each part, our solution is more disruptive: Merge the tools used and thereby improve overall simulation performance. In this paper, we provide a �rst step. We combine pre-processing, simulation core and postprocessing. We outline our idea of a general pre-processing interface steering the overall simulation and demonstrate its applicability with the sparse geometry lattice-Boltzmann code HemeLB, intended for hemodynamic simulations. The tasks of the pre-processing tool developed start with partitioning and distributing simulation data. Main aspect is to balance computation and communication costs of the entire simulation by using the costs of each simulation part. Measurement of these costs for each simulation cycle makes possible further performance improvement: Data can be redistributed in between cycles in order to achieve a better load balance according to these costs. Additionally, the pre-processing interface developed o�ers the possibility of integrating extensions covering, e.g., an automated mesh re�nement or fault tolerance awareness. Finally, we investigate the applicability of our interface within HemeLB.

Item URL in elib:https://elib.dlr.de/87024/
Document Type:Article
Title:A Pre-Processing Interface for Steering Exascale Simulations by Intermediate Result Analysis through In-Situ Post-Processing
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iD
Matura, GregorUNSPECIFIEDUNSPECIFIED
Basermann, AchimUNSPECIFIEDUNSPECIFIED
Chen, FangUNSPECIFIEDUNSPECIFIED
Flatken, MarkusUNSPECIFIEDUNSPECIFIED
Gerndt, AndreasUNSPECIFIEDUNSPECIFIED
Hetherington, JamesUniversity College LondonUNSPECIFIED
Krüger, TimmUniversity College LondonUNSPECIFIED
Nash, RupertUniversity College LondonUNSPECIFIED
Date:2014
Journal or Publication Title:Advances in Engineering Software
Refereed publication:Yes
Open Access:Yes
Gold Open Access:No
In SCOPUS:Yes
In ISI Web of Science:Yes
Editors:
EditorsEmailEditor's ORCID iD
Noor, A. K.Old Dominion UniversityUNSPECIFIED
Topping, B. H. V.University of Pécs, Hungary and Heriot-Watt UniversityUNSPECIFIED
Publisher:Elsevier
Series Name:Elsevier Advances in Engineering Software
ISSN:0965-9978
Status:Submitted
Keywords:Exascale, CRESTA, Partitioner, PPStee, ParMETIS, PTScotch, Zoltan, HemeLB, Pre-processing, Post-processing, In-Situ, Steering Interface
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Space System Technology
DLR - Research area:Raumfahrt
DLR - Program:R SY - Space System Technology
DLR - Research theme (Project):R - Vorhaben SISTEC (old)
Location: Braunschweig , Köln-Porz
Institutes and Institutions:Institut of Simulation and Software Technology
Institut of Simulation and Software Technology > Software for Space Systems and Interactive Visualisation
Institut of Simulation and Software Technology > Distributed Systems and Component Software
Deposited By: Basermann, Dr.-Ing. Achim
Deposited On:13 Jan 2014 09:29
Last Modified:31 Jul 2019 19:44

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.