elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Interactive Visualization of Large Simulation Datasets

Gerndt, Andreas and Hempel, Rolf and Wolff, Robin (2010) Interactive Visualization of Large Simulation Datasets. Euro-MPI-Konferenz 2010, 13.-15. Sept. 2010, Stuttgart, Deutschland.

[img] PDF
4MB

Abstract

At the German Aerospace Center (DLR), numerical simulation is an essential tool for many application areas. The increasing compute power of supercomputers enables tremendous improvements in detail and accuracy of simulation results. At the same time, however, the volume of the resulting data files is growing rapidly. For example, a high-end aerodynamics simulation of a complete airplane today can produce up to 100 Terabytes of data. Post-processing of such large amounts of data for visualization and then analyzing the simulation results become both time consuming and demanding in terms of hardware resources. Therefore, parallelization of the post-processing pipeline is required. We give an overview of state-of-the-art methods for the optimization of the parallel post-processing pipeline, to eventually enable interactive exploration of very large datasets. Typically the heavy post-processing work, such as converting raw datasets and feature extraction, is located at the beginning of the pipeline. We present a parallelization framework based on the visualization toolkit (VTK). It distributes the first post-processing stages to multiple processes to be executed on hardware with high-bandwidth access to the data sources. The extracted visualization objects, which are significantly smaller, are sent to the user site, where they are assembled by software that plugs directly into a virtual reality toolkit for rendering and user interaction. Geometric partitioning, e.g. using multi-block data structures, has proven to be useful for parallelization, as the resulting datasets can be easily distributed and processed in parallel. Additionally it allows for an overlap of the processing of data at the backend and visualization at the frontend. As soon as a block is processed, the resulting visualization primitives are sent to the front end. This results in a significant acceleration of the visual response. We will close with our view of future research, including the exploitation of modern hardware architectures, such as many-core CPUs and GPUs. Co-location of computation and extraction processes within an HPC system promise a substantial reduction of the disk I/O bottleneck. Rather than first writing the simulation results to disk and then reading them back in for post-processing, the simulation and the first stage of the post-processing pipeline run together on the same HPC system and communicate by message-passing. Additionally, the use of multi-resolution data structures allows fast access to data and enables progressive data streaming. This provides a rough overview of results quickly to the engineer with the high resolution visualization emerging gradually. Finally, interactive data exploration enables computational steering since the engineer can change simulation parameters while monitoring the results during an ongoing computation.

Item URL in elib:https://elib.dlr.de/67109/
Document Type:Conference or Workshop Item (Speech)
Title:Interactive Visualization of Large Simulation Datasets
Authors:
AuthorsInstitution or Email of AuthorsAuthors ORCID iD
Gerndt, AndreasSC-RVUNSPECIFIED
Hempel, RolfSC-LUNSPECIFIED
Wolff, RobinSC-RVUNSPECIFIED
Date:13 September 2010
Refereed publication:No
Open Access:Yes
Gold Open Access:No
In SCOPUS:No
In ISI Web of Science:No
Status:Published
Keywords:Visualisierung, Numerische Simulation, High-Performance Computing, Postprocessing
Event Title:Euro-MPI-Konferenz 2010
Event Location:Stuttgart, Deutschland
Event Type:international Conference
Event Dates:13.-15. Sept. 2010
Organizer:HLRS, Universität Stuttgart
HGF - Research field:Aeronautics, Space and Transport (old)
HGF - Program:Space (old)
HGF - Program Themes:W SY - Technik für Raumfahrtsysteme
DLR - Research area:Space
DLR - Program:W SY - Technik für Raumfahrtsysteme
DLR - Research theme (Project):W - Vorhaben SISTEC (old)
Location: Köln-Porz , Braunschweig
Institutes and Institutions:Institut of Simulation and Software Technology
Deposited By: Hempel, Rolf
Deposited On:06 Dec 2010 11:18
Last Modified:31 Jul 2019 19:29

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Copyright © 2008-2017 German Aerospace Center (DLR). All rights reserved.