Holke, Johannes and Rüttgers, Alexander and Klitz, Margrit and Basermann, Achim (2019) Data-adapted Parallel Merge Sort. In: Data-adapted Parallel Merge Sort. High-Performance Computing and Networking in Aerospace Workshop at EuroPar Conference 2019, 2019-08-26 - 2019-08-30, Göttingen, Germany.
![]() |
PDF
- Only accessible within DLR
3MB |
Abstract
In the aerospace sciences we produce huge amounts of data. This data must be arranged in a meaningful order, so that we can analyze or visualize it. In this paper we focus on data that is distributed among computer processes and then needs to be sorted by a single root process for further analysis. We assume that the memory on the root process is too small to hold all sorted data at once, so that we have to perform the sorting and processing of data chunk-wise. We prove the efficiency of our approach in weak scaling tests, where we achieve a near constant bandwidth. Additionally, we obtain a considerable speed up compared to the standard parallel external sort. We also demonstrate the usefulness of our algorithm in a real-life aviation application.
Item URL in elib: | https://elib.dlr.de/131410/ | ||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Document Type: | Conference or Workshop Item (Lecture) | ||||||||||||||||||||
Title: | Data-adapted Parallel Merge Sort | ||||||||||||||||||||
Authors: |
| ||||||||||||||||||||
Date: | 26 August 2019 | ||||||||||||||||||||
Journal or Publication Title: | Data-adapted Parallel Merge Sort | ||||||||||||||||||||
Refereed publication: | Yes | ||||||||||||||||||||
Open Access: | No | ||||||||||||||||||||
Gold Open Access: | No | ||||||||||||||||||||
In SCOPUS: | No | ||||||||||||||||||||
In ISI Web of Science: | No | ||||||||||||||||||||
Status: | Published | ||||||||||||||||||||
Keywords: | Parallel sorting, High-performance computing, Merge sort, Data analysis, Aerospace sciences | ||||||||||||||||||||
Event Title: | High-Performance Computing and Networking in Aerospace Workshop at EuroPar Conference 2019 | ||||||||||||||||||||
Event Location: | Göttingen, Germany | ||||||||||||||||||||
Event Type: | Workshop | ||||||||||||||||||||
Event Start Date: | 26 August 2019 | ||||||||||||||||||||
Event End Date: | 30 August 2019 | ||||||||||||||||||||
Organizer: | Ramin Yahyapour | ||||||||||||||||||||
HGF - Research field: | Aeronautics, Space and Transport | ||||||||||||||||||||
HGF - Program: | Space | ||||||||||||||||||||
HGF - Program Themes: | Space System Technology | ||||||||||||||||||||
DLR - Research area: | Raumfahrt | ||||||||||||||||||||
DLR - Program: | R SY - Space System Technology | ||||||||||||||||||||
DLR - Research theme (Project): | R - Vorhaben SISTEC (old) | ||||||||||||||||||||
Location: | Köln-Porz | ||||||||||||||||||||
Institutes and Institutions: | Institut of Simulation and Software Technology Institut of Simulation and Software Technology > High Performance Computing | ||||||||||||||||||||
Deposited By: | Holke, Johannes | ||||||||||||||||||||
Deposited On: | 11 Dec 2019 12:50 | ||||||||||||||||||||
Last Modified: | 24 Apr 2024 20:34 |
Repository Staff Only: item control page