elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Data-adapted Parallel Merge Sort

Holke, Johannes and Rüttgers, Alexander and Klitz, Margrit and Basermann, Achim (2019) Data-adapted Parallel Merge Sort. In: Data-adapted Parallel Merge Sort. High-Performance Computing and Networking in Aerospace Workshop at EuroPar Conference 2019, 2019-08-26 - 2019-08-30, Göttingen, Germany.

[img] PDF - Only accessible within DLR
3MB

Abstract

In the aerospace sciences we produce huge amounts of data. This data must be arranged in a meaningful order, so that we can analyze or visualize it. In this paper we focus on data that is distributed among computer processes and then needs to be sorted by a single root process for further analysis. We assume that the memory on the root process is too small to hold all sorted data at once, so that we have to perform the sorting and processing of data chunk-wise. We prove the efficiency of our approach in weak scaling tests, where we achieve a near constant bandwidth. Additionally, we obtain a considerable speed up compared to the standard parallel external sort. We also demonstrate the usefulness of our algorithm in a real-life aviation application.

Item URL in elib:https://elib.dlr.de/131410/
Document Type:Conference or Workshop Item (Lecture)
Title:Data-adapted Parallel Merge Sort
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Holke, JohannesGerman Aerospace Center (DLR), Linder Höhe, 51147 Köln, Germanyhttps://orcid.org/0000-0002-2783-3286UNSPECIFIED
Rüttgers, AlexanderUNSPECIFIEDhttps://orcid.org/0000-0001-6347-9272UNSPECIFIED
Klitz, MargritUNSPECIFIEDhttps://orcid.org/0000-0003-3657-4180UNSPECIFIED
Basermann, AchimUNSPECIFIEDhttps://orcid.org/0000-0003-3637-3231UNSPECIFIED
Date:26 August 2019
Journal or Publication Title:Data-adapted Parallel Merge Sort
Refereed publication:Yes
Open Access:No
Gold Open Access:No
In SCOPUS:No
In ISI Web of Science:No
Status:Published
Keywords:Parallel sorting, High-performance computing, Merge sort, Data analysis, Aerospace sciences
Event Title:High-Performance Computing and Networking in Aerospace Workshop at EuroPar Conference 2019
Event Location:Göttingen, Germany
Event Type:Workshop
Event Start Date:26 August 2019
Event End Date:30 August 2019
Organizer:Ramin Yahyapour
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Space System Technology
DLR - Research area:Raumfahrt
DLR - Program:R SY - Space System Technology
DLR - Research theme (Project):R - Vorhaben SISTEC (old)
Location: Köln-Porz
Institutes and Institutions:Institut of Simulation and Software Technology
Institut of Simulation and Software Technology > High Performance Computing
Deposited By: Holke, Johannes
Deposited On:11 Dec 2019 12:50
Last Modified:24 Apr 2024 20:34

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
OpenAIRE Validator logo electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.