DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Parallel Merge Sort for Data Analysis

Holke, Johannes and Rüttgers, Alexander and Klitz, Margrit and Basermann, Achim (2019) Parallel Merge Sort for Data Analysis. Workshop von SC-HPC mit dem Mathematischen Institut der Universität zu Köln, Universität Köln.

[img] PDF - Only accessible within DLR


In the aerospace sciences we produce huge amounts of data. This data must be arranged in a meaningful order, so that we can analyze or visualize it. In this paper we focus on data that is distributed among computer processes and then needs to be sorted by a single root process for further analysis. We assume that the memory on the root process is too small to hold all sorted data at once, so that we have to perform the sorting and processing of data chunk-wise. We prove the efficiency of our approach in weak scaling tests, where we achieve a near constant bandwidth. Additionally, we obtain a considerable speed up compared to the standard parallel external sort. We also demonstrate the usefulness of our algorithm in a real-life aviation application.

Item URL in elib:https://elib.dlr.de/132108/
Document Type:Conference or Workshop Item (Lecture)
Title:Parallel Merge Sort for Data Analysis
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Holke, JohannesGerman Aerospace Center (DLR), Linder Höhe, 51147 Köln, Germanyhttps://orcid.org/0000-0002-2783-3286UNSPECIFIED
Rüttgers, AlexanderUNSPECIFIEDhttps://orcid.org/0000-0001-6347-9272UNSPECIFIED
Klitz, MargritUNSPECIFIEDhttps://orcid.org/0000-0003-3657-4180UNSPECIFIED
Basermann, AchimUNSPECIFIEDhttps://orcid.org/0000-0003-3637-3231UNSPECIFIED
Date:September 2019
Refereed publication:No
Open Access:No
Gold Open Access:No
In ISI Web of Science:No
Keywords:Parallel sorting, High-performance computing, Merge sort, Data analysis, Aerospace sciences
Event Title:Workshop von SC-HPC mit dem Mathematischen Institut der Universität zu Köln
Event Location:Universität Köln
Event Type:Workshop
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Space System Technology
DLR - Research area:Raumfahrt
DLR - Program:R SY - Space System Technology
DLR - Research theme (Project):R - Vorhaben SISTEC (old)
Location: Köln-Porz
Institutes and Institutions:Institut of Simulation and Software Technology
Institut of Simulation and Software Technology > High Performance Computing
Deposited By: Holke, Johannes
Deposited On:10 Dec 2019 09:15
Last Modified:29 Mar 2023 00:44

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.