elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Data-adapted Parallel Merge Sort

Holke, Johannes and Rüttgers, Alexander and Klitz, Margrit and Basermann, Achim (2019) Data-adapted Parallel Merge Sort. In: Data-adapted Parallel Merge Sort. High-Performance Computing and Networking in Aerospace Workshop at EuroPar Conference 2019, 26-30 Aug 2019, Göttingen, Germany. (Unpublished)

[img] PDF - Registered users only
3MB

Abstract

In the aerospace sciences we produce huge amounts of data. This data must be arranged in a meaningful order, so that we can analyze or visualize it. In this paper we focus on data that is distributed among computer processes and then needs to be sorted by a single root process for further analysis. We assume that the memory on the root process is too small to hold all sorted data at once, so that we have to perform the sorting and processing of data chunk-wise. We prove the efficiency of our approach in weak scaling tests, where we achieve a near constant bandwidth. Additionally, we obtain a considerable speed up compared to the standard parallel external sort. We also demonstrate the usefulness of our algorithm in a real-life aviation application.

Item URL in elib:https://elib.dlr.de/131410/
Document Type:Conference or Workshop Item (Lecture)
Title:Data-adapted Parallel Merge Sort
Authors:
AuthorsInstitution or Email of AuthorsAuthors ORCID iD
Holke, JohannesGerman Aerospace Center (DLR), Linder Höhe, 51147 Köln, Germanyhttps://orcid.org/0000-0002-2783-3286
Rüttgers, AlexanderAlexander.Ruettgers (at) dlr.dehttps://orcid.org/0000-0001-6347-9272
Klitz, MargritMargrit.Klitz (at) dlr.deUNSPECIFIED
Basermann, AchimAchim.Basermann (at) dlr.dehttps://orcid.org/0000-0003-3637-3231
Date:26 August 2019
Journal or Publication Title:Data-adapted Parallel Merge Sort
Refereed publication:Yes
Open Access:No
Gold Open Access:No
In SCOPUS:No
In ISI Web of Science:No
Status:Unpublished
Keywords:Parallel sorting, High-performance computing, Merge sort, Data analysis, Aerospace sciences
Event Title:High-Performance Computing and Networking in Aerospace Workshop at EuroPar Conference 2019
Event Location:Göttingen, Germany
Event Type:Workshop
Event Dates:26-30 Aug 2019
Organizer:Ramin Yahyapour
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Space Technology
DLR - Research area:Raumfahrt
DLR - Program:R SY - Technik für Raumfahrtsysteme
DLR - Research theme (Project):R - Vorhaben SISTEC
Location: Köln-Porz
Institutes and Institutions:Institut of Simulation and Software Technology
Institut of Simulation and Software Technology > High Performance Computing
Deposited By: Holke, Johannes
Deposited On:11 Dec 2019 12:50
Last Modified:11 Dec 2019 12:50

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Copyright © 2008-2017 German Aerospace Center (DLR). All rights reserved.