elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

High-Performance Data Analysis with the Helmholtz Analytics Toolkit

Siggel, Martin and Debus, Charlotte and Rüttgers, Alexander and Krajsek, Kai and Knechtges, Philipp and Götz, Markus and Comito, Claudia and Hagemeier, Björn (2019) High-Performance Data Analysis with the Helmholtz Analytics Toolkit. Computational Sciences and AI in Industry (CSAI), 12.-14. Jun. 2019, Jyväskylä, Finnland.

[img] PDF
4MB

Abstract

This work introduces the Helmholtz Analytics Toolkit (HeAT), a scientific big data analytics library for High-Performance Computing (HPC) and High-Performance Data Analytics (HPDA) systems. The large progress in big data analytics in general and machine learning/deep learning (ML/DL) in particular, has been considerably enforced by well-designed open source libraries like Hadoop, Spark, Storm, Disco, scikit-learn, H2O.ai, Mahout, TensorFlow, PaddlePaddle, PyTorch, Caffe, Keras, MXNet, CNTK, BigDL, Theano, Neon, Chainer, DyNet, Dask and Intel DAAL to mention only a few of them. Despite the large number of existing data analytics frameworks, a library taking the specific needs in scientific big data analytics under consideration is still missing. For instance, no pre-existing library operates on heterogeneous hardware like GPU/CPU systems while allowing transparent computation on distributed systems. Typical big data analytics frameworks like Spark are designed for distributed memory systems and consequently do not fully explore the shared memory architecture as well as the network technology of HPC systems. ML/DL frameworks like Theano or Chainer focus on single node computations or when providing mechanisms for distributed computation, as done by TensorFlow or PyTorch, they impose the details of the distributed computation to the programmer. Libraries designed for HPC like Dask and Intel DAAL do not provide any GPU support. The presented library - HeAT - is designed for the specific needs of big data analytics in the scientific context. It is based on a distributed tensor data object on which operations can be performed like basic scalar functions, linear algebra algorithms, slicing or broadcasting operations necessary for most data analytics algorithms. The tensor data objects reside either on the CPU or on the GPU and, if needed, are distributed over various nodes. Operations on tensor objects are transparent to the user, i.e. they remain the same irrespective of whether the tensor object resides on a single node or if it is distributed over several nodes allowing to conveniently port algorithms from single nodes to multiple nodes or from CPUs to GPUs. HeAT's tensor module offers a Python-based API almost identical to NumPy, which allow a fast transition from vectorized NumPy code to a parallel and distributed HeAT code. HeAT builds on top of PyTorch, which already provides many required features like automatic differentiation, CPU and GPU support, linear algebra operations, and basic MPI functionality as well as an imperative programming paradigm allowing for fast prototyping essentially in scientific research. In addition to basic tensor operations, HeAT implements several common data analytics algorithms, e.g. k-means, logistic regression and neural networks, optimized for large scale distributed systems. We demonstrate the runtime performance of HeAT using a clustering of 8 GB image data of a rocket engine combustion taken from high-speed cameras. Compared to the performance of the k-means clustering algorithm on MATLAB or the serial HeAT implementation, the distributed computation with 16 MPI ranks leads to a runtime acceleration of about a factor of 20. Since the serial k-means clustering also has a very high memory requirement for these large data sets, the distributed computation even enables the computation of even larger data sets, which would not be possible with single node shared-memory only computation.

Item URL in elib:https://elib.dlr.de/132418/
Document Type:Conference or Workshop Item (Speech)
Title:High-Performance Data Analysis with the Helmholtz Analytics Toolkit
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Siggel, MartinUNSPECIFIEDhttps://orcid.org/0000-0002-3952-4659UNSPECIFIED
Debus, CharlotteUNSPECIFIEDhttps://orcid.org/0000-0002-7156-2022UNSPECIFIED
Rüttgers, AlexanderUNSPECIFIEDhttps://orcid.org/0000-0001-6347-9272UNSPECIFIED
Krajsek, KaiForschungszentrum Jülichhttps://orcid.org/0000-0003-3417-161XUNSPECIFIED
Knechtges, PhilippUNSPECIFIEDhttps://orcid.org/0000-0002-4849-0593UNSPECIFIED
Götz, MarkusKarlsruher Institut für Technologie (KIT)https://orcid.org/0000-0002-2233-1041UNSPECIFIED
Comito, ClaudiaForschungszentrum JülichUNSPECIFIEDUNSPECIFIED
Hagemeier, BjörnForschungszentrum Jülichhttps://orcid.org/0000-0003-1528-0933UNSPECIFIED
Date:14 June 2019
Refereed publication:Yes
Open Access:Yes
Gold Open Access:No
In SCOPUS:No
In ISI Web of Science:No
Status:Published
Keywords:HeAT, Data Analytics, Distributed, HPDA, MPI, Combustion
Event Title:Computational Sciences and AI in Industry (CSAI)
Event Location:Jyväskylä, Finnland
Event Type:international Conference
Event Dates:12.-14. Jun. 2019
Organizer:University of Jyväskylä
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Space System Technology
DLR - Research area:Raumfahrt
DLR - Program:R SY - Space System Technology
DLR - Research theme (Project):R - Vorhaben SISTEC (old)
Location: Köln-Porz
Institutes and Institutions:Institut of Simulation and Software Technology
Institut of Simulation and Software Technology > High Performance Computing
Deposited By: Siggel, Dr. Martin
Deposited On:10 Dec 2019 11:45
Last Modified:10 Dec 2019 11:45

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.