elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Using big data technologies to process operational events from field units as well as large scale railway network simulations

Schubert, Lucas Andreas and Erdmann, Jakob and Patil, Akhil and Melde, Eric (2019) Using big data technologies to process operational events from field units as well as large scale railway network simulations. 12th World Congress on Railway Research, 28. Okt. - 01. Nov. 2019, Tokyo, Japan.

[img] PDF - Only accessible within DLR
469kB
[img] PDF - Only accessible within DLR
2MB
[img] PDF - Only accessible within DLR
1MB

Abstract

Nowadays, in every industry sector, processes and systems are being automated and digitalized. Not only processes, but also the availability of free data sets over open data portals such as the mCloud in Germany is creating diverse new possibilities in correlating different data for creating new knowledge. The railway sector is also being directly involved in this process. This article describes the activities in the project Rail2X-Smart Servicesi concerning the use of a data management system composed by big data technologies to process real time data from the field as also a large scale simulation from Germany by using the open source microsimulation software SUMO and a simulation middleware which based on the simulated data from SUMO reproduces the project use cases behavior and generates events which are send to the big data cluster. The big data technologies used in this project is the Apache Kafka message broker framework, the Apache Flink streaming processing framework, the Apache Spark batch processing framework and the Apache Hadoop Framework. All these frameworks are open source tools which are used in the Rail2X-Smart Services project to process standardized messages from the field such as vehicle trajectories, measuring data and status messages. We describe which and how this open source frameworks are going to be used and the architectural build of the system.

Item URL in elib:https://elib.dlr.de/127276/
Document Type:Conference or Workshop Item (Speech, Poster)
Title:Using big data technologies to process operational events from field units as well as large scale railway network simulations
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iD
Schubert, Lucas AndreasLucas.Schubert (at) dlr.dehttps://orcid.org/0000-0002-5516-5326
Erdmann, JakobJakob.Erdmann (at) dlr.deUNSPECIFIED
Patil, AkhilUNSPECIFIEDUNSPECIFIED
Melde, EricEric.Melde (at) dlr.deUNSPECIFIED
Date:28 October 2019
Refereed publication:Yes
Open Access:No
Gold Open Access:No
In SCOPUS:No
In ISI Web of Science:No
Status:Published
Keywords:Big Data, Simulation, Real Time, V2X
Event Title:12th World Congress on Railway Research
Event Location:Tokyo, Japan
Event Type:international Conference
Event Dates:28. Okt. - 01. Nov. 2019
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Transport
HGF - Program Themes:Rail Transport
DLR - Research area:Transport
DLR - Program:V SC Schienenverkehr
DLR - Research theme (Project):V - Digitalisierung und Automatisierung des Bahnsystems
Location: Braunschweig
Institutes and Institutions:Institute of Transportation Systems > Data Management and Knowledge Discovery
Deposited By: Schubert, Lucas Andreas
Deposited On:23 Oct 2019 09:15
Last Modified:20 Mar 2020 13:11

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.