elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Assistant Based Speech Recognition Support for Air Traffic Controllers in a Multiple Remote Tower Environment

Ohneiser, Oliver and Helmke, Hartmut and Shetty, Shruthi and Kleinert, Matthias and Ehr, Heiko and Schier-Morgenthal, Sebastian and Sarfjoo, Seyyed Saeed and Motlicek, Petr and Murauskas, Šarūnas and Pagirys, Tomas and Usanovic, Haris and Meštrović, Mirta and Cerna, Aneta (2023) Assistant Based Speech Recognition Support for Air Traffic Controllers in a Multiple Remote Tower Environment. Aerospace, 10 (6), pp. 1-42. Multidisciplinary Digital Publishing Institute (MDPI). doi: 10.3390/aerospace10060560. ISSN 2226-4310.

[img] PDF - Published version
9MB

Abstract

Assistant Based Speech Recognition (ABSR) systems for air traffic control radiotelephony communication have shown their potential to reduce air traffic controllers' (ATCos) workload. Related research activities mainly focused on utterances for approach and en-route traffic. This is one of the first investigations of how ABSR could support ATCos in a tower environment. Ten ATCos from Lithuania and Austria participated in a human-in-the-loop simulation to validate ABSR support within a prototypic multiple remote tower controller working position. The ABSR supports ATCos by (1) highlighting recognized callsigns, (2) inputting recognized commands from ATCo utterances in electronic flight strips, (3) offering correction of ABSR output, (4) automatically accepting ABSR output, and (5) feeding the digital air traffic control system. This paper assesses human factors such as workload, situation awareness, and usability when ATCos are supported by ABSR. Those assessments result from a system with a relevant command recognition rate of 82.9% and a callsign recognition rate of 94.2%. Workload reductions and usability improvement with p-values below 0.25 ar e obtained for the case when the ABSR system is compared to the baseline situation without ABSR support. This motivates the technology to be brought to a higher technology readiness level, which is also confirmed by subjective feedback from questionnaires and objective measurement of workload reduction based on a performed secondary task.

Item URL in elib:https://elib.dlr.de/197578/
Document Type:Article
Title:Assistant Based Speech Recognition Support for Air Traffic Controllers in a Multiple Remote Tower Environment
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Ohneiser, OliverUNSPECIFIEDhttps://orcid.org/0000-0002-5411-691XUNSPECIFIED
Helmke, HartmutUNSPECIFIEDhttps://orcid.org/0000-0002-1939-0200UNSPECIFIED
Shetty, ShruthiUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Kleinert, MatthiasUNSPECIFIEDhttps://orcid.org/0000-0002-0782-4147UNSPECIFIED
Ehr, HeikoUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Schier-Morgenthal, SebastianUNSPECIFIEDhttps://orcid.org/0009-0002-9987-4869144839628
Sarfjoo, Seyyed SaeedUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Motlicek, PetrUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Murauskas, ŠarūnasState Enterprise Oro Navigacija (ON)UNSPECIFIEDUNSPECIFIED
Pagirys, TomasState Enterprise Oro Navigacija (ON)UNSPECIFIEDUNSPECIFIED
Usanovic, HarisAustro Control (ACG)UNSPECIFIEDUNSPECIFIED
Meštrović, MirtaCroControlUNSPECIFIEDUNSPECIFIED
Cerna, AnetaUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Date:14 June 2023
Journal or Publication Title:Aerospace
Refereed publication:Yes
Open Access:Yes
Gold Open Access:Yes
In SCOPUS:Yes
In ISI Web of Science:Yes
Volume:10
DOI:10.3390/aerospace10060560
Page Range:pp. 1-42
Publisher:Multidisciplinary Digital Publishing Institute (MDPI)
Series Name:Special Issue Automatic Speech Recognition and Understanding in Air Traffic Management
ISSN:2226-4310
Status:Published
Keywords:air traffic controller; multiple remote tower; assistant-based speech recognition; automatic speech recognition and understanding; electronic flight strip
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Aeronautics
HGF - Program Themes:Air Transportation and Impact
DLR - Research area:Aeronautics
DLR - Program:L AI - Air Transportation and Impact
DLR - Research theme (Project):L - Integrated Flight Guidance
Location: Braunschweig
Institutes and Institutions:Institute of Flight Guidance > Controller Assistance
Deposited By: Ohneiser, Oliver
Deposited On:19 Oct 2023 16:35
Last Modified:19 Oct 2023 16:35

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.