DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Readback Error Detection by Automatic Speech Recognition to Increase ATM Safety

Helmke, Hartmut and Kleinert, Matthias and Shetty, Shruthi and Ohneiser, Oliver and Ehr, Heiko and Arilíusson, Hörður and Simiganoschi, Teodor S. and Prasad, Amrutha and Motlicek, Petr and Veselý, Karel and Ondřej, Karel and Smrz, Pavel and Harfmann, Julia and Windisch, Christian (2021) Readback Error Detection by Automatic Speech Recognition to Increase ATM Safety. 14th ATM Seminar, 20.09.2021 - 24.09.2021, Virtual.

Full text not available from this repository.


One of the crucial tasks of an air traffic controller (ATCo) is to evaluate pilot readbacks and to react in case of errors. Unde-tected readback errors, when not corrected by ATCos, can have a dramatic impact on air traffic management (ATM) safety. Although they seldomly occur, the benefits of even one prevent-ed incident due to automatic readback error detection justifies the efforts. This, however, requires highly reliable detections, which is beyond the performance of currently available auto-matic speech recognition implementations. The HAAWAII pro-ject aims to achieve false alarm rates below 10% and readback error detection rates better than 50%. After performing a pre-liminary analysis by comparing ATCo utterances with pilot readbacks on word level, this approach proves to be very inef-fective. Callsigns are abbreviated or not even pronounced, alti-tude and speed units are often not used, for example “nineteen eight” is the same as “one one nine decimal eight”. Therefore, the presented approach transforms recognized word sequences into so-called ATC concepts, as agreed with the ontology of the SESAR project PJ.16-04. Detecting readback errors on concept level is more reliable and robust as it also considers different forms of conveying the same semantic messages and is also more tolerant to partially misrecognized words. Nevertheless, a good recognition rate on word level is essential to correctly transform words into concepts, which will be achieved by inte-grating voice data from ATCo utterances and pilot readbacks with context information such as data concerning radar, flight plans, and weather. This paper presents relevant use cases, the ontology-based algorithm, and initial results regarding callsign recognition accuracy for automatic readback error detection purposes.

Item URL in elib:https://elib.dlr.de/145401/
Document Type:Conference or Workshop Item (Speech)
Title:Readback Error Detection by Automatic Speech Recognition to Increase ATM Safety
AuthorsInstitution or Email of AuthorsAuthor's ORCID iD
Helmke, HartmutHartmut.Helmke. (at) dlr.deUNSPECIFIED
Kleinert, MatthiasMatthias.Kleinert (at) dlr.deUNSPECIFIED
Shetty, Shruthishruthi.shetty (at) dlr.deUNSPECIFIED
Ohneiser, OliverOliver.Ohneiser (at) dlr.dehttps://orcid.org/0000-0002-5411-691X
Ehr, HeikoHeiko.Ehr (at) dlr.deUNSPECIFIED
Arilíusson, HörðurHordur.Ariliusson (at) isavia.isUNSPECIFIED
Simiganoschi, Teodor S.Teodor.Simiganoschi (at) isavia.isUNSPECIFIED
Prasad, AmruthaAmrutha.Prasad (at) idiap.chUNSPECIFIED
Motlicek, PetrPetr.Motlicek (at) idiap.chUNSPECIFIED
Veselý, Kareliveselyk (at) fit.vutbr.czUNSPECIFIED
Ondřej, Karelondrej (at) fit.vutbr.czUNSPECIFIED
Smrz, Pavelsmrz (at) fit.vutbr.czUNSPECIFIED
Harfmann, JuliaJulia.Harfmann (at) nats.co.ukUNSPECIFIED
Windisch, Christianchristian.windisch (at) austrocontrol.atUNSPECIFIED
Refereed publication:Yes
Open Access:No
Gold Open Access:No
In ISI Web of Science:No
Keywords:Automatic Speech Recognition (ASR), Readback Error Detection, Air Traffic Control (ATC)
Event Title:14th ATM Seminar
Event Location:Virtual
Event Type:international Conference
Event Dates:20.09.2021 - 24.09.2021
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Aeronautics
HGF - Program Themes:other
DLR - Research area:Aeronautics
DLR - Program:L - no assignment
DLR - Research theme (Project):L - Managementaufgaben Luftfahrt
Location: Braunschweig
Institutes and Institutions:Institute of Flight Guidance > Controller Assistance
Deposited By: Kleinert, Matthias
Deposited On:10 Nov 2021 10:08
Last Modified:10 Nov 2021 10:08

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Copyright © 2008-2017 German Aerospace Center (DLR). All rights reserved.