DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Combined metrics for the evaluation of air traffic controller assistance systems

Friedrich, Maik and Helmke, Hartmut and Mühlhausen, Thorsten and Ohneiser, Oliver and Ehr, Heiko (2015) Combined metrics for the evaluation of air traffic controller assistance systems. In: Proceeding of the 6th International Conference on Applied Human Factors and Ergonomics 2015. Springer Press. 6th International Conference on Applied Human Factors and Ergonomics, 27. Jul. - 31. Jul. 2015, Las Vegas, USA.

Full text not available from this repository.


Today's assistance systems in aviation, as an arrival manager (AMAN), are able to plan efficient approach sequences and propose suggestions for optimized approaches. The AMAN acts as a suggestion system that proposes a plan and supports the air traffic control officer (ATCO) by implementing it. If the ATCO deviates from the instructions proposed by the AMAN, such as change of heading, altitude or speed, this leads to a changed flight profile. To update the planning and suggestion process current AMAN implementations use radar information to detect the changed flight profiles. The AMAN update thus depended on radio transmission, reaction time of the pilot and the implemented algorithms for change detection. Worst case, the updated planning between the pilot and sequencing of the AMAN could last more than 30 seconds. As part of the project AcListant® (Active Listening Assistant) two modalities were compared, using the ATCO behavior directly to distinguish changes to the flight path. A modality uses the mouse as input device for changes to the planning and the other uses the radio communication of the ATCO by analyzing their commands with Automatic Speech Recognition (ASR). This allows the AMAN to detect and implement changes to the planning by the ATCO much faster than before. The modalities were tested in a validation campaign with three operational experts in two different scenarios. The used traffic scenarios ensured a high degree of realism and an average traffic load. The metrics to evaluate the modalities can be categorized into safety (e.g. number of conflicts), efficiency (e.g. delay), and workload (NASA Task Load Index Score and Instantaneous Self Assessment). Also all communication of the participants were transcribed and analyzed to obtain the usage of the radio channel and also information about the context. Since the ATCO task is complex none of the selected metrics alone is suitable to give a statement about the quality of the modalities. An addition challenge is the fact that the AMAN and the modalities operate on a suggestion level and therefore is not binding for the ATCO. We chose a task analysis based on radio communication and observation to find a reasonable combination of different metrics and thus provide a comprehensive insight into the influence of modalities on the ATCO behavior. The combination of metrics is used to perform an assessment of the modalities. Therefore the assessment refers to both the complexity of the working environment as well as the observed ATCO activities.

Item URL in elib:https://elib.dlr.de/97856/
Document Type:Conference or Workshop Item (Speech)
Additional Information:http://sites.bs.dlr.de/fl/FLDA/publications/AHFE%202015%20Abstract%20Combined%20metrics%20for%20the%20evaluation%20of%20air%20traffic%20controller%20assistance%20systems.pdf
Title:Combined metrics for the evaluation of air traffic controller assistance systems
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Friedrich, MaikUNSPECIFIEDhttps://orcid.org/0000-0003-3742-2322UNSPECIFIED
Helmke, HartmutUNSPECIFIEDhttps://orcid.org/0000-0002-1939-0200UNSPECIFIED
Mühlhausen, ThorstenUNSPECIFIEDhttps://orcid.org/0000-0002-5901-7275UNSPECIFIED
Ohneiser, OliverUNSPECIFIEDhttps://orcid.org/0000-0002-5411-691XUNSPECIFIED
Date:July 2015
Journal or Publication Title:Proceeding of the 6th International Conference on Applied Human Factors and Ergonomics 2015
Refereed publication:Yes
Open Access:No
Gold Open Access:No
In ISI Web of Science:No
Publisher:Springer Press
Keywords:AMAN, ATCO, Speech recognition, AcListant
Event Title:6th International Conference on Applied Human Factors and Ergonomics
Event Location:Las Vegas, USA
Event Type:international Conference
Event Dates:27. Jul. - 31. Jul. 2015
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Aeronautics
HGF - Program Themes:air traffic management and operations
DLR - Research area:Aeronautics
DLR - Program:L AO - Air Traffic Management and Operation
DLR - Research theme (Project):L - Human factors and safety in Aeronautics (old)
Location: Braunschweig
Institutes and Institutions:Institute of Flight Guidance > Systemergonomy
Deposited By: Friedrich, Maik
Deposited On:03 Sep 2015 17:37
Last Modified:29 Mar 2023 00:23

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.