elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Integration of Eye-Tracking and Assistant Based Speech Recognition for the command prediction at the controller working position

Adamala, Jyothsna (2021) Integration of Eye-Tracking and Assistant Based Speech Recognition for the command prediction at the controller working position. Master's, Technische Universität Chemnitz.

Full text not available from this repository.

Abstract

This thesis aims to improve task-specific Assistant Based Speech Recognition (ABSR) for Air Traffic Controllers (ATCOs) by extracting information from multiple modalities (gaze and mouse data). ABSR processes the radar information and generates a set of hypotheses with uniform probability which is used as an additional input for speech recognition along with the audio signal. Each proposal has a command type, command value associated with an aircraft available on the screen. A framework for integrating multimodal information with proposed hypotheses by redistributing the probability for each proposal based on a rescoring algorithm is formulated. The rescoring algorithm to identify aircraft of interest has been developed based on ATCO’s gaze and mouse interaction with the radar screen. Based on trial runs done at DLR, the rescoring algorithm shows improvement in probability for predicting the correct aircraft by a factor of 4.7 in comparison with uniform probability. Further, a rescoring method for identifying the most likely command based on aircraft situation is also proposed. This framework could further be used to integrate other possible modalities in the future.

Item URL in elib:https://elib.dlr.de/146429/
Document Type:Thesis (Master's)
Additional Information:Betreuer: Dr. Oliver Ohneiser
Title:Integration of Eye-Tracking and Assistant Based Speech Recognition for the command prediction at the controller working position
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Adamala, JyothsnaTU ChemnitzUNSPECIFIEDUNSPECIFIED
Date:2021
Refereed publication:No
Open Access:No
Number of Pages:98
Status:Published
Keywords:Eye tracking, ABSR, ASR, ATCO
Institution:Technische Universität Chemnitz
Department:Dept. of Computer Science Chair of Computer Engineering
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Aeronautics
HGF - Program Themes:other
DLR - Research area:Aeronautics
DLR - Program:L - no assignment
DLR - Research theme (Project):L - Managementaufgaben Luftfahrt
Location: Braunschweig
Institutes and Institutions:Institute of Flight Guidance > Controller Assistance
Deposited By: Diederich, Kerstin
Deposited On:30 Nov 2021 17:54
Last Modified:30 Nov 2021 17:54

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.