Gontar, Patrick and Hörmann, H.-J. (2015) RELIABILITY OF INSTRUCTOR PILOTS' NON-TECHNICAL SKILLS RATINGS. 18th International Symposium on Aviation Psychology, 4.-7. Mai 2015, Dayton/OH, USA.
![]() |
PDF
347kB |
Abstract
This paper presents the results of different methods to assess reliability when instructor pilots rate pilots regarding their non-technical skills (NOTECHS). In preparation for a major inter-rater reliability study, this pretest analyzes the rating behavior of two instructor pilots during a full-flight simulator mission. Besides inter-rater reliability and test-retest reliability, the pilots’ self-rating (n =12) and the instructors’ point of view is analyzed. Results indicate a wide spread from poor to excellent reliabilities as a function of the different rating dimensions. Regarding inter-rater reliability, it is found that non-technical skills are rated more reliably under high workload conditions than under low workload conditions, and social aspects of non-technical skills are rated more reliably than cognitive aspects. Test-retest reliability is found to be .6 on average, whereas self-rating / instructor rating reliability is .5 on average. Based on these findings, implications for the major inter-rater reliability study will be derived and incorporated.
Item URL in elib: | https://elib.dlr.de/97309/ | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Document Type: | Conference or Workshop Item (Speech) | |||||||||
Title: | RELIABILITY OF INSTRUCTOR PILOTS' NON-TECHNICAL SKILLS RATINGS | |||||||||
Authors: |
| |||||||||
Date: | May 2015 | |||||||||
Refereed publication: | No | |||||||||
Open Access: | Yes | |||||||||
Gold Open Access: | No | |||||||||
In SCOPUS: | No | |||||||||
In ISI Web of Science: | No | |||||||||
Status: | Published | |||||||||
Keywords: | interrater reliability, non-technical skills, pilot performance, flight simulator | |||||||||
Event Title: | 18th International Symposium on Aviation Psychology | |||||||||
Event Location: | Dayton/OH, USA | |||||||||
Event Type: | international Conference | |||||||||
Event Dates: | 4.-7. Mai 2015 | |||||||||
HGF - Research field: | Aeronautics, Space and Transport | |||||||||
HGF - Program: | Aeronautics | |||||||||
HGF - Program Themes: | air traffic management and operations | |||||||||
DLR - Research area: | Aeronautics | |||||||||
DLR - Program: | L AO - Air Traffic Management and Operation | |||||||||
DLR - Research theme (Project): | L - Human factors and safety in Aeronautics (old) | |||||||||
Location: | Hamburg | |||||||||
Institutes and Institutions: | Institute of Aerospace Medicine > Aviation and Space Psychology | |||||||||
Deposited By: | Hörmann, Dr.phil. Hans-Jürgen | |||||||||
Deposited On: | 27 Jul 2015 15:32 | |||||||||
Last Modified: | 31 Jul 2019 19:54 |
Repository Staff Only: item control page