elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Contact | Deutsch
Fontsize: [-] Text [+]

Validation Methods and Techniques derived by lessons learnt in EMMA2

Biella, Marcus and Kaltenhäuser, Sven and Jakobi, Jörn (2010) Validation Methods and Techniques derived by lessons learnt in EMMA2. ASDA Seminar 2010, 3.-4. Nov. 2010, Neapel, Italien.

Full text not available from this repository.

Abstract

Beyond the scientific results the European Project EMMA2 was able to learn lessons how to validate in the future. The strengths of the E-OCVM – the basis of validation – are obvious: its six sub-steps facilitate planning of validation studies for both laymen and experts. In the same way E-OCVM’s levels of maturity are helpful in determining the status of a new concept. However good advice about how to find the appropriate methods and techniques for each maturity level is lacking. The sketchiness and novelty of concepts with levels V1/V2 should lead to measure “Operational Feasibility” only but not “Operational Improvements” in terms of Efficiency, Capacity, Safety, Human Factors issues etc. It is unlikely to expect meaningful or even statistically significant effects e.g. for increased capacity or enhanced situation awareness, if the system is too unclear or maybe even too complex or simply too novel for the user. Operational Feasibility consists of acceptance and usability of the new system by tomorrow’s user. It should be measured for example with a tailor-made questionnaire consisting of items directly derived from the operational concept. Hence the number of baseline scenarios may be reduced as far as possible because scenarios with today’s concepts won’t shed too much light in the acceptance of new systems. Given a transformation of a new concept to more mature levels like V3/V4, additional measurements are recommended to be applied to test finally Operational Improvements. Such kind of tests should only be conducted in shape of real-time simulations: Effects of increased efficiency or decreased workload can only be measured if an accurate designing of test scenarios took place in sub-step 2.5. It has to be guaranteed that baseline scenarios make the results of a new applied system comparable. Here the use of standard questionnaires like NASA-TLX or simple scales like ISA are suitable to measure operators’ reaction to new systems. For experiments in a complex and increasingly cooperative ATM the need for distributed- or coupled simulation setups is getting more and more relevant. The efficient use of such an experimental environment for validation requires the provision of standardised ways to connect simulators and exchange simulation data. To improve interoperability between validation platforms the EUROCAE WG81 is therefore developing the required standards and recommendation.

Document Type:Conference or Workshop Item (Speech)
Additional Information:referiertes Abstract
Title:Validation Methods and Techniques derived by lessons learnt in EMMA2
Authors:
AuthorsInstitution or Email of Authors
Biella, MarcusFL-SE
Kaltenhäuser, SvenFL-AS
Jakobi, JörnFL-SE
Date:November 2010
Refereed publication:Yes
In ISI Web of Science:No
Status:Published
Keywords:Validation, A-SMGCS, Real Time Simulation, Field Tests, Flight Tests, Questionnaires
Event Title:ASDA Seminar 2010
Event Location:Neapel, Italien
Event Type:international Conference
Event Dates:3.-4. Nov. 2010
Organizer:ASDA
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Aeronautics
HGF - Program Themes:ATM and Operation
DLR - Research area:Aeronautics
DLR - Program:L AO - Air Traffic Management and Operation
DLR - Research theme (Project):L - Human Factors and Safety in Aeronautics
Location: Braunschweig
Institutes and Institutions:Institute of Flight Control > Systemergonomy
Institute of Flight Control > ATM-Simulation
Deposited By: Marcus Biella
Deposited On:30 Jul 2012 15:23
Last Modified:08 May 2014 23:23

Repository Staff Only: item control page

Browse
Search
Help & Contact
Informationen
electronic library is running on EPrints 3.3.12
Copyright © 2008-2012 German Aerospace Center (DLR). All rights reserved.