DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Implementation of a mixed-reality flight simulator: blending real and virtual with a video-see-through head-mounted display

Ernst, Johannes Maria and Laudien, Tim and Schmerwitz, Sven (2023) Implementation of a mixed-reality flight simulator: blending real and virtual with a video-see-through head-mounted display. In: Proceedings of SPIE - The International Society for Optical Engineering, 125380R. SPIE Press. SPIE Defense + Commercial Sensing 2023, 2023-05-01 - 2023-05-04, Orlando, FL, USA. doi: 10.1117/12.2664848. ISSN 0277-786X.

[img] PDF

Official URL: https://www.spiedigitallibrary.org/conference-proceedings-of-spie/12538/2664848/Implementation-of-a-mixed-reality-flight-simulator--blending-real/10.1117/12.2664848.full


Conventional flight simulators usually include a complex and expensive outside vision projection system. Especially scenarios where the helicopter pilots look far to the side or through the windows near the pedals require a large projection dome to provide an image of the outside world. Additionally, simulators used for research need to be highly customizable: For rapid prototyping of new flight deck designs, the cockpit mockup must be adaptable enough to change the appearance and arrangement of its elements. The recent technological advancements of head-mounted displays (HMDs) offer many new ways to create a simulator that fulfills the stated requirements at moderate cost. A non-see-through HMD can immerse the pilots into a computer-generated cockpit with "unrestricted" virtual out-the-window view. The downwards view is even better than with dome projections. Such a fully virtual approach, however, requires complex finger-tracking and haptic feedback solutions to enable the user to interact with the cockpit. By contrast, a video-see-through HMD allows us to selectively combine a highly customizable virtual world with a video-stream of the real surroundings. One can, for instance, show the pilot's hands and relevant parts of the physical flight deck mockup, enriched with virtual elements and virtual out-the-window view. In such a mixed setup, the pilots can naturally and directly interact with conventional input devices in an otherwise virtual environment. The paper presents our implementation of a mixed reality simulator with the Varjo XR-3 video-see-through HMD. We assess different variants, discuss implementation details like real-to-virtual-world-alignment, and explain the major challenges of such setups.

Item URL in elib:https://elib.dlr.de/195622/
Document Type:Conference or Workshop Item (Speech)
Title:Implementation of a mixed-reality flight simulator: blending real and virtual with a video-see-through head-mounted display
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Ernst, Johannes MariaUNSPECIFIEDhttps://orcid.org/0000-0001-8238-3671UNSPECIFIED
Laudien, TimUNSPECIFIEDhttps://orcid.org/0009-0005-9178-115X140634432
Schmerwitz, SvenUNSPECIFIEDhttps://orcid.org/0000-0002-9194-8838UNSPECIFIED
Journal or Publication Title:Proceedings of SPIE - The International Society for Optical Engineering
Refereed publication:Yes
Open Access:Yes
Gold Open Access:No
In ISI Web of Science:Yes
Page Range:125380R
EditorsEmailEditor's ORCID iDORCID Put Code
Publisher:SPIE Press
Series Name:Proceedings of SPIE
Keywords:head-mounted display, head-worn display, mixed reality, video-see-through HMD, flight simulator, augmented reality, virtual reality
Event Title:SPIE Defense + Commercial Sensing 2023
Event Location:Orlando, FL, USA
Event Type:international Conference
Event Start Date:1 May 2023
Event End Date:4 May 2023
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Aeronautics
HGF - Program Themes:Air Transportation and Impact
DLR - Research area:Aeronautics
DLR - Program:L AI - Air Transportation and Impact
DLR - Research theme (Project):L - Integrated Flight Guidance
Location: Braunschweig
Institutes and Institutions:Institute of Flight Guidance > Pilot Assistance
Deposited By: Ernst, Johannes Maria
Deposited On:17 Aug 2023 12:17
Last Modified:24 Apr 2024 20:56

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.