Virtual Cockpit: an immersive head-worn display as human machine interface for helicopter operations

Abstract

Increasing the pilot's situation awareness is a major goal for the design of next generation aircraft cockpits. A fundamental problem poses the pilot's out-the-window view which is often degraded due to adverse weather, darkness, or the aircraft structure itself. A common approach to this problem is to generate an enhanced model of the surroundings via aircraft-mounted sensors and databases containing terrain and obstacle information. In the helicopter domain, the resulting picture of the environment is then presented to the pilot either via a panel-mounted display or via a see-through head-worn display. This paper investigates a third method for information display. The concept - called Virtual Cockpit - applies a non-see-through head-worn display. With such a virtual reality display, advantages of established synthetic and enhanced vision systems can be combined while existing limitations can be overcome. Besides a theoretical discussion of advantages and drawbacks, two practical implementations of this concept are shown for helicopter offshore operations exemplarily. Two human factors studies were conducted in a simulation environment based on the game engine Unity. They prove the general potential of the Virtual Cockpit to become a candidate for a future cockpit in the long-term.