Virtual Cockpit Instruments - How Head-Worn Displays Can Enhance the Obstacle Awareness of Helicopter Pilots

Abstract

The rise of augmented reality glasses and related technologies offers new possibilities for the human-machine interface design of future aircraft. Today, head-worn displays (HWDs) are mainly used by military pilots, for instance by helicopter crews for low-visibility operations close to ground and obstacles. Nevertheless, recent technological advances in this area allow the prediction that these systems could become available for more pilots in the future. This article presents a concept how state-of-the-art HWD symbology can be expanded to get even more out of the advantages of this technology. With so-called "virtual cockpit instruments" (VCIs), an HWD can show information, which is conventionally rendered on panel-mounted displays. These VCIs can be imagined as virtual display screens, which can be positioned freely around the pilot. Their major benefit is that they create many new options for the design of a flexible, situation-adaptive cockpit environment. This article introduces the general concept and presents several options how such an approach can be put into practice. Here, the concept is applied to helicopter operations in offshore windparks. We implemented a VCI-adapted obstacle awareness display and assessed a set of positioning variants for the new VCI. Two simulator studies -- with 11 and 7 participants -- provide interesting insights on the realization of this concept. In addition to high subjective ratings, the VCI significantly increased the pilot's head-up, eyes-out time -- an important measure for challenging maneuvers close to obstacles. Overall, this article illustrates a promising concept for the human-machine interface design of future cockpits and discusses its potentials and limitations.