Bohemia Interactive Simulations (BISim), a developer of advanced simulation and training software, has developed an augmented reality visual system for TRU Simulation + Training Inc., a Textron company, that provides a synthetically generated visual scene and supports a trainee’s interactions with the real world. Leveraging emerging augmented reality/virtual reality (AR/VR) technologies, the system lets trainees see and interact with the physical aircraft controls, equipment and crew members using video that is digitally composited with a realistic, synthetically generated virtual environment through a helmet-mounted display.

Integrated with TRU’s Bell V-280 Valor technology demonstrator, the solution provides a highly interactive visual environment combined with tactile feedback and physical interactions with controls in a portable package. The system is on display this week during I/ITSEC 2017 at TRU Simulation + Training Inc.’s booth #1700.

At the heart of this augmented reality visual system is BISim’s VBS Blue IG, a WGS-84 round-earth, blended procedural and imagery-based whole-earth visualization solution designed to simulate the air, land, maritime and space domains. It’s optimized for AR/VR applications and provides high frame rates needed to combat cybersickness and supports integration with a variety of HMDs and peripherals. The solution leverages a variety of emerging consumer and professional AR/VR HMD technologies and offers a scalable solution. VBS Blue IG demonstrations are also taking place at BISim’s booth #2235 during I/ITSEC.

The Augmented Reality Visual System is designed to support a new class of simulator devices that are offered as part of a continuum of training or as an upgrade to any existing simulator that can benefit from the addition of a high-fidelity, full field-of-view image generation system. Using a system of simple markers applied to the physical crewstation and a custom masking system that controls the mix of video and synthetic imagery, the system supports most any physical device without the need for greenscreen compositing or special lighting, including devices with physical heads-up displays (HUD)s.