Novel, Lightweight Flight Simulator System Based on Mixed Reality

Formation training and natural interaction between pilot and cockpit are two key technology issues for developing flight simulator. A lightweight flight simulator system was developed with virtual–real cockpit view using mixed reality technology. First innovation of the system is that a fusion approach of virtual-real scene, based on multiple fixed cameras (MFC), was proposed to superimpose real image streams of cockpit interaction area on virtual graphics of cockpit environment using 2D four points texture mapping. Second one is to simulate formation training realistically. The results of primary test show that the developed lightweight flight simulator is an important complement to current large flight simulator due to its strong enhancement of understanding cockpit environment, effective improvement of natural interaction capability between pilot and cockpit and special predominance over other in terms of multiple planes training such as formation training.