BMW partners with Meta to make vehicle-compatible VR goggles a reality

Virtual reality and cars don’t mix, but BMW and social media conglomerate Meta are investing time, money, and effort to change that. For nearly a decade now, BMW has dedicated its efforts to seamlessly incorporating virtual reality into its vehicles. Unfortunately for BMW, they have hit wall after wall in development until recently due to the challenges posed by the interaction between VR devices and the car's dynamic movements, as well as the visual consistency within its interior. Fortunately, BMW is making considerable progress with the assistance of Meta, marking a significant breakthrough in the integration of VR technology.

In a collaborative effort, Meta and BMW have developed a proof of concept virtual reality (VR) headset capable of distinguishing between the activities occurring within the car and the world outside of the car’s cabin surrounding it. 

The proof-of-concept prototype showcases a comprehensive range of movements within the vehicle, referred to as six degrees of freedom, along with an extended reality (XR) experience. This innovative system seamlessly combines two crucial calculations: determining the headset's position relative to the car and tracking the car's movement in relation to the external world.

In order to address the disconnect between what the camera sees and what the VR headset senses, BMW devised a solution by connecting a test vehicle's sensors to the tracking system of a Meta Quest Pro headset. BMW’s headset-to-vehicle integration enables the system to accurately determine the device's position in relation to the car, as well as the car's movement in relation to the surrounding environment. By combining these data points, BMW has successfully resolved the issue of alignment between the camera's observations and the VR headset's interpretation.

So what does this mean exactly for the future of motoring? Aside from situations that BMW pointed out like hazard recognition and displaying information about your vehicle’s conditions in real life, we’re at a loss on the other potential uses of VR in a car. Fortunately for us, the smart people over at BMW and Meta will continue to delve deeper into VR applications in cars.