OpenXR Toolkit Now Supports Eye-Tracking for PC VR Games
Quest Pro’s PC graphics are about to improve considerably as the OpenXR Toolkit now supports eye-tracking with the Quest Pro for PC VR games.
The OpenXR Toolkit has added the eye tracking feature in PC apps when the Quest Pro headset is wirelessly connected to the computer through Air Link. This creates “Dynamic Foveated Rendering” in the supported virtual reality games allowing for greater details.
With foveated rendering, the scenery is rendered in full detail only in the areas where the player’s gaze is focused with the peripheral areas remaining less detailed. This optimization saves on the computing power for the areas of the image the eyes are focused on. Foveated rendering is also used for graphically complex games in PlayStation VR 2.
Foveated rendering supports the more graphically complex shooter games like Hubris, the role-playing game The Light Brigade as well as the racing simulation iRacing.
🔥 Quest Pro Eye Tracked Foveated Rendering 🔥
OpenXR Toolkit is an amazing tool that adds eye tracked foveated rendering (along with color adjustments, sharpening & more) on different supported headsets for OpenXR games.
Here's a quick test using it on https://t.co/R9zczvQeVb… pic.twitter.com/dTQ5tHeFOh
— Flat2VR (@Flat2VR) February 23, 2023
However, there are some VR titles that aren’t optimized for foveated rendering technology such as Microsoft’s Flight Simulator where Dynamic Foveated Rendering produces a blurry main menu. The “Easy Anti-Cheat” in War Thunder prevents the use of the foveated rendering technology. The mod community Flat2VR has already showcased successful experiments with Praydog’s upcoming Unreal Engine VR mod.
On the Quest Pro headset, this feature can be used via the official Oculus runtime. Quest Pro’s eye tracking cannot be used in PC applications if you select SteamVR as the OpenXR runtime, for instance.
For the feature to work with Oculus software, the “Eye tracking via Oculus Link” checkbox must also be enabled in the beta section. You must also activate the “Developer Runtime Features” option.
Some titles still using the old OpenVR will be compatible through “OpenComposite”. These include Elite Dangerous, American Truck Simulator 2, Pavlov VR, F1 22, and Subnautica.
There are VR headsets that already support eye-tracking in the OpenXR Toolkit like the HP Reverb G2 Omnicept Edition and the Varjo headsets. Many of these headsets are already using SteamVR as their runtime environment.
Technically, the OpenXR Toolkit is a layer of an application programming interface (API). It provides an intermediate interface between the game and the OpenXR runtime environment that communicates with the OS, drivers as well as VR Compositor.