Panasonic AR HUD 2.0 Unveiled at CES 2022: Now Includes a New Patented Eye Tracking System
At the CES 2022 last week, Panasonic Automotive Systems Company of America showcased its Augmented Reality HUD 2.0. which now features a new patented eye-tracking system (ETS) for better AR experiences to users.
The Panasonic AR HUD is powered by Panasonic’s eCockpit infotainment controller SkipGen2. It also features a patented ETS leveraging Panasonic’s advanced optics technology. This proprietary innovation has been made possible by an IR camera packaged with the AR HUD projector and optics. Panasonic says you won’t need a standalone driver-facing camera with its new AR HUD. The eye-tracking system recognizes the line of sight of the driver and then maximizes the AR imagery to deliver better accuracy and clarity thereby creating a pleasant and more intuitive experience.
According to Panasonic, the AR HUD 2.0 continues the company’s trend of “up-integration of display domains” like HUD and Cluster into the central infotainment compute module. Through the integration of Panasonic’s proprietary eye-tracking technology into the AR HUD, the company has been able to improve the fidelity of images in the driver’s field of view by knowing the exact point that the driver is looking and then correspondingly matching and focusing Augmented Reality images to the real world with greater precision.
Panasonic’s ETS will specifically identify the height and head movement of the individual driver behind the wheel and then perform a dynamic adjustment and compensation of the images in the “eyebox.”
In the real world, drivers don’t just fixate their heads and gaze in one position. They are constantly shifting their heads and changing their line of sight. However, with the combination of parallax adjustment and dynamic autofocus, working in concert in the Panasonic AR HUD 2.0, the company says the system will enable drivers to see accurately positioned and high-resolution overlays as well as icons. The experience of the driver will be powered by an Artificial Intelligence (AI) navigation software that will match the changing environment with the AR overlays and icons thereby delivering a more intuitive awareness of the surrounding environment and situations.
The Panasonic AR HUD has the following features: –
- An AI-powered navigation software that has 3D AR overlays, mapping and icons.
- DLP that delivers crisp and high-resolution images as well as icons
- A simulated 3D that uses a tilted, dual image plane and provides 3D at the cost of a 2D
The HUD also includes a patented and freshly updated tracking system that provides the following: –
- Automatic driver height adjustment
- Driver monitoring capability (it can identify and monitor the state of the driver)
- Parallax compensation (which ensures proper alignment of AR icons in the driver’s optical path)
- Dynamic autofocus (this caters to the shifting driver eyebox positioning)
Panasonic says the placement of the IR camera within the AR HUD means drivers no longer have to package a standalone driver monitoring camera. The IR camera also provides support for driver identification along with other driver monitoring functions such as the detection of impairment, distraction, and drowsiness.
The Panasonic AR HUD was first announced at the CES 2021 last year. Also, in late 2020, Panasonic revealed its collaboration with Phiar Technologies, the developer of a spatial AI technology and automotive AR navigation platform, which was aimed at expanding Panasonic’s driver safety and navigation support for its automotive solutions.
Click here to read more about Panasonic’s AR HUD 2.0.