A. Large FOV see through HMD with eye gaze tracking and iris identification Gaze tracking accuracy: ≤ 0.5 ° Gaze tracking FOV: ≥ 60 ° horizontal, ≥ 45 ° vertical Refresh rate: ≥ 60 fps Iris identification accuracy: FRR ≤ 0.6%, FAR ≤ 0.01% B. External sensing module Refresh rate: ≥ 30 fps External sensing FOV: ≥ 60 ° horizontal, ≥ 45 ° vertical Gesture detection: selection C. Large FOV see through HMD with internal and external sensing Gaze tracking accuracy: ≤ 0.5° Gaze tracking FOV: ≥ 60 ° horizontal, ≥ 45 ° vertical Iris identification accuracy: FRR ≤ 0.6%, FAR ≤ 0.01% External sensing FOV: ≥ 60 ° horizontal, ≥ 45 ° vertical Gesture detection: selection User control interface with eye gaze tracking and gesture input D. Near eye display see-through modules with sensing for contract service deliverables 3 sets of prototypes of near eye display modules 2 sets of prototypes of near eye display and sensing modules Sensing development tool kit and its user manual for eye gaze tracking and iris identification E. Panel adjustment and calibration platform for near eye display and sensing module for contract service deliverables Note: Please refer to Part C (I) 2d for the customer names.
Huawei Technologies Co., LTD
Huawei Technologies Co., LTD (CS) [Sponsor]
Profit Peak Hong Kong Holdings Limited [Sponsor]
Profit Peak Hong Kong Holdings Limited (CS) [Sponsor]
Smart Secure ID AG [Sponsor]
The Hong Kong Polytechnic University
Under the era of information explosion, the approach of acquiring the information has been evolved from physical (newspaper, magazine, books) to digital (personal computer, mobile phone) so that more information could be obtained from easier and effective way. As people need to process more and more information, head mount display (HMD) will be act as a next generation information provider to change the information format from digital to virtual. As the HMD will create a virtual information layer between the end user and the external real world, user can directly align the provided information with the external corresponding object to enable a more intuitive and immediate understanding.
The displayed image quality, security level and human machine interaction are three key factors for the measurement of the success of HMD. The R&D focus of this project is the latter two aspects. Because the HMD is a personal device, identifying ‘who is who’ and giving authorization of control to the permitted user is very critical. The user identification function also allows the development for the customized user interface so the whole system can better align with user’s interest and behavior. In order to make the human machine interface so intuitive as become second nature, both internal sensing for user gaze tracking and external sensing for gesture detection and environmental understanding are critical.
In this project, a novel hybrid biometric sensing fusion platform will be built on top of ASTRI patent protected ‘Smart Optics’ structure. A large FOV see through HMD device with internal sensing for gaze direction tracking and iris identification as well as external sensing for gesture control and environmental understanding will be developed. We target to mining maximized information from both user and external environment with minimum number of sensors and computation complexity. Such cost effective and performance optimized reference design solution will be implanted in wearable display device for wide variety of market such as education, training, design, etc.