Intelligent Wearable Information Display (IWID)

Intelligent Wearable Information Display (IWID)

Intelligent Wearable Information Display (IWID)
ART/186CP
20150301 - 20160831
11471

Dr Chen-jung Tsai
A. Single Sensing Wearable Display Optical Engine and System 1. Single Sensing See-Through Optical Engine To develop a compact size optical engine with module size<10cc, light guild prism thickness<10mm, view angle 16 degree and optical brightness >500nits. Film based optical engine for light weight with optical weight reduction>4g compare with glass design. On top of the coaxial optical design, add an IR pattern light source with 12x9 optical resolution for optical tracking. 2. Single Sensing Wearable Display Driving System To develop an electrical driving board for single sensing wearable display driving system. The driving control module provides a pattern light source to the object and then use a sensing module to capture the image of the object (e.g. user's finger).The driving system includes: application processor with memory, power management module, wireless connectivity, display panel driver, light sensor and image sensor. 3. Embedded Single Sensing "Inspiration" Tracking Methodology To develop a low power embedded real time object tracking methodology for Single-Sensing Wearable Display. Such algorithm is developed to determine user’s natural touch behavior so as to understand user’s command and make interaction with user. Such algorithm will adopt IR pattern light with detection resolution ≥ 12x9, sensing accuracy ≤3mm and response time > 30fps B. Bi-Sensing Wearable Display Optical Engine and System 1. Bi-Sensing See-Through Optical Engine To develop a compact size bi-sensing optical engine with module size 8cc, thickness~10mm, view angle 20 degree and optical brightness>1000nits. Add an IR pattern light source with 24x18 optical resolution for optical tracking of both eye pupil and finger/object. 2. Bi-sensing Wearable Display Driving System To develop an electrical driving board for bi-sensing wearable display driving system. The software inside the on-board processor is able to perform recognition by collecting the information of human pupil and finger location. The driving system includes: application processor with memory, power management module, wireless connectivity, display panel driver, light sensor and image sensor. 3. Embedded Bi-Sensing eye "Inspiration" tracking methodology To develop a low power embedded real time eye pupil tracking and gaze detection methodology for Bi-Sensing Wearable Display. Together with the finger tracking and touch detection methodology, it will be faster and more robust to understand the user's intention and determine the user’s command for better interaction with user. Such algorithm will have the bi-sensing resolution ≥24x18, sensing accuracy ≤ 3mm and sensing response time >30fps. C. Large Field Of View (FOV)/wide eye-box See-Through Optical design To develop novel see-through optical design: work out the new design approach and complete the simulation of 1) large FOV using multi-layer waveguide which is targeted to meet 40 degree FOV, thickness <10mm and optical brightness >500nits;and 2) wide eye-box using off-axis deformable design which is targeted to meet eye-box size 120mmx60mm and optical brightness >10,000nits. D. Contract Service Deliverables with Customer (1) Non see-through type head mounted display engine design and two sets of prototypes To design and prototype a Non-See-Through optical engine based on the extending technology of film based polarization optics used in project deliverable A. It is targeted to meet >22 degree FOV, thickness <12mm and 720P resolution.
Dr Chen Jung TSAI Dr Pei Chin, Ryan Chung Mr Kin Lung, Kenny Chan Dr Mi Suen, Michelle Lee Ms Ying, Anna Liu Dr Xiu Ling Zhu Mr Derek Dehua Liu Mr Wei Ping Tang Mr Chang Li Wu Dr Yong Chi Mr Chun Yip Wong Dr Xueyan Tang Ms Jenny Tian Ms Wei,Wendy Zhang Dr Zhao, Fiona Wang Mr You Ding Mr Chi Kin, Dennis Wong Dr Yan Wang Mr Chak Wai Chau Mr Yuk lung, Alex Cheung Mr Kwok Chung Chan Mr Chao Wu Ms Yuan,Fiona Wang Dr Xuyan Huang Dr Jinhui Hu Dr Weiwen, Wilman Zou Ms Hui, Tracy Hu Mr Guan Wang Mr Wai Kin Luk Ms Ka Man, Carmen Liu
Polarlight Technology Co., Limited [Sponsor] Polarlight Technology Co., Limited(Technology Licensing) [Sponsor] SELcos Co., Ltd. [Sponsor] Truly Semiconductors Limited [Sponsor] Truly Semiconductors Limited(Technology Licensing) [Sponsor] Vendor Chain International Co., Limited Vendor Chain International Co., Limited(Contract Service) [Sponsor] Vendor Chain International Co., Limited(Technology Licensing) [Sponsor] Wintronic Technology Limited [Sponsor]

While Google, Samsung and other market leading companies announced their product development plans on wearable devices and the acceleration of perceptual computing technologies development for such devices, wearable devices and their applications become the next major battle field after PC and smartphone. However, the current sensing capabilities are very limited, such as Google Glass, which mainly relies on voice recognition for sensing; and even if equips with an external camera module, the image processing power for object sensing and detection is too heavy, to be applied in a wearable device which demands ultra low power processing. Therefore, wearable display device with functions such as eye tracking, finger detection and touch sensing is still at a cconceptual stage. In this project, instead of using traditional image processing development approach for object sensing, we will use a patent protected and ASTRI developed optics component to realize optical sensing mechanism with ultra low power, in order to further develop the next generation intelligent wearable information display with eye tracking, finger tracking and object detection functions. The technology developed this project will be embedded in mobile wearable display devices providing eye tracking , finger tracking, touch detection and object detection function bringing new user experience. This technology can be widely applied in automotive, aviation, education, healthcare, tele-communications, interactive media, tourism, navigation and other industries. Global wearable display device market will reach 200,000 pieces in the second quarter of 2014, and in the first quarter of 2019 it is estimated to be up to 4.5 million pieces. This project is committed to helping the development of Hong Kong and the Pearl River Delta to become the R & D center of wearable display product and technology and also the manufacturing center of the core components and equipments. Furthermore, this project will benefit local industry and bolster industrial capabilities.