Neuromorphic Optical Sensing System (ART/343CP)

Neuromorphic Optical Sensing System (ART/343CP)

Neuromorphic Optical Sensing System (ART/343CP)
ART/343CP
Platform
16 / 03 / 2022 - 15 / 01 / 2024
8,253.435

Mr Kenny Kin-lung CHAN

Sanfield Construction Innovations Limited
Sanfield Construction Innovations Limited (CS)
Sensus Technology Limited
Sensus Technology Limited (CS)


Safety is extremely important in construction industry and so as other industries. Fatal accidents occurred quite often. In a 3-month period, 4 people died during their work in construction sites in Hong Kong in 2021. Existing surveillance system is not able to provide ultra-fast response, high-resolution and high accuracy sensing solution; especially while facing extreme ambient environments such as ultra-bright, ultra-dark. Comparing with traditional vision-based sensing device, event-based dynamic vision sensors encode illumination changing with high temporal precision, low data rate, and high-dynamic range, which make it particularly suited for scenarios with high motion, challenging lighting conditions and requiring low latency. While event-based sensing device cannot sense fine detailed features. An AI enabled event and vision-based sensing fusion system would solve the above problems. In this project, a smart optics based sensing fusion system, combining stereo dynamic vision sensors (DVS) and CMOS image sensor (CIS) with tunable lens (e.g. Geometric Phase Lens) enabled for instant event triggering detection and region of interest (ROI) extraction, will be developed. And an AI enabled software architecture for ultra-fast object detection and distance estimation to realize environment understanding with 4K+ high resolution image source will be built on the developed smart optics based sensing fusion system. The proposed world first 4K+ AI enabled sensing system with ultra-fast detection and depth sensing capability can be applied for construction and property industries. Through this project, we will work with our partners to move the technology from prototype to mass production ready solution. We will develop eco-system and engage potential partners (SHK, Nexplore (Leighton), Hip Hing, SINO, etc.) to realize local deployment in Hong Kong. Furthermore, the technology can be extended to support other application such as robotics, automobiles, etc.