1. Software engines with the following technologies: a) Fisheye image processing, computer vision and SLAM algorithms b) Middleware level motion tracking, 3D gesture control and 3D room reconstruction with compatible Android API c) A optimized OS supporting heterogeneous computing and offloading computing 2. Reference design of demo applications for business engagements: a) “VR Virtual Tour” applications with above software engines and a self-developed HMD/fisheye camera prototype. 3. Contract Service Deliverables for Customer 1: a: Prototype hardware module - VR head mounted display (HMD) device b: VR HMD software prototype with 3D gesture control engine c: Optimized prototype hardware module - VR head mounted display (HMD) device d: Optimized software modules for final release package. e: Document of algorithms and application programming interface(API)1. Software engines with the following technologies: a) Fisheye image processing, computer vision and SLAM algorithms b) Middleware level motion tracking, 3D gesture control and 3D room reconstruction with compatible Android API c) A optimized OS supporting heterogeneous computing and offloading computing 2. Reference design of demo applications for business engagements: a) “VR Virtual Tour” applications with above software engines and a self-developed HMD/fisheye camera prototype. 3. Contract Service Deliverables for Customer 1: a: Prototype hardware module - VR head mounted display (HMD) device b: VR HMD software prototype with 3D gesture control engine c: Optimized prototype hardware module - VR head mounted display (HMD) device d: Optimized software modules for final release package. e: Document of algorithms and application programming interface(API)
Clever Motion Technology Ltd
Comba Telecom Limited
HK JiuLing Technology Co., Limited
Shenzhen Magic Eye Technology Co., Ltd.
Virtual reality (VR) and augment reality (AR) have become the next major wave of technology and market trend after mobile internet computing. While most industry players are focusing on head-mounted display (HMD) hardware design and various VR application development, the overall system and operation software aspects are still in the early stage. Many important aspects have not been systematically explored, such as how to conveniently transfer the real environment into the virtual reality model, how to enable natural interaction with the reality world, and so on. In this project we will focus on development of a highly customizable Linux/Android OS platform and visual computing engines to address above challenges and help to enable such a device more "intelligent". In particular, we will leverage on the ubiquitous imaging sensors available in mobile VR and AR devices to extract important information. Technical feature development includes utilizing visual odometry technology to enable 6-DoF motion tracking of a HMD device, gesture recognition to enable effortless human-machine interaction, and stereo vision to enable environment mapping and reconstruction. Moreover, to address the intensive computing load involved in these functions, adaptive GPU acceleration and dynamic offloading to edge servers will be applied for system performance optimization.