移動視覺計算平台 (ART/229CP)

移動視覺計算平台 (ART/229CP)

移動視覺計算平台 (ART/229CP)
ART/229CP
平台
30 / 03 / 2017 - 29 / 09 / 2018
11,694

吳曉華博士

1. Software engines with the following technologies: a) Fisheye image processing, computer vision and SLAM algorithms b) Middleware level motion tracking, 3D gesture control and 3D room reconstruction with compatible Android API c) A optimized OS supporting heterogeneous computing and offloading computing 2. Reference design of demo applications for business engagements: a) “VR Virtual Tour” applications with above software engines and a self-developed HMD/fisheye camera prototype. 3. Contract Service Deliverables for Customer 1: a: Prototype hardware module - VR head mounted display (HMD) device b: VR HMD software prototype with 3D gesture control engine c: Optimized prototype hardware module - VR head mounted display (HMD) device d: Optimized software modules for final release package. e: Document of algorithms and application programming interface(API)1. Software engines with the following technologies: a) Fisheye image processing, computer vision and SLAM algorithms b) Middleware level motion tracking, 3D gesture control and 3D room reconstruction with compatible Android API c) A optimized OS supporting heterogeneous computing and offloading computing 2. Reference design of demo applications for business engagements: a) “VR Virtual Tour” applications with above software engines and a self-developed HMD/fisheye camera prototype. 3. Contract Service Deliverables for Customer 1: a: Prototype hardware module - VR head mounted display (HMD) device b: VR HMD software prototype with 3D gesture control engine c: Optimized prototype hardware module - VR head mounted display (HMD) device d: Optimized software modules for final release package. e: Document of algorithms and application programming interface(API)

佳駿科技有限公司
京信通信系統有限公司
香港久凌技術有限公司
深圳市魔眼科技有限公司


虛擬現實(VR)和增強現實(AR)已成為繼移動互聯網計算之後的下一個主要技術和市場趨勢。目前, 大多數的業內人士都專注於頭戴式顯示器(HMD)的硬件設計和各種虛擬現實應用的開發,整體系統和作業軟件方面, 則仍處於起步階段。許多重要的範疇還沒有深入的研究,比如如何將真實環境方便地轉移到虛擬現實,以及如何實現人機的自然交互等。本項目旨在開發一個Linux / Android操作系統平台和視覺計算引擎以解決上述挑戰,從而使機器更智能。 我們將利用移動VR和AR設備上的圖像傳感器來獲取重要信息,研發的技術特點包括利用視覺測程技術實現HMD設備的六自由度運動跟踪,利用手勢識別實現輕鬆的人機交互及利用立體視覺技術建立環境地圖和模型。此外,為解決涉及這些功能的密集型計算負載,適應性的GPU加速器和動態卸載計算到邊緣服務器將被應用到我們的系統上。