GT4Tech: Gesture Tracking In 4-Dimensional Space (ARD/316) | ASTRI - Hong Kong Applied Science And Technology Research Institute Company Limited

Project Title:

GT4Tech: Gesture Tracking in 4-Dimensional Space (ARD/316)

Project Reference:

ARD/316

Project Type:

Seed

Project Period:

01 / 04 / 2024 - 31 / 03 / 2025

Funds Approved (HK$’000):

1,613.680

Project Coordinator:

Dr Chun Yin Ricky CHUE

Deputy Project Coordinator:

Deliverable:

Research Group:

Sponsor:

Hong Kong Science & Technology Parks Corporation

Description:

The proposed project aims to develop a novel human-computer interaction method based on hand detecting and tracking algorithm with multi-sensor fusion, paving the way for the application of immersive virtual reality (VR) and augmented reality (AR) technologies in Hong Kong. The algorithm allows users to interact with display devices, including monitors, projections, etc., in high dimensions at low cost by tracking the user's hand and perceiving the environment in 3D. The proposed methodology is divided into two parts, hand tracking and display localization. Hand tracking includes multi-camera based hand detection, joint localization and gesture understanding, which will be mainly done with computer vision and AI algorithms. Display localization includes image-based auto-calibration and coordinate mapping, which will be mainly done using image recognition.

Co-Applicant:

Keywords:

More about ASTRI

Hong Kong Applied Science and Technology Research Institute (ASTRI) was founded by the Government of the Hong Kong Special Administrative Region in 2000 with the mission of enhancing Hong Kong’s competitiveness through applied research. ASTRI’s core R&D competence in various areas is grouped under five Technology Divisions: Advanced Electronic Components and Systems; Artificial Intelligence and Trust Technologies; Communications Technologies; IoT Sensing and AI Technologies; and Intelligent Perception and Control Technologies. It is applied across six core areas which are Smart City, Financial Technologies, New Industrialisation and Intelligent Manufacturing, Digital Health, Application Specific Integrated Circuits and Metaverse.

Over the years, ASTRI has nurtured a pool of research, I&T talents and received numerous international awards for its pioneering innovations as well as outstanding business and community contributions. ASTRI has transferred about 1,600 technologies to the industry and has been granted close to 1,200 patents in the Mainland, the United States, and other countries.

As a Hong Kong R&D centre, one of ASTRI’s important goals is to help customers harness business opportunities from the thriving technology market and increase their competitive strengths. Customers and partners can improve their efficacy by drawing on ASTRI’s expertise and research achievements.