Human-AI Co-Creative Platform For Controllable And Subject-driven Content Generation (ART/400CP) | ASTRI - Hong Kong Applied Science And Technology Research Institute Company Limited

Project Title:

Human-AI Co-Creative Platform for Controllable and Subject-driven Content Generation (ART/400CP)

Project Reference:

ART/400CP

Project Type:

Platform

Project Period:

01 / 04 / 2025 - 30 / 09 / 2026

Funds Approved (HK$’000):

10,550.100

Project Coordinator:

Dr Qijun ZHU

Deputy Project Coordinator:

Deliverable:

Research Group:

Sponsor:

OCBC Bank (Hong Kong) Limited (Contract Research)
GienTech Technology (Hong Kong) Limited (Contract Research)
AsiaPac Net Media Limited

Description:

The year 2024 witnessed the breakthrough of AI Generated Content (AIGC) technologies and the outbreak of the AI content generation requirement. However, the current AIGC models are designed for general purpose and are hard to cater to business that requires special domain knowledge and user-specified topics/subjects. Thus, for business AIGC, there is a strong demand for a platform with controllable and subject-driven content generation power to serve business users. In this project, we are proposing an interactive human-AI co-creative system for business AIGC. Specifically, we will focus on three types of content: 1. End-to-end controllable text generation with high data fidelity regarding a subject; 2. Subject-driven image generation with personalized text-to-image diffusion model; 3. Controllable video generation conditioned on a sequence of control signals. The developed solutions are based on large AIGC models including Large Language Model (LLM), Text-to-Image Model, and Text-to-Video Model to serve various applications in various domains, such as market promotion, exam question generation, financial document writing, report generation, etc.

Co-Applicant:

Keywords:

More about ASTRI

Hong Kong Applied Science and Technology Research Institute (ASTRI) was founded by the Government of the Hong Kong Special Administrative Region in 2000 with the mission of enhancing Hong Kong’s competitiveness through applied research. ASTRI’s core R&D competence in various areas is grouped under five Technology Divisions: Advanced Electronic Components and Systems; Artificial Intelligence and Trust Technologies; Communications Technologies; Innovative Mind; and IoT Sensing and AI Technologies. It is applied across six core areas which are Smart City, Financial Technologies, New Industrialisation and Intelligent Manufacturing, Digital Health, Application Specific Integrated Circuits and Metaverse.

Over the years, ASTRI has nurtured a pool of research, I&T talents and received numerous international awards for its pioneering innovations as well as outstanding business and community contributions. As of 2023/24, ASTRI has transferred more than 1,500 technologies to the industry and has been granted over 1,100 patents in the Mainland, the US, and other countries.

As a Hong Kong R&D centre, one of ASTRI’s important goals is to help customers harness business opportunities from the thriving technology market and increase their competitive strengths. Customers and partners can improve their efficacy by drawing on ASTRI’s expertise and research achievements.