Two PolyU projects awarded RGC Theme-based Research Scheme Funding for sustainable impacts

15 Jul 2024

Achievements Knowledge Transfer and Entrepreneurship Office

Prof. Tao, Xiaoming, Vincent and Lily Woo Professor in Textile Technology, Chair Professor of Textile Technology of the School of Fashion and Textiles and Director of the Research Institute for Intelligent Wearable Systems (left), leads the project “Mechanisms and Key Technologies of Multi-Sensory Emulation Wearable Devices,” which has been awarded funding of HK$62.37 million. Prof. Johan Hoorn, Professor of the School of Design and Department of Computing (right), leads the project “Social Robots with Embedded Large Language Models Releasing Stress among the Hong Kong Population,” which has received funding of HK$40.89 million.

Two research projects led by The Hong Kong Polytechnic University (PolyU) have won over HK$100 million funding from the Research Grants Council’s Theme-based Research Scheme 2024/25 to advance emerging research and innovations important to Hong Kong . PolyU has secured this substantial funding support for its impactful inter-disciplinary research, contributing to Hong Kong’s sustainable development.

Prof. TAO, Xiaoming, Vincent and Lily Woo Professor in Textile Technology, Chair Professor of Textile Technology of the School of Fashion and Textiles and Director of the Research Institute for Intelligent Wearable Systems, leads the project “Mechanisms and Key Technologies of Multi-Sensory Emulation Wearable Devices,” which has been awarded funding of HK$62.37 million.

Prof. Johan Hoorn, Professor of the School of Design and Department of Computing, leads the project “Social Robots with Embedded Large Language Models Releasing Stress among the Hong Kong Population,” which has received funding of HK$40.89 million.

Prof. Christopher CHAO, Vice President (Research and Innovation) of PolyU, said, “Fully demonstrating the University's exceptional interdisciplinary research capabilities, these PolyU projects have wide-ranging application potential and bring tangible benefits to society. PolyU has consistently performed excellently in the Theme-based Research Scheme, supporting our efforts to make important contributions to Hong Kong's long-term development. We will continue to expand innovative and cutting-edge research that enhances wellbeing and leads to a brighter future.”

Prof. TAO’s project aims to lead global research in multi-sensory emulation wearable devices, capitalising on PolyU’s exceptional multidisciplinary expertise and facilities in flexible materials, sensors and actuators for the Internet of Things (IoT), wearable and biomedical applications, electronic fabrics, mathematics for artificial intelligence, acoustics and signal processing.

This research has far-reaching impacts that extend beyond the development of novel fibre-based multi-sensory emulation wearable devices. Ultimately, it also contributes to diverse social and industrial fields, encompassing healthcare, IoT, smart cities, art technology, robotics, education, sports, fashion and textiles, and personal protection.

Prof. Hoorn’s project is undertaken to provide psychological support for Hong Kong people, of whom it is estimated 61% experience stress, anxiety, depression or negative moods. It utilises Embedded Large Language Models to train social robots, incorporating localised cultural and personal data. The research aims to bring personalised mental care to individuals who may otherwise be overlooked by the formal medical care system.

In addition to the development of social robots and avatars for mobile applications connected to the new HK AI-hub, the project will also develop a new software architecture for distributed computing, scalability and privacy protection. The innovation will benefit the working population of Hong Kong, care professionals, social workers, and AI and robotics developers. It is also planned to establish an online platform for developers of robot and avatar solutions, with a focus on the care domain, as well as also catering to other fields including education, hospitality and entertainment.

PolyU projects funded by the Theme-based Research Scheme 2024/25

Project Coordinator	Prof. Tao Xiaoming Vincent and Lily Woo Professor in Textile Technology Chair Professor of Textile Technology of the School of Fashion and Textiles Director of the Research Institute for Intelligent Wearable Systems
Project Title	Mechanisms and Key Technologies of Multi-Sensory Emulation Wearable Devices (MSEWDs)
Abstract	This project aims to emulate the less enhanced yet urgently needed sensations of touch (tactile) and smell (olfactory) through a study of multi-sensory emulation wearable devices (MSEWDs) that reveals their operational mechanisms, and to develop relevant key technologies and applications. First-of-its-kind emulation mechanisms based on fibrous structures and their bionic actuation devices will be developed for delivering mixed scents and tactile sensations. Leveraging AI models to link measured signals obtained by biosensors and algorithms for controlling the bionic emulation devices will offer more immersive experiences. The target of the MSEWDs include: A device that senses and simulates olfactory sensation by AI-controlled scent-making and dispersion of mixed scents; A fabric tactile emulator that senses and tunes reactive forces and temperature by changing its rigidity, dimension, surface morphology and thermoelectric properties; and A wearable fabric-based acoustic stethoscope that continuously detects the location and intensity of sound generated from human internal organs. This project has great potential to fundamentally alter metaverse technology and influence industrial fields as diverse as healthcare, IoT, art technology, robotics, sports, fashion, textiles and beyond.
Approved Budget*	HKD 62.378 million

Project Coordinator	Prof. Johan Hoorn Professor of the School of Design and Department of Computing
Project Title	Social Robots with Embedded Large Language Models Releasing Stress among the Hong Kong Population
Abstract	This project will develop human-like at-home social robots with embedded large language models, using localised cultural and personal data to provide customised mental health support for the mentally under-served population in Hong Kong. Complementary on-screen avatars for mobile applications will also be delivered. A new software architecture will enable distributed computing, scalability and privacy protection. Training protocols, logic-symbolic AI and design guidelines will be created for novel methods and functionality, evaluated in situ by local communities. This will inform a communication model capable of predicting and recognising signs of stress or low mood and intervening with empathetic dialogue, help-seeking information or professional care referrals. The long-term goal is to reduce the burden on Hong Kong's formal mental health system while empowering citizens to better self-manage their well-being through accessible AI-driven social support. The working population, especially care professionals and social workers, stand to benefit, alongside an established online platform for AI and robotics developers in the care domain and open to other fields including education, hospitality, and entertainment.
Approved Budget*	HKD 40.899 million