Prof. LI Ping, Department of Chinese and Bilingual Studies

Multimodal language learning and representation: Neurocognitive and computational mechanisms. Sixth International Conference on Linguistics and Language Studies. Chartered Institute of Linguists Hong Kong Society, Hong Kong Metropolitan University, Hong Kong, 21-22 June 2024.

Abstract
In an era of rapid developments in digital technology and generative AI, we need to examine the mechanisms of language learning and representation from an integrative neurocomputational perspective. In this talk, I outline an approach that combines emerging technologies and data-driven methodologies with current neurocomputational theories, with particular reference to embodied language learning. I highlight the interactive mechanisms and integrative processes that enable us to understand the differences between child and adult language learning, as well as individual differences in diverse language learning contexts. This approach gains insights into the understanding of how human learners, as compared with AI models, effectively integrate multimodal information in a social interactive context. Methodologically, this approach relies on collecting and analyzing real-time multimodal data towards the study of embodied language learning. Practically, it highlights context-based communicative abilities so that we can develop personalized pedagogical designs that tailor to individual learners’ needs and learning profiles.