Speaker's Abstract

(Kim) Chun Ki Chuang
MPhil Student
Academic Unit of Language and Literacy Education, Faculty of Education
The University of Hong Kong

Title:
"EMI teacher assessment literacy and the potential of AI-powered question generation platform "
In English-medium education and other similar bilingual education programmes where students learn content subjects through an additional language (L2), assessment represents one of the most controversial yet under-researched components. Unlike conventional content instruction, EMI assessment must capture students’ development in disciplinary knowledge and L2 academic literacies. This dual-focus presents significant challenges for assessment design, in the sense that assessment outcomes may misrepresent what students actually know and can do. It follows that EMI teachers need to be equipped with knowledge and skills of evaluating and supporting their students, which is also known as their assessment literacy.
This talk will unpack the complexities of EMI assessment and illustrate a conceptual framework capturing the key components of assessment literacy for teachers working in bilingual education programmes. It will then explore the opportunities brought about by the rapid development of artificial intelligence (AI). In particular, it will present the development and pilot testing of an AI-powered question generation platform designed to facilitate assessment design in EMI. The platform is theoretically grounded in the teacher assessment literacy framework and assessment design matrix, which categorises assessment questions by different levels cognitive and linguistic demands. Built using Retrieval-Augmented Generation (RAG) architecture and aligned with Hong Kong secondary curriculum guides for Biology and Geography subjects, the platform helps generate assessment questions accompanied by explicit labels indicating their cognitive and linguistic demands. It also supports multimodal question generation, producing items that incorporate diagrams, graphs, tables, maps and other visual representations characteristic of content subject assessment. By making the underlying assessment framework transparent through AI-generated labels and explanations, the platform aims to scaffold teachers’ development in assessment literacy.