Michael Liut

Investigating Data Features for Reproducibility of Robust Educational Data Models

Research description:

Several metareviews in the area of educational data mining have highlighted challenges to reproducing results in the field. Differences in an educational context and student population make it difficult to determine whether or not a particular result is generalizable and transferable. I propose to develop a standard for processing and reporting data from educational discussion/Q&A boards to support the comparison of results between sites and to enable multi-institutional studies of student behaviour on Q&A boards. The proposed student will investigate literature in the area of modelling data from discussion/Q&A boards to identify features of the data that are important to interpreting the data. The goal is to create a robust data pipeline for collecting, cleaning, storing, and packaging data from a singular source. In this case, we will build tools to collect and package data from Piazza discussion/Q&A boards as it is utilized at numerous institutions internationally. In addition, the student will collect multiple datasets from UofT to produce a baseline of “standard student usage” for comparison.

Year: 2022

Researcher:
Michael Liut, Mathematical & Computational Science, University of Toronto Mississauga

Student: 
Pan Chen, University of Toronto

Through SUDS, undergraduate students engage in hands-on research focused on data sciences and AI methodology applications.

Data-Driven Analysis of Help-Seeking Student Behaviour in Programming Education with LLM Integration

Research description:

The landscape of student help-seeking behaviour is undergoing a significant transformation with the rise of generative AI tools like Large Language Models (LLMs). Building on prior research that explores help-seeking tendencies among university students, this project aims to investigate and analyse large-scale student data on the effects of integrating LLM-powered assistants in programming courses, focusing on their influence on student behaviour, engagement, and learning outcomes. Ideally generating an approach for improved (predictive and prescriptive) decision making. The research will involve a comprehensive analysis of how the introduction of LLM-based conversational agents (e.g., ChatGPT) and other LLM-based educational tools, such as CodeAid and QuickTA, both developed at the University of Toronto, influence student approaches to seeking help. This will involve data mapping and analysis, but also the need to identify patterns in large conversational data. Traditional help-seeking behaviours have shown a reliance on informal support (e.g., peers) rather than formal educational resources (e.g., instructors), often due to perceived barriers like stigma or accessibility. We hypothesise that the availability of LLM tools may shift these dynamics, increasing students’ reliance on automated, real-time assistance and providing data-rich insights into evolving help-seeking patterns that could enhance predictive and prescriptive modelling for educational support strategies.

Year: 2025

Researcher:
Michael Liut, Department of Mathematical and Computational Sciences, University of Toronto Mississauga, University of Toronto

Students:
Zoey (Zeling) Zhang, University of Toronto
Boushra Mohammed Almazroua, King Abdullah University of Science & Technology

Through SUDS, undergraduate students engage in hands-on research focused on data sciences and AI methodology applications.