Application of mathematical and machine learning techniques to analyse eye-tracking data enabling better understanding of children’s visual-cognitive behaviours

Abstract

In this research, we aimed to investigate the visual-cognitive behaviours of a sample of 106 children in Year 3 (8.8 ± 0.3 years) while completing a mathematics bar-graph task. Eye movements were recorded while children completed the task and the patterns of eye movements explored using machine learning approaches. Two different techniques of machine-learning were used (Bayesian and K-Means) to obtain separate model sequences or average scan-paths for those children who responded either correctly and incorrectly to the graph task.  Application of these machine-learning approaches indicated distinct differences in the resulting scan-paths for children who completed the graph task correctly or incorrectly:  children who responded correctly accessed information that was mostly categorised as critical, whereas children responding incorrectly did not.  There was also evidence that the children who were correct accessed the graph information in a different, more logical order, compared to the children who were incorrect. The visual behaviours aligned with different aspects of graph comprehension, such as initial understanding and orienting to the graph, and later interpretation and use of relevant information on the graph. The findings are discussed in terms of the implications for early mathematics teaching and learning, particularly in the development of graph comprehension, as well as the application of machine learning techniques to investigations of other visual-cognitive behaviours.