IUI 2023: "Steering Recommendations and Visualising Its Impact: Effects on Adolescents’ Trust in E-Learning Platforms"

Date

This is my work together with Leen Dereu and Katrien Verbert for IUI 2023, a conference on intelligent user interfaces. I am particularly proud of this work because it is based on Leen's master's thesis, which I guided. We studied how a control mechanism and a visualisation that depicts the control's impact affected adolescents' trust in a platform that recommends mathematics exercises.

Slider to steer exercises' difficulty Visualisation of changes in mastery level

Paper

Download the preprint underneath or read the paper on ResearchGate or ACM Digital Library.

Abstract

Researchers have widely acknowledged the potential of control mechanisms with which end-users of recommender systems can better tailor recommendations. However, few e-learning environments so far incorporate such mechanisms, for example for steering recommended exercises. In addition, studies with adolescents in this context are rare. To address these limitations, we designed a control mechanism and a visualisation of the control’s impact through an iterative design process with adolescents and teachers. Then, we investigated how these functionalities affect adolescents’ trust in an e-learning platform that recommends maths exercises. A randomised controlled experiment with 76 middle school and high school adolescents showed that visualising the impact of exercised control significantly increases trust. Furthermore, having control over their mastery level seemed to inspire adolescents to reasonably challenge themselves and reflect upon the underlying recommendation algorithm. Finally, a significant increase in perceived transparency suggested that visualising steering actions can indirectly explain why recommendations are suitable, which opens interesting research tracks for the broader field of explainable AI.

First page of the IUI 2023 paper