Invited Speakers

 

Dr. Caitlin Bentley
King's College London, UK 

Title: From Model Accuracy to Learner Progression: A Multi-Level Approach to AI Assurance in Education
Abstract: Assurance frameworks for AI in education are emerging, but they remain technocentric. This talk argues that technocentric assurance frameworks are a design flaw in the context of education. Competence effects of AI use in education have varying impacts over time for different learners. Cumulatively, over the course of a learner's progression, negative impacts may be structurally invisible when focusing only on model outputs at a specific moment in time. I illustrate this with findings from a recent human-AI teaming study, where learners trained to operate an autonomous system became less effective over time with increasing dependence on AI, despite indistinguishable self-reported confidence. Drawing on this research and on intersectional data science methods more broadly, I set out what a multi-level assurance approach for AI in education would need to evaluate, and who is responsible for assurance in this context.

Bio: Caitlin Bentley is a Senior Lecturer in AI Education, actively shaping the future of responsible AI through education. She is a member of the Delivery Team on the UKRI Responsible Artificial Intelligence UK (RAI UK) programme. Previously, she served on the UKRI Trustworthy Autonomous Hub Skills Committee, Syllabus Lab, and EDI working group. As a newly appointed co-director of the UKRI Safe and Trusted AI Centre for Doctoral Training, and ex officio member of MASSPeople, the first international working group establishing competency frameworks and standards for remote and autonomously enabled marine surface vessels, Caitlin contributes to initiatives that nurture the next generation of experts in safe and trusted AI, promoting responsible innovation and ethical practices. Caitlin's multi-disciplinary academic background includes prior positions at the University of Sheffield, the 3A Institute at Australian National University, and Nanyang Technological University, Singapore. Her academic journey includes a PhD in Human Geography, ICT4D, from Royal Holloway, University of London, a Masters in Educational Technology from Concordia University, and a BA in Computer Science from McGill University. Beyond academia, Caitlin's professional experiences in international development and the technology sectors have taken her to Canada, the UK, Africa, and the Asia-Pacific region. This background allows her to bring a global perspective and an appreciation for diverse cultures and contexts to her work.