Comparing Supporter, Arguer, and Comprehensive Debater: How AI Debate Agent Roles Influence Critical Thinking

Abstract

AI debate agents show promise for cultivating critical
thinking through dynamic dialogue, yet the influence of
their conversational roles remains underexplored. This
randomized controlled trial investigated how three distinct
roles—supporter, arguer, and comprehensive debater—affect
learners’ critical thinking. Results showed that all three
roles similarly enhanced self-perceived critical thinking
but did not improve the quality of written arguments. These
findings indicate that a single interaction with an AI
debate agent can boost learners’ confidence in their
thinking skills, regardless of the agent’s role. However,
fostering long-term argumentation skills requires
structured, iterative feedback mechanisms that address the
gap between self-perception and actual ability.