User Reception of Babylon Health's Chatbot

Magalhaes Azevedo, Daniela [UCL] Legay, Axel [UCL] Kieffer, Suzanne [UCL]

Over the past decade, renewed interest in artificial intelligence systems prompted a proliferation of human-computer studies studies. These studies uncovered several factors impacting users’ appraisal and evaluation of AI systems. One key finding is that users consistently evaluated AI systems performing a given task more harshly than human experts performing the same task. This study aims to uncover another finding: by presenting a mHealth app as either AI or omitting the AI label and asking participants to perform a task, we evaluated whether users still consistently evaluate AI systems more harshly. Moreover, by picking young and well educated participants, we also open new research avenues to be further studied.