King's Speech: Pronounce a Foreign Language with Style

Athanasopoulos, Georgios [UCL] Lucas, Céline [UCL] Cierro, Alessandro [UCL] Guerit, Robin [UCL] Hagihara, Kaori [UCL] Chatelain, Julie [UCL] Lugan, Sébastien [UCL] Macq, Benoît [UCL]

Computer assisted pronunciation training requires strategies that capture the attention of the learners and guide them along the learning pathway. In this paper, we introduce an immersive storytelling scenario for creating appropriate learning conditions. The proposed learning interaction is orchestrated by a spoken karaoke. We motivate the concept of the spoken karaoke and describe our design. Driven by the requirements of the proposed scenario, we suggest a modular architecture designed for immersive learning applications. We present our prototype system and our approach for the processing of spoken and visual interaction modalities. Finally, we discuss how technological challenges can be addressed in order to enable the learner's self-evaluation.