Tongue S(t)imulator - A Comprehensive Parametrized Pose Model for Speech Therapy

Abstract

Recent digital applications in speech therapy address patients to train auditive speech comprehension, reading or semantics, in a playful way. Virtual tutors consist of three-dimensional head models for assisting the patient with conversational exercises. However, speech therapists also have to give pronunciation instructions and motility training of the tongue very often, but only have two-dimensional drawings or their own mouths for demonstration. In this paper we propose a comprehensive application for speech therapy as a therapeutical tool, simulating the articulation of German phones including color-coded expiration flows and the deglutition process (swallowing). A three-dimensional visualization of anatomical models of pharyngo-laryngeal area can be used in an interactive way. For examining the benefits of our tool over common conventional therapy media, our approach considers iteratively the demands of speech therapists. A final expert interview was conducted to assess how the application could be involved in treatment and the application’'s limits.