Objectives

The GEPETO project proposes pedagogical innovations and experiments in the use of gesture, using Human Machine Interfaces, in the education and rehabilitation of intonation. Gestural control of synthetic voice (chironomy) is a new research paradigm in human-computer interaction. It is studied and applied here for various communication tasks. The proposed project develops a pedagogical program based on chironomy, for tonal (Mandarin) and non-tonal (French, English) second language learning. In the case of impaired phonatory function (forcing), gestural control allows for improved intonational expressiveness in an augmented reality paradigm. In the situation of laryngeal loss (laryngectomy), gestural control of intonation must allow vocal substitution in order to restore a linguistic and expressive intonation of quality.