Multimodal creativity in speech-gesture production (C02)

C02 examines multimodal creativity in speech–gesture production and targets the underlying processes by investigating how creativity in language is enabled or constrained by being combined with the gestural modality and how this interplay is further conditioned by communicative or cognitive demands. We will identify patterns of multimodal creativity by combining behavioural experiments with psycholinguistic and computational AI modelling. The ultimate goal is to develop a cognitive-computational model that accounts for general mechanisms and processes of multimodal creativity.

DFG Programme Collaborative Research Centres

Subproject of SFB 1646:  Linguistic Creativity in Communication

Applicant Institution Universität Bielefeld

Project Heads Professorin Dr. Joana Cholin; Professor Dr.-Ing. Stefan Kopp