Project Details
Projekt
EXC 284: Multimodal Computing and Interaction - Robust, Efficient and Intelligent Processing of Text, Speech, Visual Data and High Dimensional Representations
Subject Area
Computer Science
Term
from 2007 to 2019
Project identifier
Deutsche Forschungsgemeinschaft (DFG) - Project number 39134088
The past three decades have brought dramatic changes in the way we live and work. This phenomenon is widely characterised as the advent of the Information Society. Ten years ago, most digital content was textual. Today, it has expanded to include audio, video and graphical data. The challenge is now to organise, understand and search this multimodal information in a robust, efficient and intelligent way, and to create dependable systems that allow natural and intuitive multimodal interaction.
The cluster of excellence addresses this challenge. The term multimodal describes the different kinds of information such as text, speech, images, video, graphics and high-dimensional data, and the way it is perceived and communicated, particularly through vision, hearing and human expression. The first goal is to enable natural multimodal interaction with information systems anytime and anywhere, exploiting the wealth of modalities present in everyday human-to-human interaction. The systems must be aware of each user's environment and situation, must react to speech, text, and gestures, and must respond with speech, text, video, virtual 3D environments and virtual characters.
The second goal is to enhance the ability of computer systems to acquire, process and present different modes of data in an efficient and robust way. We aim for systems that can analyse and interpret multimodal information even when it is large, distributed, noisy and possibly incomplete; that can organise the obtained knowledge for powerful querying; and that can produce 3D virtual environments to visualise complex information in real-time. We refer to this type of computing as multimodal computing.
The cluster of excellence comprises the nationally top-ranked Computer Science and Computational Linguistics and Phonetics departments of Saarland University, the Max Planck Institute for Informatics, the German Research Center for Artificial Intelligence and the newly established Max Planck Institute for Software Systems. All participating institutions have agreed on a common long-term research agenda, which forms the basis of this proposal.
An integral goal of the cluster of excellence is the promotion of young researchers, and as such, we will commit the majority of the requested funding to the establishment of junior research groups.
The cluster of excellence addresses this challenge. The term multimodal describes the different kinds of information such as text, speech, images, video, graphics and high-dimensional data, and the way it is perceived and communicated, particularly through vision, hearing and human expression. The first goal is to enable natural multimodal interaction with information systems anytime and anywhere, exploiting the wealth of modalities present in everyday human-to-human interaction. The systems must be aware of each user's environment and situation, must react to speech, text, and gestures, and must respond with speech, text, video, virtual 3D environments and virtual characters.
The second goal is to enhance the ability of computer systems to acquire, process and present different modes of data in an efficient and robust way. We aim for systems that can analyse and interpret multimodal information even when it is large, distributed, noisy and possibly incomplete; that can organise the obtained knowledge for powerful querying; and that can produce 3D virtual environments to visualise complex information in real-time. We refer to this type of computing as multimodal computing.
The cluster of excellence comprises the nationally top-ranked Computer Science and Computational Linguistics and Phonetics departments of Saarland University, the Max Planck Institute for Informatics, the German Research Center for Artificial Intelligence and the newly established Max Planck Institute for Software Systems. All participating institutions have agreed on a common long-term research agenda, which forms the basis of this proposal.
An integral goal of the cluster of excellence is the promotion of young researchers, and as such, we will commit the majority of the requested funding to the establishment of junior research groups.
DFG Programme
Clusters of Excellence
Applicant Institution
Universität des Saarlandes
Participating Institution
Deutsches Forschungszentrum für Künstliche Intelligenz GmbH (DFKI); Max-Planck-Institut für Informatik; Max-Planck-Institut für Softwaresysteme
Spokesperson
Professor Dr. Hans-Peter Seidel
Participating Researchers
Professor Dr. Michael Backes; Professor Dr. Matthew W. Crocker; Professor Peter Druschel, Ph.D.; Professor Dr. Matthias Hein; Professor Dr. Antonio Krüger; Professor Dr. Thomas Lengauer; Professor Dr. Kurt Mehlhorn; Professor Dr. Manfred Pinkal; Professor Dr. Bernt Schiele; Professor Dr. Raimund Seidel; Professor Dr.-Ing. Philipp Slusallek; Professorin Dr. Elke Teich; Professor Dr. Hans Uszkoreit; Professor Dr. Wolfgang Wahlster; Professor Dr. Joachim Weickert; Professor Dr. Gerhard Weikum
