High-level visual and multi-modal representations in the human brain and ANNs (B01*)

• Subject Area: Cognitive, Systems and Behavioural Neurobiology ; Human Cognitive and Systems Neuroscience
• Term: since 2025
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 276693517

Project B1 will study how the human brain integrates high-level visual and multisensory information to build robust multi-sensory semantic representations. We will examine neural processing of a naturalistic and dynamic audio-visual feature film, using recordings of brain activity from single neurons, LFPs, MEG and fMRI. We will develop generative modelling approaches to compare neural representations in artificial neural networks and the human brain across all data modalities. We will then study how multi-sensory information helps resolve ambiguities to achieve robust representations. All data and models (including those from projects B2 and B3) will be publicly shared via an integrated database.

• DFG Programme: Collaborative Research Centres
• Subproject of: SFB 1233: Robust Vision - Inference Principles and Neural Mechanisms
• Applicant Institution: Eberhard Karls Universität Tübingen
• Project Heads: Stefanie Liebe, Ph.D.; Professor Dr. Jakob Macke; Dr. Yulia Oganian