Evaluation of autonomous vision for agent-centric vision (A02*)

• Subject Area: Image and Language Processing, Computer Graphics and Visualisation, Human Computer Interaction, Ubiquitous and Wearable Computing
• Term: since 2025
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 276693517

Project A2 will add an explicitly agent-centric task, namely the dexterous manipulations of objects within those scenes. Recognising physical interactions as a key task that visual agents need to support, we aim to overcome the shortcomings of current benchmarking environments which rely on simplified surrogates. We will build a highly realistic simulation-based benchmark in which virtual robotic agents can be tested on various dexterous manipulation tasks. Building upon scene representations developed in A1, we will investigate which inductive biases lead to visual representations that capture the structure of the 3D world and allow planning dexterous manipulations.

• DFG Programme: Collaborative Research Centres
• Subproject of: SFB 1233: Robust Vision - Inference Principles and Neural Mechanisms
• Applicant Institution: Eberhard Karls Universität Tübingen
• Project Heads: Professorin Dr. Zeynep Akata; Professor Dr. Wieland Brendel