Multisensory perception, learning and action for crossmodal tele-operations (C06)

• Subject Area: General, Cognitive and Mathematical Psychology
• Term: from 2016 to 2019
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 261402652

Project C6 explores crossmodal perception, adaptation and learning during human-robot collaboration with the focus on tele-operations, which are performed inside the human operator¿s peripersonal space. In particular, the operator will be able to control a remote robot arm while receiving real-time visual and tactile feedback through an immersive display and haptic input device. The goals are (1) to understand the human¿s perception and action during interactions in the peripersonal space, and (2) to use these insights to allow a human operator to accept the remote robot as an extension of his/her own body, thereby providing the operator effective and efficient interactions with objects near the remote robot arm. The project will use virtual reality and human-computer interaction techniques, and conduct psychophysical as well as fMRI experiments to explore the operator¿s estimations of sizes, distances, and motions in the remote environment.

• DFG Programme: CRC/Transregios
• Subproject of: TRR 169: Crossmodal Learning: Adaptivity, Prediction and Interaction
• International Connection: China
• Applicant Institution: Universität Hamburg
• Co-Applicant Institution: Peking University
• Project Heads: Professor Dr. Lihan Chen; Professor Dr. Fang Fang; Professor Dr. Frank Steinicke