Immersive Digital Reality

• Applicant: Professor Dr.-Ing. Marcus Magnor
• Subject Area: Image and Language Processing, Computer Graphics and Visualisation, Human Computer Interaction, Ubiquitous and Wearable Computing
• Term: from 2016 to 2023
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 283369270

Motivated by the advent of mass-market head-mounted immersive displays, the proposed project will pioneer the technology needed to experience recordings of the real world with the sense of full immersion as provided by VR goggles. To achieve this goal, a number of interdisciplinary, tightly interrelated challenges from video processing, computer graphics, computer vision, and applied visual perception need to be addressed collectively: Instead of filming a shot from the outside looking in, the action must now be captured and digitally modeled omni-directionally from within the scene; to facilitate motion parallax and stereoscopic vision during display, authentic views of the recorded scene must be created in real-time for arbitrary viewing position and direction; and to optimize the visual experience of full field-of-view immersive displays, perception-aware rendering algorithms must simultaneously accommodate the characteristics of our foveal and peripheral vision. This five-year research endeavor sets out to develop the means needed to experience the recorded real world in full immersion: The overall objective of the proposed project is to import the real world into immersive displays, laying the foundations for the way we may watch movies in the future by leaving fixed-viewpoint, limited field-of-view screens behind for a completely immersive, collective experience.

• DFG Programme: Reinhart Koselleck Projects