Insight: Neuroscientific investigations of knowledge effects on visual perception and awareness

• Applicant: Professorin Dr. Rasha Abdel Rahman
• Subject Area: General, Cognitive and Mathematical Psychology
• Term: from 2012 to 2022
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 221029803

• Final Report Year: 2023

Final Report Abstract

What influence does our knowledge have on how we perceive and judge the world around us? The results of this project paint a clear picture of how declarative knowledge affects perceptionrelated processes. Socio-emotional information about individuals, functional information about objects, social information about artists, as well as long-established knowledge related to our native language influence how we perceive and judge social stimuli like faces or deepfake faces and emotional facial expressions, as well as objects, artworks, and even color contrasts. In addition to these basic components of perception, other perception-related functions are influenced by our knowledge. Specifically, the various types of knowledge described above can facilitate the access of these different object categories to visual consciousness. This is associated with altered brain activity in early time ranges between 100 and 300 milliseconds. Hence, knowledge not only alters how we perceive our environment but also determines which aspects of our environment actually enter our consciousness in the first place. Even in the case of visual mental imagery, parallels to visual perception can be found in very early processing components, as well as similar effects of knowledge on perception and imagination. For instance, imagining an emotional facial expression is accompanied by a similar pattern of event-related brain activity in the EEG as perceiving neutral faces when they are associated with socio-emotional knowledge, and when facial expressions are actually perceived. Further, similar to visually presented objects, where knowledge effects can be observed in the amplitude of the P1 component, approximately after 100 milliseconds, such early effects are also present in the P1 component during the mental visualization of objects. The findings of this project together indicate that knowledge can significantly influence our perceptual experiences, our consciousness, imagination, and our judgments. This is particularly true when processing is difficult, such as when visual stimulation is absent, as in mental imagery, or under conditions of reduced attention, when conscious perception is difficult. Particularly in these situations, knowledge may guide our perception. The project's findings are inconsistent with the assumption of perception being isolated from higher cognitive functions; rather, they suggest that knowledge can have both immediate top-down effects on perception and modulate stored object representations. In this sense, our perception can be described as intelligent.

Publications

• Native Language Promotes Access to Visual Consciousness. Psychological Science, 29(11), 1757-1772.
  Maier, Martin & Abdel Rahman, Rasha
  
• Semantic Knowledge Enhances Conscious Awareness of Visual Objects. Journal of Cognitive Neuroscience, 31(8), 1216-1226.
  Weller, Peter D.; Rabovsky, Milena & Abdel Rahman, Rasha
  
• Clear judgments based on unclear evidence: Person evaluation is strongly influenced by untrustworthy gossip.. Emotion, 20(2), 248-260.
  Baum, Julia; Rabovsky, Milena; Rose, Sebastian Benjamin & Abdel Rahman, Rasha
  
• Effects of Language on Visual Perception. Trends in Cognitive Sciences, 24(11), 930-944.
  Lupyan, Gary; Abdel Rahman, Rasha; Boroditsky, Lera & Clark, Andy
  
• Emotional content reduces the cognitive effort invested in processing the credibility of social (mis)information. (2020, 11, 13). Wallstein Verlag.
  Baum, Julia; Frömer, Romy; Abdel, Rahman & Rasha
  
• Emotional news affects social judgments independent of perceived media credibility. Social Cognitive and Affective Neuroscience, 16(3), 280-291.
  Baum, Julia & Abdel Rahman, Rasha
  
• Visual consciousness of faces in the attentional blink: Knowledge-based effects of trustworthiness dominate over appearance-based impressions. Consciousness and Cognition, 83(2020, 8), 102977.
  Eiserbeck, Anna & Abdel Rahman, Rasha
  
• Electrophysiological Chronometry of Graded Consciousness during the Attentional Blink. Cerebral Cortex, 32(6), 1244-1259.
  Eiserbeck, Anna; Enge, Alexander; Rabovsky, Milena & Abdel Rahman, Rasha
  
• Negative news dominates fast and slow brain responses and social judgments even after source credibility evaluation. NeuroImage, 244(2021, 12), 118572.
  Baum, Julia & Abdel Rahman, Rasha
  
• Deepfake smiles matter less—the psychological and neural impact of presumed AI-generated faces. Scientific Reports, 13(1).
  Eiserbeck, Anna; Maier, Martin; Baum, Julia & Abdel Rahman, Rasha
  
• Instant Effects of Semantic Information on Visual Perception. The Journal of Neuroscience, 43(26), 4896-4906.
  Enge, Alexander; Süß, Franziska & Abdel Rahman, Rasha
  
• Separating art from the artist: The effect of negative affective knowledge on ERPs and aesthetic experience. PLOS ONE, 18(1),e0281082.
  Kaube, Hannah; Eiserbeck, Anna & Abdel Rahman, Rasha
  
• Distrust before first sight? Examining knowledge- and appearance-based effects of trustworthiness on the visual consciousness of faces. Consciousness and Cognition, 117(2024, 1), 103629.
  Eiserbeck, Anna; Enge, Alexander; Rabovsky, Milena & Abdel Rahman, Rasha
  
• Transient and Long‐Term Linguistic Influences on Visual Perception: Shifting Brain Dynamics With Memory Consolidation. Language Learning, 74(S1), 157-184.
  Maier, Martin & Abdel Rahman, Rasha