de Gelder, B
Pourtois, G
Weiskrantz, L
Multisensory integration is a powerful mechanism for increasing adaptive responses, as illustrated by binding of fear expressed in a face with fear present in a voice. To understand the role of awareness in intersensory integration of affective information we studied multisensory integration under conditions of conscious and nonconscious processing of the visual component of an audiovisual stimulus pair. Auditory-event-related potentials were measured in two patients (GY and DB) who were unable to perceive visual stimuli consciously because of striate cortex damage. To explore the role of conscious vision of audiovisual pairing, we also compared audiovisual integration in either naturalistic pairings (a facial expression paired with an emotional voice) or semantic pairings (an emotional picture paired with the same voice). We studied the hypothesis that semantic pairings, unlike naturalistic pairings, might require mediation by intact visual cortex and possibly by feedback to primary cortex from higher cognitive processes. Our results indicate that presenting incongruent visual affective information together with the voice translates as an amplitude decrease of auditory-event-related potentials. This effect obtains for both naturalistic and semantic pairings in the intact field, but is restricted to the naturalistic pairings in the blind field.
- ESTEVES FRANCISCO, ÖHMAN ARNE, Masking the face: Recognition of emotional facial expressions as a function of the parameters of backward masking, 10.1111/j.1467-9450.1993.tb01096.x
- de Gelder Beatrice, Vroomen Jean, The perception of emotions by ear and by eye, 10.1080/026999300378824
- Dolan R. J., Morris J. S., de Gelder B., Crossmodal binding of fear in voice and face, 10.1073/pnas.171288598
- de Gelder Beatrice, Böcker Koen B.E, Tuomainen Jyrki, Hensen Menno, Vroomen Jean, The combined perception of emotion from voice and face: early interaction revealed by human electric brain responses, 10.1016/s0304-3940(98)00963-x
- &NA;, The Demonstration and study of apoptosis in vivo : , 10.1097/00001756-199406000-00008
- Vroomen, Cognit Affect Neurosci, 1, 382 (2001)
- de Gelder Beatrice, Pourtois Gilles, Vroomen Jean, Bachoud-Lévi Anne-Catherine, Covert Processing of Faces in Prosopagnosia Is Restricted to Facial Expressions: Evidence from Cross-Modal Bias, 10.1006/brcg.1999.1203
- Weiskrantz L (1997) Consciousness Lost and Found (Oxford Univ. Press, Oxford).
- Lamme Victor A.F., Blindsight: the role of feedforward and feedback corticocortical connections, 10.1016/s0001-6918(01)00020-8
- Marzi C.A., Tassinari G., Aglioti S., Lutzemberger L., Spatial summation across the vertical meridian in hemianopics: A test of blindsight, 10.1016/0028-3932(86)90074-6
- LeDoux J (1996) The Emotional Brain: The Myterious Underpinnings of Emotional Life (Simon and Schuster, New York).
- Lang P J Bradley M M Cuthbert B N (1995) The International Affective Picture System (IAPS): Photographic Slides (Center for Research in Psychophysiology, Gainesville, FL).
- Morris J. S., Öhman A., Dolan R. J., 10.1038/30976
- Morris J. S., Frith C. D., Perrett D. I., Rowland D., Young A. W., Calder A. J., Dolan R. J., A differential neural response in the human amygdala to fearful and happy facial expressions, 10.1038/383812a0
- Baseler, J Neurosci, 19, 2619 (1999)
- Barbur J. L., Watson J. D. G., Frackowiak R. S. J., Zeki S., Conscious visual perception without VI, 10.1093/brain/116.6.1293
- BARBUR J. L., RUDDOCK K. H., WATERFIELD VICKI A., HUMAN VISUAL RESPONSES IN THE ABSENCE OF THE GENICULO-CALCARINE PROJECTION, 10.1093/brain/103.4.905
- WEISKRANTZ L., WARRINGTON ELIZABETH K., SANDERS M. D., MARSHALL J., VISUAL CAPACITY IN THE HEMIANOPIC FIELD FOLLOWING A RESTRICTED OCCIPITAL ABLATION, 10.1093/brain/97.1.709
- Weiskrantz L (1986) Blindsight: A Case Study and Implications (Oxford Univ. Press, Oxford).
- Ekman P Friesen W (1976) Pictures of Facial Affect (Consulting Psychologists Press, Palo Alto, CA).
- Weiskrantz Lawrence, Cowey Alan, Hodinott-Hill Iona, Prime-sight in a blindsight subject, 10.1038/nn793
- Nataanen R (1992) Attention and Brain Function (Erlbaum, Hillsdale, NJ).
- Hillyard S A Mangun G R Woldorff M G Luck S J (1995) in The Cognitive Neurosciences, ed Gazzaniga M S (MIT Press, Cambridge, MA), pp 665â681.
- Morris J. S., Ohman A., Dolan R. J., A subcortical pathway to the right amygdala mediating "unseen" fear, 10.1073/pnas.96.4.1680
- Giard M. H., Peronnet F., Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study, 10.1162/089892999563544
- Calvert G. A., Activation of Auditory Cortex During Silent Lipreading, 10.1126/science.276.5312.593
- Ross E D (2000) in Principles of Behavioral and Cognitive Neurology, ed Mesulam M M (Oxford Univ. Press, Oxford), 2nd Ed. pp 316â331.
- Rutter J., Regulation of Clock and NPAS2 DNA Binding by the Redox State of NAD Cofactors, 10.1126/science.1060698
- Bullier Jean, Feedback connections and conscious vision, 10.1016/s1364-6613(00)01730-7
- Dimberg Ulf, Thunberg Monika, Elmehed Kurt, Unconscious Facial Reactions to Emotional Facial Expressions, 10.1111/1467-9280.00221
- de Gelder Béatrice, Vroomen Jean, Pourtois Gilles, Weiskrantz Lawrence, Non-conscious recognition of affect in the absence of striate cortex : , 10.1097/00001756-199912160-00007
- de Gelder Beatrice, Pourtois Gilles, van Raamsdonk Monique, Vroomen Jean, Weiskrantz Lawrence, Unseen stimuli modulate conscious visual experience: evidence from inter-hemispheric summation : , 10.1097/00001756-200102120-00040
- Morris J. S., Differential extrageniculostriate and amygdala responses to presentation of emotional faces in a cortically blind field, 10.1093/brain/124.6.1241
- Murray E., Mishkin M, Amygdalectomy impairs crossmodal association in monkeys, 10.1126/science.3983648
- Málková, Psychobiology, 24, 255 (1996)
- de Gelder, B., Vroomen, J. & Teunisse, J.-P. (1995) Bull. Psychonom. Soc. 30.
Bibliographic reference |
de Gelder, B ; Pourtois, G ; Weiskrantz, L. Fear recognition in the voice is modulated by unconsciously recognized facial expressions but not by unconsciously recognized affective pictures. In: National Academy of Sciences. Proceedings, Vol. 99, no. 6, p. 4121-4126 (2002) |
Permanent URL |
http://hdl.handle.net/2078.1/42282 |