東華大學圖書館 |

Language: English

Help

回圖書館首頁

手機版館藏查詢

Back

Switch To: Labeled | MARC Mode | ISBD

Multisensory integration of audition...

Stevenson, Ryan Andrew.

Linked to FindBook

Google Book

Amazon

博客來

Multisensory integration of audition and vision in object recognition and speech perception.

Record Type:	Language materials, printed : Monograph/item
Title/Author:	Multisensory integration of audition and vision in object recognition and speech perception./
Author:	Stevenson, Ryan Andrew.
Description:	283 p.
Notes:	Source: Dissertation Abstracts International, Volume: 71-09, Section: B, page: 5839.
Contained By:	Dissertation Abstracts International71-09B.
Subject:	Psychology, Psychobiology. -
Online resource:	http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3413715
ISBN:	9781124150673

Multisensory integration of audition and vision in object recognition and speech perception.
Stevenson, Ryan Andrew.

Multisensory integration of audition and vision in object recognition and speech perception. - 283 p.

Source: Dissertation Abstracts International, Volume: 71-09, Section: B, page: 5839.

Thesis (Ph.D.)--Indiana University, 2010.

While the senses humans utilize to interact with their environment are commonly thought of as independent systems, there is now clear evidence that these sensory systems are highly interactive. What is less clear is the manner with which the neural systems underlying each of our senses interact, and at what level of processing these interactions take place. Through a series of experiments, we provide evidence of multisensory interactions observed with ecologically relevant stimuli take place at many stages of sensory processing. These experiments were undertaken in three phases. In the first phase, we utilized a sensory interaction in single-neuron recordings known as inverse effectiveness to measure interactions in neural populations using fMRI. We identified a multisensory region in the superior temporal cortex in which the multisensory gain increased as stimulus saliency decreased. That is, the less salient the stimulus, the greater the benefit gained by presenting stimuli in both sensory domains. In the second phase, we applied an additive-factors analysis novel to fMRI to these data which provided a means to disambiguate neuronal convergence from areal convergence. This technique measures the changes within each sensory presentation across an added factor, in this case stimulus saliency. We then furthered this technique by generalizing its utility across stimulus type, experimental design, and sensory modality. Finally, we conducted a whole brain analysis to identify a network of brain regions that showed multisensory interactions across levels of stimulus saliency. In the third phase of this research track, we applied our additive-factors paradigm to a study of audiovisual speech using EEG. Gains in reaction time were correlated with larger multisensory interactions in P1-N1 responses. These studies provide a framework with which researchers can identify and measure multisensory interactions using population measures of neuronal activity.

ISBN: 9781124150673Subjects--Topical Terms:

1017821
Psychology, Psychobiology.

Multisensory integration of audition and vision in object recognition and speech perception.
LDR:03428nam 2200361 4500 001 1405970
005 20111213102352.5
008 130515s2010 ||||||||||||||||| ||eng d
020 $a 9781124150673
035 $a (UMI)AAI3413715
035 $a AAI3413715
040 $a UMI $c UMI
100 1 $a Stevenson, Ryan Andrew. $3 1685397
245 1 0 $a Multisensory integration of audition and vision in object recognition and speech perception.
300 $a 283 p.
500 $a Source: Dissertation Abstracts International, Volume: 71-09, Section: B, page: 5839.
500 $a Advisers: Thomas W. James; David B. Pisoni.
502 $a Thesis (Ph.D.)--Indiana University, 2010.
520 $a While the senses humans utilize to interact with their environment are commonly thought of as independent systems, there is now clear evidence that these sensory systems are highly interactive. What is less clear is the manner with which the neural systems underlying each of our senses interact, and at what level of processing these interactions take place. Through a series of experiments, we provide evidence of multisensory interactions observed with ecologically relevant stimuli take place at many stages of sensory processing. These experiments were undertaken in three phases. In the first phase, we utilized a sensory interaction in single-neuron recordings known as inverse effectiveness to measure interactions in neural populations using fMRI. We identified a multisensory region in the superior temporal cortex in which the multisensory gain increased as stimulus saliency decreased. That is, the less salient the stimulus, the greater the benefit gained by presenting stimuli in both sensory domains. In the second phase, we applied an additive-factors analysis novel to fMRI to these data which provided a means to disambiguate neuronal convergence from areal convergence. This technique measures the changes within each sensory presentation across an added factor, in this case stimulus saliency. We then furthered this technique by generalizing its utility across stimulus type, experimental design, and sensory modality. Finally, we conducted a whole brain analysis to identify a network of brain regions that showed multisensory interactions across levels of stimulus saliency. In the third phase of this research track, we applied our additive-factors paradigm to a study of audiovisual speech using EEG. Gains in reaction time were correlated with larger multisensory interactions in P1-N1 responses. These studies provide a framework with which researchers can identify and measure multisensory interactions using population measures of neuronal activity.
520 $a INDEX WORDS: Multisensory Integration, Object Recognition, Speech Perception, Sensory Processing, Sensory Perception, Audition, Vision, Haptics, fMRI, EEG, ERP, Evoked Potentials, Inverse Effectiveness, Cross-modal, Multimodal, Reaction Time, Accuracy
590 $a School code: 0093.
650 4 $a Psychology, Psychobiology. $3 1017821
650 4 $a Psychology, Experimental. $3 517106
650 4 $a Psychology, Cognitive. $3 1017810
690 $a 0349
690 $a 0623
690 $a 0633
710 2 $a Indiana University. $b Psychology. $3 1273001
773 0 $t Dissertation Abstracts International $g 71-09B.
790 1 0 $a James, Thomas W., $e advisor
790 1 0 $a Pisoni, David B., $e advisor
790 1 0 $a James, Thomas W. $e committee member
790 1 0 $a Pisoni, David B. $e committee member
790 1 0 $a Puce, Aina $e committee member
790 1 0 $a Townsend, James T. $e committee member
790 $a 0093
791 $a Ph.D.
792 $a 2010
856 4 0 $u http://pqdd.sinica.edu.tw/twdaoapp/servlet/advanced?query=3413715