Social and Behavioral Sciences Commons^™

Hearing And Seeing A Speaker: How Perceptual And Cognitive Factors Modulate The Dynamics Of Audiovisual Speech Perception, Elina Kaplan

Doctoral Dissertations

In face-to-face conversations, listeners process and combine speech information obtained from hearing and seeing the speaker talk. Audiovisual speech typically leads to more robust recognition of speech, as it provides more information for recognition but also as it helps listeners adjust to speaker idiosyncrasies. The goal of the current thesis was to examine how certain perceptual and cognitive factors modulate how listeners use visual speech to facilitate momentary speech perception and to adjust to a speaker’s idiosyncrasies. Results showed that (older) listeners’ sensitivity to cross-modal synchrony is related to the size of the audiovisual interactions during early perceptual processing. Furthermore, …