Individual differences on an auditory-visual speech perception test for people with hearing loss

  • Tatsuo Nakagawa College of Education and Human Sciences, Yokohama National University, Yokohama, Japan


Individual differences in auditory-visual speech perception in people with hearing loss were investigated using syllables, words, and sentences. The stimuli were presented in auditory-only, visual-only, and auditory-visual conditions for both congruent and incongruent conditions. In the congruent condition auditory speech stimuli were presented with their identical visual cues, and in the incongruent condition auditory stimuli were presented with conflicting visual cues. Nine young adults with varying degrees of hearing loss, fitted with hearing-aids or cochlear implants participated in the study. The relative increase in auditory-visual speech perception as measured by these tests resulting from the addition of visual cues to the auditory signal was calculated for each condition. The results showed that the subjects were better able to integrate both auditory and visual cues in the auditory-visual congruent condition. The auditory-visual gain in speech perception was less for the incongruent condition. The subjects showed significant individual differences in the amount of gain for different experimental conditions. These results suggest that auditory-visual integration of speech information does occur but that the degree of integration varies among the subjects. The speech stimuli showing the most auditory-visual integration are discussed in the text.


Desai, S., Stickney, G., and Zeng, F.G. (2008). “Auditory-visual speech perception in normal-hearing and cochlear-implant listeners,” J. Acoust Soc Am, 123, 428-440.

Grant, K. and Seitz, P. (1998). “Measures of auditory-visual integration in nonsense syllables and sentences,” J. Acoust. Soc. Am., 104, 2438-2450.

Huyse, A., Berthommier, F., and Leybaert, J. (2012). “Degradation of labial information modifies audiovisual speech perception in cochlea-implanted children,” Ear Hearing, 34, 110-121.

Rouger, J., Fraysse, B., Deguine, O., and Barone, P. (2008). “McGurk effects in cochlear-implanted deaf subjects,” Brain Res., 1188, 87-99.

Schwartz, J. (2010). “A reanalysis of McGurk data suggests that audiovisual fusion in speech perception is subject-dependent,” J. Acoust. Soc. Am., 127, 1584-1594.

How to Cite
Nakagawa, T. (2015). Individual differences on an auditory-visual speech perception test for people with hearing loss. Proceedings of the International Symposium on Auditory and Audiological Research, 5, 81-87. Retrieved from
2015/1. Characterizing individual differences in hearing loss