Combining acoustic and electric stimulation to attack the cocktail party problem

Forfattere

  • Helen Cullington Hearing and Speech Lab, University of California, Irvine, CA 92697, USA; Hearing and Balance Centre, University of Southampton, SO17 1BJ, UK
  • Fan-Gang Zeng Hearing and Speech Lab, University of California, Irvine, CA 92697, USA

Resumé

Residual low-frequency acoustic hearing can provide critical temporal ne structure and pitch cues that are not conveyed by current cochlear implants, while electric hearing can provide high-frequency temporal envelope cues that are not effectively delivered by current hearing aids. Therefore combined acoustic and electric stimulation provides complementary information and may have great potential to improve performance on tasks that require good pitch perception, for example speech recognition in noise, music perception, understanding tonal languages, perceiving tone of voice, and talker identification. These tasks are particularly challenging for current cochlear implant users. Acoustic and electric hear- ing may be combined via electroacoustic stimulation in the same ear (ipsilateral EAS), or via a cochlear implant in one ear and a hearing aid in the other (contralateral EAS). At present, clinical outcomes are encouraging but show large inter-subject variability. Theoretical considerations on the underlying mechanisms and optimal tting are lacking. This paper reviews the difficulties cochlear implant users face on pitch-related tasks, and presents speech recognition results from EAS users and simulation data from normal-hearing controls. In addition, results are presented from a unique subject who has a cochlear implant in one ear, and virtually normal hearing in the other ear; he was implanted due to intractable tinnitus. It is suggested that in some important tasks, the hearing aid and cochlear implant combination may provide a more effective solution than not only each device alone but also than bilateral cochlear implants.

Referencer

Armstrong, M., Pegg, P., James, C., and Blamey, P. (1997). “Speech perception in noise with implant and hearing aid,” Am. J. Otol. 18, S140-141.

Bermingham McDonogh, O., and Rubel, E. W. (2003). “Hair cell regeneration: winging our way towards a sound future,” Current Opinion in Neurobiology 13, 119-126.

Brokx, J. P. L. and Nooteboom, S. G. (1982). “Intonation and the perceptual separation of simultaneous voices,” J. Phonetics 10, 23-36.

Brungart, D. S. (2001). “Informational and energetic masking effects in the perception of two simultaneous talkers,” J. Acoust. Soc. Am. 109, 1101-1109.

Brungart, D. S., Simpson, B. D., Ericson, M. A., and Scott, K. R. (2001). “Informational and energetic masking effects in the perception of multiple simultaneous talkers,” J. Acoust. Soc. Am. 110, 2527-2538.

Carton, J. S., Kessler, E. A., and Pape, C. L. (1999). “Nonverbal decoding skills and relationship well-being in adults,” Journal of Nonverbal Behavior 23, 91-100.

Chang, J. E., Bai, J. Y., and Zeng, F. G. (2006). “Unintelligible low-frequency sound enhances simulated cochlear-implant speech recognition in noise,” IEEE Trans. Biomed. Eng. 53, 2598-2601.

Ching, T. Y., Hill, M., Brew, J., Incerti, P., Priolo, S., Rushbrook, E., and Forsythe, L. (2005a). “The effect of auditory experience on speech perception, localization, and functional performance of children who use a cochlear implant and a hearing aid in opposite ears,” Int. J. Audiol. 44, 677-690.

Ching, T. Y., Incerti, P., and Hill, M. (2004). “Binaural bene ts for adults who use hearing aids and cochlear implants in opposite ears,” Ear. Hear. 25, 9-21.

Ching, T. Y., van Wanrooy, E., Hill, M., and Dillon, H. (2005b). “Binaural redundancy and inter-aural time difference cues for patients wearing a cochlear implant and a hearing aid in opposite ears,” Int. J. Audiol. 44, 513-521.

Cleary, M. and Pisoni, D. B. (2002). “Talker discrimination by prelingually deaf children with cochlear implants: preliminary results,” Ann. Otol. Rhinol. Laryngol. Suppl. 189, 113-118.

Cleary, M., Pisoni, D. B., and Kirk, K. I. (2005). “Influence of voice similarity on talker discrimination in children with normal hearing and children with cochlear implants,” J. Speech Lang. Hear. Res. 48, 204-223.

Dettman, S. J., D’Costa, W. A., Dowell, R. C., Winton, E. J., Hill, K. L., and Williams, S. S. (2004). “Cochlear implants for children with signi cant residual hearing,” Arch. Otolaryngol. Head Neck Surg. 130, 612-618.

Drullman, R., and Bronkhorst, A. W. (2004). “Speech perception and talker segregation: effects of level, pitch, and tactile support with multiple simultaneous talkers,” J. Acoust. Soc. Am. 116, 3090-3098.

Dunn, C. C., Tyler, R. S., and Witt, S. A. (2005). “Bene t of Wearing a Hearing Aid on the Unimplanted Ear in Adult Users of a Cochlear Implant,” J. Speech Lang. Hear. Res. 48, 668-680.

Fu, Q. J., Chinchilla, S., Nogaki, G., and Galvin, J. J., 3rd. (2005). “Voice gender identification by cochlear implant users: the role of spectral and temporal resolution,” J. Acoust. Soc. Am. 118, 1711-1718.

Gantz, B. J., and Turner, C. (2004). “Combining acoustic and electrical speech processing: Iowa/Nucleus hybrid implant,” Acta Otolaryngol. 124, 344-347.

Gantz, B. J., Turner, C., Gfeller, K. E., and Lowder, M. W. (2005). “Preservation of hearing in cochlear implant surgery: advantages of combined electrical and acoustical speech processing,” Laryngoscope 115, 796-802.

Gantz, B. J., and Turner, C. W. (2003). “Combining acoustic and electrical hearing,” Laryngoscope 113, 1726-1730.

Gfeller, K., Olszewski, C., Rychener, M., Sena, K., Knutson, J. F., Witt, S., and Macpherson, B. (2005). “Recognition of “real-world” musical excerpts by cochlear implant recipients and normal-hearing adults,” Ear. Hear. 26, 237-250.

Green, T., Faulkner, A., Rosen, S., and Macherey, O. (2005). “Enhancement of temporal periodicity cues in cochlear implants: effects on prosodic perception and vowel identification,” J. Acoust. Soc. Am. 118, 375-385.

Holt, R. F., Kirk, K. I., Eisenberg, L. S., Martinez, A. S., and Campbell, W. (2005). “Spoken word recognition development in children with residual hearing using cochlear implants and hearing AIDS in opposite ears,” Ear. Hear. 26, 82S-91S.

Kiefer, J., Pok, M., Adunka, O., Sturzebecher, E., Baumgartner, W., Schmidt, M., Tillein, J., Ye, Q., and Gstoettner, W. (2005). “Combined electric and acoustic stimulation of the auditory system: results of a clinical study,” Audiol. Neurootol. 10, 134-144.

Kong, Y. Y., Stickney, G. S., and Zeng, F. G. (2005). “Speech and melody recognition in binaurally combined acoustic and electric hearing,” J. Acoust. Soc. Am. 117, 1351-1361.

Litovsky, R. Y., Parkinson, A., Arcaroli, J., Peters, R., Lake, J., Johnstone, P., and Yu, G. (2004). “Bilateral cochlear implants in adults and children,” Arch. Otolaryngol. Head Neck Surg. 130, 648-655.

Offeciers, E., Morera, C., Muller, J., Huarte, A., Shallop, J., and Cavalle, L. (2005). “International consensus on bilateral cochlear implants and bimodal stimulation,” Acta Otolaryngol. 125, 918-919.

Peretz, I., Champod, A. S., and Hyde, K. (2003). “Varieties of musical disorders. The Montreal Battery of Evaluation of Amusia,” Ann. N .Y. Acad. Sci. 999, 58-75.

Qin, M. K., and Oxenham, A. J. (2003). “Effects of simulated cochlear-implant processing on speech reception in fluctuating maskers,” J. Acoust. Soc. Am. 114, 446-454.

Ross, E. D., Thompson, R. D., and Yenkosky, J. (1997). “Lateralization of affective prosody in brain and the callosal integration of hemispheric language functions,” Brain Lang. 56, 27-54.

Shannon, R. V., Zeng, F. G., Kamath, V., Wygonski, J., and Ekelid, M. (1995). “Speech recognition with primarily temporal cues,” Science 270, 303-304.

Smith, Z. M., Delgutte, B., and Oxenham, A. J. (2002). “Chimaeric sounds reveal dichotomies in auditory perception,” Nature 416, 87-90.

Stickney, G. S., Zeng, F. G., Litovsky, R., and Assmann, P. (2004). “Cochlear implant speech recognition with speech maskers,” J. Acoust. Soc. Am. 116, 1081-1091.

Tyler, R. S., Parkinson, A. J., Wilson, B. S., Witt, S., Preece, J. P., and Noble, W. (2002). “Patients utilizing a hearing aid and a cochlear implant: speech perception and localization,” Ear. Hear. 23, 98-105.

Vongphoe, M., and Zeng, F. G. (2005). “Speaker recognition with temporal cues in acoustic and electric hearing,” J. Acoust. Soc. Am. 118, 1055-1061.

Yderligere filer

Publiceret

2007-12-15

Citation/Eksport

Cullington, H., & Zeng, F.-G. (2007). Combining acoustic and electric stimulation to attack the cocktail party problem. Proceedings of the International Symposium on Auditory and Audiological Research, 1, 471–482. Hentet fra https://proceedings.isaar.eu/index.php/isaarproc/article/view/2007-46

Nummer

Sektion

2007/5. Recent concepts in cochlear-implant and hearing-aid processing