Compensating for impaired prosody perception in cochlear implant recipients: A novel approach using speech preprocessing

  • Felix Kuhnke Fraunhofer Institute for Digital Media Technology IDMT, Ilmenau, Germany Institute for Media Technology, Faculty of Electrical Engineering and Information Technology, Ilmenau University of Technology, Ilmenau, Germany
  • Lorenz Jung Fraunhofer Institute for Digital Media Technology IDMT, Ilmenau, Germany Institute for Media Technology, Faculty of Electrical Engineering and Information Technology, Ilmenau University of Technology, Ilmenau, Germany
  • Tamás Harczos Fraunhofer Institute for Digital Media Technology IDMT, Ilmenau, Germany Institute for Media Technology, Faculty of Electrical Engineering and Information Technology, Ilmenau University of Technology, Ilmenau, Germany Cochlear-Implant Rehabilitationszentrum Thüringen, Erfurt, Germany

Abstract

Due to inherent device limitations, cochlear implant (CI) recipients are provided with greatly reduced pitch information. However, detecting changes in pitch is necessary to perceive intonation, a main feature of prosody. Therefore, CI recipients’ ability to perceive prosody is typically below that of normal-hearing subjects. We propose a novel preprocessing algorithm to enhance intonation perception by broadening the range of pitch changes in speech signals. To proof this concept, we have developed the pitch range extension (PREX) algorithm. PREX is capable of low-delay pitch modifications to speech signals. In addition, it provides automatic and intonation based amplification of pitch movements. In an evaluation with 23 CI recipients, the proposed algorithm significantly improved intonation perception in a question vs. statement experiment. However, the improved performance of CI subjects was still inferior to the performance of normal-hearing subjects. The results support the idea that preprocessing algorithms can improve the perception of prosodic speech features. Furthermore, we suggest utilizing the PREX algorithm for individualized treatment and rehabilitation.

References

Hamon, C., Mouline, E., and Charpentier, F. (1989), “A diphone synthesis system based on time-domain prosodic modifications of speech,” Proc. International Conference on Acoustics, Speech, and Signal Processing, 1989, 238-241.

Meister, H., Landwehr, M., Pyschny, V., Walger, M., and Wedel, H.v. (2009), “The perception of prosody and speaker gender in normal-hearing listeners and cochlear implant recipients,” Int. J. Audiol., 48, 38-48.

Nolan, F. (2003), “Intonational equivalence: An experimental evaluation of pitch scales,” Proc. 15th International Congress of Phonetic Sciences, 771-774.

Nooteboom, S. (1997), “The prosody of speech: Melody and rhythm,” in The Handbook of Phonetic Sciences. Eds. Hardcastle, W.J. and Laver, J. (Oxford, UK: Blackwell), pp. 640-673.

Wagener, K., Kühnel, V., and Kollmeier, B. (1999). “Entwicklung und Evaluation eines Satztests in deutscher Sprache I: Design des Oldenburger Satztests,” Zeitschrift für Audiologie/Audiological Acoustics, 38, 4-15.

Wang, W., Zhou, N., and Xu, L. (2011), “Musical pitch and lexical tone perception with cochlear implants,” Int. J. Audiol., 50, 270-278.
Published
2015-12-15
How to Cite
KUHNKE, Felix; JUNG, Lorenz; HARCZOS, Tamás. Compensating for impaired prosody perception in cochlear implant recipients: A novel approach using speech preprocessing. Proceedings of the International Symposium on Auditory and Audiological Research, [S.l.], v. 5, p. 309-316, dec. 2015. Available at: <https://proceedings.isaar.eu/index.php/isaarproc/article/view/2015-36>. Date accessed: 20 nov. 2017.
Section
2015/5. Compensation strategies for rehabilitation with cochlear implants