Information based speech transduction
Abstract
Modern hearing aids use a variety of advanced digital signal processing methods in order to improve speech intelligibility. These methods are based on knowledge about the acoustics outside the ear as well as psychoacoustics. We present a novel observation based on the fact that acoustic prominence is not equal to information prominence for time intervals at the syllabic and sub-syllabic levels. The idea is that speech elements with a high degree of information can be robustly identified based on basic acoustic properties. We evaluated the correlation of (information rich) content words in the DanPASS corpus with fundamental frequency (F0) and spectral tilt across four frequency bands. Our results show a correlation of certain band-level differences and the presence of content words. Similarly, but to a lesser extent, a correlation between F0 and the presence of content words was found. The principle described here has the potential to improve the “information-to-noise” ratio in hearing aids. In addition, this concept may also be applicable in automatic speech recognition systems.
References
Boersma, P. (2001). ”Praat, a system for doing phonetics by computer” Glot International, 5 (9/10), 341–345.
Dik, S. C. (1997). The Theory of Functional Grammar, Part 1: The Structure of the Clause, 2nd ed., Mouton de Gruyter, Berlin.
Grønnum, N. (2009). “A Danish phonetically annotated spontaneous speech corpus (DanPASS)” Speech Communication 51, 594–603.
Henrichsen, P. J. (2011). “Fishing in a speech stream, angling for a lexicon” Proceedings of 18th Nordic conference of computational linguistics NODALIDA, Pedersen, B. S., Nespore, G. and Skadina, I. (Eds.), pp. 90–97.
Jurafsky, D. and Martin, J. H. (2009). Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition, 2nd edition. Prentice-Hall.
Klammer, T., Schulz, M. R. and Volpe, A. D. (2009). Analyzing English Grammar 6th edition, Longman.
Moore, B. J. C. M. (2003). An introduction to the psychology of Hearing, 5th edition, Academic Press, pp. 72-75.
Uneson, M. and P. J. Henrichsen (2011). ”Expanding a Corpus of Closed-World Descriptions by Semantic Unit Selection” accepted for the Proceedings of Computational Linguistic Applications, Warsaw, October 2011
Additional Files
Published
How to Cite
Issue
Section
License
Authors who publish with this journal agree to the following terms:
a. Authors retain copyright* and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
b. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
c. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
*From the 2017 issue onward. The Danavox Jubilee Foundation owns the copyright of all articles published in the 1969-2015 issues. However, authors are still allowed to share the work with an acknowledgement of the work's authorship and initial publication in this journal.