The effect of harmonic number and pitch salience on the ability to understand speech-on-speech based on differences in fundamental frequency

  • Sara Miay Kim Madsen Department of Psychology, University of Minnesota, 75 East River Parkway, Minneapolis, MN, 55455, USA
  • Torsten Dau Hearing Systems Section, Department of Health Technology, Technical University of Denmark, Ørsteds Plads, Building 352, 2800 Lyngby, Denmark
  • Andrew J Oxenham Department of Psychology, University of Minnesota, 75 East River Parkway, Minneapolis, MN, 55455, USA
Keywords: Pitch, harmonic rank, speech-on-speech

Abstract

Differences in fundamental frequency (F0) between competing voices facilitate the ability to segregate a target voice from interferers, thereby enhancing speech intelligibility. Although lower-numbered harmonics produce greater pitch salience than higher-numbered harmonics, it remains unclear whether differences in harmonic ranks, and therefore pitch salience, affect the benefit of pitch differences. Earlier studies have not reported an effect of pitch salience, but have generally used only conditions where the difference in average F0 (ΔF0) between the two competing voices was large. It is possible that the effect of pitch salience is greater in more challenging conditions, in which the ΔF0 is relatively small. This study tested speech intelligibility in the presence of one speech masker for ΔF0s of 0, 2, and 4 semitones. The speech was presented in a broadband condition or was highpass or lowpass filtered to manipulate the pitch salience of the voicing. Results showed no interaction between filter type and ΔF0, suggesting little or no effect of harmonic rank or pitch salience in the ability to use F0 to segregate voices, even with smaller ΔF0s between competing voices. The results suggest some benefit of ΔF0 between competing voices, even in the absence of low-numbered spectrally resolved harmonics.

References

Bernstein, J.G.W., & Oxenham, A.J. (2003). "Pitch discrimination of diotic and dichotic tone complexes: Harmonic resolvability or harmonic number?" J. Acoust. Soc. Am., 113(6), 3323–3334. doi: 10.1121/1.1572146

Bernstein, J.G.W., & Oxenham, A.J. (2006). "The relationship between frequency selectivity and pitch discrimination: Sensorineural hearing loss," J. Acoust. Soc. Am., 120(6), 3929–3945. doi: 10.1121/1.2372452

Bird, J., & Darwin, C.J. (1998). "Effects of a difference in fundamental frequency in separating two sentences," Psychophysical and Physiological Advances in Hearing, 263–269.

Boersma, P., & Weenink, D. (2009). Praat: Doing phonetics by computer (Version 5.1.3.1).

Brokx, J.P.L., & Nooteboom, S.G. (1982). "Intonation and the perceptual separation of simultaneous voices," J. Phon., 10, 23–36.

Graves, J.E., & Oxenham, A.J. (2019). "Pitch discrimination with mixtures of three concurrent harmonic complexes," J. Acoust. Soc. Am., 145(4), 2072-2083.

Grimault, N., Micheyl, C., Carlyon, R. P., Arthaud, P., & Collet, L. (2000). "Influence of peripheral resolvability on the perceptual segregation of harmonic complex tones differing in fundamental frequency," J. Acoust. Soc. Am., 108(1), 263– 271. doi: 10.1121/1.429462

Hoekstra, A., & Ritsma, R.J. (1977). "Perceptive hearing loss and frequency selectivity," Psychophysics and Physiology of Hearing, 263–271.

Madsen, S.M.K., Dau, T., & Moore, B.C.J. (2018). "Effect of harmonic rank on sequential sound segregation," Hear. Res., 367, 161–168. doi: 10.1016/j.heares.2018.06.002

Madsen, S.M.K., Marschall, M., Dau, T., & Oxenham, A.J. (2019). "Speech perception is similar for musicians and non-musicians across a wide range of conditions," Sci. Rep., 9(1), 1-10. doi: 10.1038/s41598-019-46728-1

Madsen, S.M.K., Whiteford, K.L., & Oxenham, A.J. (2017). "Musicians do not benefit from differences in fundamental frequency when listening to speech in competing speech backgrounds," Sci. Rep., 7, 1-9. doi: 10.1038/s41598-017- 12937-9

Nielsen, J.B., & Dau, T. (2009). "Development of a Danish speech intelligibility test," Int. J. Audiol., 48(10), 729–741. doi: 10.1080/14992020903019312

Nilsson, M., Soli, S.D., & Sullivan, J.A. (1994). "Development of the Hearing In Noise Test for the measurement of speech reception thresholds in quiet and in noise," J. Acoust. Soc. Am., 95, 1085–1099. doi: 10.1121/1.408469

Oxenham, A.J., & Simonson, A.M. (2009). "Masking release for low- and high-pass- filtered speech in the presence of noise and single-talker interference," J. Acoust. Soc. Am., 125(1), 457–468. doi: 10.1121/1.3021299

Shackleton, T.M., & Carlyon, R.P. (1994). "The role of resolved and unresolved harmonics in pitch perception and frequency modulation discrimination," J. Acoust. Soc. Am., 95(6), 3529–3540. doi: 10.1121/1.409970

Sørensen, A.J., Fereczkowski, M., & MacDonald, E.N. (2018). "Task dialog by native-Danish talkers in Danish and English in both quiet and noise," Zenodo. doi: 10.5281/zenodo.1204951

Vliegen, J., & Oxenham, A.J. (1999). "Sequential stream segregation in the absence of spectral cues," J. Acoust. Soc. Am., 105, 339–346. doi: 10.1121/1.424503

Published
2020-04-20
How to Cite
Madsen, S., Dau, T., & Oxenham, A. (2020). The effect of harmonic number and pitch salience on the ability to understand speech-on-speech based on differences in fundamental frequency. Proceedings of the International Symposium on Auditory and Audiological Research, 7, 45-52. Retrieved from https://proceedings.isaar.eu/index.php/isaarproc/article/view/2019-06
Section
2019/2. Learning from natural sounds