Fishing for meaningful units in connected speech

Resumé

In many branches of spoken language analysis including Automatic Speech Recognition (ASR), the set of smallest meaningful units of speech is taken to coincide with the set of phones or phonemes. However, shing for phones is dif cult, error-prone, and computationally expensive. We present an experiment, based on machine learning, with an alternative approach. Instead of stipulating a basic set of target units, the determination of the set is considered to be part of the learning task. Given 18 recordings of Danish talkers performing a simple lab task, our algorithm produced a set of acoustically well- de ned units suf cient for identifying all the major semantic elements (be they parts of words, single words or several words), relevant to the task. As the sound encoding used was very simple – fundamental frequency (F0), Harmonicity- to-Noise-Ratio (HNR), and Intensity samples only – the computational complexity involved was far lower than for phonemic recognition. Our ndings show that it is possible to automatically characterize a linguistic message, without detailed spectral information or presumptions about the target units. Further, shing for simple meaningful cues and enhancing these selectively would potentially be a more effective way of achieving intelligibility transfer, which is the end goal for speech transducing technologies.