A Corpus-Based Approach to Speech Enhancement from Nonstationary Noise

Ming Ji, Ramji Srinivasan, Danny Crookes

Research output: Contribution to journalArticlepeer-review

49 Citations (Scopus)

Abstract

Temporal dynamics and speaker characteristics are two important features of speech that distinguish speech from noise. In this paper, we propose a method to maximally extract these two features of speech for speech enhancement. We demonstrate that this can reduce the requirement for prior information about the noise, which can be difficult to estimate for fast-varying noise. Given noisy speech, the new approach estimates clean speech by recognizing long segments of the clean speech as whole units. In the recognition, clean speech sentences, taken from a speech corpus, are used as examples. Matching segments are identified between the noisy sentence and the corpus sentences. The estimate is formed by using the longest matching segments found in the corpus sentences. Longer speech segments as whole units contain more distinct dynamics and richer speaker characteristics, and can be identified more accurately from noise than shorter speech segments. Therefore, estimation based on the longest recognized segments increases the noise immunity and hence the estimation accuracy. The new approach consists of a statistical model to represent up to sentence-long temporal dynamics in the corpus speech, and an algorithm to identify the longest matching segments between the noisy sentence and the corpus sentences. The algorithm is made more robust to noise uncertainty by introducing missing-feature based noise compensation into the corpus sentences. Experiments have been conducted on the TIMIT database for speech enhancement from various types of nonstationary noise including song, music, and crosstalk speech. The new approach has shown improved performance over conventional enhancement algorithms in both objective and subjective evaluations.
Original languageEnglish
Pages (from-to)822-836
Number of pages15
JournalIEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING
Volume19
Issue number4
DOIs
Publication statusPublished - May 2011

Fingerprint Dive into the research topics of 'A Corpus-Based Approach to Speech Enhancement from Nonstationary Noise'. Together they form a unique fingerprint.

Cite this