SPEECH ANALYSIS FOR MONITORING OR DIAGNOSIS OF A HEALTH CONDITION

摘要

The invention relates to a computer-implemented method of training a machine learning model for performing speech analysis for monitoring or diagnosis of a health condition. The method uses training data comprising audio speech data and comprises obtaining one or more linguistic representations that each encode a sub-word, word, or multiple word sequence, of the audio speech data; obtaining one or more audio representations that each encode audio content of a segment of the audio speech data; combining the linguistic representations and audio representations into an input sequence comprising: linguistic representations of a sequence of one or more words or sub-words of the audio speech data; and audio representations of segments of the audio speech data, where the segments together contain the sequence of the one or more words or sub-words. The method further includes training a machine learning model using unsupervised learning to map the input sequence to a target output to learn combined audio-linguistic representations of the audio speech data for use in speech analysis for monitoring or diagnosis of a health condition.