CONSISTENCY PREDICTION ON STREAMING SEQUENCE MODELS

摘要

A method (600) for training a speech recognition model (200) includes receiving a set of training utterance pairs (302) each including a non-synthetic speech representation (304) and a synthetic speech representation (306) of a same corresponding utterance (106). The method also includes determining a consistent loss term (352) for the corresponding training utterance pair based on a first probability distribution (311) over possible non-synthetic speech recognition hypotheses generated for the corresponding non- synthetic speech representation and a second probability distribution (312) over possible synthetic speech recognition hypotheses generated for the corresponding synthetic speech representation. The first and second probability distributions are generated for output by the speech recognition model. The method also includes updating parameters of the speech recognition model based on the consistent loss term.