Dual monolingual cross-entropy-delta filtering of noisy parallel data and use thereof

摘要

Sentence pairs can be filtered using dual monolingual conditional cross-entropy filtering. The filtered sentence pairs can be used to train a model for performing a language processing task, such as machine translation.