DETECTING DUPLICATED QUESTIONS USING REVERSE GRADIENT ADVERSARIAL DOMAIN ADAPTATION

摘要

Detect duplicated questions using reverse gradient adversarial domain adaptation includes applying a general network to multiple general question pairs to obtain a first set of losses. A target domain network is applied to multiple domain specific network pairs to obtain a second set of losses. Further, a domain distinguishing network is applied to a set of domain specific questions and a set of general questions to obtain a third set of losses. A set of accumulated gradients is calculated from the first set of losses, the second set of losses, and the third set of losses. Multiple features are updated according to the set of accumulated gradients to train the target domain network.