Mixed proposal based model training system

摘要

In implementations of the subject matter described herein, each token for containing an element in the training data is sampled according to a factorization strategy in training. Instead of using a single proposal, the property value of the target element located at the token being scanned is iteratively updated one or more times based on a combination of an element proposal and a context proposal. The element proposal tends to accept a value that is popular for the target element independently of the current piece of data, while the context proposal tends to accept whenever the property value that is popular in the context of the target data or popular for the element itself. The proposed modeling training approach can converge in a quite efficient way.