UNSUPERVISED TEXT SIMPLIFICATION USING AUTOENCODERS WITH A CONSTRAINED DECODER

摘要

A method of producing an unsupervised constrained text simplification autoencoder including an encoder and a constrained decoder, including: encoding, by the encoder, input text to produce a code; combining a complexity parameter with the code; decoding, by constrained decoder, the combined code to produce a plurality of outputs, wherein the constrained decoder uses a dropout function to randomize the parameters of the constrained decoder; evaluating a loss function for each of the plurality of outputs, wherein the loss function is based upon the complexity parameter, indicates an achieved text simplification level, and produces an output indicating the difference between the achieved text simplification level and a desired text simplification level; and optimizing the constrained text simplification autoencoder by repeatedly evaluating the loss function for each input text in an input text training data set while varying parameters of the encoder, the parameters of the constrained decoder, and the complexity parameter until the output of the loss function is minimized.