An Evaluation Set for Tibetan Sentences Similarity Computing

摘要

Sentence is not only the basic unit of natural language, but also the research object of Nature Language Process. Sentence similarity computing is the basic of text similarity computing, so sentence similarity evaluation set is an essential data set for similarity technology research. Only by establishing an appropriate evaluation set can we objectively evaluate the advantages and disadvantages of similarity computing methods. In order to objectively evaluate the performance of Tibetan sentence similarity, this paper designs the construction scheme of Tibetan sentence similarity evaluation set, and builds the evaluation set TSS_320 for evaluating Tibetan sentence similarity, based on the analysis of the construction method of English and Chinese sentence similarity evaluation set, also combined with the characteristics of Tibetan sentences. The validity of the evaluation set is verified by statistical methods.