DEEP LEARNING-BASED METHOD FOR FILTERING OUT SIMILAR TEXT, AND APPARATUS USING SAME

摘要

According to the present invention, provided is a method for collecting filtered text data, comprising the steps in which: a computing device acquires first text data and records the first text data in a text data pool; the computing device acquires second text data; the computing device performs a calculation in a deep learning model by using the first text data and the second text data as input values and calculates a first feature vector corresponding to the first text data and a second feature vector corresponding to the second text data; and the computing device compares the degree of similarity between the first feature vector and the second feature vector, and records the second text data in the text data pool when the degree of similarity is less than a predetermined value.