Method and apparatus for constructing a compact similarity structure and for using the same in analyzing document relevance

摘要

A computer-readable medium comprises data structure for providing information about levels of similarity between pairs of N documents. The data structure comprises a plurality of entries of similarity values representing levels of similarity for a plurality of pairs of the documents. Each of the similarity values represents a level of similarity of one document of a given pair relative to the other document of the given pair. The similarity value of each entry is greater than a threshold similarity value that is greater than zero. The plurality of similarity-value entries are fewer than N²−N in number if the similarity values are asymmetric with regard to document pairing, and the plurality of similarity-value entries are fewer than; $$ \frac{N^2-N}{2}$$in number if the similarity values are symmetric with regard to document pairing. A method and apparatus for generating the data structure are described.