SYSTEM AND METHOD FOR HIERARCHICALLY ORGANIZING DOCUMENTS BASED ON DOCUMENT PORTIONS

摘要

Embodiments as disclosed may generate an organizational hierarchy based on embeddings of portions of documents. Embeddings resulting from the embedding of the portions of the documents can be clustered using a hierarchical clustering mechanism to segment the portion space into a set of hierarchical clusters. Documents can be assigned to these clusters based on the presence of a portion of a document within a cluster. In this manner, the documents may themselves be clustered based on the clusters created from portions across the documents of the corpus. The clusters to which a document is assigned may also be ranked with respect to that document. Similarly, documents assigned to cluster can be ranked within the cluster to which they are assigned. Additionally, in certain embodiments, names or snippets for the clusters of the hierarchy may be derived from the portions comprising that cluster.