System and method for providing multi-core and multi-level topical organization in social indexes

摘要

A computer-implemented method affords multi-core and multi-level topical organization in social indexes. A corpus of articles is accessed. Each article includes online textual materials. A finite state pattern for a topic filters the articles as candidate articles, which are potentially on-topic. Similarity-based representations are formed for on-topic and off-topic core meanings of the topic. An aggregate score for each of the candidate articles is determined using the similarity-based representations to indicate whether the candidate article is sufficiently on-topic. The candidate articles are presented ordered by their aggregate scores. In a further embodiment, a hierarchy of topics is used to guide the presentation of articles from subtopics, with considerations of fairness of subtopic coverage, elimination of similarity-duplicates in articles, and article freshness.