Systems and methods for scalable topic detection in social media

摘要

Embodiments generally relate to systems and methods for detecting topics in social media data. More particularly, the systems and methods can extract a concept hierarchy from a set of data, wherein the concept hierarchy comprises a plurality of layers. Further, the systems and methods can train topic models based on the content in each of the layers. Still further, the systems and methods can select the most appropriate topic model for social media data by balancing the complexity of the model and the accuracy of the topic detection result. Moreover, the systems and methods can use the most appropriate topic model to detect topics in social media data.