Parallel Micro Blog Crawler Construction for Effective Opinion Leader Approximation

摘要

It is important to research and find out opinion leader in time of increased huge number of Micro Blog users around our world and daily life. Our governments in different countries around the world have found that it is a vital fact to analysis and control message spreading in Micro Blog and other social network. For the reason that opinion leaders always play vital role in information spreading in Micro Blog and it is necessary to detect opinion leaders precisely. In this article, we has constructed a SINA Micro Blog APIs based Micro Blog crawling and analysis tool. Furthermore, a novel MapReduce based Micro blog crawler and node betweenness approximation computation method was proposed better accuracy and less running time to detect core opinion leaders in Micro Blog graphs.