Research of Focused Crawler for Financial Social Network

摘要

With the rapid rise in social network users during recent years, social network is changing business models in the China's Internet industry. Social network produces large amounts of data that reflect the real world, so we can make conclusions about financial incidents by monitoring people's interests in social network and analyzing investors' feelings based on the data. To obtain the data from financial social networks, crawling the web entirely is expensive and unrealistic because of limited resources. A focused crawler that targets a particular topic is more suitable. This paper implements a focused crawler for collecting pages on the financial social network.