Design of focused crawler for information retrieval of Indian origin Academicians

摘要

Search engines alleviate the task of finding information on Internet very easy. Web crawler is the main part of any search engine that follows the URLs to gather information from the Web. For topic specific crawling, a special type of crawler called focused Web crawler is used. Focused crawler tries to find high quality information on a specific topic while avoiding irrelevant links. In the era of contemporary world, boundary of countries has evanesces for researchers, scientists and academicians. In this paper, we have applied the concept of focused crawling for information retrieval of Indian origin academicians working abroad. The aim is to develop a database of such academicians working in universities abroad, finding, and connecting with them. Gathering all such individuals through manual search is an impossible task and hence this paper gives a design of a focused crawler that can conglomerate all such information. This continuously updating database will cater to students wishing to connect with their alumni or other professors for academic collaboration.