A mobile phone information search engine based on Heritrix and Lucene

摘要

With the rapid spread of web application, the search engine based on personalized services becomes more important in the society. The paper proposes an approach to design and implement a personalized search engine based on Heritrix and Lucene. In particular, the design a web crawler of mobile information with URL hashing algorithm, achieving the multithread and efficient web crawl. Experimental results show the efficient performance.