The study and design of the full-text search engine in electrical power industry based on Nutch

摘要

At present, the general search engine not only covers the small percentage of the particular field and the particular. subject, but also can not make sure the safety of the data which is indexed by the engine. Therefore, the paper developed a professional search engine with bright electrical power industry character based on the open-source search engine framework of Nutch. The system has a dictionary of electrical power industry, using an improved VSM algorithm to calculate the correlation of content which is captured by the crawler, and then filter the relevant parts. The indexed data is ordered by PageRank algorithm. The system also has an access control module, which can certificate the user's authority and classify the information. The system can improve the specialty of the information retrieval in some fields, and enhance the security of the search engine.