INFORMATION FORECAST AND ACQUISITION METHOD BASED ON WEBPAGE LINK PARAMETER ANALYSIS

摘要

The present invention discloses an information prediction and crawling method based on a webpage link parameter analysis, comprising the following sequence of steps: calculating statistical parameter features of webpage links, calculating distribution patterns of outlinks contained in webpages, classifying the webpages according to the distribution patterns of the outlinks of the webpages, performing a sampling prediction on webpage resources, performing an crawling test on prediction samples, and performing an overall prediction on the webpage resources. According to the method of the present invention, the deficiencies of the traditional webpages crawling mode are effectively supplemented, the quantity of link resources to be crawled is expanded, a great number of undiscovered webpage resources are predicted by means of the known webpage resource features, and the speed and coverage rate of the webpage information crawling is improved.