经验爬虫应用于网络地图服务获取

摘要

网络地图服务已经渗透到国民经济的方方面面,如何从海量的地图服务中获取需要的数据成为当下研究的热点问题.本文针对目前Web地图服务数据在使用爬虫技术获取中,存在效率和准确性低的问题,提出在经典网络爬虫基础上,增加“经验树”环节,实现了“经验爬虫”.将改进后的“经验爬虫”与其他3种经典爬虫爬取的结果对比分析,“经验爬虫”爬取的效率和准确性是其他3种经典爬虫均值的2倍以上.%Web map service has penetrated into all aspects of the national economy,how to get the data from the massive map service has become a hot issue in the present study.Low efficiency and low accuracy always occurs when using crawler technology to obtain web map service data.Aiming at addressing those problems,the concept of experienced crawler is proposed by introducing the experienced tree into the classic web crawler.By comparing the results of the improved "experienced crawler" and the other three classical crawler,the performance and accuracy of the "experienced crawler" is more than 2 times of the average of the other three kinds of classical crawler.