首页>
外国专利>
METHOD AND DEVICE FOR CRAWLING WEBSITE DATA, STORAGE MEDIUM AND SERVER
METHOD AND DEVICE FOR CRAWLING WEBSITE DATA, STORAGE MEDIUM AND SERVER
展开▼
机译:检索网站数据,存储介质和服务器的方法和装置
展开▼
页面导航
摘要
著录项
相似文献
摘要
Disclosed are a method and device for crawling website data, a computer-readable storage medium and a server, solving the problem that many websites require input of a verification code to block a crawler system, resulting in the crawler system not being able to crawl data. The method provided by the present application comprises: initiating an access request to a target website of which data is to be crawled; receiving feedback information that the target website requires input of a verification code, and then acquiring a target verification code picture, on the target website, corresponding to feedback information; putting the target verification code picture into a pre-trained machine learning model for recognition, to obtain a verification code answer output by the machine learning model; executing, according to the output verification code answer, a verification operation of the target website requiring input of a verification code; and when verification of the target website is passed, crawling data from the target website.
展开▼