首页> 外国专利> APPARATUS, METHOD AND COMPUTER PROGRAM FOR CLOUD SCRAPING USING PRE-SCRAPED BIG DATA

APPARATUS, METHOD AND COMPUTER PROGRAM FOR CLOUD SCRAPING USING PRE-SCRAPED BIG DATA

机译:使用预分块的大数据进行云分块的装置,方法和计算机程序

摘要

A cloud scraping system using pre-scraped big data includes an information providing server which, when receiving a scraping request from a user terminal, provides the user terminal with response information to the received scraping request, and a big data storage which stores pre-scraped information, wherein when the scraping request is about static information, the information providing server acquires the response information using the pre-scraped information. According to the above cloud scraping system using pre-scraped big data, there is an advantage that it is possible to quickly respond to a scraping request from the user terminal afterwards by pre-scraping and storing static information in the big data storage. Additionally, it is possible to improve the scraping server operation efficiency by making a proper use of a single or multi-processing scraping server based on policy information of a scraping target external institution.
机译:使用预先抓取的大数据的云抓取系统包括:信息提供服务器,该信息提供服务器在从用户终端接收到抓取请求时,向用户终端提供对接收到的抓取请求的响应信息;以及大数据存储器,其存储预先抓取的信息,其中当抓取请求是关于静态信息时,信息提供服务器使用预先抓取的信息获取响应信息。根据上述使用预先抓取的大数据的云抓取系统,具有以下优点:可以通过预先将静态信息抓取并存储在大数据存储器中来快速响应于来自用户终端的抓取请求。另外,可以通过基于刮擦目标外部机构的策略信息适当地使用单个或多个处理的刮擦服务器来提高刮擦服务器的操作效率。

著录项

  • 公开/公告号US2019332720A1

    专利类型

  • 公开/公告日2019-10-31

    原文格式PDF

  • 申请/专利权人 COOCON CO. LTD.;

    申请/专利号US201816112544

  • 发明设计人 JAE WON JEONG;CHEONG SEOK BACK;

    申请日2018-08-24

  • 分类号G06F17/30;G06F11/07;

  • 国家 US

  • 入库时间 2022-08-21 12:09:29

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号