首页> 外国专利> Application server for distributing data in Hadoop ecosystem based on scheduler and Hadoop ecosystem including the same

Application server for distributing data in Hadoop ecosystem based on scheduler and Hadoop ecosystem including the same

机译:基于调度程序的Hadoop生态系统中的数据分发应用服务器和包括该服务器的Hadoop生态系统

摘要

The present invention relates to a Hadoop ecosystem, which comprises: a distributed message queuing device for classifying stream data for each topic and temporarily storing the same; and an application server for fetching data for each topic from the distributed message queuing device at a predetermined time in accordance with a scheduler policy, and distributing the fetched data to each platform. According to the present invention, by distributing the stream data to each platform in the Hadoop ecosystem based on a scheduler, it is possible to reduce duplicate codes and improve productivity of the entire system.
机译:本发明涉及一种Hadoop生态系统,其包括:分布式消息队列设备,用于对每个主题的流数据进行分类并将其临时存储;一种应用服务器,用于根据调度器策略在预定时间从分布式消息队列设备获取每个主题的数据,并将获取的数据分配给每个平台。根据本发明,通过基于调度器将流数据分配给Hadoop生态系统中的每个平台,可以减少重复代码并提高整个系统的生产率。

著录项

相似文献

  • 专利
  • 外文文献
  • 中文文献
获取专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号