首页> 外文期刊>Information Technology Journal >A New Massive Data Processing Framework under Cloud Environment for Digital Community
【24h】

A New Massive Data Processing Framework under Cloud Environment for Digital Community

机译:云环境下数字社区的海量数据处理新框架

获取原文
           

摘要

Digital community involves e-government, e-commerce, smart health and other applications. With the increase of customers and types of business, it becomes more important for digital community to process massive data efficiently. Although, the current cloud-based applications can provide some elastic and on-demand calculation abilities to digital community, their underlying programming models still have certain limitations. This study aims to provide a new framework of massive data processing for digital community. In the framework, multiple programming models are adopted and each programming model handles the specific calculations that they do best. These calculations mainly include embarrassingly parallel calculation, iteration calculation and data-dependent complex calculation. To improve the performance of the framework, the programming model connection pool and the virtual subnet are designed and applied. Compared to Hadoop and its modified version, on average, the proposed framework can reduce runtime by 1.32. The experimental results show that the proposed framework has higher generality and efficiency. Moreover, it is reasonable and valuable for digital community to analyze comprehensively trade area on geographical location and business volume.
机译:数字社区涉及电子政务,电子商务,智能健康和其他应用程序。随着客户和业务类型的增加,数字社区有效地处理海量数据变得越来越重要。尽管当前基于云的应用程序可以为数字社区提供一些弹性和按需计算能力,但是其基础编程模型仍然存在某些局限性。这项研究旨在为数字社区提供海量数据处理的新框架。在该框架中,采用了多种编程模型,每种编程模型都处理它们最擅长的特定计算。这些计算主要包括令人尴尬的并行计算,迭代计算和与数据相关的复杂计算。为了提高框架的性能,设计并应用了编程模型连接池和虚拟子网。与Hadoop及其修改版本相比,所提出的框架平均可将运行时间减少1.32。实验结果表明,该框架具有较高的通用性和效率。此外,对于数字社区来说,全面分析贸易区域的地理位置和业务量是合理且有价值的。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号