云计算环境下海量分布式数据处理协同机制的研究

摘要

In cloud computing environment, data management and storage present the characteristics of heterogeneous, distributed and dynamic, which bring certain challenge for the design and development of data processing system. The cooperation of data processing is an effective means to solve these problems. Based on analysing the cooperation computing model, in the paper we propose a cooperation mechanism of data processing, and put the emphasis on the cooperation of distributed data management ( Co-DDM) and the cooperation of task scheduling. (Co-TS). Practical cases analyses demonstrate that this mechanism and method are able to improve the ability of parallel data processing greatly, it provides a feasible thought and approach for the research and development of data processing platform in cloud computing environment.%云计算环境下的数据管理和存储呈现出异构、分布式和动态等特点,为数据处理系统的设计和开发带来一定挑战,数据处理过程的协同是解决上述问题的有效手段.在协同计算模型分析的基础上,提出一种数据处理的协同机制,重点研究分布式数据的协同管理和任务的协同调度.实际的案例分析表明,该机制和方法可以大大提高并行数据处理的能力,为云计算环境下的数据处理平台的研发提供了一种可行的思路和方法.