OnceDeep 数据交换服务器集群系统的设计与实现

摘要

In data exchanging process there usually has data centre.The volume of concurrent tasks handled by the centre is high, the requirement of performance and reliability for the server is high as well, this could become the bottleneck of the data exchanging.In order to improve the performance and reliability of data centre of the data exchanging platform and reduce managerial cost, we design and implement an OnceDeep data exchange server cluster system.The system is based on existing data exchange platform OnceDeep, and uses the cluster framework of Shoal to achieve the management on OnceDeep server cluster.In the paper we discuss the design of data exchanging process in cluster environment, the design of dynamic load balancing algorithm based on prediction in accordance with the characteristics of data exchanging tasks, and make recovery mechanism for tasks failures.Tests show that the cluster system performs much better than existing data exchanging servers, and has good expansion ability as well.%数据交换中一般存在数据中心。中心处理的并发任务量高，对服务器性能和可靠性要求高，往往会成为数据交换的瓶颈。为了提高数据交换平台的数据中心的性能、可靠性，并降低管理成本，设计和实现了OnceDeep数据交换服务器集群系统。基于现有的数据交换平台OnceDeep，使用Shoal集群框架实现对OnceDeep服务器集群的管理。讨论集群环境下数据交换流程的设计。针对数据交换任务的特点设计基于预测的动态负载均衡算法，制定任务失效的恢复策略。测试表明，集群系统较现有数据交换服务器在性能上有很大提高，并具有较好的扩展能力。