首页> 外文OA文献 >Load balancing techniques for I/O intensive tasks on heterogeneous clusters
【2h】

Load balancing techniques for I/O intensive tasks on heterogeneous clusters

机译:异构集群上I / O密集型任务的负载平衡技术

摘要

Load balancing schemes in a cluster system play a critically important role in developing highperformance cluster computing platform. Existing load balancing approaches are concerned with the effective usage of CPU and memory resources. I/O-intensive tasks running on a heterogeneous cluster need a highly effective usage of global I/O resources, previous CPU-or memory-centric load balancing schemes suffer significant performance drop under I/O- intensive workload due to the imbalance of I/O load. To solve this problem, Zhang et al. developed two I/O-aware load-balancing schemes, which consider system heterogeneity and migrate more I/O-intensive tasks from a node with high I/O utilization to those with low I/O utilization. If the workload is memory-intensive in nature, the new method applies a memory-based load balancing policy to assign the tasks. Likewise, when the workload becomes CPU-intensive, their scheme leverages a CPU-based policy as an efficient means to balance the system load. In doing so, the proposed approach maintains the same level of performance as the existing schemes when I/O load is low or well balanced. Results from a trace-driven simulation study show that, when a workload is I/O-intensive, the proposed schemes improve the performance with respect to mean slowdown over the existing schemes by up to a factor of 8. In addition, the slowdowns of almost all the policies increase consistently with the system heterogeneity.
机译:集群系统中的负载平衡方案在开发高性能集群计算平台中起着至关重要的作用。现有的负载平衡方法与CPU和内存资源的有效使用有关。在异构集群上运行的I / O密集型任务需要高效地使用全局I / O资源,由于I的不平衡,以前的以CPU或内存为中心的负载平衡方案在I / O密集型工作负载下性能显着下降/ O负载。为了解决这个问题,Zhang等人。开发了两种I / O感知负载均衡方案,这些方案考虑了系统异构性,并将更多I / O密集型任务从I / O利用率高的节点迁移到I / O利用率低的节点。如果工作负载本质上是占用大量内存的,则新方法将应用基于内存的负载平衡策略来分配任务。同样,当工作负载变得占用大量CPU时,他们的方案利用基于CPU的策略作为平衡系统负载的有效手段。这样做时,当I / O负载较低或平衡良好时,建议的方法可保持与现有方案相同的性能水平。跟踪驱动模拟研究的结果表明,当工作负载是I / O密集型时,相对于现有方案,所提出的方案相对于平均方案,其性能提高了8倍。此外,几乎所有策略都随着系统异质性的增长而一致。

著录项

  • 作者

    Lakra Sukromony;

  • 作者单位
  • 年度 2007
  • 总页数
  • 原文格式 PDF
  • 正文语种
  • 中图分类

相似文献

  • 外文文献
  • 中文文献
  • 专利

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号