【24h】

An active storage system with dynamic task assignment policy

机译:具有动态任务分配策略的主动存储系统

获取原文

摘要

As the amount of data grows exponentially, active storage was proposed as an alternative solution in order to mitigate the I/O performance problem in distributed cluster system. It moves appropriate computation to the location in which data is stored and hence reduces the amount of data transferred. Prior research has investigated and deployed the concept in different forms. However, balancing the computation load between compute and storage nodes in active storage system according to the current system status has been largely unexplored. In this paper, we propose an active storage system that provides programming interfaces for applications to implement the offload computing algorithm and assignment policy. We have implemented a dynamic task assignment policy that assigns computing tasks between compute and storage nodes according the feedback information of system environment. Our experimental results show that there is a optimal allocation proportion with the considerable impact of system status and characteristics of computation, and the proposed dynamic task assignment policy can make an allocation of computing tasks at a proportion close to the optimal assignment.
机译:随着数据量呈指数增长,提出了主动存储作为替代解决方案,以缓解分布式集群系统中的I / O性能问题。它将适当的计算移至存储数据的位置,从而减少了传输的数据量。先前的研究已经以不同形式调查和部署了该概念。但是,在很大程度上尚未探索根据当前系统状态在主动存储系统中的计算节点与存储节点之间平衡计算负载的问题。在本文中,我们提出了一个主动存储系统,该存储系统为应用程序提供编程接口,以实现卸载计算算法和分配策略。我们已经实现了动态任务分配策略,该策略根据系统环境的反馈信息在计算节点和存储节点之间分配计算任务。我们的实验结果表明,存在一个最佳分配比例,这对系统状态和计算特性有很大影响,并且所提出的动态任务分配策略可以使计算任务的分配比例接近最佳分配。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号