首页> 外文会议>International conference on algorithms and architectures for parallel processing >Efficient Scheduling with Intensive In-Memory File Accesses Considering Bandwidth Constraint on Memory Bus
【24h】

Efficient Scheduling with Intensive In-Memory File Accesses Considering Bandwidth Constraint on Memory Bus

机译:考虑内存总线带宽限制的密集型内存文件访问的高效调度

获取原文

摘要

The latest trend in high performance computing and big data applications inspires new solutions of in-memory filesystems to achieve high throughput of file data accesses. However, new concerns arise because intensive in-memory file accesses can cause contention problem on memory bus. With existing schedulers, such as Complete Fair Scheduler (CFS) in Linux system, memory access intensive processes can excessively occupy memory bandwidth. As a result, the performance of a set of running processes is degraded. In this paper, we propose a scheduling algorithm to consider memory bandwidth consumption during scheduling and improve the completion time of a given working set. We first present the data to show that CFS can not efficiently handle a set of running processes involving intensive in-memory file accesses. Then, a heuristic algorithm is proposed to solve the scheduling problem with bandwidth consumption and execution time consideration. The scheduling algorithm is implemented and extensively experimented in Linux system. The experimental results show that the completion time is reduced up to 33.3% compared with that generated by Linux scheduler CFS.
机译:高性能计算和大数据应用程序的最新趋势启发了内存文件系统的新解决方案,以实现文件数据访问的高吞吐量。但是,由于密集的内存文件访问会导致内存总线上的争用问题,因此引起了新的关注。使用现有的调度程序,例如Linux系统中的完全公平调度程序(CFS),占用大量内存的进程可能会过度占用内存带宽。结果,一组正在运行的进程的性能下降。在本文中,我们提出一种调度算法,以考虑调度期间的内存带宽消耗并改善给定工作集的完成时间。我们首先提供数据以表明CFS无法有效处理涉及大量内存文件访问的一组正在运行的进程。然后,提出了一种启发式算法,以解决带宽消耗和执行时间考虑的调度问题。该调度算法在Linux系统中实现并进行了广泛的实验。实验结果表明,与Linux Scheduler CFS生成的完成时间相比,完成时间最多减少了33.3%。

著录项

相似文献

  • 外文文献
  • 中文文献
  • 专利
获取原文

客服邮箱:kefu@zhangqiaokeyan.com

京公网安备:11010802029741号 ICP备案号:京ICP备15016152号-6 六维联合信息科技 (北京) 有限公司©版权所有
  • 客服微信

  • 服务号