基于思维进化的集群作业调度方法研究

薛正华; 刘伟哲; 董小社; 伍卫国

您当前的位置：

首页 >

文章列表页 >

基于思维进化的集群作业调度方法研究

专题研究 | 更新时间：2025-12-08

- 基于思维进化的集群作业调度方法研究
- Research on Mind Evolutionary Computation Based Job Scheduling for Server Clusters
- 西安交通大学学报 2008年42卷第6期页码：651-654+764
- 作者机构：
  
  西安交通大学计算机科学与技术系,西安,710049
- 作者简介：
- 基金信息：
  
  : 2007-09-20. 作者简介: 薛正华(1978-),男,博士生;董小社(联系人), 男, 教授, 博士生导师. 基金项目: 国家自然科学基金资助项目(60773118);国家高技术研究发展计划资助项目(2004AA111110,2006AA01A109)
- DOI：
  中图分类号： TP391.9
- 网络首发：2008-06-09，
  
  纸质出版：2008
- 稿件说明：
移动端阅览
薛正华, 刘伟哲, 董小社, 等. 基于思维进化的集群作业调度方法研究[J]. 西安交通大学学报, 2008,42(6):651-654+764.

薛正华, 刘伟哲, 董小社, et al. Research on Mind Evolutionary Computation Based Job Scheduling for Server Clusters[J]. 2008, 42(6): 651-654+764.
薛正华, 刘伟哲, 董小社, 等. 基于思维进化的集群作业调度方法研究[J]. 西安交通大学学报, 2008,42(6):651-654+764. DOI：

薛正华, 刘伟哲, 董小社, et al. Research on Mind Evolutionary Computation Based Job Scheduling for Server Clusters[J]. 2008, 42(6): 651-654+764. DOI：

摘要

为了减少不准确的时间估计对作业调度的影响

提出了动态预约调度模式.在该模式中

预约队列中的作业与被预约资源是松耦合的

可根据作业完成情况进行重映射

以减少作业提前完成而产生的资源碎片.基于动态预约模式

将思维进化计算引入到作业调度中

以各种回填算法的调度结果作为初始群体

通过趋同和异化操作

使群体不断向最优解进化

从而产生更优的调度方案.基于真实作业集的仿真结果表明

所提算法的作业平均的等待、延迟时间比最优的基于回填的组合算法分别下降了68.5%和66.9%.

Abstract

A dynamic reservation based on scheduling method is proposed to reduce the disadvantage caused by inaccurate estimation on job run time. The method combines the reservation jobs and the computing resources in loose couple

and it enables the scheduler to recombine the reservation jobs and resources to reduce the idle resources caused by jobs completed in advance. Based on the dynamic reservation mode

the mind evolutionary computation(MEC)based algorithm is introduced into the scheduler. The algorithm sets the result obtained from the backfill algorithms as the initial population

and it can achieve better scheduling result by adopting assimilation and dissimilation operations. Simulations based on a real workload show that the proposed method is valid. Compared with the backfill algorithm

the proposed algorithm decreases both the average job wait time and the average slowdown by 68.5% and 66.9%

respectively.

关键词

Keywords

references

SRINIVASAN S, KETTIMUTHU R, SUBRAMANI V, et al. Selective reservation strategies for backfill job scheduling [C]∥8th International Workshop on Job Scheduling Strategies for Parallel Processing. Berlin, Germany: Springer-Verlag, 2002:55-71.

SHMUELI E, FEITELSON D. Backfilling with look ahead to optimize the performance of parallel job scheduling [C]∥9th International Workshop on Job Scheduling Strategies for Parallel Processing. Berlin, Germany: Springer-Verlag, 2003:228-251.

LAWSON B, SMIRNI E. Multiple-queue backfilling scheduling with priorities and reservations for parallel systems [C]∥8th International Workshop on Job Scheduling Strategies for Parallel Processing. Berlin, Germany: Springer-Verlag, 2002:72-87.

WARD W, MAHOOD C Jr, WEST J. Scheduling jobs on parallel systems using a relaxed backfill strategy [C]∥8th International Workshop on Job Scheduling Strategies for Parallel Processing. Berlin, Germany: Springer-Verlag, 2002: 88-102.

DROR F. Parallel workloads archive [EB/OL].[2007-09-20]. http:∥www.cs.huji.ac.il/labs/parallel/workload/index.html.

XUE Zhenghua,DONG Xiaoshe, MA Siyuan et al. An energy-efficient management mechanism for large-scale server clusters [C]∥Proceedings of the 2nd IEEE Asia-Pacific Services Computing. Piscataway, NJ, USA: IEEE, 2007:509-516.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

自适应大规模服务器集群监控系统的构建

采用资源划分的云环境下Hadoop资源许可调度方法

多工况下离心压气机叶轮-机匣一体联合设计优化

采用试验设计方法的第三代CO2气体箔轴承箔片几何参数敏感性分析

冷库水平空气幕热湿阻隔性能数值模拟研究