Publication: An Improved Job Co-Allocation Strategy in Multiple HPC Clusters

All || By Area || By Year

Title	An Improved Job Co-Allocation Strategy in Multiple HPC Clusters
Authors/Editors*	J. Qin, M. Bauer
Where published*	The 20th Annual Symposium on High Performance Computing Systems and Applications (HPCS 2007)
How published*	Proceedings
Year*	2007
Volume
Number
Pages	18-24
Publisher	IEEE
Keywords	process allocation, resource management
Link
Abstract	To more effectively use HPC clusters, co-allocating jobs across multiple clusters becomes an attractive possibility with the primary benefit being reduced turn-around time. This, ultimately, depends on the inter-cluster communication cost. In our previous research, we introduced a co-allocation strategy, MBAS, that made use of two threshold values to control allocation: one for control link saturation and another to control job splitting. In this paper, we examine the performance of MBAS. A simulation study concludes that assigning jobs with different priorities according to their communication patterns, and adjusting the threshold values for link saturation level control and chunk size control in splitting jobs, the MBAS co-allocation strategy can significantly improve both userâ satisfaction (in terms of turn around time) and system resource utilization consistently, even for jobs having large communication requirements.