Skip to main content
SHARE
Publication

JOSHUA: Symmetric Active/Active Replication for Highly Available HPC Job and Resource Management...

by Kai Uhlemann, Christian Engelmann, Steven L Scott
Publication Type
Conference Paper
Book Title
Proceedings on a CD
Publication Date
Page Numbers
0 to 182
Conference Name
IEEE International Conference on Cluster Computing (Cluster) 2006
Conference Location
Barcelona, Spain
Conference Date
-

Most of today's HPC systems employ a single head node for control, which represents a single point of failure as it interrupts an entire HPC system upon failure. Furthermore, it is also a single point of control as it disables an entire HPC system until repair. One of the most important HPC system service running on the head node is the job and resource management. If it goes down, all currently running jobs loose the service they report back to. They have to be restarted once the head node is up and running again.

With this paper, we present a generic approach for providing symmetric active/active replication for highly available HPC job and resource management. The JOSHUA solution provides a virtually synchronous environment for continuous availability without any interruption of service and without any loss of state. Replication is performed externally via the PBS service interface without the need to modify any service code. Test results as well as a reliability analysis of our proof-of-concept prototype implementation show that continuous availability can be provided by JOSHUA with an acceptable performance trade-off.