Physical Sciences and Mathematics Commons^™

Kestrel: Job Distribution And Scheduling Using Xmpp, Lance Stout

All Theses

A new distributed computing framework, named Kestrel, for Many-Task Computing
(MTC) applications and implementing Virtual Organization Clusters (VOCs) is
proposed. Kestrel is a lightweight, highly available system based on the
Extensible Messaging and Presence Protocol (XMPP), and has been developed to
explore XMPP-based techniques for improving MTC and VOC tolerance to faults due
to scaling and intermittently connected heterogeneous resources. Kestrel provides
a VOC with a special purpose scheduler for VOCs which can provide better scalability
under certain workload assumptions, namely CPU bound processes and bag-of-task
applications.
Experimental results have shown that Kestrel is capable of operating
a VOC of …