Open Access. Powered by Scholars. Published by Universities.®

Physical Sciences and Mathematics Commons

Open Access. Powered by Scholars. Published by Universities.®

OS and Networks

PDF

Computer Science Graduate Projects and Theses

Series

Articles 1 - 2 of 2

Full-Text Articles in Physical Sciences and Mathematics

Parallel Copying Tools For Distributed File Systems, Kevin Matthew Nuss Mar 2013

Parallel Copying Tools For Distributed File Systems, Kevin Matthew Nuss

Computer Science Graduate Projects and Theses

Parallel distributed files systems are increasingly being used on clusters to allow greater throughput of data to the many compute nodes. They are also an effective way to store massive amounts of data. However, using the standard core utility cp does not make good use of the potential parallelism of the file systems. Using multiple cp commands has inherent problems too.

Two utilities were created to help recursively copy directories containing large amounts of data on parallel distributed file systems. One of the test data sets contains very many files, and the other contains large files. One utility is a …


Beosh: The Beowulf Cluster Shell, Mason E. Vail Aug 2006

Beosh: The Beowulf Cluster Shell, Mason E. Vail

Computer Science Graduate Projects and Theses

The Beowulf Cluster Shell (beosh) has been created to provide cluster users with a Single System Image (SSI) by distributing individual commands or pipelined jobs over available nodes without requiring the user to be aware of where or how jobs are distributed. Job control of distributed jobs enables management of multiple concurrent remote jobs from a single shell session. In addition to SSI features, beosh supports parallel job execution through pdsh, a commonly used parallel-only cluster shell. In either distributed or parallel mode, beosh can limit nodes to those reserved through a system like the Portable Batch System (PBS).

This …