Civil Engineering Commons^™

Advancing Distributed Data Management For The Hydroshare Hydrologic Information System, Hong Yi, Ray Idaszak, Michael Stealey, Chris Calloway, Alva L. Couch, David G. Tarboton

Civil and Environmental Engineering Faculty Publications

HydroShare (https://www.hydroshare.org) is an online collaborative system to support the open sharing of hydrologic data, analytical tools, and computer models. Hydrologic data and models are often large, extending to multi-gigabyte or terabyte scale, and as a result, the scalability of centralized data management poses challenges for a system such as HydroShare. A distributed data management framework that enables distributed physical data storage and management in multiple locations thus becomes a necessity. We use the iRODS (Integrated Rule-Oriented Data System) data grid middleware as the distributed data storage and management back end in HydroShare. iRODS provides a unified virtual file system …