Engineering Commons^™

Assessing Data Availability And Research Reproducibility In Hydrology And Water Resources, James H. Stagge, David E. Rosenberg, Adel M. Abdallah, Hadia Akbar, Nour A. Atallah, Ryan James

Civil and Environmental Engineering Faculty Publications

There is broad interest to improve the reproducibility of published research. We developed a survey tool to assess the availability of digital research artifacts published alongside peer-reviewed journal articles (e.g. data, models, code, directions for use) and reproducibility of article results. We used the tool to assess 360 of the 1,989 articles published by six hydrology and water resources journals in 2017. Like studies from other fields, we reproduced results for only a small fraction of articles (1.6% of tested articles) using their available artifacts. We estimated, with 95% confidence, that results might be reproduced for only 0.6% to 6.8% …