Open Access. Powered by Scholars. Published by Universities.®

Digital Commons Network

Open Access. Powered by Scholars. Published by Universities.®

PDF

Environmental Sciences

City University of New York (CUNY)

Data Standards and Protocols

Articles 1 - 21 of 21

Full-Text Articles in Entire DC Network

Linked Data Approach For Automated Failure Detection In Pressure Sewers Using Real-Time Sensor Data, Jonathan Yu, Paul Davis, Kerry Taylor, Scott Gould Aug 2014

Linked Data Approach For Automated Failure Detection In Pressure Sewers Using Real-Time Sensor Data, Jonathan Yu, Paul Davis, Kerry Taylor, Scott Gould

International Conference on Hydroinformatics

The increased availability of sensor data presents opportunities for machine-assisted analytics, reporting and exploration of the sensed environment. Sensor networks provide the ability to observe physical phenomena in real-time and provide useful information to help conservation and management of environmental resources. Thus, exploring these real-time datasets can provide valuable insights for informing policy and decision support in domains such as water quality monitoring, early warning disaster detection, and physical asset degradation monitoring. However, the semantic meaning, format and interface heterogeneity of the sensors and sensor observations are barriers to effective discovery and analysis of events. We propose ontology-driven approaches for …


The Provision Of Data From The Cosmos-Uk Soil Moisture Monitoring Network, Matthew J. Fry, Jonathan Evans, Helen Ward, James Blake, Lucy Ball, Louisa Doughty Aug 2014

The Provision Of Data From The Cosmos-Uk Soil Moisture Monitoring Network, Matthew J. Fry, Jonathan Evans, Helen Ward, James Blake, Lucy Ball, Louisa Doughty

International Conference on Hydroinformatics

This paper describes the data available from COSMOS-UK, a new soil moisture monitoring network for the UK based on passive cosmic-ray moisture probes which are capable of measuring average soil water content over a circular footprint of around 350m in radius and depths of up to 0.5 m. Around 35 probes, with an associated array of meteorological and point soil moisture sensors, will be deployed across the UK in a network designed to best represent a range of soil and land cover types, complement existing scientific monitoring over a wide range of subject areas, and capture the variability in soil …


Using Smart Water Meters In (Near) Real-Time On The Iwidget System, Michael G. Barry, Mark E. Purcell, Bradley J. Eck Aug 2014

Using Smart Water Meters In (Near) Real-Time On The Iwidget System, Michael G. Barry, Mark E. Purcell, Bradley J. Eck

International Conference on Hydroinformatics

Devices and technologies to measure and report water consumption at sub-daily intervals are growing in popularity. Data from these devices are creating new opportunities to manage the supply and demand of water in near real-time. To this end, The EU FP7 iWidget project is developing a state-of-the art analytics platform for the integrated management of urban water. Key challenges include extracting useful insights from high-resolution consumption data and exploring a range of decision-support tools for water utilities and consumers. To overcome these challenge iWIDGET is developing a distributed, open, robust, collaborative architecture that allows partners and utilities to collect and …


Integration Of Water Supply Distribution Systems By Using Interoperable Standards To Make Effective Decisions, Gabriel Anzaldi, Wenyan Wu, Andreas Abecker, Edgar Rubión, Aitor Corchero, Ambreen Hussain, Michael Quenzer Aug 2014

Integration Of Water Supply Distribution Systems By Using Interoperable Standards To Make Effective Decisions, Gabriel Anzaldi, Wenyan Wu, Andreas Abecker, Edgar Rubión, Aitor Corchero, Ambreen Hussain, Michael Quenzer

International Conference on Hydroinformatics

This paper aims at presenting current standards used and their implementation to integrate different decision making tools spread throughout the Water Supply Distribution Chain. Nowadays in Europe the water supply distribution managers use many tools to perform their decisional processes and multiple data sources to aid in decision making which are totally unconnected and use different communication languages. The data and protocols heterogeneity provides a lack of fluidity in communications between the tools, and in many cases non-existent. An architectural proposal, which uses hydrologic standards, with the aim to offer a common way to interconnect existing tools and data to …


Gap Filling Based On A Quantile Perturbation Factor Technique, Diego E. Mora, Guido Wyseure, Patrick Willems Aug 2014

Gap Filling Based On A Quantile Perturbation Factor Technique, Diego E. Mora, Guido Wyseure, Patrick Willems

International Conference on Hydroinformatics

The presence of hydro-meteorological series gaps is a common problem in hydrological and water engineering applications. This is also the case for the Ecuadorian hydrological data-series, showing many gaps of short term duration. This study focuses on the Paute River Basin, in the Southern Ecuadorian Andes. It is one of the most monitored basins in Ecuador, with 25 rainfall observed sites during the period 1963 - 1990. These series suffer of about 20% of missing data. Two techniques were evaluated comparing their efficiency in the filling of missing gaps. The first one is a traditional one based on multiple linear …


Enhancing Water Quality Data Service Discovery And Access Using Standard Vocabularies, Jonathan Yu, Bruce A. Simons, Nicholas J. Car, Simon J.D. Cox Aug 2014

Enhancing Water Quality Data Service Discovery And Access Using Standard Vocabularies, Jonathan Yu, Bruce A. Simons, Nicholas J. Car, Simon J.D. Cox

International Conference on Hydroinformatics

There is a growing need for consistency across the publishing, discovering, integrating and access to scientific datasets, such as water quality data. Such datasets may have varying formats and service interfaces. The Network Common Data Form (NetCDF) is both a software package and a data format for producing array-oriented scientific data, which is commonly used to exchange data, including water quality data. NetCDF datasets are also published through service interfaces using the THREDDS data server. Alternatively water quality datasets can be encoded with standard XML formats such as WaterML 2.0, which can be published with services such as the Open …


Harmonization Of Vocabularies For Water Data, Simon J.D. Cox, Jonathan Yu, Bruce A. Simons Aug 2014

Harmonization Of Vocabularies For Water Data, Simon J.D. Cox, Jonathan Yu, Bruce A. Simons

International Conference on Hydroinformatics

Observational data encodes values of properties associated with a feature of interest, estimated by a specified procedure. For water the properties are physical parameters like level, volume, flow and pressure, and concentrations and counts of chemicals, substances and organisms. Water property vocabularies have been assembled at project, agency and jurisdictional level. Organizations such as EPA, USGS, CEH, GA and BoM maintain vocabularies for internal use, and may make them available externally as text files. BODC and MMI have harvested many water vocabularies alongside others of interest in their domain, formalized the content using SKOS, and published them through web interfaces. …


Opensdm - An Open Sensor Data Management Tool, David Camhy, Günter Gruber, David Steffelbauer, Thomas Hofer, Dirk Muschalla Aug 2014

Opensdm - An Open Sensor Data Management Tool, David Camhy, Günter Gruber, David Steffelbauer, Thomas Hofer, Dirk Muschalla

International Conference on Hydroinformatics

Exchange of scientific data and metadata between single users or organizations is a challenging task due to differences in data formats, the genesis of data collection, ontologies and prior knowledge of the users. Different data storage requirements, mostly defined by the structure, size and access scenarios, require also different data storage solutions, since there is no and there cannot be a data format which is suitable for all tasks and needs that occur especially in a scientific workflow. Besides data, the generation and handling of additional corresponding metadata leads us to the additional challenge of defining the "meaning" of data, …


International Standardization Of Water Information Exchange: Activities Of The Wmo/Ogc Hydrology Domain Working Group, Ulrich Looser, Ilya Zaslavsky, Tony Boston, David Lemon, Lance Mckee, Irina Dornblut Aug 2014

International Standardization Of Water Information Exchange: Activities Of The Wmo/Ogc Hydrology Domain Working Group, Ulrich Looser, Ilya Zaslavsky, Tony Boston, David Lemon, Lance Mckee, Irina Dornblut

International Conference on Hydroinformatics

Hydrologic information is generated and published by many government, research, commercial and citizen groups around the world. The formats and protocols used to share the data are heterogeneous, with little agreement about semantics of hydrologic measurements, description of hydrologic features, or metadata content. A broad consensus on hydrologic data sharing formats is needed to ensure that the information can be reliably discovered, interpreted, accessed and integrated. This has been the focus of the Hydrology Domain Working Group (Hydro DWG), established in 2009 as a joint working group of the World Meteorological Organisation (WMO) and the Open Geospatial Consortium (OGC). It …


Harmonization - Towards A Standardized River Geometry Format, Stephen Jackson, David R. Maidment, David K. Arctur Aug 2014

Harmonization - Towards A Standardized River Geometry Format, Stephen Jackson, David R. Maidment, David K. Arctur

International Conference on Hydroinformatics

RiverML is a proposed language for conveying a description of river channel and floodplain geometry and flow characteristics through the internet in a standardized way, which is currently in the early stages of development. RiverML is a joint effort between the CUAHSI HydroShare development team, the World Meteorological Organization (WMO) / Open Geospatial Consortium (OGC) Hydrology Domain Working Group, and an international community of data providers, data users, and software developers. In order to create a standard that will serve the needs of the international hydrologic community, a harmonization effort of three forms of data is presented. First, relevant initiatives …


Enabling Access To Non-Point Source Risk Mapping Tools Using Open Source Software And Open Geospatial Consortium (Ogc) Standards : The Development Of The Scimap Webapp, Peter Wells, Sim Reaney Aug 2014

Enabling Access To Non-Point Source Risk Mapping Tools Using Open Source Software And Open Geospatial Consortium (Ogc) Standards : The Development Of The Scimap Webapp, Peter Wells, Sim Reaney

International Conference on Hydroinformatics

No-point (diffuse) pollution is a key environmental pressure effecting water quality and ecology in lakes and rivers. Many governmental and NGO bodies are working to tacking the problem but their efforts are constrained by the complexities of the problem. To enable the spatial targeting of the mitigation measures at the landscape scale, the SCIMAP risk mapping approach was developed by Durham and Lancaster Universities in the UK. The approach was well received but the desktop implementation created problems for users. NGO users generally did not have the required datasets or GIS skills. Governmental users within a corporate managed IT environment …


Getting Hydroinformatic Tools From Research Into Practice: The Watershare Approach, Christos Makropoulos, Idsart Dijkstra, Wim Van Vierssen Aug 2014

Getting Hydroinformatic Tools From Research Into Practice: The Watershare Approach, Christos Makropoulos, Idsart Dijkstra, Wim Van Vierssen

International Conference on Hydroinformatics

The global Water Sector is faced with significant challenges, including, but not restricted to aging infrastructure, fluctuating populations, new pollutants, more stringent regulations and the need for benchmarking their performance. At the same time the Sector remains very fragmented and hence its R&D often doesn’t have the critical mass to develop the tools and models that are required. Although research institutes and academia do develop such tools, the road from the research environment to the first practical application often proves an insurmountable barrier. Watershare offers a platform for such a transition: Launched as an online placeholder for expert water-related tools, …


Overview Of Coupling Of Data, Models And Information Through The Web Using Existing Standards, Gerben De Boer, Fedor Baart, Bernhard P. J. Becker, Bert Jagers Aug 2014

Overview Of Coupling Of Data, Models And Information Through The Web Using Existing Standards, Gerben De Boer, Fedor Baart, Bernhard P. J. Becker, Bert Jagers

International Conference on Hydroinformatics

Assessment of environmental status and integral safety requires combination of information from many sources, coming from either databases or increasingly via live model (scenario) simulations. Many of these models require input from one another, sometimes unidirectional, but more and more two-directional as well. Many protocols and frameworks are available for model coupling, often based on open standards and implementations. Previous overviews of coupling protocols have focused on data exchange volume, data complexity, invasiveness into existing models and support for specific programming languages. We extend the overview using recent developments in web-based protocols and focus on the suitability for internet-based data …


Drihm - An Infrastructure To Advance Hydro-Meteorological Research, Bert Jagers, Antonio Parodi, Michael Schiffers, Nils Otto Vor Dem Gentschen Felde, Christian Straube, Andrea Clematis, Daniele D'Agostino, Quillon Harpham Aug 2014

Drihm - An Infrastructure To Advance Hydro-Meteorological Research, Bert Jagers, Antonio Parodi, Michael Schiffers, Nils Otto Vor Dem Gentschen Felde, Christian Straube, Andrea Clematis, Daniele D'Agostino, Quillon Harpham

International Conference on Hydroinformatics

One of the main challenges in hydro-meteorological research (HMR) is predicting the impact of weather and climate changes on the environment, society and economy, including local severe hazards such as floods and landslides. At the heart of this challenge lies the ability to have easy access to hydro-meteorological data and models, and facilitate the collaboration across discipline boundaries. Within the DRIHM project (Distributed Research Infrastructure for Hydro-Meteorology, www.drihm.eu, EC funded FP7 project 2011-2015) we develop a prototype e-Science environment to facilitate this collaboration and provide end-to-end HMR services (models, datasets, and post-processing tools) at the European level, with the ability …


A Services' Frameworks And Support Services For Environmental Information Communities, Nicholas J. Car, Matthew Paul Stenson, Simon J. D. Cox, Robert A. Atkinson, Peter Fitch Aug 2014

A Services' Frameworks And Support Services For Environmental Information Communities, Nicholas J. Car, Matthew Paul Stenson, Simon J. D. Cox, Robert A. Atkinson, Peter Fitch

International Conference on Hydroinformatics

For environmental datasets to be used effectively via the Internet, they must present standardized data and metadata services and link the two. The Open Geospatial Consortium's (OGC) web services (WFS, WMS, CSW etc.), have seen widespread use over many years however few organizations have deployed information architectures based solely on OGC standards for all their datasets. Collections of organizations within a thematically-based community certainly cannot realistically be expected to do so. To enable service use flexibility we present a services framework - a Data Brokering Layer (DBL). A DBL presents access to data and metadata services for datasets, and links …


An Information Model For Exchanging Hydrological Rating Tables, Peter Taylor, Paul Sheahan, Stuart Hamilton, David Briar, Matthew J. Fry, Michael Natschke, David Valentine, Gavin Walker Aug 2014

An Information Model For Exchanging Hydrological Rating Tables, Peter Taylor, Paul Sheahan, Stuart Hamilton, David Briar, Matthew J. Fry, Michael Natschke, David Valentine, Gavin Walker

International Conference on Hydroinformatics

Many hydrological data systems provide Internet access to observational and processed data in various forms, from websites to web services. This data is generally described with basic metadata, such as units, names of measured variables, spatial coordinates, and so on. This metadata is largely suitable for further analysis or ingestion into hydrological models. However, when the data has been processed through many – potentially complex – steps, more information is required to give users details of implicit assumptions, inaccuracies, or uncertainties that may have been introduced. A common example of this within hydrology is the use of ratings tables to …


Model Configuration And Data Management In The Short-Term Water Information Forecasting Tools, Jean-Michel Perraud, James Bennett, David Robertson, Phil Ward Aug 2014

Model Configuration And Data Management In The Short-Term Water Information Forecasting Tools, Jean-Michel Perraud, James Bennett, David Robertson, Phil Ward

International Conference on Hydroinformatics

The Short-term Water Information and Forecasting Tools (SWIFT) is a suite of tools for flood and short-term streamflow forecasting, consisting of a collection of hydrologic model components and utilities. Catchments are modeled using conceptual subareas and a node-link structure for channel routing. The tools comprise modules for calibration, model state updating, output error correction, ensemble runs and data assimilation. Given the combinatorial nature of the modelling experiments and the sub-daily time steps typically used for simulations, the volume of model configurations and time series data is substantial and its management is not trivial. SWIFT is currently used mostly for research …


Publishing And Federating Global Water Data And Maps Via Web Services, David K. Arctur, David R. Maidment Aug 2014

Publishing And Federating Global Water Data And Maps Via Web Services, David K. Arctur, David R. Maidment

International Conference on Hydroinformatics

Finding and accessing data in most countries of the world about local, regional and national water resources (streamflow discharge, gauge depth, soil moisture, etc.) has been complicated by a number of issues, from concerns of local and national security, to lack of suitable conventions and standards for data exchange that could be reasonably implemented and enforced at the national and international levels. These issues are now starting to be addressed, thanks to recently adopted standards for hydrologic data exchange, and growing acceptance of community standards for web services to perform such data exchange. This presentation reviews recent work in this …


Next Generation Hydro Software, Gennadii Donchyts, Fedor Baart, Arthur Van Dam, Erik De Goede, Joost Icke, Hans Van Putten Aug 2014

Next Generation Hydro Software, Gennadii Donchyts, Fedor Baart, Arthur Van Dam, Erik De Goede, Joost Icke, Hans Van Putten

International Conference on Hydroinformatics

A few years ago Deltares started a large multidisciplinary project named Next Generation Hydro Software. The main focus of the project is to improve, harmonize and integrate existing hydro software that has been developed throughout the years. Important technological innovations include development of the new computational core D-Flow Flexible Mesh, as well as the user-friendly, open modelling environment Delta Shell. The project involves more than 40 scientists and software engineers. The new integrated system will allow both water managers and modellers to do their work better and faster. The unique characteristic of the project is that it focuses on the …


Levels Of Data Interoperability In The Emerging North American Groundwater Data Network, Boyan Brodaric, Nate Booth, Eric Boisvert, Jessica Lucido Aug 2014

Levels Of Data Interoperability In The Emerging North American Groundwater Data Network, Boyan Brodaric, Nate Booth, Eric Boisvert, Jessica Lucido

International Conference on Hydroinformatics

The Canadian Groundwater Information Network (GIN) and the US National Ground-Water Monitoring Network (NGWMN) connect data from a variety of sources including states, provinces and federal agencies. Data heterogeneity is a major challenge faced by these networks, one that must be overcome at five distinct levels: systems, syntax, structure, semantics, and pragmatics. This paper discusses approaches taken at each of the five levels to ensure interoperability between the Canadian and American networks. The result is an emerging North American Groundwater Data Network, which enables users to access data transparently and uniformly on either side of the shared border.


Toward A Foundational Hydro Ontology For Water Data Interoperability, Boyan Brodaric, Torsten Hahmann Aug 2014

Toward A Foundational Hydro Ontology For Water Data Interoperability, Boyan Brodaric, Torsten Hahmann

International Conference on Hydroinformatics

Hydro ontologies are digital artifacts that contain representations of hydrological entities. They are being constructed to advance interoperability within and between various water data networks. Increased growth of such networks, however, is prompting integration of a greater variety of data, which requires a more general and principled approach to hydro ontology. One such approach is the development of a canonical reference ontology. This paper describes recent progress on the development of such an ontology for both the surface and subsurface hydro domains. Identified is a container schema that anchors the ontology, and also described is an initial representation of the …