Open Access. Powered by Scholars. Published by Universities.®

Data Storage Systems Commons

Open Access. Powered by Scholars. Published by Universities.®

1014 Full-Text Articles 2548 Authors 160229 Downloads 58 Institutions

All Articles in Data Storage Systems

Faceted Search

1014 full-text articles. Page 1 of 47.

Automating Data Management And Sharing Within A Large-Scale, Heterogeneous Sensor Network, Jeffery S. Horsburgh, Amber Spackman Jones, Stephanie Reeder 2016 Utah State University

Automating Data Management And Sharing Within A Large-Scale, Heterogeneous Sensor Network, Jeffery S. Horsburgh, Amber Spackman Jones, Stephanie Reeder

Amber Jones

Hydrology researchers are collecting data using in situ sensors at high frequencies, for extended durations, and with spatial distributions that require infrastructure for data storage, management, and sharing. Managing streaming sensor data is challenging, especially in large networks with large numbers of sites and sensors. The availability and utility of these data in addressing scientific questions related to water availability, water quality, and natural disasters relies on effective cyberinfrastructure that facilitates transformation of raw sensor data into usable data product. It also depends on the ability of researchers to share and access the data in usable formats. In this paper ...


Time Series Analyst: Interactive Online Visualization Of Standards Based Environmental Time Series Data, Jeffery S. Horsburgh, Amber Spackman Jones, Maurier Ramírez, Juan Caraballo 2016 Utah State University

Time Series Analyst: Interactive Online Visualization Of Standards Based Environmental Time Series Data, Jeffery S. Horsburgh, Amber Spackman Jones, Maurier Ramírez, Juan Caraballo

Amber Jones

Visualization is a common need of many researchers, organizations, and projects that collect and use environmental sensor data. Web-based tools can provide screening-level visualization and data analysis functionality for users with a range of technical expertise. However, it is difficult to integrate data from multiple sources due to syntactic and semantic differences in data formats and different data delivery mechanisms that are not always interoperable. We developed an open-source time series visualization tool called the Time Series Analyst (TSA) that integrates data from multiple sources using web service interfaces and a standardized data encoding format. The TSA provides multiple types ...


Tethys: A Software Framework For Web-Based Modeling And Decision Support Applications, Norm Jones, Jim Nelson, Nathan Swain, Scott Christensen, David Tarboton, Pabitra Dash 2016 Brigham Young University

Tethys: A Software Framework For Web-Based Modeling And Decision Support Applications, Norm Jones, Jim Nelson, Nathan Swain, Scott Christensen, David Tarboton, Pabitra Dash

David Tarboton

We have developed a software framework called Tethys to aid in the creation of web-based water resource modeling applications. This suite is a Python-based scripting environment that leverages open source tools for geoprocessing of spatial data, map rendering and visualization, distributed computing, and database management. The system makes it possible to deploy a calibrated, high-resolution watershed or surface water model as a web-based application for decision support. The framework provides data managements, access to computing resources, and pluggable components (e.g. plots, maps and user controls) that enable rapid development of modeling applications. We have used the system to develop ...


Automating Data Management And Sharing Within A Large-Scale, Heterogeneous Sensor Network, Jeffery S. Horsburgh, Amber Spackman Jones, Stephanie Reeder 2016 Utah State University

Automating Data Management And Sharing Within A Large-Scale, Heterogeneous Sensor Network, Jeffery S. Horsburgh, Amber Spackman Jones, Stephanie Reeder

Stephanie Reeder

Hydrology researchers are collecting data using in situ sensors at high frequencies, for extended durations, and with spatial distributions that require infrastructure for data storage, management, and sharing. Managing streaming sensor data is challenging, especially in large networks with large numbers of sites and sensors. The availability and utility of these data in addressing scientific questions related to water availability, water quality, and natural disasters relies on effective cyberinfrastructure that facilitates transformation of raw sensor data into usable data product. It also depends on the ability of researchers to share and access the data in usable formats. In this paper ...


Learning And Practicing Data Analytics Using Sap In-Memory Computing, Hong G. Jung, Vincent L. Mitchell, Jihoon Park, Sam Chung 2016 Southern Illinois University Carbondale

Learning And Practicing Data Analytics Using Sap In-Memory Computing, Hong G. Jung, Vincent L. Mitchell, Jihoon Park, Sam Chung

ASA Multidisciplinary Research Symposium

The analysis and organization of Big Data is becoming important in the business industry. Using and understanding ERP (Enterprise Resource Planning) software to interpret Big Data is essential to the evolution of Information System Technology. This research on SAP HANA and SAP Lumira allows us the opportunity to explore.


Can Flight Data Recorder Memory Be Stored On The Cloud?, Yair Wiseman 2016 Bar-Ilan University

Can Flight Data Recorder Memory Be Stored On The Cloud?, Yair Wiseman

Journal of Aviation Technology and Engineering

Flight data recorders (FDRs, or black boxes) generate data that is collected on an embedded memory device. A well-known difficulty with these devices is that the embedded memory device runs out of space. To avoid getting into this problematic situation, the software of the FDR is designed to operate in a watchful mode, constantly working to minimize the use of memory space; otherwise a larger FDR would be needed. However, larger FDRs can be a problem because they have very rigorous requirements; thus, enlargement is costly. Outcomes of this research include the recommendation to send FDR data to a remote ...


Achieving High Reliability And Efficiency In Maintaining Large-Scale Storage Systems Through Optimal Resource Provisioning And Data Placement, Lipeng Wan 2016 University of Tennessee, Knoxville

Achieving High Reliability And Efficiency In Maintaining Large-Scale Storage Systems Through Optimal Resource Provisioning And Data Placement, Lipeng Wan

Doctoral Dissertations

With the explosive increase in the amount of data being generated by various applications, large-scale distributed and parallel storage systems have become common data storage solutions and been widely deployed and utilized in both industry and academia. While these high performance storage systems significantly accelerate the data storage and retrieval, they also bring some critical issues in system maintenance and management. In this dissertation, I propose three methodologies to address three of these critical issues.

First, I develop an optimal resource management and spare provisioning model to minimize the impact brought by component failures and ensure a highly operational experience ...


Fire-Spotting Modelling And Parametrisation For Wild-Land Fires, Inderpreet Kaur, Gianni Pagnini 2016 BCAM–Basque Center for Applied Mathematics

Fire-Spotting Modelling And Parametrisation For Wild-Land Fires, Inderpreet Kaur, Gianni Pagnini

International Congress on Environmental Modelling and Software

This article describes a mathematical formulation for simulating the effects of firebrands on the propagation of the wild-land fires. Among the different approaches available in literature, this formulation is defined in a way to provide a versatile approach for application to operational wildfire models. Most of the operational wildfire models like WRF-SFIRE and ForeFire model only the evolution of the fire-line according to the definition of the rate of spread, fuel characterisation and the average fire properties and concurrent atmospheric conditions. But this information is not enough to simulate the effects of turbulence and fire-spotting. The formulation presented here can ...


Optimal Land Use?! – A Review On Optimization Techniques Used In Multi-Criteria Decision Analysis, Andrea Kaim, Anna Cord, Martin Volk 2016 Helmholtz Centre for Environmental Research – UFZ

Optimal Land Use?! – A Review On Optimization Techniques Used In Multi-Criteria Decision Analysis, Andrea Kaim, Anna Cord, Martin Volk

International Congress on Environmental Modelling and Software

Agriculture, forest management, conservation planning and other related disciplines have specific land use demands, and thus different perspectives on how land should be used in an “optimal way”. One way to solve arising land use conflicts is employing the ecosystem services concept together with methods from the field of multi-criteria decision analysis (MCDA). Especially optimization techniques provide the possibility to include socio-economic and ecological aspects as well as the protection of biodiversity. In this study, we give an overview of these methods, focusing especially on their application in agricultural areas. We explore their abilities for the identification of ecosystem service ...


A Generator Of Landuse Application For Complex And Heterogeneous Agricultural Practices, Odile Leccia-Phelpin, Jean-Marie Lescot, Françoise Vernier 2016 Irstea, ETBX

A Generator Of Landuse Application For Complex And Heterogeneous Agricultural Practices, Odile Leccia-Phelpin, Jean-Marie Lescot, Françoise Vernier

International Congress on Environmental Modelling and Software

Non-point source pollution from agriculture has become a major concern for water managers and institutional stakeholders. To reduce diffuse pollution, agricultural conservation measures are widely used with efficiency. On non-monitored territories environmental modelling enables the assessment of their long term impacts on water and soils and to evaluate land-use change scenarios. We developed an innovative Generator of Landuse (GenLU) application in order to build up multi-year spatial crop successions from identified crop rotations with their related management schedule s. GenLU can be used solely for generating landuse or coupled with the Soil and Water Assessment Tool (SWAT) model so as ...


Water Supply System Classification For Water Quality Improvement, Bruno Melo Brentan, Gustavo Meirelles Lima, Edevar Luvizotto Junior, Joaquín Izquierdo, Rafael Pérez-García 2016 LHC - FEC, University of Campinas

Water Supply System Classification For Water Quality Improvement, Bruno Melo Brentan, Gustavo Meirelles Lima, Edevar Luvizotto Junior, Joaquín Izquierdo, Rafael Pérez-García

International Congress on Environmental Modelling and Software

Universal access to drinkable water is a constitutional right guaranteed in Brazil. However, not all cities in this country are able to supply the population with the expected quality. Important actions should be taken to improve the supply of drinkable water. To define a strategic plan for this purpose, classification tools can facilitate the design of plans, by grouping cities with similar quality conditions. During the last decades, neural network approaches have been used in environmental models, allowing more accurate representation of some complex systems. This work proposes the use of self-organizing maps (SOM’s) coupled with the k-means ...


Data-Driven Wildfire Behaviour Modelling: Application Of Firefly To Field-Scale Grassland Controlled Burns, M. C. Rochoux, C. Zhang, D. Lucor, S. Ricci, A. Trouve 2016 CECI, CNRS-CERFACS

Data-Driven Wildfire Behaviour Modelling: Application Of Firefly To Field-Scale Grassland Controlled Burns, M. C. Rochoux, C. Zhang, D. Lucor, S. Ricci, A. Trouve

International Congress on Environmental Modelling and Software

Assessing epistemic uncertainties is now considered as a milestone for improving numerical predictions of a dynamically evolving system. The objective of this project is to demonstrate the benefits of data assimilation combined with sensor observations of the fire front position to both quantify and reduce the uncertainties in wildfire behaviour forecasting capability. The challenges found on the route to modelling wildfire behaviour are two-fold. There is the modelling challenge associated with providing accurate representations of the multi-scale multi-physics processes governing wildfire dynamics. There is also the data challenge associated with providing accurate estimates of the environmental conditions (biomass moisture, near-surface ...


Atlas: A Tool To Model Spatial-Temporal Dynamics Of Processes Influencing Ecosystem Services, Hugo Thierry, Aude Vialatte, Claude Monteil, Annie Ouin 2016 Dynafor, Université de Toulouse, INRA, INPT, INP-EI Purpan

Atlas: A Tool To Model Spatial-Temporal Dynamics Of Processes Influencing Ecosystem Services, Hugo Thierry, Aude Vialatte, Claude Monteil, Annie Ouin

International Congress on Environmental Modelling and Software

Biodiversity provides various benefits to humankind throughout what is defined as ecosystem services. Within a specific ecosystem, a wide range of ecosystem services can be identified. During the past decades, human intervention has aimed to increase some services such as food production through agricultural intensification, at the expense of other services such as water regulation. Mapping, evaluating and quantifying each of these ecosystem services provided by biodiversity to crop production could help to increase the multi-functionality of agricultural landscapes. In this context, we developed a spatially-explicit model called ATLAS (AgriculTural LandscApe Simulator). ATLA ...


The Economics Of Agricultural Water Productivity In The Blue Nile, Imeshi Weerasinghe, James Booker, Wim Bastiaanssen, Lisa-Marie Rebelo, Ann van Griensven 2016 Vrije Universiteit Brussel (VUB)

The Economics Of Agricultural Water Productivity In The Blue Nile, Imeshi Weerasinghe, James Booker, Wim Bastiaanssen, Lisa-Marie Rebelo, Ann Van Griensven

International Congress on Environmental Modelling and Software

Agricultural Water Productivity (AWP) is often simplified as the ‘crop per drop’, described as the output in terms of yield or biomass per unit of water input. This purely physical measure of Water Productivity (WP) using only a single factor input (water) does not consider: (1) the level of other inputs used in conjunction with water, (2) the opportunity cost of water as an input, (3) the value of the output and (4) the costs of production for different crops. This study presents a justification and methodology for incorporating these factors into WP indicators. The application of these extensions to ...


Resilience Of Punta S’Aliga Barrier Beach To Storm Impacts, Andrea Sulis 2016 University of Cagliari

Resilience Of Punta S’Aliga Barrier Beach To Storm Impacts, Andrea Sulis

International Congress on Environmental Modelling and Software

Beach and dune provide natural defense against erosion and flooding, and associated mitigation measures are classical coastal engineering problems studied by many researchers. Winter storms cause severe erosion leading to dune breaching and then flooding of the hinterland areas. Resiliency of a barrier beach depends on the ability of the dune (resistor) to recover in height and extent following storms. Whereas erosion of the beach and dune occurs over hours and days, it can be years to decades before the beach and dune are able to recover to their pre-storm state. In the last two decades, numerical modelling methods have ...


Understanding The Relationships Between Sanitation And Health In Nicaragua And Honduras, Through Data Mining Tools, Ginevra Marina Lazerini, Josep Nualart, Sergio Ruiz-Cayuela, Maialen Urbina, Miquel Sànchez Marrè, Karina Gibert 2016 University Research Institute for Sustainability Science And Technology, Universitat Politècnica de Catalunya – Barcelona Tech

Understanding The Relationships Between Sanitation And Health In Nicaragua And Honduras, Through Data Mining Tools, Ginevra Marina Lazerini, Josep Nualart, Sergio Ruiz-Cayuela, Maialen Urbina, Miquel Sànchez Marrè, Karina Gibert

International Congress on Environmental Modelling and Software

The aim of this work is to analyze water and sanitation supply data from Nicaragua and Honduras by using different data mining tools. The data has been provided by SIASAR (Rural Water and Sanitation Information System), which is a water and sanitation management and information platform created through the joint effort of different Central American Governments and the World Bank. In the study data from a survey performed in all the rural communities in Nicaragua and in a sample of the rural communities in Honduras from 2012 to 2015 is analyzed. Database contains 10206 communities described by 23 numerical variables ...


E3.Pt – An E3 Portabledyme Model For Portugal, Anett Großmann, Frank Hohmann 2016 Institute of Economic Structure Research (GWS)

E3.Pt – An E3 Portabledyme Model For Portugal, Anett Großmann, Frank Hohmann

International Congress on Environmental Modelling and Software

E3 models are environmentally extended economic models. They are extensively used for impact assessment of energy, climate and resource policies at national and international level. E3 models have proven to be suitable tools for quantifying effects on the economy, environment and energy system. Usually, the structure and documentation of such models are only accessible by the model builders. They are facing the allegation to be a "black box" meaning that only their creators are able to operate and fully understand the model system. Decision makers are often only engaged at the end of the model building process to discuss the ...


A Markov Decision Process Model To Compare Ecosystem Services Provided By Agricultural Landscapes, Sabrina Gaba, Nathalie Peyrard, Régis Sabbadin, Julia Radoszyckic 2016 INRA-UMR Agroécologie

A Markov Decision Process Model To Compare Ecosystem Services Provided By Agricultural Landscapes, Sabrina Gaba, Nathalie Peyrard, Régis Sabbadin, Julia Radoszyckic

International Congress on Environmental Modelling and Software

One current challenge in managing agricultural landscapes, is to reach a trade-off between provision of food and biodiversity conservation. Two extreme land-use strategies, land sharing and land sparing, are often discussed. The design of decision rules for allocating crops and lands for biodiversity conservation (e.g. grasslands) can be formalized as an optimization problem. However the target to optimize, representing the trade-off between ecosystem services (ES) can be complex to model since ES are usually not defined on comparable scales and may rely on different sides of biodiversity. Here, we will investigate how landscape composition and structure affect the magnitude ...


A Mathematical Model For Ghg From Sb-Mbr: Calibration By An Innovative Protocol, Giorgio Mannina, Alida Cosenza 2016 Universita di Palermo

A Mathematical Model For Ghg From Sb-Mbr: Calibration By An Innovative Protocol, Giorgio Mannina, Alida Cosenza

International Congress on Environmental Modelling and Software

A mathematical model to quantify greenhouse gases (GHG) (carbon dioxide, CO2 and nitrous oxide, N2O) for a membrane bioreactor (MBR) is presented. The model has been applied to a pilot plant with a pre-denitrification MBR scheme. The pilot plant was cyclically filled with real saline wastewater according to the fill-draw-batch operation. The model was calibrated by adopting a specific protocol based on extensive field dataset. Standardised Regression Coefficient (SRC) method was adopted to select the most influential model factors to be calibrated. Results related to SRC method show that among the important model factors a key role ...


Sectorization Of Intermittent Water Supply Networks Based On Graph Theory And Clustering Techniques, Amilkar E. Ilaya-Ayza, David Ayala-Cabrera, Joaquín Izquierdo, Enrique Campbell, Rafael Pérez-García 2016 FluIng-IMM Universitat Politècnica de València

Sectorization Of Intermittent Water Supply Networks Based On Graph Theory And Clustering Techniques, Amilkar E. Ilaya-Ayza, David Ayala-Cabrera, Joaquín Izquierdo, Enrique Campbell, Rafael Pérez-García

International Congress on Environmental Modelling and Software

Intermittent water supply is the form of access to water in many countries around the world. It is very common that design, operation, maintenance and, in general, decision-making in these systems are performed using tools originally developed for systems with continuous supply, which are not adequate. However, these tools can be reasonably applied to network sectorization of intermittent supply networks. We propose a sectorization methodology for networks that do not have the possibility of working with continuous supply. In addition, to ensure sufficient pressure, sector design must guarantee equity in the supply. Furthermore, it is not enough to establish sector ...


Digital Commons powered by bepress