Data Storage Systems Commons^™

Enhancing The Performance Of Disk-Based Key-Value Stores: From Learned Index Acceleration To I/O-Efficient Hybrid Caching, Sujit Maharjan

Computer Science and Engineering Dissertations - Archive

The exponential growth of data in modern computing environments has rendered the efficient extraction of information from massive datasets a critical systemic requirement. Key-value (KV) storage systems serve as the backbone for these operations; however, their performance is consistently bottlenecked by two primary functional requirements: identifying the data's location and managing the physical cost of accessing the storage device. Data locations are typically identified via an index, while disk I/O is minimized through caching. This dissertation presents LearnedStore, TurboIndex, and ReadBooster, which break these performance bottlenecks by introducing architectural modifications to the index and cache. LearnedStore accelerates operations by adapting …

Methods Of Optimizing Storage And Retrieval Of Structured Data, Neelim Haider

Computer Science and Engineering Theses - Archive

Storing and retrieving large amounts of data reliably is becoming more and more important as time goes on. There are high demands to store highly personal information such as social security numbers, bank account information, and residence information to rapidly changing data such as employee information, inventory information, and stock information. Therefore, the ability of a system to store, remove, and update such information efficiently and correctly is critical. There are different types of data that database systems can potentially hold: structured, unstructured, and semistructured data. Various database models have been developed to provide a framework that allows designers to …

Development And Simulation Of A Damage Assessment And Recovery Method For Critical Database Systems, Anthony Pham

Computer Science and Computer Engineering Undergraduate Honors Theses

With how much the world relies on technology and the critical database infrastructure that supports it, the infrastructures require efficient methods to detect and resolve suspicious database transactions, whether malicious or not. This paper focuses on an algorithm that detects and resolves malicious transactions in a database. The process begins with identifying suspicious transactions based on common patterns. When a transaction is flagged, the algorithm segments groups of suspicious transactions in separate log files, separating them for easy access. Within these segments, any dependent transactions that use data affected by the suspicious transactions will be stored there. After the transaction …

Orms And Database Design, Kalim Dumas

Honors Program: Senior Projects (Public)

This thesis explores the relationship between database design and Object-Relational Mapping (ORM) design, investigating how they have evolved together and influenced each other. It addresses a theoretical discussion, a practical implementation, and some observations regarding integrating an ORM into my Senior Design project. My Senior Design project was originally built without the intention of implementing an ORM.

There are a lot of complicated discrepancies between Relational Databases (RDBs) and Object-Oriented Programming Languages (OOPLs), called the Impedance Mismatch Problem. The fact that they are both foundational pillars in software engineering means that one cannot simply change to match the other. ORMs …

Managing Inventory With A Database, David Bartlett

Williams Honors College, Honors Research Projects

Large commercial companies often use warehouses to store and organize their product inventory. However, manually keeping track of inventory through physical means can be a tedious process and is at risk for a variety of potential issues. It is very easy for records to be inaccurate or duplicated, especially if large reorganizations are undertaken, as this can cause issues such as duplicate product ID numbers. Therefore, it was decided that an inventory management system utilizing a SQL database should be created. The system needed to have capabilities including allowing the entry of product information, the ability to search database records …

Magic: The Gathering Card Virtualizer, Vincent Garbonick, Jacen C. Conlan, Jaret A. Varn

Williams Honors College, Honors Research Projects

Any well-versed Magic: The Gathering (MTG) player or collector knows how difficult it can be to keep track of all cards in their collection. Some spend hours searching for that one specific card, and others are constantly scouring the internet for how much their collection costs. However, this issue does not only affect casual fans. Resale companies spend hours a day determining the costs of cards, and tournament judges painstakingly check players’ decks to ensure they are not cheating. To assist with these struggles, the design team proposed to create the MTG Card Virtualizer. This device scans MTG playing cards …

Synthesizing Realistic Substitute Data For A Law Enforcement Database Using A Python Library, Anthony Carrola

Graduate Theses, Dissertations, and Problem Reports (ETD)

In many databases, there is private or sensitive data that should not be accessible to any but a few individuals, such as HIPAA (Health Insurance Portability and Accountability Act) protected or LE (law enforcement) data. However, there is often a need to work with the data or change it for proper and thorough testing, especially for the developers . In some cases, the developers may be authorized to access and view the data, but it is rarely allowable for that data to be changed. Further, it is unlikely, especially on a large project, that all of the developers will have …

Multilateration Index., Chip Lynch

Electronic Theses and Dissertations

We present an alternative method for pre-processing and storing point data, particularly for Geospatial points, by storing multilateration distances to fixed points rather than coordinates such as Latitude and Longitude. We explore the use of this data to improve query performance for some distance related queries such as nearest neighbor and query-within-radius (i.e. “find all points in a set P within distance d of query point q”). Further, we discuss the problem of “Network Adequacy” common to medical and communications businesses, to analyze questions such as “are at least 90% of patients living within 50 miles of a covered emergency …

Effect Of Information Technology Capital: Technology Infrastructure, Database, Software, And Brainware Toward Optimize The Use Of Information Technology (Case Study : Uin Sunan Ampel Of Surabaya), Rismawati Br Sitepu, Ilham M.Said, Tanti Handriana, Praptini Yulianti

Library Philosophy and Practice (e-journal)

This research was conducted to determine the extent of the influence of technology infrastructure costs, software costs, database costs and brainware costs to increase the information technology budget of the Sunan Ampel State Islamic University in Surabaya and efficient use of the budget. The purpose of this study is to prove that there is a positive and significant influence of technology infrastructure costs, software costs, database costs and brainware costs to increase information technology budgets by using validity and reliability tests and classic tests such as the Normality test, Multicollinearity test, autocorrelation test, Heteroskedasticity test , and Linearity test. This …

Guitar Store Inventory, Alexander Didonato

Williams Honors College, Honors Research Projects

This project displays my senior programming project for a made up Guitar store inventory.

Dbknot: A Transparent And Seamless, Pluggable Tamper Evident Database, Islam Khalil

Theses and Dissertations

Database integrity is crucial to organizations that rely on databases of important data. They suffer from the vulnerability to internal fraud. Database tampering by internal malicious employees with high technical authorization to their infrastructure or even compromised by externals is one of the important attack vectors.

This thesis addresses such challenge in a class of problems where data is appended only and is immutable. Examples of operations where data does not change is a) financial institutions (banks, accounting systems, stock market, etc., b) registries and notary systems where important data is kept but is never subject to change, and c) …

A Database For Indexable Carbide Inserts, Andrew Yoder

Computer Engineering

The indexable inserts project is a collaborative effort to aggregate into a single database as many indexable carbide inserts from as many manufacturers as possible. Inserts are generally labeled with a part number following a specific standard determined by shapes and measurements, however specifications for certain aspects of carbide inserts—such as which materials they can cut—can vary by manufacturer. There currently is not a way to search a comprehensive database containing tools from multiple manufacturers for a handful of inserts that would satisfy some necessary parameters, making finding the correct tool in a shop a much more time-consuming process than …

An Embarrassment Of Riches: Data Integration In Vr Pompeii, Adam Schoelz

Computer Science and Computer Engineering Undergraduate Honors Theses

It is fair to say that Pompeii is the most studied archaeological site in the world. Beyond the extensive remains of the city itself, the timing of its rediscovery and excavation place it in a unique historiographical position. The city has been continuously studied since the 18th century, with historians and archaeologists constantly reevaluating older sources as our knowledge of the ancient world expands. While several studies have approached the city from a data driven perspective, no studies of the city have taken a quantitative holistic approach on the scale of the VR Pompeii project. Hyper-specificity has been the order …

Chronic Risk And Disease Management Model Using Structured Query Language And Predictive Analysis, Mamata Ojha

Electronic Theses and Dissertations

Individuals with chronic conditions are the ones who use health care most frequently and more than 50% of top ten causes of death are chronic diseases in United States and these members always have health high risk scores. In the field of population health management, identifying high risk members is very important in terms of patient health care, disease management and cost management. Disease management program is very effective way of monitoring and preventing chronic disease and health related complications and risk management allows physicians and healthcare companies to reduce patient’s health risk, help identifying members for care/disease management along …

Modelling Approach For A Pcb Inventory In Our Environment, Gerlinde Knetsch

International Congress on Environmental Modelling and Software

The data of more than 100 monitoring programs in Germany for the substance group of persistent organic pollutants (POPs), including the polychlorinated biphenyls (PCBs) are to be used for a modelling approach for a PCB inventory. The application landscape of the Federation/Laender POP-DioxinDatabase, which is operated in the German Environment Agency, pursues an interdisciplinary approach and includes all these data. A cross-media evaluation and assessment of environmental data are necessary and relevant to the target system, compiling an inventory of PCBs in our environment. The question arises how the integrated modelling concept can control the knowledge-based methods, with the aim …

Wearable Ekg, Cale Hopkins, Tanner Papenfuss, Travis E. Michael

Computer Engineering

No abstract provided.

An Integrative Modeling Framework To Evaluate Wheat Production Systems: Fusarium Head Blight, Willingthon Pavan, José Maurício Cunha Fernandes, Alexandre Lazzaretti, Josué Toebe, Jorge Luis Bavaresco, Alex C. Ruane, Rodrigo Yoiti Tsukahara

International Congress on Environmental Modelling and Software

This paper describes a practical, integrated, web-based and user friendly analysis tool for crop model users that provides quality control of input data, tracks user selections in model parameterization, and enables visual analysis of model outcomes using a single graphical user interface. This allows the user to undertake numerous steps in crop modeling and analysis in a seamless and integrated environment. The analysis and visualization components of the system were enabled utilizing R (pl/r) and the robustness of the underlying data structures and coupling point between crop and disease models were achieved through use of PostgreSQL database management system. The …

Cplop - Cal Poly's Library Of Pyroprints, Kevin Webb

Computer Engineering

California Polytechnic Library of Pyroprints, CPLOP, is a web driven data-base application that stores data from the biology’s departments E. coli Pyrosequencing project. Some of this data was stored in Excel datasheets, while data from the pyrosequencing machines was stored as just a list of random .xml files. There was no useful way to organize and store the massive amounts of data from multiple file sources in one location, nor to perform the complicated searches and comparisons that the project requires. CPLOP’s primary goal is to store such data in three organized tables that relate to one another. It was …

Jdiet: Footprint Reduction For Memory-Constrained Systems, Michael John Huffman

Master's Theses

Main memory remains a scarce computing resource. Even though main memory is becoming more abundant, software applications are inexorably engineered to consume as much memory as is available. For example, expert systems, scientific computing, data mining, and embedded systems commonly suffer from the lack of main memory availability.

This thesis introduces JDiet, an innovative memory management system for Java applications. The goal of JDiet is to provide the developer with a highly configurable framework to reduce the memory footprint of a memory-constrained system, enabling it to operate on much larger working sets. Inspired by buffer management techniques common in modern …

Splash: Systematic Proteomics Laboratory Analysis And Storage Hub, Siaw Ling Lo, You Tao, Qingsong Lin, Shashikant B. Joshi, Maxey Chung, Choy Leong Hew

Research Collection School Of Computing and Information Systems

In the field of proteomics, the increasing difficulty to unify the data format, due to the different platforms/instrumentation and laboratory documentation systems, greatly hinders experimental data verification, exchange, and comparison. Therefore, it is essential to establish standard formats for every necessary aspect of proteomics data. One of the recently published data models is the proteomics experiment data repository [Taylor, C. F., Paton, N. W., Garwood, K. L., Kirby, P. D. et al., Nat. Biotechnol. 2003, 21, 247-254]. Compliant with this format, we developed the systematic proteomics laboratory analysis and storage hub (SPLASH) database system as an informatics infrastructure to support …