Digital Commons Network^™

Comparative Analysis Of Teacher Effects Parameters In Models Used For Assessing School Effectiveness: Value-Added Models & Persistence, Merlin J. Kamgue

Graduate Theses and Dissertations

Longitudinal measures for students have become increasingly popular to estimate the effects of individual teachers and schools. Value-added models are one of the approaches using longitudinal data to evaluate teachers and schools. In the value-added model (VAM) literature, many statistical approaches have been developed and used to estimate teacher or school effects on student learning. This study opted to use a Bayesian multivariate model for evaluating teacher effects. The generalized persistence models can handle longitudinal data, not vertically scaled, allowing for a below-par teacher’s effects correlation across test administrations. This study first generated longitudinal students’ test score data and used …

Towards Robust Long-Form Text Generation Systems, Kalpesh Krishna

Doctoral Dissertations

Text generation is an important emerging AI technology that has seen significant research advances in recent years. Due to its closeness to how humans communicate, mastering text generation technology can unlock several important applications such as intelligent chat-bots, creative writing assistance, or newer applications like task-agnostic few-shot learning. Most recently, the rapid scaling of large language models (LLMs) has resulted in systems like ChatGPT, capable of generating fluent, coherent and human-like text. However, despite their remarkable capabilities, LLMs still suffer from several limitations, particularly when generating long-form text. In particular, (1) long-form generated text is filled with factual inconsistencies to …

Computerized Psychological Testing: Designing And Developing An Efficient Test Suite Using Hci And Reinforcement Learning Techniques, William Henry Hoskins

Theses and Dissertations

In this work we discuss the design and development of the Carolina Automated Reading Evaluation (CARE), created to facilitate the finding of deficits in the reading ability of children from four to nine years of age. Designed to automate the process of screening for reading deficits, the CARE is an interactive computer-based tool that helps eliminate the need for one-on-one evaluations of pupils to detect dyslexia and other reading deficits and facilitates the creation of new reading tests within the platform. While other tests collect specific data points in order to determine whether a pupil has dyslexia, they typically focus …

Beyond Algorithms: A User-Centered Evaluation Of A Feature Recommender System In Requirements Engineering, Oluwatobi Lasisi

Theses and Dissertations

Several studies have applied recommender technologies to support requirements engineering activities. As in other application areas of recommender systems (RS), many studies have focused on the algorithms’ prediction accuracy, while there have been limited discussions around users’ interactions with the systems. Since recommender systems are designed to aid users in information retrieval, they should be assessed not just as recommendation algorithms but also from the users’ perspective. In contrast to accuracy measures, user-related issues can only be effectively investigated via empirical studies involving real users. Furthermore, researchers are becoming increasingly aware that the effectiveness of the systems goes beyond recommendation …

Probabilistic Commonsense Knowledge, Xiang Li

Doctoral Dissertations

Commonsense knowledge is critical to achieving artificial general intelligence. This shared common background knowledge is implicit in all human communication, facilitating efficient information exchange and understanding. But commonsense research is hampered by its immense quantity of knowledge because an explicit categorization is impossible. Furthermore, a plumber could repair a sink in a kitchen or a bathroom, indicating that common sense reveals a probable assumption rather than a definitive answer. To align with these properties of commonsense fundamentally, we want to not only model but also evaluate such knowledge human-like using abstractions and probabilistic principles. Traditional combinatorial probabilistic models, e.g., probabilistic …

Still No Crystal Ball: Toward An Application For Broad Evaluation Of Student Understanding, Piper Armstrong

Theses and Dissertations

Evaluation of student understanding of learning material is critical to effective teaching. Current computer-aided evaluation tools exist, such as Computer Adaptive Testing (CAT); however, they require expert knowledge to implement and update. We propose a novel task, to create an evaluation tool that can predict student performance (knowledge) based on general performance on test questions without expert curation of the questions or expert understanding of the evaluation tool. We implement two methods for creating such a tool, find both methods lacking, and urge further investigation.

Expanding The Network Evaluation Toolkit: Combining Social Network Analysis & Qualitative Comparative Analysis, Debbie Gowensmith

Electronic Theses and Dissertations

Collective action networks are complex systems of interrelated individuals or groups that come together for a common social change purpose (Ernstson, 2011). Researchers have used social network analysis (SNA) to examine the relationship structures and characteristics of collective action networks. However, determining whether collective action networking produces outcomes has been challenging because networks are complex, affected by context, and produce interdependent data. I addressed these challenges by pairing SNA with qualitative comparative analysis (QCA), a configurational comparative method. Using QCA, researchers can tease out which conditions are necessary or sufficient to produce an outcome. I analyzed a collective action network …

Using Generalizability And Rasch Measurement Theory To Ensure Rigorous Measurement In An International Development Education Evaluation, Louise Bahry

Doctoral Dissertations

Between the United States and Great Britain, over 30 billion USD was spent in 2018 on international aid, over a billion of which is dedicated to education programs alone. Recently, there has been increased attention on the rigorous evaluation of aid-funded programs, moving beyond counting outputs to the measurement of educational impact. The current study uses two methodological approaches (Generalizability (Brennan, 1992, 2001) and Rasch Measurement Theory (Andrich, 1978; Rasch, 1980; Wright & Masters, 1982) to analyze data from math and literacy assessments, and self-report surveys used in an international evaluation of an educational initiative in the Democratic Republic of …

Improving Evaluation Methods For Causal Modeling, Amanda Gentzel

Doctoral Dissertations

Causal modeling is central to many areas of artificial intelligence, including complex reasoning, planning, knowledge-base construction, robotics, explanation, and fairness. Active communities of researchers in machine learning, statistics, social science, and other fields develop and enhance algorithms that learn causal models from data, and this work has produced a series of impressive technical advances. However, evaluation techniques for causal modeling algorithms have remained somewhat primitive, limiting what we can learn from the experimental studies of algorithm performance, constraining the types of algorithms and model representations that researchers consider, and creating a gap between theory and practice. We argue for expanding …

Youth Leadership Development Program Evaluation, Loreley Lyn Smith

Walden Dissertations and Doctoral Studies

In competitive youth sports organizations, few organizational leaders focus on leadership development to prepare youth for life situations. Sports organizational leaders are concerned about youth leadership development, as development allows youth to build skills necessary to understand their strengths and weaknesses and recognize ways to overcome fears. Grounded in social learning theory, the purpose of this summative program evaluation was to determine the extent to which a competitive youth sports leadership development program aligned with the organization’s primary objective to provide skilled athletic training while providing lessons to prepare youth for adulthood. The participants comprised 40 key stakeholders, including participants …

Perceptions Of The Effectiveness Of Food Policy Coalitions In Strengthening Community Food Security In The United States., Joseph G. England Iii

USF Tampa Graduate Theses and Dissertations

Food insecurity is experienced most acutely and addressed most innovatively at the community level to which the concept of community food security (CFS) finds purchase (Hamm and Bellows, 2003). In recognition of the many varying dynamics embedded in the CFS concept, Food Policy Coalitions have become an organizational model adapted by communities across the United States. While FPCs have grown in number considerably over the last decade, there remains a considerable lack of empirical research documenting evaluation and engagement methods, as well as strategies used to address community food security. This research, framed by the Community Coalition Action Theory, draws …

A Framework For Personalized Content Recommendations To Support Informal Learning In Massively Diverse Information Wikis, Heba M Ismail

Dissertations

Personalization has proved to achieve better learning outcomes by adapting to specific learners’ needs, interests, and/or preferences. Traditionally, most personalized learning software systems focused on formal learning. However, learning personalization is not only desirable for formal learning, it is also required for informal learning, which is self-directed, does not follow a specified curriculum, and does not lead to formal qualifications. Wikis among other informal learning platforms are found to attract an increasing attention for informal learning, especially Wikipedia. The nature of wikis enables learners to freely navigate the learning environment and independently construct knowledge without being forced to follow a …

Deepcon-Pre: Improved Protein Contact Map Prediction Using Inverse Covariance And Deep Residual Networks, Nachammai Palaniappan

Theses

As with most domains where machine learning methods are applied, correct feature engineering is critical when developing deep learning algorithms for solving the protein folding problem. Unlike the domains such as computer vision and natural language processing, feature engineering is not rigorously studied towards solving the protein folding problem. A recent research has highlighted that input features known as precision matrix are most informative for predicting inter-residue contact map, the key for building three-dimensional models. In this work, we study the significance of the precision matrix feature when very deep residual networks are trained. Using a standard dataset of 3456 …

Evaluating Software Testing Techniques: A Systematic Mapping Study, Mitchell Mayeda

Electronic Theses and Dissertations

Software testing techniques are crucial for detecting faults in software and reducing the risk of using it. As such, it is important that we have a good understanding of how to evaluate these techniques for their efficiency, scalability, applicability, and effectiveness at finding faults. This thesis enhances our understanding of testing technique evaluations by providing an overview of the state of the art in research. To accomplish this we utilize a systematic mapping study; structuring the field and identifying research gaps and publication trends. We then present a small case study demonstrating how our mapping study can be used to …

A Needs Assessment Of The Perceptions And Opportunities To Enhance Nature Exploration At Publicly Funded Preschools, Naomi Liebhold

WWU Graduate School Collection

Extensive research supports the benefits of nature exploration in children’s lives. Research also suggests, however, that low-income families and other historically marginalized groups experience multiple barriers to accessing green spaces. In an attempt to counteract this inequality, a needs assessment was performed to understand the challenges and barriers public preschool providers face in regularly leading their children in nature exploration. The target audience of this evaluation was Head Start and Early Childhood Education and Assistance Program [ECEAP] teachers and parents. Along with measuring the challenges and barriers at these centers in regard to nature exploration, this evaluation assessed the resources …

A Microscopic Simulation Laboratory For Evaluation Of Off-Street Parking Systems, Yun Yuan

Theses and Dissertations

The parking industry produces an enormous amount of data every day that, properly analyzed, will change the way the industry operates. The collected data form patterns that, in most cases, would allow parking operators and property owners to better understand how to maximize revenue and decrease operating expenses and support the decisions such as how to set specific parking policies (e.g. electrical charging only parking space) to achieve the sustainable and eco-friendly parking.

However, there lacks an intelligent tool to assess the layout design and operational performance of parking lots to reduce the externalities and increase the revenue. To address …

Evaluation Of 'Structure-From-Motion' From A Pole-Mounted Camera For Monitoring Geomorphic Change, Rebecca K. Rossi

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

Emerging "Structure-from-Motion" (SfM) photogrammetry techniques encourage faster, cheaper, and more accessible field methods for accurately reconstructing 3D topography. The SfM method consists of collecting sets of overlapping images of the ground surface with a point and shoot camera, and reconstructing surface topography from the images with developed software programs. This research develops and implements a SfM image acquisition method and post-processing workflow as a supplemental technique to the traditional total-station method to aid in monitoring sandbar change in Marble and Grand Canyons along the Colorado River in Arizona. Due to permitting in Grand Canyon National Park, a 4.9 m pole-mounted …

Cityscape Connections: National Park Service Relevance And Resilience In Urban Areas, Elizabeth Eleanor Perry

Graduate College Dissertations and Theses

The National Park Service (NPS) strives to embody U.S. democratic ideals, conserving our collective stories and scenery for their intrinsic value and the enjoyment of current and future generations. However, although these places are conserved for all, they are not enjoyed by all. As with other conservation agencies, the NPS finds itself increasingly concerned with building relevance with diverse potential stewards. In cities, where 80% of the U.S. population and 40% of the NPS portfolio is based, there is a prime opportunity to build relevance with large, diverse, and proximate audiences. Recognizing this opportunity, the NPS initiated its Urban Agenda …

Policy Analysis: Alaska Salmon Hatcheries, Jessica Eller

Graduate Student Theses, Dissertations, & Professional Papers

Using an adapted Ecological Risk Assessment (ERA) - Evaluation, this study analyzes policy regulating Alaska salmon hatcheries to evaluate its effectiveness at sustaining wild salmon runs.When Alaska became a state in 1959, its salmon industry was suffering from years of overfishing. Runs were at an all-time low, prompting constitutional drafters to mandate management of salmon via the sustained yield principle. The hatchery system that operates today and is responsible for a third of the commercial catch each year was put in place in the 1970s to help supplement depressed salmon runs. The effects of hatchery salmon on wild salmon populations …

An Integrated Evaluation Of The Conservation Reserve Enhancement Program In South Dakota, Jarrett D. Pfrimmer

Electronic Theses and Dissertations

Grassland restoration efforts in North America typically share the goal of improving ecological conditions for wildlife; however, it is unclear in many cases if goals are met. The South Dakota Conservation Reserve Enhancement Program (CREP) was initiated to alleviate agriculturally-related environmental degradation by converting 40,469 hectares of eligible cropland and marginal pastureland to perennial vegetation. The program aims to provide habitat for obligate grassland breeding songbirds, while producing an additional 285,000 pheasants and 60,000 ducks annually. As part of a collaborative comprehensive evaluation effort, my research assessed the response of grassland-dependent breeding birds to CREP implementation at varying spatial scales …

Effects Of An Integrated Electronic Health Record On An Academic Medical Center, Kenneth E. Koppenhaver Ii

Walden Dissertations and Doctoral Studies

The debate about healthcare reform revolves around a triple aim of improving the health of populations, improving the patient experience, and reducing the cost of care. A major tool discussed in this debate has been the adoption of electronic health record (EHR) systems to record and guide care delivery. Due to low adoption rates and limited examples of success, the problem was a lack of understanding by healthcare organizations of how the EHR fundamentally changes an organization through the interactions of people, processes, and technology over time. The purpose of this case study was to explore the people, processes, and …

An Evaluation Framework For Scientific Programming Productivity, W.K. Umayanganie Munipala Munipala

Open Access Theses & Dissertations

Substantial time is spent on building, optimizing and maintaining large-scale software that is run on supercomputers. However, little has been done to utilize overall resources efficiently when it comes to including expensive human resources. The community is beginning to acknowledge that optimizing the hardware performance such as speed and memory bottlenecks contributes less to the overall productivity than does the development lifecycle of high-performance scientific applications. Researchers are beginning to look at overall scientific workflows for high performance computing. Scientific programming productivity is measured by time and effort required to develop, configure, and maintain a simulation experiment and its constituent …

Exploiting Social Media Sources For Search, Fusion And Evaluation, Chia-Jung Lee

Doctoral Dissertations

The web contains heterogeneous information that is generated with different characteristics and is presented via different media. Social media, as one of the largest content carriers, has generated information from millions of users worldwide, creating material rapidly in all types of forms such as comments, images, tags, videos and ratings, etc. In social applications, the formation of online communities contributes to conversations of substantially broader aspects, as well as unfiltered opinions about subjects that are rarely covered in public media. Information accrued on social platforms, therefore, presents a unique opportunity to augment web sources such as Wikipedia or news pages, …

Computational Approaches For Monitoring Of Health Parameters And Their Evaluation For Application In Clinical Setting., Mohammad Adibuzzaman

Dissertations (1934 -)

The algorithms and mathematical methods developed in this work focus on using computational approaches for low cost solution of health care problems for better patient outcome. Furthermore, evaluation of those approaches for clinical application considering the risk and benefit in a clinical setting is studied. Those risks and benefits are discussed in terms of sensitivity, specificity and area under the receiver operating characteristics curve. With a rising cost of health care and increasing number of aging population, there is a need for innovative and low cost solutions for health care problems. In this work, algorithms, mathematical techniques for the solutions …

Economic Efficiency Of Fuel Reduction Treatments In The Home Ignition Zone To Mitigate Wildfire Risk In Montana, Usa, Howard L. Williams

Graduate Student Theses, Dissertations, & Professional Papers

Wildland-urban interface growth and factors increasing the probability of wildfire suggest that annual spending on wildfire risk mitigation and suppression will continue to increase. With limited information about the benefits and costs of risk mitigation, land managers and homeowners may under- or over-invest in risk mitigation, where costs are disproportionate to the expected benefits of the strategy. This study accounted for expected increases in wildfire risk (due to growth of the WUI, climate change and vegetation growth) over time in Flathead County, Montana, and estimated the expected avoided loss in structure values associated with three treatment levels that would require …

Adaptive Step-Sizes For Reinforcement Learning, William C. Dabney

Doctoral Dissertations

The central theme motivating this dissertation is the desire to develop reinforcement learning algorithms that “just work” regardless of the domain in which they are applied. The largest impediment to this goal is the sensitivity of reinforcement learning algorithms to the step-size parameter used to rescale incremental updates. Adaptive step-size algorithms attempt to reduce this sensitivity or eliminate the step-size parameter entirely by automatically adjusting the step size throughout the learning process. Such algorithms provide an alternative to the standard “guess-and-check” methods used to find parameters known as parameter tuning. However, the problems with parameter tuning are currently masked by …

An Investigation Of The Dayton Regional Stem School Public-Private Partnerships, Kimberly S. Poole

CCE Theses and Dissertations

This dissertation study documents in-depth the exploration of the Public Private Partnerships (PPPs) between the Dayton Regional STEM School (DRSS) and their industry partners as well as the establishment of a framework for evaluating and assessing PPPs. The public-private partnership agreements were studied in order to answer the over-arching research question: How is an effective public-private partnership established, assessed, and evaluated in education? A descriptive case study methodology was used to study DRSS' public-private partnership agreements to determine if goals and objectives were established and whether or not the partnerships met those goals and objectives. This case study also included …

A Decision Support System To Analyze, Predict, And Evaluate Solar Energy System Performance: Pvsysco (Photovoltaic System Comparison), Lisa Bosman

Theses and Dissertations

In 2010, the U.S. Department of Energy announced the SunShot Initiative, which aims to reduce the total installation cost of solar technologies by 75% between 2010 and 2020. This implies that solar energy is a top priority in the U.S. and many other countries. The purpose of this dissertation research is focused on creating a model to better understand the performance and reliability of photovoltaic (PV) energy systems over time. The model will be used to analyze, predict, and evaluate the performance of PV systems, taking into consideration technological and geographical location attributes. The overall research goal is to build …

Indexing Proximity-Based Dependencies For Information Retrieval, Samuel Huston

Doctoral Dissertations

Research into term dependencies for information retrieval has demonstrated that dependency retrieval models are able to consistently improve retrieval effectiveness over bag-of-words models. However, the computation of term dependency statistics is a major efficiency bottleneck in the execution of these retrieval models. This thesis investigates the problem of improving the efficiency of dependency retrieval models without compromising the effectiveness benefits of the term dependency features. Despite the large number of published comparisons between dependency models and bag-of-words approaches, there has been a lack of direct comparisons between alternate dependency models. We provide this comparison and investigate different types of proximity …

A Metaevaluation Of Energy Efficiency Evaluations, Brandy Brown

Dissertations

This study systematically reviews the methodological characteristics of energy efficiency evaluations and uses metaevaluation to assess its quality. Metaevaluation is used to systematically assess the quality of evaluation products, confirm that evaluations deliver sound findings and conclusions, are useful to the client, are credible, are ethically conducted, and are done as cost-effective as possible. The results of this study show that the ability to accurately assess evaluation for methodological quality using evaluations reports as a primary data source depends on the presence of detailed descriptions of evaluation methods. Furthermore, the study suggests that methodological variations of energy efficiency evaluations coalesce …