Digital Commons Network^™

A New Reinforcement Learning Algorithm With Fixed Exploration For Semi-Markov Decision Processes, Angelo Michael Encapera

Masters Theses

"Artificial intelligence or machine learning techniques are currently being widely applied for solving problems within the field of data analytics. This work presents and demonstrates the use of a new machine learning algorithm for solving semi-Markov decision processes (SMDPs). SMDPs are encountered in the domain of Reinforcement Learning to solve control problems in discrete-event systems. The new algorithm developed here is called iSMART, an acronym for imaging Semi-Markov Average Reward Technique. The algorithm uses a constant exploration rate, unlike its precursor R-SMART, which required exploration decay. The major difference between R-SMART and iSMART is that the latter uses, in addition …

A Bounded Actor-Critic Algorithm For Reinforcement Learning, Ryan Jacob Lawhead

Masters Theses

"This thesis presents a new actor-critic algorithm from the domain of reinforcement learning to solve Markov and semi-Markov decision processes (or problems) in the field of airline revenue management (ARM). The ARM problem is one of control optimization in which a decision-maker must accept or reject a customer based on a requested fare. This thesis focuses on the so-called single-leg version of the ARM problem, which can be cast as a semi-Markov decision process (SMDP). Large-scale Markov decision processes (MDPs) and SMDPs suffer from the curses of dimensionality and modeling, making it difficult to create the transition probability matrices (TPMs) …

Quantifying Current Sediment Deposition, Legacy Sediments, And Pre-Impoundment Vertical Accretion And Carbon Dynamics Following Dam Removal In A Recently Restored Tidal Freshwater Wetland, Melissa J. Davis

Theses and Dissertations

Damming disrupts natural sediment flow to downstream resulting in legacy sediment accumulation. Legacy sediments have been well investigated in streams throughout the Piedmont region; however, there is no research of legacy sediments following dam removal in low-gradient Coastal Plain streams. Research objectives were to: characterize legacy sediments in a low-gradient stream restoration, quantify pre-impoundment accretion and carbon dynamics, and assess current sediment deposition rates via ¹⁴C analyses within sediment cores and sediment collection tiles. Carbon accumulation and accretion rates of modern tidal sediment have reached that of the tidal relic benchmark and current sediment deposition rates are similar between …

Effects Of Silencing Cyc2-Like Genes On Floral Development In Solanum Lycopersicum L. And Nicotiana Obtusifolia M. Martens & Galeotti (Solanaceae), Joonseog Kim

Theses and Dissertations

CYCLOIDEA (CYC) and DICHOTOMA (DICH) of the CYC2 clade of the TCP gene family have been shown to play a significant role in regulating the identity of the dorsal petals and abortion of the single dorsal stamen in Antirrhinum majus. It is believed that CYC2-like genes are responsible for the convergent evolution of floral zygomorphy, but their role in the development of actinomorphic flowers is still unknown. In Solanaceae, previous analysis has identified two paralogs of CYC2-like genes, CYC2A and CYC2B, resulting from a gene duplication that predates the origin the family. …

Recognizing Her Characteristics As A Leader: An Examination Of The Self-Assessment Of Women Leaders As Shaped By Social Identity Theory And The Concept Of Double Consciousness, John C. Gregory

Theses and Dissertations

Women leaders are grossly underrepresented in police and Army organizations and relevant research suggests that women face the most significant challenges in reaching leadership positions in male dominant organizations. Although there have been recent policy changes to increase opportunities for women in police and Army organizations, women are still barely represented in senior command and primary staff positions in police and Army organizations. When women are underrepresented, particularly at the most senior ranks, there are implications regarding cultural, structural, and attitudinal challenges that simply should not still exist in these organizations. Using qualitative methods, this study examined the experiences of …

Decomposition Algorithms In Stochastic Integer Programming: Applications And Computations., Babak Saleck Pay

Theses and Dissertations

In this dissertation we focus on two main topics. Under the first topic, we develop a new framework for stochastic network interdiction problem to address ambiguity in the defender risk preferences. The second topic is dedicated to computational studies of two-stage stochastic integer programs. More specifically, we consider two cases. First, we develop some solution methods for two-stage stochastic integer programs with continuous recourse; second, we study some computational strategies for two-stage stochastic integer programs with integer recourse. We study a class of stochastic network interdiction problems where the defender has incomplete (ambiguous) preferences. Specifically, we focus on the shortest …

Comparative Studies Of Diffusion Models And Artificial Neural Intelligence On Electrochemical Process Of U And Zr Dissolutions In Licl-Kcl Eutectic Salts, Samaneh Rakhshan Pouri

Theses and Dissertations

The electrorefiner (ER) is the heart of pyroprocessing technology operating at a high-temperature (723 K – 773 K) to separate uranium from Experimental Breeder Reactor-II (EBR-II) used metallic fuel. One of the most common electroanalytical methods for determining the thermodynamic and electrochemical behavior of elemental species in the eutectic molten salt LiCl-KCl inside ER is cyclic voltammetry (CV). Information from CV can possibly be used to estimate diffusion coefficients, apparent standard potentials, transfer coefficients, and numbers of electron transferred. Therefore, predicting the trace of each species from the CV method in an absence of experimental data is important for safeguarding …

A Hierarchical Architectural Framework For Securing Unmanned Aerial Systems, Matthew Leccadito

Theses and Dissertations

Unmanned Aerial Systems (UAS) are becoming more widely used in the new era of evolving technology; increasing performance while decreasing size, weight, and cost. A UAS equipped with a Flight Control System (FCS) that can be used to fly semi- or fully-autonomous is a prime example of a Cyber Physical and Safety Critical system. Current Cyber-Physical defenses against malicious attacks are structured around security standards for best practices involving the development of protocols and the digital software implementation. Thus far, few attempts have been made to embed security into the architecture of the system considering security as a holistic problem. …

Tuning Optimization Software Parameters For Mixed Integer Programming Problems, Toni P. Sorrell

Theses and Dissertations

The tuning of optimization software is of key interest to researchers solving mixed integer programming (MIP) problems. The efficiency of the optimization software can be greatly impacted by the solver’s parameter settings and the structure of the MIP. A designed experiment approach is used to fit a statistical model that would suggest settings of the parameters that provided the largest reduction in the primal integral metric. Tuning exemplars of six and 59 factors (parameters) of optimization software, experimentation takes place on three classes of MIPs: survivable fixed telecommunication network design, a formulation of the support vector machine with the ramp …

Eye Movement Control: An Index For Athleticism, Brittany L. Oshea

Theses and Dissertations

Athletic potential is one of the most complex human traits. An elite athlete is produced from a complex interaction of an innumerable number of traits exhibited by the athlete. However, it’s not clear whether these traits are innate, allowing the athlete to excel, or, alternatively, are a consequence of practice. To be successful, athletes rely heavily on sensory information from the visual and vestibular systems. This study investigated the relationship eye movement control has with innate athleticism by comparing the saccadic and Vestibulo-Ocular Reflex (VOR) responses of former, no longer practicing, elite athletes against their age and gender matched counterparts …

Adversarial Decision Making In Counterterrorism Applications, Dogucan Mazicioglu

Theses and Dissertations

Our main objective is to improve decision making in counterterrorism applications by implementing expected utility for prescriptive decision making and prospect theory for descriptive modeling. The areas that we aim to improve are behavioral modeling of adversaries with multi objectives in counterterrorism applications and incorporating risk attitudes of decision makers to risk matrices in assessing risk within an adversarial counterterrorism framework. Traditionally, counterterrorism applications have been approached on a single attribute basis. We utilize a multi-attribute prospect theory approach to more realistically model the attacker’s behavior, while using expected utility theory to prescribe the appropriate actions to the defender. We …

Modified Pamam Dendrimers In Tunable Drug-Delivery Systems: A Sustained-Release Dendrimer Hydrogel For Anti-Glaucoma Drugs And Surface-Engineered Macrophages As Nanoparticle Carriers For Targeted Anti-Cancer Therapy, Christopher A. Holden

Theses and Dissertations

Two specific drug-delivery applications were sought in this work using polyamidoamine (PAMAM) dendrimers. One drug-delivery system used a novel dendrimer hydrogel (DH) for sustained delivery of anti-glaucoma drugs. In this work, PAMAM G3.0 dendrimers were covalently bonded with poly(ethylene glycol) (PEG­₁₂₀₀₀) molecules which were subsequently acrylated, resulting in photocurable DH conjugates. For pharmacological studies, DH were loaded with a solution of intraocular pressure lowering drugs, brimonidine and timolol maleate, and were characterized for in vitro release and ex vivo transport and uptake. DH formulations were shown to increase the loading of drug molecules, increase transcorneal drug delivery, and …

The Identity Formation Of South Asians: A Phenomenological Study, Shabana Shaheen

Theses and Dissertations

This research explores the lived experiences of South Asians college students. This research, through a qualitative study that is rooted in the philosophy of phenomenology, explores the essence South Asians’ identity formation. Qualitative data was collected through semi-structured interviews with South Asian college students. The data analysis was under a phenomenological lens that centered the lived experiences and the essence of these experiences in the results. Seven themes emerged from this phenomenological study: negotiating bicultural identity, model minority expectations, meaningful impact of religious spaces, understandings of intra-community tensions, racialization of Islamophobia, understandings of South Asian identity and efficacy of Asian …

Respiratory Prediction And Image Quality Improvement Of 4d Cone Beam Ct And Mri For Lung Tumor Treatments, Seonyeong Park

Theses and Dissertations

Identification of accurate tumor location and shape is highly important in lung cancer radiotherapy, to improve the treatment quality by reducing dose delivery errors. Because a lung tumor moves with the patient's respiration, breathing motion should be correctly analyzed and predicted during the treatment for prevention of tumor miss or undesirable treatment toxicity. Besides, in Image-Guided Radiation Therapy (IGRT), the tumor motion causes difficulties not only in delivering accurate dose, but also in assuring superior quality of imaging techniques such as four-dimensional (4D) Cone Beam Computed Tomography (CBCT) and 4D Magnetic Resonance Imaging (MRI). Specifically, 4D CBCT used in CBCT …

Communication, Empathy, And Trust: Exploring Teachers' Partnerships With The Families Of Their Most Challenging Students, Kimberly W. Mcknight

Theses and Dissertations

The purpose of this embedded mixed methods collective case study was to explore eight kindergarten, first, and second grade teachers’ experiences partnering with families of their students who are at risk for emotional or behavioral disorders (EBDs). The teachers worked in two high-poverty, non-accredited Title-1 schools in an urban city. The study was part of a federally funded intervention called Behavioral, Emotional, and Social Training: Competent Learners Achieving School Success (BEST in CLASS- Elementary; BiC-E; Sutherland et al., 2017), which is targeted for students at risk for the development of EBDs. It uses evidence- based instructional practices to decrease students’ …

An Investigation Of How Black Stem Faculty At Historically Black Colleges And Universities Approach The National Science Foundation Merit Review Process, Falcon Rankins

Theses and Dissertations

This qualitative inquiry explored the ways in which US-born, Black faculty member participants in science, technology, engineering, and mathematics (STEM) disciplines at Historically Black Colleges and Universities (HBCUs) interact with the National Science Foundation (NSF). Eight Black HBCU STEM faculty members with a range of involvement in NSF-related activities were individually interviewed. Topics of discussion with participants included their prior experiences with NSF, their understanding of the merit review process, and their understanding of their personal and institutional relationships with NSF and the STEM community. Two broad findings emerged from the conversations. The first was that issues of communities and …

Enhanced Energy Storage And Conversion Applications By Porous Carbon And Atomic Layer Deposition, Yomna H. Abdelmoaty

Theses and Dissertations

The design and synthesis of porous materials attracted great attention recently because of their potential use in many fields like clean energy and environmental protection. Herein, we introduced new synthetic approaches for the preparation for porous carbons and organic polymers for selective CO₂ and iodine capture application. Regarding CO₂ capture application, Two new

series of porous carbons (PYDCs) and (TRI-Ps) were synthesized by thermally activating Pyrazole and Triazolo Pyridine monomers respectively using KOH as a catalyst, which leads to porous carbon. PYDCs exhibit high surface area according to Brunauer–Emmett–Tellertheory (SA_BET = 1266–2013 m² g⁻¹), …

Quantitative Analysis Of Tobacco-Specific Nitrosamines And Their Precursor Alkaloids In Tobacco Extracts, Celeste T. Wilkinson

Theses and Dissertations

Tobacco-specific nitrosamines (TSNA) are carcinogenic constituents derived from alkaloids in tobacco. Researchers are actively exploring several avenues to reduce TSNA levels in tobacco products like moist snuff tobacco. The focus of the research presented within is the quantitative analysis of TSNA in tobacco, specifically N’-nitrosonornicotine (NNN), 4-(methylnitrosamino)-1(3-pyridyl)-1-butanone (NNK), N’-nitrosoanatabine (NAT), and N’-nitrosoanabasine (NAB).

Tobacco alkaloids and nitrosamines in tobacco are currently analyzed by different instrumentation due to orders of magnitude difference in their concentrations, chromatographic separation challenges due to structural similarities, and similar mass fragmentation patterns. An analytical column using silica and 1,2-bis(siloxy)ethane hybrid particles of 1.7 µm size is …

Nanopore Thermodynamics Via Infrared Laser Heating, Christopher Angevine

Theses and Dissertations

Single molecule nanopore spectroscopy is a label-free method for characterizing a wide variety of water-soluble molecules. Recently there have been efforts to expand nanopore sensing to new areas of study. Forensic investigators require an easy to deploy method to identify an unknown number of contributors in a solution. Currently there is no easily available method to distinguish between a single or multiple contributor solution of DNA before being processed by more advanced analytical techniques which has led to wasted time and resources increasing the backlog of samples waiting to be processed. In this work we present a new nanopore technique …

Silver Nanoparticle Fate And Accumulation In The Aquatic Food Web Of Stream Microcosms, Stefan J. Petersen

College of Graduate Studies: Theses & Dissertations

Silver nanoparticles (AgNPs) are used in 25% of all nano-enabled products and applied for anti-microbial properties. Silver nanoparticles are discharged into aquatic environments through wastewater discharge, runoff, and chemical spills. Once in aquatic environments silver nanoparticles have the potential to harm aquatic organisms. While the fate of silver nanoparticles in lentic systems has been investigated, limited information is available for the fate of silver nanoparticles in flowing environments. The purpose of this study was to compare the fate of AgNPs following a one-time pulsed application simulating a chemical spill, or small repetitive applications simulating effluent discharge, in artificial stream communities …

The Effect Of Patellofemoral Pain On Joint Motion And Variability During A Prolonged Run, Klarie Ake

College of Graduate Studies: Theses & Dissertations

INTRODUCTION: Patellofemoral pain (PFP) is a common overuse injury where the cause of the pain is largely unknown. Previous research has not compared the variability of joint coordination and kinematics in the same study. PURPOSE: The purpose of this study was to examine the effects of PFP and exertion on the variability of lower extremity kinematics, and joint coordination. METHODS: The participants included 6 female runners with PFP (R-PFP) (21.0 ± 0.55 years; 66.1 ± 7.9 kg; 1.62 ± 0.09 m), and a control group of 6 healthy female runners (CON) (21.2 ± 1.17 years; 61.5 ± 6.9 kg; 1.67 …

Examining And Exposing The Darknet, Ton H. Don

College of Graduate Studies: Theses & Dissertations

This thesis consists of two studies; the first study is “Diving into the Darknet” and the second is “Exposing the Darknet on Mobile Devices”. The Darknet is a network of hidden sites and services which are built based on anonymity. In “Diving into the Darknet”, we applied different data science methods to establish the relationships between the data in the data set. This data set has information related to seller, drug types, and transactions. Additionally, we used Tableau to visualize the data set. For the second study, we took a digital forensics perspective of the Darknet. Orfox and Orbot, a …

Investigating Problems Associated With Patient Care Reports And Transferring Data Between Ambulance And Hospitals From The Perspective Of Emergency Medical Technicians, Smiljana Cuk

College of Graduate Studies: Theses & Dissertations

Many hospitals have switched to electronic records but emergency medical services continue to use some paper-based reports. Ambulances that have electronic-based systems use them only internally because they are not integrated with hospitals’ systems. This study investigated problems with paper-based, computer-based reports, and transferring patients and their information from an ambulance to the emergency department. Emergency medical technicians were interviewed using qualitative methods. After coding and analyzing their answers, results showed that all emergency medical technicians would like to see a change from paper to electronic transfer of information and that it was difficult to write the report while riding …

A Case Study Of Student Veteran Efficacy In The College Of Engineering And Information Technology At Georgia Southern University, Kevin G. Finley

College of Graduate Studies: Theses & Dissertations

This thesis addresses the issues student veterans face in their transition from military to academic life while pursuing an undergraduate degree in the STEM fields (Science, Technology, Engineering, Math) at Georgia Southern University’s College of Engineering and Information Technology (CEIT). Historically this transition has been a difficult one. Through the implementation of a mentorship program comprised of military veterans on the staff and faculty of Georgia Southern University as well as assistance and participation from members of the case study researcher team and primary researcher this program assisted incoming military student veterans as they assimilated into the collegiate atmosphere. The …

Oasis - Identifying The Core Attributes For Rdbms Alternatives, Benjamin P. Mcpherson

College of Graduate Studies: Theses & Dissertations

Since their introduction in the 1970s, relational database management systems have served as the dominate data storage technology. However, the demands of big data and Web 2.0 necessitated a change in the market, sparking the beginning of the NoSQL movement in the late 2000s. NoSQL databases exchanged the relational model and the guaranteed consistency of ACID transactions for improved performance and massive scalability [1]. While the benefits NoSQL provided proved useful, the lack of sufficient SQL functionality presented a major hurdle for organizations which require it to properly operate. It was clear that new RDBMS solutions which did not compromise …

Audio-Based Productivity Forecasting Of Construction Cyclic Activities, Chris A. Sabillon

College of Graduate Studies: Theses & Dissertations

Due to its high cost, project managers must be able to monitor the performance of construction heavy equipment promptly. This cannot be achieved through traditional management techniques, which are based on direct observation or on estimations from historical data. Some manufacturers have started to integrate their proprietary technologies, but construction contractors are unlikely to have a fleet of entirely new and single manufacturer equipment for this to represent a solution. Third party automated approaches include the use of active sensors such as accelerometers and gyroscopes, passive technologies such as computer vision and image processing, and audio signal processing. Hitherto, most …

Cultivating Ecological Literacy And Rethinking Our Connections To Nature, Sean Fretwell

College of Graduate Studies: Theses & Dissertations

In this dissertation I explore the complex, often contested, relationships between humankind and nature. I consider the changing state of these relationships as they are influenced by factors rooted in science, technology, and economics. I also examine these relationships as they relate to human activities with agriculture. Considering the present state of environmental crisis and the abundance of evidence indicating the deleterious activities of humankind as primary causes for the many global calamities, I argue for revising industrially-driven ideologies; particularly those driven by the economic paradigm of capitalism and self-interest. Additionally, I submit that a return to kinship with nature …

Energy Storage Management And Simulation For Nano-Grids, Shantu Ghose

College of Graduate Studies: Theses & Dissertations

Energy storage has been utilized in many forms and applications from a flashlight to the Space Shuttle. There is a worldwide effort to develop battery model with high energy level and power densities for a variety range of applications, including hybrid electric vehicles (HEV) and photovoltaic system (PV). To improve battery technology, understanding the battery modeling is very important. So, modeling the thermal behavior of a battery is a vital consideration before designing an effective thermal management system which will operate safely and prolong the lifespan of an energy storage system. The first part of this work focused on the …

Performance Analysis Of Massive Mimo System With Quality Of Service Requirements And Precoding Techniques, Kishan Neupane

College of Graduate Studies: Theses & Dissertations

The massive MIMO is a promising technology for future 5G wireless communication systems to provide high spectrum efficiency. The use of a very large number of antennas for both transmission and reception is an intuitive approach to boost the system capacity and enhance the link reliability. The main requirement of future wireless systems are high throughput, serving many users simultaneously with optimal energy consumption. In the first part of the thesis, we proposed a novel algorithm for secrecy rate analysis of massive MIMO with QoS requirement by adapting the transmit signal vector and power of user using game theory. The …

Natural Convection Heat Transfer Of Inclined Sierpinski Carpet Fractal Fins, Luke A. Fussell

College of Graduate Studies: Theses & Dissertations

When designing extended surfaces for the thermal management of electronic devices in aerospace applications it is critically important to minimize mass. However, this can be difficult to achieve as the rate of heat dissipated is directly proportional to the surface area. Fortunately, when certain fractal geometries, like the Sierpinski carpet, are utilized in the design of extended surfaces an increase in surface area and simultaneous decrease in mass can be achieved. The thermal performance of fins inspired by the first four fractal iterations of the Sierpinski carpet pattern was experimentally examined in a natural convection environment. The fractal fins were …