Open Access. Powered by Scholars. Published by Universities.®
- Institution
-
- University of Dar es Salaam (8)
- University of Nevada, Las Vegas (5)
- Old Dominion University (4)
- California State University, San Bernardino (2)
- Clemson University (2)
-
- Embry-Riddle Aeronautical University (2)
- New Jersey Institute of Technology (2)
- University of Connecticut (2)
- University of South Carolina (2)
- Virginia Commonwealth University (2)
- Air Force Institute of Technology (1)
- Binghamton University (1)
- California Polytechnic State University, San Luis Obispo (1)
- City University of New York (CUNY) (1)
- Michigan Technological University (1)
- San Jose State University (1)
- Southern Methodist University (1)
- University of Arkansas, Fayetteville (1)
- University of Kentucky (1)
- University of Louisville (1)
- University of Lynchburg (1)
- University of New Hampshire (1)
- University of New Mexico (1)
- Washington University in St. Louis (1)
- Keyword
-
- Control (4)
- Machine Learning (4)
- Robotics (4)
- Artificial Intelligence (3)
- Automated guided vehicle systems (3)
-
- Intelligent control systems (3)
- Machine learning (3)
- Reinforcement learning (3)
- Artificial Neural Network (2)
- Artificial intelligence (2)
- Autonomous (2)
- Biomechanics (2)
- Control theory (2)
- Convolutional Neural Network (2)
- Deep Learning (2)
- Fuzzy logic (2)
- Reinforcement Learning (2)
- Robots (2)
- Simulation (2)
- 3d (1)
- A* Algorithm (1)
- AGC (1)
- AI (1)
- AI Agents (1)
- ANTI VIRUSES (1)
- AUV (1)
- Accident (1)
- Accuracy (1)
- Adaptive Control (1)
- Adaptive stepsize (1)
- Publication Year
- Publication
-
- Tanzania Journal of Engineering and Technology (TJET) (8)
- Electrical & Computer Engineering Faculty Research (3)
- Electrical & Computer Engineering Theses & Dissertations (3)
- Theses and Dissertations (3)
- All Theses (2)
-
- Publications (2)
- Beyond: Undergraduate Research Journal (1)
- College of Engineering Summer Undergraduate Research Program (1)
- Communications of the IIMA (1)
- Computer Science ETDs (1)
- Computer Science and Computer Engineering Undergraduate Honors Theses (1)
- Dissertations (1)
- Dissertations, Master's Theses and Master's Reports (1)
- Doctoral Dissertations and Master's Theses (1)
- Electronic Theses and Dissertations (1)
- Electronic Theses, Projects, and Dissertations (1)
- Engineering Management & Systems Engineering Faculty Publications (1)
- Honors Scholar Theses (1)
- Honors Theses and Capstones (1)
- Library Philosophy and Practice (e-journal) (1)
- McKelvey School of Engineering Graduate Student Theses & Dissertations (1)
- Mechanical Engineering Faculty Presentations (1)
- Mechanical Engineering Faculty Research (1)
- Mechanical Engineering Research Theses and Dissertations (1)
- Northeast Journal of Complex Systems (NEJCS) (1)
- Open Educational Resources (1)
- Student Scholar Showcase (1)
- Theses (1)
- Theses and Dissertations--Electrical and Computer Engineering (1)
- University Scholar Projects (1)
- Publication Type
- File Type
Articles 1 - 30 of 45
Full-Text Articles in Controls and Control Theory
When Does Global Search Pay For Itself? A Measured Exploration Cost And Energy Break-Even Analysis Of A Metaheuristic Search Controller In Solar Energy Systems, Mohamed Ali Muammar Ezgour
When Does Global Search Pay For Itself? A Measured Exploration Cost And Energy Break-Even Analysis Of A Metaheuristic Search Controller In Solar Energy Systems, Mohamed Ali Muammar Ezgour
Communications of the IIMA
Autonomous energy systems increasingly delegate the choice of operating point to embedded search algorithms, trading a fast local optimizer that can settle on a wrong point against a slower global search that guarantees the right one at a measurable cost. This paper reframes maximum power point tracking under partial shading as that decision and measures its economics on a fixed photovoltaic plant in MATLAB/Simulink. A Hippopotamus Optimization global search handed over to incremental conductance is compared with incremental conductance alone across seventeen initial duty cycles and thirty random seeds. The hybrid reached the global peak in all thirty seeds, whereas …
On The Use Of Lorawan For Smart Fishing Applications In The Blue Economy Sector, Eva Shayo
On The Use Of Lorawan For Smart Fishing Applications In The Blue Economy Sector, Eva Shayo
Tanzania Journal of Engineering and Technology (TJET)
The growth of digital technology is expected to transform small-scale fishery sectors, where a need for robust, low-cost, long-range communication networks becomes critical. There exist several technologies that are used in the fishery sector but they are never affordable to small scale fisheries. This study evaluates the feasibility of using low cost Long Range Wide Area Network (LoRaWAN) technology specifically tailored for smart fishing environments to small scale fishery sector. Using simulation, we assess the performance of the key performance metrics including probability of success and energy efficiency under varying device densities and time. During evaluation, we considered end devices …
Robust Real-Time Uav Target Tracking With Onboard Vision-Based Yaw Control, Rylan Malarchick, Jose Castelblanco, Enrique Amaya, Carmen Dimario, Graysen Brinkman, Chirag Kumar, Kiwon Yoon, Sajid Berhane
Robust Real-Time Uav Target Tracking With Onboard Vision-Based Yaw Control, Rylan Malarchick, Jose Castelblanco, Enrique Amaya, Carmen Dimario, Graysen Brinkman, Chirag Kumar, Kiwon Yoon, Sajid Berhane
Beyond: Undergraduate Research Journal
Autonomous tracking of agile unmanned aerial vehicles (UAVs) presents significant challenges for real-time perception and control systems. This work presents AIRHOUND (Autonomous Intelligent Rotorcraft for Hostile Object Unified Navigation and Detection), a UAV platform implementing vision-based yaw tracking through a modular ROS2 software architecture. The system employs YOLOv8 object detection optimized with NVIDIA TensorRT for embedded deployment on an NVIDIA Jetson Orin companion computer. Detected targets are processed through a geometric tracking module that converts pixel coordinates to angular yaw errors using pinhole camera intrinsics, with a proportional controller generating rate-limited yaw commands. These commands are streamed to a PX4 …
Parameter Informed Reinforcement Learning For Vehicle System Identification, Nathan Schaff
Parameter Informed Reinforcement Learning For Vehicle System Identification, Nathan Schaff
Doctoral Dissertations and Master's Theses
Accurate system identification is essential for modeling and controlling vehicle dynamics. This dissertation explores the application of Parameter Informed Reinforcement Learning (PIRL) as a novel approach to system identification (SYSID). PIRL integrates prior system knowledge, such as physical parameters, into reinforcement learning (RL) frameworks to improve estimation accuracy. The study begins with an overview of traditional SYSID methods and then introduces PIRL as a modification of standard RL. The research applies PIRL to short-period aircraft dynamics, demonstrating its effectiveness in both offline and online learning frameworks. The dissertation then further explores PIRL’s utility in an indirect model reference adaptive control …
Csc36000 - Modern Distributed Computing Assignment, Saptarashmi Bandyopadhyay
Csc36000 - Modern Distributed Computing Assignment, Saptarashmi Bandyopadhyay
Open Educational Resources
This assignment covers standard performance metrics for Distributed Systems and the basics of Multiprocessing for CSC36000 - Modern Distributed Computing at the City College of New York CUNY. It is an interactive coding assignment intended to be executed in a Python notebook.
Optimizing Hip And Knee Assistance For Walking And Sit-To-Stand Transitions: An Intrinsic Muscle Mechanics Based Predictive Approach, Neethan Ratnakumar
Optimizing Hip And Knee Assistance For Walking And Sit-To-Stand Transitions: An Intrinsic Muscle Mechanics Based Predictive Approach, Neethan Ratnakumar
Dissertations
As the global population ages, the demand for wearable assistive technologies continues to rise, driven by their potential to enhance mobility and independence in older adults. Effectively designed controllers for lower-limb exoskeletons to assist sit-to-stand (STS) and walking are crucial for delivering efficient, safe, and comfortable assistance during daily activities. Traditionally, controller optimization involves biomechanical modeling and user-specific customization. Musculoskeletal simulations play a central role in this process by providing insights into human-exoskeleton interaction dynamics, thereby informing and refining control strategies.
This work presents a simulation-driven approach for developing exoskeleton controllers for walking and STS using two distinct methods: optimal …
Analysis Of An Improved Reliability Dual-Buck Structured Three-Level Flying Capacitor Inverter, Almachius Kahwa Dr.
Analysis Of An Improved Reliability Dual-Buck Structured Three-Level Flying Capacitor Inverter, Almachius Kahwa Dr.
Tanzania Journal of Engineering and Technology (TJET)
With the increased demand for high-reliability power converters in the electric drive-train and propulsion systems, the efforts to design and analyze converters with high fault tolerance have become apparent. Among the emerging trends to improve the reliability of power converters is the incorporation of dual-buck (DB) structures in traditional converter topologies. Thus, this paper studies a single-phase dual-buck structured three-level flying capacitor (FC) inverter. The dual-buck flying capacitor (DBFC) inverter was constructed in such a way as to suppress the shoot-through problems that may occur because of the switching mismatch and gate driver delay, as exhibited in the traditional FC …
Energy Optimal Coverage Motion Trajectory Generation Using A Fourth-Order Motion Profile, Mathias Halinga
Energy Optimal Coverage Motion Trajectory Generation Using A Fourth-Order Motion Profile, Mathias Halinga
Tanzania Journal of Engineering and Technology (TJET)
Industrial machines are widely used in manufacturing sector to manufacture several products to meet customer demands. Most of these industries runs all the time throughout a day leading to high operating cost. To cut costs and satisfy customer demand for precise products, industrial machines’ motion generation is important in improving machine motion precision while using less energy. This study presents a coverage motion energy optimization which is generated by linear interpolation of each segment described by the fourth-order motion profile. The phase changes in the profile are attained with continuity of machine kinematic limits jerk, acceleration, and velocity, which are …
Gamified Gait Rehabilitation Via Real-Time Biofeedback And Adaptive Hip-Exoskeleton Control, Mariya Huzaifa Tohfafarosh
Gamified Gait Rehabilitation Via Real-Time Biofeedback And Adaptive Hip-Exoskeleton Control, Mariya Huzaifa Tohfafarosh
Theses
Gait impairments arise from systemic diseases, age-related degeneration, musculoskeletal dysfunctions, or neurological conditions. While traditional rehabilitation can be effective, they often face challenges such as high costs, inaccessibility, and low patient engagement. To address these challenges, my work introduces a virtual reality-based rehabilitation (VRBR) system, integrating real-time motion and electromyographic (EMG) muscle activation feedback with a gamified virtual environment for enhanced adaptability and engagement. The system includes a custom-designed hip-exoskeleton that provides adaptive spring-like assistance or resistance, supporting both mobility-impaired users and strength training. Assistance levels can be tuned to match the user's progress. Additionally, a custom pressure insole was …
Aerial Robotic Studies Of Volcanic Co2 Emissions, John Ericksen
Aerial Robotic Studies Of Volcanic Co2 Emissions, John Ericksen
Computer Science ETDs
Volcanic systems are inherently complex, involving dynamic interactions among magma flow, gas emissions, and atmospheric dispersion. This dissertation focuses on developing and analyzing autonomous UAS algorithms for efficiently surveying volcanic CO2 plumes, introducing several novel methods: the LoCUS algorithm, a swarm coordination and self-healing algorithm that supports gradient-based plume tracking, a transect-based technique that employs a 2D Gaussian fit to calculate CO2 plume flux, and the Sketch algorithm for rapid plume boundary tracing. By treating multiple UAS as a single scientific instrument, these methods leverage swarm algorithms to use in-situ data in ways impossible with individual drones. Validated through simulations …
Integrating Neural Networks For Predictive Torque Control And Obstacle Avoidance In Autonomous Robot, Viswanath Kodali, Harsha Vardhan Borra, Kiran P
Integrating Neural Networks For Predictive Torque Control And Obstacle Avoidance In Autonomous Robot, Viswanath Kodali, Harsha Vardhan Borra, Kiran P
Northeast Journal of Complex Systems (NEJCS)
In the field of robotics, precise motion control and accurate computation of joint forces are critical for ensuring optimal performance. Traditional methods, such as using the Jacobian matrix for joint angle determination and Euler-Lagrange equations for torque computation, are reliable but computationally intensive, making them less suitable for real-time applications. This paper presents an advanced approach to improving the productivity and efficiency of a 3-Degree of Freedom (DOF) robotic arm by utilizing Artificial Neural Network (ANN). The proposed system dynamically predicts joint angles and torque, enabling faster and more efficient motion control.
To address the challenge of obstacle avoidance in …
Safety And Optimality Monitors For Learning-Enabled Systems Using Conformal Prediction, Jackson Cox
Safety And Optimality Monitors For Learning-Enabled Systems Using Conformal Prediction, Jackson Cox
McKelvey School of Engineering Graduate Student Theses & Dissertations
The use of machine learning to create data-driven plant models and controllers has led to an increased need for safety and optimality monitors for model-based systems. System plant models are subject to uncertainty due to learning constraints such as unseen data and overfitting or physical constraints such as unknown dynamics and noise. This uncertainty is detrimental to safety-critical systems and must be properly regulated. To curb this uncertainty, we create prediction sets using the guarantees provided by Conformal Prediction. With a user-specified high probability, these prediction sets contain the true plant system states for an entire prediction horizon, which we …
Learning To Represent Temporal Dynamics And Generative Factors For Intelligent Visual Navigation, Sahand Khoshdel
Learning To Represent Temporal Dynamics And Generative Factors For Intelligent Visual Navigation, Sahand Khoshdel
All Theses
Visual navigation systems are crucial in various applications, including autonomous driving, unmanned aerial systems (UAS), and industrial automation. For these systems to operate efficiently in dynamic environments, they must not only interpret complex surroundings but also anticipate changes over time. Temporal prediction—forecasting environmental changes like moving obstacles or shifting lighting conditions—enables navigation systems to act proactively, enhancing both safety and performance. This dissertation investigates representation learning methods both as a backbone feature extractor for RL agents as well as a proxy for systems oriented for Explainable AI (XAI). Two main projects are presented as case studies to achieve the aforementioned …
Measurement Automation & Measurement System Research Endowment, Brian Bivinetto, Beneda Loya, Shiron Bendrihem
Measurement Automation & Measurement System Research Endowment, Brian Bivinetto, Beneda Loya, Shiron Bendrihem
College of Engineering Summer Undergraduate Research Program
Road travel safety is always the most important issue in transportation systems. In general, several factors cause road accidents, such as human error, vehicle mechanical failure, roadway limitations (e.g. pavement, lane geometry, etc.), and inclement weather conditions. The major focus of today’s transportation developments is related to making highway transportation safer, smarter, and greener to enhance livability. Many accidents are caused when drivers lack a better understanding of the surrounding traffic conditions because the driver not only needs to control his/her vehicle but also needs to be aware of the movements of the vehicles around him/her. A driver cannot be …
Reinforcement Learning For Optimal Kicking Actions In Humanoid Robotics: Advancing Robotic Autonomy And Versatility, Suresh Dodda, Sathish Kumar Chintala, Sukender Reddy Mallreddy, Sharath Chandra Macha, Yashwanth Vasa, Sapan Bharadwaj Bonala, Navin Kamuni, Sujatha Alla
Reinforcement Learning For Optimal Kicking Actions In Humanoid Robotics: Advancing Robotic Autonomy And Versatility, Suresh Dodda, Sathish Kumar Chintala, Sukender Reddy Mallreddy, Sharath Chandra Macha, Yashwanth Vasa, Sapan Bharadwaj Bonala, Navin Kamuni, Sujatha Alla
Engineering Management & Systems Engineering Faculty Publications
Acquiring the necessary skills to perform a work effectively and efficiently requires a significant investment of time and computing power. Previous applications of Reinforcement Learning (RL) for action optimization in humanoid robotics have shown how promising this technology is for moving robotics towards true autonomy and versatility. Therefore, this study offers the first use of RL to create an entirely optimal kicking action for the Alderbaran Nao robot. Kicking motions that were steady, precise, quick, and able to kick farther than any existing RoboCup squad were generated by optimizing for a multi-objective reward function. We demonstrate that the ideal kicking …
Modeling, Simulation And Control Of Microrobots For The Microfactory., Zhong Yang
Modeling, Simulation And Control Of Microrobots For The Microfactory., Zhong Yang
Electronic Theses and Dissertations
Future assembly technologies will involve higher levels of automation in order to satisfy increased microscale or nanoscale precision requirements. Traditionally, assembly using a top-down robotic approach has been well-studied and applied to the microelectronics and MEMS industries, but less so in nanotechnology. With the boom of nanotechnology since the 1990s, newly designed products with new materials, coatings, and nanoparticles are gradually entering everyone’s lives, while the industry has grown into a billion-dollar volume worldwide. Traditionally, nanotechnology products are assembled using bottom-up methods, such as self-assembly, rather than top-down robotic assembly. This is due to considerations of volume handling of large …
Chatgpt As Metamorphosis Designer For The Future Of Artificial Intelligence (Ai): A Conceptual Investigation, Amarjit Kumar Singh (Library Assistant), Dr. Pankaj Mathur (Deputy Librarian)
Chatgpt As Metamorphosis Designer For The Future Of Artificial Intelligence (Ai): A Conceptual Investigation, Amarjit Kumar Singh (Library Assistant), Dr. Pankaj Mathur (Deputy Librarian)
Library Philosophy and Practice (e-journal)
Abstract
Purpose: The purpose of this research paper is to explore ChatGPT’s potential as an innovative designer tool for the future development of artificial intelligence. Specifically, this conceptual investigation aims to analyze ChatGPT’s capabilities as a tool for designing and developing near about human intelligent systems for futuristic used and developed in the field of Artificial Intelligence (AI). Also with the helps of this paper, researchers are analyzed the strengths and weaknesses of ChatGPT as a tool, and identify possible areas for improvement in its development and implementation. This investigation focused on the various features and functions of ChatGPT that …
Moment-Based Reinforcement Learning For Ensemble Control, Yao-Chi Yu, Vignesh Narayanan, Jr-Shin Li
Moment-Based Reinforcement Learning For Ensemble Control, Yao-Chi Yu, Vignesh Narayanan, Jr-Shin Li
Publications
Problems involving controlling the collective behavior of a population of structurally similar dynamical systems, the so-called ensemble control, arise in diverse emerging applications and pose a grand challenge in systems science and control engineering. Owing to the severely under-actuated nature and the difficulty of placing large-scale sensor networks, ensemble systems are limited to being actuated and monitored at the population level. Moreover, mathematical models describing the dynamics of ensemble systems are often elusive. Therefore, it is essential to design broadcast controls that excite the entire population in such a way that the heterogeneity in system dynamics are robustly compensated. In …
Cooperative Deep Q -Learning Framework For Environments Providing Image Feedback, Krishnan Raghavan, Vignesh Narayanan, Sarangapani Jagannathan
Cooperative Deep Q -Learning Framework For Environments Providing Image Feedback, Krishnan Raghavan, Vignesh Narayanan, Sarangapani Jagannathan
Publications
In this article, we address two key challenges in deep reinforcement learning (DRL) setting, sample inefficiency, and slow learning, with a dual-neural network (NN)-driven learning approach. In the proposed approach, we use two deep NNs with independent initialization to robustly approximate the action-value function in the presence of image inputs. In particular, we develop a temporal difference (TD) error-driven learning (EDL) approach, where we introduce a set of linear transformations of the TD error to directly update the parameters of each layer in the deep NN. We demonstrate theoretically that the cost minimized by the EDL regime is an approximation …
Distributed Learning With Automated Stepsizes, Benjamin Liggett
Distributed Learning With Automated Stepsizes, Benjamin Liggett
All Theses
Stepsizes for optimization problems play a crucial role in algorithm convergence, where the stepsize must undergo tedious manual tuning to obtain near-optimal convergence. Recently, an adaptive method for automating stepsizes was proposed for centralized optimization. However, this method is not directly applicable to decentralized optimization because it allows for heterogeneous agent stepsizes. Furthermore, directly using consensus between agent stepsizes to mitigate stepsize heterogeneity can decrease performance and even lead to divergence.
This thesis proposes an algorithm to remedy the tedious manual tuning of stepsizes in decentralized optimization. Our proposed algorithm automates the stepsize and uses dynamic consensus between agents’ stepsizes …
Machine Learning Approach For Classifying Power Outage In Secondary Electric Distribution Network, Stephan Mgaya, Hellen Maziku
Machine Learning Approach For Classifying Power Outage In Secondary Electric Distribution Network, Stephan Mgaya, Hellen Maziku
Tanzania Journal of Engineering and Technology (TJET)
Power outage is the problem that hinders social and economic development especially for developing countries like Tanzania. Frequent power outages damage electric equipment, and negatively affect the industrial production process. Power outages cannot be completely eradicated due to uncontrolled cause like natural calamities but technical challenges can be managed and hence reducing power outages. The existing manual methods used to locate power outage like customer calls is inefficient and time consuming. On the other hand, modern method like the Advanced Metering Infrastructure (AMI) still faces a challenge in effectively classifying power line outage due to the nature of imbalanced datasets. …
Learning Robot Motion From Creative Human Demonstration, Charles C. Dietzel
Learning Robot Motion From Creative Human Demonstration, Charles C. Dietzel
Theses and Dissertations
This thesis presents a learning from demonstration framework that enables a robot to learn and perform creative motions from human demonstrations in real-time. In order to satisfy all of the functional requirements for the framework, the developed technique is comprised of two modular components, which integrate together to provide the desired functionality. The first component, called Dancing from Demonstration (DfD), is a kinesthetic learning from demonstration technique. This technique is capable of playing back newly learned motions in real-time, as well as combining multiple learned motions together in a configurable way, either to reduce trajectory error or to generate entirely …
Smart City Management Using Machine Learning Techniques, Mostafa Zaman
Smart City Management Using Machine Learning Techniques, Mostafa Zaman
Theses and Dissertations
In response to the growing urban population, "smart cities" are designed to improve people's quality of life by implementing cutting-edge technologies. The concept of a "smart city" refers to an effort to enhance a city's residents' economic and environmental well-being via implementing a centralized management system. With the use of sensors and actuators, smart cities can collect massive amounts of data, which can improve people's quality of life and design cities' services. Although smart cities contain vast amounts of data, only a percentage is used due to the noise and variety of the data sources. Information and communication technology (ICT) …
Integration Of Blockchain Technology Into Automobiles To Prevent And Study The Causes Of Accidents, John Kim
Integration Of Blockchain Technology Into Automobiles To Prevent And Study The Causes Of Accidents, John Kim
Electronic Theses, Projects, and Dissertations
Automobile collisions occur daily. We now live in an information-driven world, one where technology is quickly evolving. Blockchain technology can change the automotive industry, the safety of the motoring public and its surrounding environment by incorporating this vast array of information. It can place safety and efficiency at the forefront to pedestrians, public establishments, and provide public agencies with pertinent information securely and efficiently. Other industries where Blockchain technology has been effective in are as follows: supply chain management, logistics, and banking. This paper reviews some statistical information regarding automobile collisions, Blockchain technology, Smart Contracts, Smart Cities; assesses the feasibility …
Data Forgery Detection In Automatic Generation Control: Exploration Of Automated Parameter Generation And Low-Rate Attacks, Yatish R. Dubasi
Data Forgery Detection In Automatic Generation Control: Exploration Of Automated Parameter Generation And Low-Rate Attacks, Yatish R. Dubasi
Computer Science and Computer Engineering Undergraduate Honors Theses
Automatic Generation Control (AGC) is a key control system utilized in electric power systems. AGC uses frequency and tie-line power flow measurements to determine the Area Control Error (ACE). ACE is then used by the AGC to adjust power generation and maintain an acceptable power system frequency. Attackers might inject false frequency and/or tie-line power flow measurements to mislead AGC into falsely adjusting power generation, which can harm power system operations. Various data forgery detection models are studied in this thesis. First, to make the use of predictive detection models easier for users, we propose a method for automated generation …
Evaluating Driving Performance Of A Novel Behavior Planning Model On Connected Autonomous Vehicles, Keyur Shah
Evaluating Driving Performance Of A Novel Behavior Planning Model On Connected Autonomous Vehicles, Keyur Shah
Honors Scholar Theses
Many current algorithms and approaches in autonomous driving attempt to solve the "trajectory generation" or "trajectory following” problems: given a target behavior (e.g. stay in the current lane at the speed limit or change lane), what trajectory should the vehicle follow, and what inputs should the driving agent apply to the throttle and brake to achieve this trajectory? In this work, we instead focus on the “behavior planning” problem—specifically, should an autonomous vehicle change lane or keep lane given the current state of the system?
In addition, current theory mainly focuses on single-vehicle systems, where vehicles do not communicate with …
Landing Throttleable Hybrid Rockets With Hierarchical Reinforcement Learning In A Simulated Environment, Francesco Alessandro Stefano Mikulis-Borsoi
Landing Throttleable Hybrid Rockets With Hierarchical Reinforcement Learning In A Simulated Environment, Francesco Alessandro Stefano Mikulis-Borsoi
Honors Theses and Capstones
In this paper, I develop a hierarchical Markov Decision Process (MDP) structure for completing the task of vertical rocket landing. I start by covering the background of this problem, and formally defining its constraints. In order to reduce mistakes while formulating different MDPs, I define and develop the criteria for a standardized MDP definition format. I then decompose the problem into several sub-problems of vertical landing, namely velocity control and vertical stability control. By exploiting MDP coupling and symmetrical properties, I am able to significantly reduce the size of the state space compared to a unified MDP formulation. This paper …
A Comparative Analysis Of Reinforcement Learning Applied To Task-Space Reaching With A Robotic Manipulator With And Without Gravity Compensation, Jonathan Fugal
A Comparative Analysis Of Reinforcement Learning Applied To Task-Space Reaching With A Robotic Manipulator With And Without Gravity Compensation, Jonathan Fugal
Theses and Dissertations--Electrical and Computer Engineering
Advances in computing power in recent years have facilitated developments in autonomous robotic systems. These robotic systems can be used in prosthetic limbs, wearhouse packaging and sorting, assembly line production, as well as many other applications. Designing these autonomous systems typically requires robotic system and world models (for classical control based strategies) or time consuming and computationally expensive training (for learning based strategies). Often these requirements are difficult to fulfill. There are ways to combine classical control and learning based strategies that can mitigate both requirements. One of these ways is to use a gravity compensated torque control with reinforcement …
The Potentials Of Faecal Sludge Treatment Using Local Conditioners In Tanzania: A Review, Doglas Benjamin1
The Potentials Of Faecal Sludge Treatment Using Local Conditioners In Tanzania: A Review, Doglas Benjamin1
Tanzania Journal of Engineering and Technology (TJET)
Worldwide, every day human beings generate millions of tons of Faecal Sludge (FS), which is rich in water, nutrients, energy, and organic compounds. Yet FS is not being managed in a way that permits us to derive value from its reuse, while at the same time, millions of farmers struggle with depleted soils and lack of water. In most of the developing countries, energy for cooking is mainly derived from cutting of trees, either as wood or charcoal. Resource recovery and reuse from FS can create livelihoods, enhance food security, support green economies, reduce waste and contribute to cost recovery …
Autonomous Watercraft Simulation And Programming, Nicholas J. Savino
Autonomous Watercraft Simulation And Programming, Nicholas J. Savino
Student Scholar Showcase
Automation of various modes of transportation is thought to make travel more safe and efficient. Over the past several decades, advances to semi-autonomous and autonomous vehicles have led to advanced autopilot systems on planes and boats, and an increasing popularity of self-driving cars. We predicted the motion of an autonomous vehicle using simulations in Python. The simulation models the motion of a small scale watercraft, which can then be built and programmed using an Arduino Microcontroller. We examined different control methods for a simulated rescue craft to reach a target. We also examined the effects of different factors, such as …