Open Access. Powered by Scholars. Published by Universities.®
- Institution
-
- China Simulation Federation (3880)
- TÜBİTAK (3106)
- Wright State University (1960)
- Old Dominion University (949)
- Singapore Management University (885)
-
- Washington University in St. Louis (730)
- Embry-Riddle Aeronautical University (590)
- Air Force Institute of Technology (443)
- Missouri University of Science and Technology (439)
- Neutrosophic Systems with Applications (380)
- University of Nebraska - Lincoln (274)
- Chulalongkorn University (235)
- University of Central Florida (189)
- Portland State University (158)
- University of Nevada, Las Vegas (152)
- University of Arkansas, Fayetteville (150)
- University of South Carolina (125)
- Purdue University (118)
- Chapman University (114)
- University for Business and Technology in Kosovo (114)
- University of Kentucky (111)
- University of South Florida (111)
- Technological University Dublin (100)
- California Polytechnic State University, San Luis Obispo (79)
- University of Dar es Salaam (77)
- University of New Haven (77)
- New Jersey Institute of Technology (63)
- Michigan Technological University (61)
- University of Texas at El Paso (61)
- University of Malaya (58)
- Keyword
-
- Machine learning (396)
- Computer Science (356)
- Deep learning (302)
- Department of Computer Science and Engineering (285)
- Engineering (253)
-
- Simulation (216)
- Machine Learning (186)
- Artificial intelligence (172)
- Optimization (164)
- Technical writing (158)
- College of Engineering and Computer Science (157)
- Newsletters (157)
- Science news (157)
- Classification (130)
- Genetic algorithm (120)
- Cybersecurity (115)
- Security (110)
- Deep Learning (104)
- Computer vision (102)
- Reinforcement learning (102)
- Computer Engineering (101)
- Neural networks (100)
- Artificial Intelligence (92)
- Path planning (91)
- Particle swarm optimization (88)
- Algorithms (85)
- Clustering (79)
- Image processing (78)
- Robotics (78)
- Virtual reality (77)
- Publication Year
- Publication
-
- Journal of System Simulation (3880)
- Turkish Journal of Electrical Engineering and Computer Sciences (3106)
- Computer Science & Engineering Syllabi (1312)
- Research Collection School Of Computing and Information Systems (858)
- All Computer Science and Engineering Research (683)
-
- Theses and Dissertations (503)
- Neutrosophic Systems with Applications (380)
- Browse all Theses and Dissertations (308)
- Journal of Digital Forensics, Security and Law (300)
- Electrical and Computer Engineering Faculty Research & Creative Works (282)
- Electronic Theses and Dissertations (249)
- Chulalongkorn University Theses and Dissertations (Chula ETD) (235)
- Electrical & Computer Engineering Theses & Dissertations (219)
- Computer Science and Engineering Faculty Publications (184)
- Annual ADFSL Conference on Digital Forensics, Security and Law (174)
- BITs and PCs Newsletter (157)
- School of Computing: Dissertations, Theses, and Student Research (154)
- Faculty Publications (150)
- Electrical & Computer Engineering Faculty Publications (138)
- Dissertations (121)
- Computer Science Faculty Publications (108)
- USF Tampa Graduate Theses and Dissertations (101)
- Computer Science Faculty Publications and Presentations (83)
- Engineering Faculty Articles and Research (81)
- UBT International Conference (73)
- Tanzania Journal of Engineering and Technology (TJET) (72)
- Electrical & Computer Engineering and Computer Science Faculty Publications (71)
- Graduate Theses and Dissertations (70)
- UNLV Theses, Dissertations, Professional Papers, and Capstones (64)
- Doctoral Dissertations (59)
- Publication Type
Articles 11761 - 11790 of 17350
Full-Text Articles in Engineering
A Quantitative Analysis Of Decision Process In Social Groups Using Human Trajectories, Truc Viet Le, Siyuan Liu, Hoong Chuin Lau, Ramayya Krishnan
A Quantitative Analysis Of Decision Process In Social Groups Using Human Trajectories, Truc Viet Le, Siyuan Liu, Hoong Chuin Lau, Ramayya Krishnan
Research Collection School Of Computing and Information Systems
A group's collective action is an outcome of the group's decision-making process, which may be reached by either averaging of the individual preferences or following the choices of certain members in the group. Our problem here is to decide which decision process the group has adopted given the data of the collective actions. We propose a generic statistical framework to infer the group's decision process from the spatio-temporal data of group trajectories, where each "trajectory" is a sequence of group actions. This is achieved by systematically comparing each agent type's influence on the group actions based on an array of …
Decentralized Multi-Agent Reinforcement Learning In Average-Reward Dynamic Dcops, Duc Thien Nguyen, William Yeoh, Hoong Chuin Lau, Shlomo Zilberstein
Decentralized Multi-Agent Reinforcement Learning In Average-Reward Dynamic Dcops, Duc Thien Nguyen, William Yeoh, Hoong Chuin Lau, Shlomo Zilberstein
Research Collection School Of Computing and Information Systems
Researchers have introduced the Dynamic Distributed Constraint Optimization Problem (Dynamic DCOP) formulation to model dynamically changing multi-agent coordination problems, where a dynamic DCOP is a sequence of (static canonical) DCOPs, each partially different from the DCOP preceding it. Existing work typically assumes that the problem in each time step is decoupled from the problems in other time steps, which might not hold in some applications. Therefore, in this paper, we make the following contributions: (i) We introduce a new model, called Markovian Dynamic DCOPs (MD-DCOPs), where the DCOP in the next time step is a function of the value assignments …
Humanity Hyper-Externalized, Josh Gloe
Humanity Hyper-Externalized, Josh Gloe
Honors Capstones
Capstone submitted as a graduation requirement for the BSU Honors Program.
First Step Mental Health App, Joshua Martin, James Faraday, Mackenzie Lopez
First Step Mental Health App, Joshua Martin, James Faraday, Mackenzie Lopez
Undergraduate Research Symposium
The goal of this project is to create a tool that provides students at Minnesota State University, Mankato with mental health information through a freely available smartphone application (App). Our approach uses a software engineering design process that focuses on who our customers are, what resources are available, and how we can best connect the two to improve student lives. We identified the stakeholders involved and worked with campus mental health professionals to help shape our App. While there is a broad range of mental health topics, we have focused on materials related to depression. The first process gives the …
Major Advancements In Personal Computing, Brandon Brooks
Major Advancements In Personal Computing, Brandon Brooks
Senior Seminars
This research essay expounds on the history and the journey of the Personal Computer. You will read about some of the most important items that the author felt contributed to the advancement of the PC over the years. The dates of the information ranges from the late 1960s up until the last year or so. The author talks about hardware components and software components, but the bulk of the material in this paper explains the history of each major milestone and what contributed to making it better, or more useful than the last. Each sub-topic will bring us closer to …
Software Architecture And Development For Controlling A Hubo Humanoid Robot, Manas Ajit Paldhe
Software Architecture And Development For Controlling A Hubo Humanoid Robot, Manas Ajit Paldhe
Open Access Theses
Due to their human-like structure, humanoid robots are capable of doing some complex tasks. Since a humanoid robot has a large number of actuators and sensors, controlling it is a difficult task. For various tasks like balancing, driving a car, and interacting with humans, real-time response of the robot is essential. Efficiently controlling a humanoid robot requires a software that guarantees real-time interface and control mechanism so that real-time response of the robot is possible. Addition- ally, to reduce the development effort and time, the software should be open-source, multi-lingual and should have high-level constructs inbuilt in it.
Currently Robot …
Analysis Of Eye Tracking Data Obtained By Customers’ Product Evaluations, Shweta Sanjay Sareen
Analysis Of Eye Tracking Data Obtained By Customers’ Product Evaluations, Shweta Sanjay Sareen
Open Access Theses
Within the mechanical engineering discipline, product representational studies have been used to inform engineers on the suitability of their product designs for prospective customers. Mainly based in customers' oral responses, engineers would modify the product design accordingly. The incorporation of eye tracking data, in addition to the oral responses, in these product representational studies is a recent addition. This case study performs data analysis of a product representational study conducted by Reid, MacDonald and Du (2012), which considers the impact of 2D and 3D product representation on customer judgments with associated eye gaze patterns. The aim of this thesis is …
Reliability Guided Resource Allocation For Large-Scale Supercomputing Systems, Shruti Umamaheshwaran
Reliability Guided Resource Allocation For Large-Scale Supercomputing Systems, Shruti Umamaheshwaran
Open Access Theses
In high performance computing systems, parallel applications request a large number of resources for long time periods. In this scenario, if a resource fails during the application runtime, it would cause all applications using this resource to fail. The probability of application failure is tied to the inherent reliability of resources used by the application. Our investigation of high performance computing systems operating in the field has revealed a significant difference in the measured operational reliability of individual computing nodes. By adding awareness of the individual system nodes' reliability to the scheduler along with the predicted reliability needs of parallel …
A Farm Management Information System With Task-Specific, Collaborative Mobile Apps And Cloud Storage Services, Jonathan Tyler Welte
A Farm Management Information System With Task-Specific, Collaborative Mobile Apps And Cloud Storage Services, Jonathan Tyler Welte
Open Access Theses
Modern production agriculture is beginning to advance beyond deterministic, scheduled operations between relatively few people to larger scale, information-driven efficiency in order to respond to the challenges of field variability and meet the needs of a growing population. Since no two farms are the same with respect to information and management structure, a specialized farm management information system (FMIS) which is tailored to the realities on the ground of individual farms is likely to be more effective than generalized FMIS available today.
This thesis presents the design of a FMIS using proven user-centered design principles. This approach resulted in the …
Predictive Analytics For Outpatient Appointments, Nang Laik Ma, Khataniar Seemanta, Dan Wu, Serene Seng Ying Ng
Predictive Analytics For Outpatient Appointments, Nang Laik Ma, Khataniar Seemanta, Dan Wu, Serene Seng Ying Ng
Research Collection School Of Computing and Information Systems
Healthcare is a very important industry where analytics has been applied successfully to generate insights about patients, identify bottleneck and to improve the business efficiency. In this paper, we aim to look at the patient appointment process as the hospital is experiencing high volume of ?no shows. ?No shows have a high impact on longer appointment lead time for patients, poor patient satisfaction and loss of revenue for hospital. We use data analytics to identify pattern of ?no shows, develop a statistical model to predict the probability of ?no shows and finally operationalizing the model to embed the analytics solution …
Assessing The Impact Of Electronic Health Record Systems Implementation On Hospital Patient Perceptions Of Care, Katherine Sofia Palacio Salgar
Assessing The Impact Of Electronic Health Record Systems Implementation On Hospital Patient Perceptions Of Care, Katherine Sofia Palacio Salgar
Engineering Management & Systems Engineering Theses & Dissertations
The delivery of health care services has been impacted by advances in Knowledge Management Information Systems (KMIS) and Information Technology (IT). The literature reveals that Electronic Health Records Systems (EHRs) are a comprehensive KMIS. There is a wide recognition in the body of knowledge that demonstrates the potential of EHRs to transform all aspects of health care services and, in consequence, the performance of Health Care Delivery Organizations (HCDO). Authors of published research also agree that there is a need for more empirical contributions that demonstrate the impact of EHRs upon HCDO. It is argued that in most cases, studies …
Transparent Spectrum Co-Access In Cognitive Radio Networks, Jonathan Daniel Backens
Transparent Spectrum Co-Access In Cognitive Radio Networks, Jonathan Daniel Backens
Electrical & Computer Engineering Theses & Dissertations
The licensed wireless spectrum is currently under-utilized by as much as 85%. Cognitive radio networks have been proposed to employ dynamic spectrum access to share this under-utilized spectrum between licensed primary user transmissions and unlicensed secondary user transmissions. Current secondary user opportunistic spectrum access methods, however, remain limited in their ability to provide enough incentive to convince primary users to share the licensed spectrum, and they rely on primary user absence to guarantee secondary user performance. These challenges are addressed by developing a Dynamic Spectrum Co-Access Architecture (DSCA) that allows secondary user transmissions to co-access transparently and concurrently with primary …
Web Archive Services Framework For Tighter Integration Between The Past And Present Web, Ahmed Alsum
Web Archive Services Framework For Tighter Integration Between The Past And Present Web, Ahmed Alsum
Computer Science Theses & Dissertations
Web archives have contained the cultural history of the web for many years, but they still have a limited capability for access. Most of the web archiving research has focused on crawling and preservation activities, with little focus on the delivery methods. The current access methods are tightly coupled with web archive infrastructure, hard to replicate or integrate with other web archives, and do not cover all the users' needs. In this dissertation, we focus on the access methods for archived web data to enable users, third-party developers, researchers, and others to gain knowledge from the web archives. We build …
Simulation Modeling And Analysis Of Customs-Regulated Container Terminal Operations With Multimodal Transportation, Mariam A. Kotachi
Simulation Modeling And Analysis Of Customs-Regulated Container Terminal Operations With Multimodal Transportation, Mariam A. Kotachi
Engineering Management & Systems Engineering Theses & Dissertations
World trade has been increasing dramatically in the past two decades and, as a result, container exchange has grown significantly. Consequently and to meet this increase, several container terminals are expanding and many new ones are being established. A port with one or more container terminals is considered a complex system in which many entities interact to accomplish seamless handling of containers inbound and outbound. The level of complexity is drastically heightened for container terminals containing multimodal transportation systems as they typically involve ships, rail, and trucks arriving to one or more terminals delivering containers of different sizes to several …
Where Am I? : Studying Users’ Indoor Navigation Location Needs, Kartik Muralidharan, Archan Misra, Rajesh Krishna Balan
Where Am I? : Studying Users’ Indoor Navigation Location Needs, Kartik Muralidharan, Archan Misra, Rajesh Krishna Balan
Research Collection School Of Computing and Information Systems
Location has emerged as the single-most important context whilst building pervasive mobile applications. Several mobile applications have appeared that use location to provide a host of services such as location-specific advertising as well as navigation. As a result, the key challenge of positioning techniques has been to provide the most precise location of the user (device) and much effort has been put in computing this fine grained location in indoor environments. This is under the assumption that highly accurate location is crucial for all indoor services. To understand the location accuracy, that should prove sufficient, for users to navigate to …
An Analysis Of Eye Movements With Helmet Mounted Displays, Kalyn A. Tung
An Analysis Of Eye Movements With Helmet Mounted Displays, Kalyn A. Tung
Theses and Dissertations
Helmet or Head-Mounted Displays (HMD) applications have expanded to include a range from advanced military cockpits to consumer glasses. However, users have documented loss of legibility while undergoing vibration. Recent research indicates that undesirable eye movement is related to the vibration frequency a user experiences. In vibrating environments, two competing eye reflexes likely contribute to eye movements. The Vestibulo-ocular Reflex responds to motion sensed in the otoliths while the pursuit reflex is driven by the visual system to maintain the desired image on the fovea. This study attempts to isolate undesirable eye motions that occur while using a HMD by …
Multi Sensor System For Pedestrian Tracking And Activity Recognition In Indoor Environments, Juan Jose Marron Monteserin
Multi Sensor System For Pedestrian Tracking And Activity Recognition In Indoor Environments, Juan Jose Marron Monteserin
USF Tampa Graduate Theses and Dissertations
The widespread use of mobile devices and the rise of Global Navigation Satellite Systems (GNSS) have allowed mobile tracking applications to become very popular and valuable in outdoor environments. However, tracking pedestrians in indoor environments with Global Positioning System (GPS)-based schemes is still very challenging given the lack of enough
signals to locate the user. Along with indoor tracking, the ability to recognize pedestrian behavior and activities can lead to considerable growth in location-based applications including
pervasive healthcare, leisure and guide services (such as, museum, airports, stores, etc.), and emergency services, among the most important ones.
This thesis presents a …
Addressing User Requirements In Open Source Software: The Role Of Online Forums, Arif Raza, Luiz Fernando Capretz
Addressing User Requirements In Open Source Software: The Role Of Online Forums, Arif Raza, Luiz Fernando Capretz
Electrical and Computer Engineering Publications
User satisfaction has always been important in the success of software, regardless of whether it is closed and proprietary or open source software (OSS). OSS users are geographically distributed and include technical as well as novice users. However, it is generally believed that if OSS was more usable, its popularity would increase tremendously. Hence, users and their requirements need to be addressed in the priorities of an OSS environment. Online public forums are a major medium of communication for the OSS community. The research model of this work studies the relationship between user requirements in open source software and online …
Conception, Design And Construction Of A Remote Wifi Vehicle Using Arduino, Clayton Broman
Conception, Design And Construction Of A Remote Wifi Vehicle Using Arduino, Clayton Broman
Physics
The scope of this senior project was to make a wireless vehicle controlled via Internet Protocol. This vehicle operates remotely and without direct line of sight. Commands are sent from a program running on a laptop and transmitted using a wireless router. Visual data is retrieved from a network camera, mounted on the vehicle, in real-time, to see where you are going.
A Review Of Active Management For Distribution Networks: Current Status And Future Development Trends, Junhui Zhao, Bo Zhao, Feng Lin, Quan Zhou, Yang Wang, Caisheng Wang
A Review Of Active Management For Distribution Networks: Current Status And Future Development Trends, Junhui Zhao, Bo Zhao, Feng Lin, Quan Zhou, Yang Wang, Caisheng Wang
Electrical & Computer Engineering and Computer Science Faculty Publications
Driven by smart distribution technologies, by the widespread use of distributed generation sources, and by the injection of new loads, such as electric vehicles, distribution networks are evolving from passive to active. The integration of distributed generation, including renewable distributed generation changes the power flow of a distribution network from unidirectional to bi-directional. The adoption of electric vehicles makes the management of distribution networks even more challenging. As such, an active network management has to be fulfilled by taking advantage of the emerging techniques of control, monitoring, protection, and communication to assist distribution network operators in an optimal manner. This …
Sampled Fictitious Play For Multi-Action Stochastic Dynamic Programs, Archis Ghate, Shih-Fen Cheng, Stephen Baumert, Daniel Reaume, Dushyant Sharma, Robert L. Smith
Sampled Fictitious Play For Multi-Action Stochastic Dynamic Programs, Archis Ghate, Shih-Fen Cheng, Stephen Baumert, Daniel Reaume, Dushyant Sharma, Robert L. Smith
Research Collection School Of Computing and Information Systems
We introduce a class of finite-horizon dynamic optimization problems that we call multi-action stochastic dynamic programs (DPs). Their distinguishing feature is that the decision in each state is a multi-dimensional vector. These problems can in principle be solved using Bellman's backward recursion. However, complexity of this procedure grows exponentially in the dimension of the decision vectors. This is called the curse of action-space dimensionality. To overcome this computational challenge, we propose an approximation algorithm rooted in the game theoretic paradigm of Sampled Fictitious Play (SFP). SFP solves a sequence of DPs with a one-dimensional action-space, which are exponentially smaller than …
Nanosensor Data Processor In Quantum-Dot Cellular Automata, Fenghui Yao, Mohamed Saleh Zein-Sabatto, Guifeng Shao, Mohammad Bodruzzaman, Mohan Malkani
Nanosensor Data Processor In Quantum-Dot Cellular Automata, Fenghui Yao, Mohamed Saleh Zein-Sabatto, Guifeng Shao, Mohammad Bodruzzaman, Mohan Malkani
Computer Science Faculty Research
Quantum-dot cellular automata (QCA) is an attractive nanotechnology with the potential alterative to CMOS technology. QCA provides an interesting paradigm for faster speed, smaller size, and lower power consumption in comparison to transistor-based technology, in both communication and computation. This paper describes the design of a 4-bit multifunction nanosensor data processor (NSDP). The functions of NSDP contain (i) sending the preprocessed raw data to high-level processor, (ii) counting the number of the active majority gates, and (iii) generating the approximate sigmoid function. The whole system is designed and simulated with several different input data.
Scheduling And Resource Allocation In Wireless Sensor Networks, Yosef Alayev
Scheduling And Resource Allocation In Wireless Sensor Networks, Yosef Alayev
Dissertations, Theses, and Capstone Projects
In computer science and telecommunications, wireless sensor networks are an active research area. Each sensor in a wireless sensor network has some pre-defined or on demand tasks such as collecting or disseminating data. Network resources, such as broadcast channels, number of sensors, power, battery life, etc., are limited. Hence, a schedule is required to optimally allocate network resources so as to maximize some profit or minimize some cost. This thesis focuses on scheduling problems in the wireless sensor networks environment. In particular, we study three scheduling problems in the wireless sensor networks: broadcast scheduling, sensor scheduling for area monitoring, and …
Building Thinc: User Incentivization And Meeting Rescheduling For Energy Savings, Jun Young Kwak, Debarun Kar, William Haskell, Pradeep Reddy Varakantham, Milind Tambe
Building Thinc: User Incentivization And Meeting Rescheduling For Energy Savings, Jun Young Kwak, Debarun Kar, William Haskell, Pradeep Reddy Varakantham, Milind Tambe
Research Collection School Of Computing and Information Systems
This paper presents THINC, an agent developed for saving energy in real-world commercial buildings. While previous work has presented techniques for computing energy-efficient schedules, it fails to address two issues, centered on human users, that are essential in real-world agent deployments: (i) incentivizing users for their energy saving activities and (ii) interacting with users to reschedule key “energy-consuming” meetings in a timely fashion, while handling the uncertainty in such interactions. THINC addresses these shortcomings by providing four new major contributions. First, THINC computes fair division of credits from energy savings. For this fair division, THINC provides novel algorithmic advances for …
Los And Nlos Classification For Underwater Acoustic Localization, Roee Diamant, Hwee-Pink Tan, Lutz Lampe
Los And Nlos Classification For Underwater Acoustic Localization, Roee Diamant, Hwee-Pink Tan, Lutz Lampe
Research Collection School Of Computing and Information Systems
The low sound speed in water makes propagation delay (PD)-based range estimation attractive for underwater acoustic localization (UWAL). However, due to the long channel impulse response and the existence of reflectors, PD-based UWAL suffers from significant degradation when PD measurements of nonline-of-sight (NLOS) communication links are falsely identified as line-of-sight (LOS). In this paper, we utilize expected variation of PD measurements due to mobility of nodes and present an algorithm to classify the former into LOS and NLOS links. First, by comparing signal strength-based and PD-based range measurements, we identify object-related NLOS (ONLOS) links, where signals are reflected from objects …
Providing Flexible File-Level Data Filtering For Big Data Analytics, Lei Xu, Ziling Huang, Hong Jiang, Lei Tian, David Swanson
Providing Flexible File-Level Data Filtering For Big Data Analytics, Lei Xu, Ziling Huang, Hong Jiang, Lei Tian, David Swanson
School of Computing: Technical Reports
The enormous amount of big data datasets impose the needs for effective data filtering technique to accelerate the analytics process. We propose a Versatile Searchable File System, VSFS, which provides a transparent, flexible and near real-time file-level data filtering service by searching files directly through the file system. Therefore, big data analytics applications can transparently utilize this filtering service without application modifications. A versatile index scheme is designed to adapt to the exploratory and ad-hoc nature of the big data analytics activities. Moreover, VSFS uses a RAM-based distributed architecture to perform file indexing. The evaluations driven by three real-world analytics …
Ivus Validation Of Patient Coronary Artery Lumen Area Obtained From Ct Images, Tong Luo, Thomas Wischgoll, Bon Kwon Koo, Yunlong Huo, Ghassan S. Kassab
Ivus Validation Of Patient Coronary Artery Lumen Area Obtained From Ct Images, Tong Luo, Thomas Wischgoll, Bon Kwon Koo, Yunlong Huo, Ghassan S. Kassab
Computer Science and Engineering Faculty Publications
Aims
Accurate computed tomography (CT)-based reconstruction of coronary morphometry (diameters, length, bifurcation angles) is important for construction of patient-specific models to aid diagnosis and therapy. The objective of this study is to validate the accuracy of patient coronary artery lumen area obtained from CT images based on intravascular ultrasound (IVUS).
Methods and Results
Morphometric data of 5 patient CT scans with 11 arteries from IVUS were reconstructed including the lumen cross sectional area (CSA), diameter and length. The volumetric data from CT images were analyzed at sub-pixel accuracy to obtain accurate vessel center lines and CSA. A new center line …
Scene-Dependent Human Intention Recognition For An Assistive Robotic System, Kester Duncan
Scene-Dependent Human Intention Recognition For An Assistive Robotic System, Kester Duncan
USF Tampa Graduate Theses and Dissertations
In order for assistive robots to collaborate effectively with humans for completing everyday tasks, they must be endowed with the ability to effectively perceive scenes and more importantly, recognize human intentions. As a result, we present in this dissertation a novel scene-dependent human-robot collaborative system capable of recognizing and learning human intentions based on scene objects, the actions that can be performed on them, and human interaction history. The aim of this system is to reduce the amount of human interactions necessary for communicating tasks to a robot. Accordingly, the system is partitioned into scene understanding and intention recognition modules. …
Model-Free Q-Learning Over Finite Horizon For Uncertain Linear Continuous-Time Systems, Hao Xu, S. Jagannathan
Model-Free Q-Learning Over Finite Horizon For Uncertain Linear Continuous-Time Systems, Hao Xu, S. Jagannathan
Electrical and Computer Engineering Faculty Research & Creative Works
In this paper, a novel optimal control over finite horizon has been introduced for linear continuous-time systems by using adaptive dynamic programming (ADP). First, a new time-varying Q-function parameterization and its estimator are introduced. Subsequently, Q-function estimator is tuned online by using both Bellman equation in integral form and terminal cost. Eventually, near optimal control gain is obtained by using the Q-function estimator. All the closed-loop signals are shown to be bounded by using Lyapunov stability analysis where bounds are functions of initial conditions and final time while the estimated control signal converges close to the optimal value. The simulation …
Event-Based Optimal Regulator Design For Nonlinear Networked Control Systems, Avimanyu Sahoo, Hao Xu, S. Jagannathan
Event-Based Optimal Regulator Design For Nonlinear Networked Control Systems, Avimanyu Sahoo, Hao Xu, S. Jagannathan
Electrical and Computer Engineering Faculty Research & Creative Works
This paper presents a novel stochastic event-based near optimal control strategy to regulate a networked control system (NCS) represented as an uncertain nonlinear continuous time system. An online stochastic actor-critic neural network (NN) based approach is utilized to achieve the near optimal regulation in the presence of network constraints, such as, network induced time-varying delays and random packet losses under event-based transmission of the feedback signals. The transformed nonlinear NCS in discrete-time after the incorporation the delays and packet losses are utilized for the actor-critic NN based controller design. To relax the knowledge of the control coefficient matrix, a NN …