Open Access. Powered by Scholars. Published by Universities.®

Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 91 - 108 of 108

Full-Text Articles in Engineering

Reinforcement Learning-Based Output Feedback Control Of Nonlinear Systems With Input Constraints, Pingan He, Jagannathan Sarangapani Feb 2005

Reinforcement Learning-Based Output Feedback Control Of Nonlinear Systems With Input Constraints, Pingan He, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

A novel neural network (NN) -based output feedback controller with magnitude constraints is designed to deliver a desired tracking performance for a class of multi-input-multi-output (MIMO) discrete-time strict feedback nonlinear systems. Reinforcement learning in discrete time is proposed for the output feedback controller, which uses three NN: 1) a NN observer to estimate the system states with the input-output data; 2) a critic NN to approximate certain strategic utility function; and 3) an action NN to minimize both the strategic utility function and the unknown dynamics estimation errors. The magnitude constraints are manifested as saturation nonlinearities in the output feedback …


Neural Network-Based Control Of Nonlinear Discrete-Time Systems In Non-Strict Form, Jagannathan Sarangapani, Zheng Chen, Pingan He Jan 2005

Neural Network-Based Control Of Nonlinear Discrete-Time Systems In Non-Strict Form, Jagannathan Sarangapani, Zheng Chen, Pingan He

Electrical and Computer Engineering Faculty Research & Creative Works

A novel reinforcement learning-based adaptive neural network (NN) controller, also referred as the adaptive-critic NN controller, is developed to deliver a desired tracking performance for a class of non-strict feedback nonlinear discrete-time systems in the presence of bounded and unknown disturbances. The adaptive critic NN controller architecture includes a critic NN and two action NNs. The critic NN approximates certain strategic utility function whereas the action neural networks are used to minimize both the strategic utility function and the unknown dynamics estimation errors. The NN weights are tuned online so as to minimize certain performance index. By using gradient descent-based …


Decentralized Discrete-Time Neural Network Controller For A Class Of Nonlinear Systems With Unknown Interconnections, Jagannathan Sarangapani Jan 2005

Decentralized Discrete-Time Neural Network Controller For A Class Of Nonlinear Systems With Unknown Interconnections, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

A novel decentralized neural network (NN) controller in discrete-time is designed for a class of uncertain nonlinear discrete-time systems with unknown interconnections. Neural networks are used to approximate both the uncertain dynamics of the nonlinear systems and the unknown interconnections. Only local signals are needed for the decentralized controller design and the stability of the overall system can be guaranteed using the Lyapunov analysis. Further, controller redesign for the original subsystems is not required when additional subsystems are appended. Simulation results demonstrate the effectiveness of the proposed controller. The NN does not require an offline learning phase and the weights …


A Robust Controller For The Manipulation Of Micro Scale Objects, Qinmin Yang, Jagannathan Sarangapani Jan 2005

A Robust Controller For The Manipulation Of Micro Scale Objects, Qinmin Yang, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

A suite of novel robust controllers is presented for the manipulation and handling of micro-scale objects in a micro-electromechanical system (MEMS) where adhesive, surface tension, friction and van der Waals forces are dominant. Moreover, these forces are typically unknown. The robust controller overcomes the unknown system dynamics and ensures the performance in the presence of actuator constraints by assuming that the upper bounds on these forces are known. On the other hand, for the robust adaptive controller, the unknown forces are estimated online. Using the Lyapunov approach, the uniformly ultimate boundedness (UUB) of the closed-loop manipulation error is shown for …


Energy-Efficient Rate Adaptation Mac Protocol For Ad Hoc Wireless Networks, Maciej Jan Zawodniok, Jagannathan Sarangapani Jan 2005

Energy-Efficient Rate Adaptation Mac Protocol For Ad Hoc Wireless Networks, Maciej Jan Zawodniok, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

Resource constraints in ad hoc wireless networks require that they are energy efficient during both transmission and rate adaptation. In this paper, we propose a novel energy-efficient rate adaptation protocol that selects modulation schemes online to maximize throughput based on channel state while saving energy. This protocol uses the distributed power control (DPC) algorithm (M. Zawodniok et al., 2004) to accurately determine the necessary transmission power and to reduce the energy consumption. Additionally, the transmission rate is altered using energy efficiency as a constraint to meet the required throughput, which is estimated with queue fill ratio. Moreover, back-off scheme is …


Predictive Congestion Control Mac Protocol For Wireless Sensor Networks, Maciej Jan Zawodniok, Jagannathan Sarangapani Jan 2005

Predictive Congestion Control Mac Protocol For Wireless Sensor Networks, Maciej Jan Zawodniok, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

Available congestion control schemes, for example transport control protocol (TCP), when applied to wireless networks results in a large number of packet drops, unfairness with a significant amount of wasted energy due to retransmissions. To fully utilize the hop by hop feedback information, a suite of novel, decentralized, predictive congestion control schemes are proposed for wireless sensor networks in concert with distributed power control (DPC). Besides providing energy efficient solution, embedded channel estimator in DPC predicts the channel quality. By using the channel quality and node queue utilizations, the onset of network congestion is predicted and congestion control is initiated. …


Block Phase Correlation-Based Automatic Drift Compensation For Atomic Force Microscopes, Qinmin Yang, Eric W. Bohannan, Jagannathan Sarangapani Jan 2005

Block Phase Correlation-Based Automatic Drift Compensation For Atomic Force Microscopes, Qinmin Yang, Eric W. Bohannan, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

Automatic nanomanipulation and nanofabrication with an Atomic Force Microscope (AFM) is a precursor for nanomanufacturing. In ambient conditions without stringent environmental controls, nanomanipulation tasks require extensive human intervention to compensate for the many spatial uncertainties of the AFM. Among these uncertainties, thermal drift is especially hard to solve because it tends to increase with time and cannot be compensated simultaneously by feedback. In this paper, an automatic compensation scheme is introduced to measure and estimate drift. This information can be subsequently utilized to compensate for the thermal drift so that a real-time controller for nanomanipulation can be designed as if …


Feedback Linearization Based Power System Stabilizer Design With Control Limits, Wenxin Liu, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Jagannathan Sarangapani Aug 2004

Feedback Linearization Based Power System Stabilizer Design With Control Limits, Wenxin Liu, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

In power system controls, simplified analytical models are used to represent the dynamics of power system and controller designs are not rigorous with no stability analysis. One reason is because the power systems are complex nonlinear systems which pose difficulty for analysis. This paper presents a feedback linearization based power system stabilizer design for a single machine infinite bus power system. Since practical operating conditions require the magnitude of control signal to be within certain limits, the stability of the control system under control limits is also analyzed. Simulation results under different kinds of operating conditions show that the controller …


Neural Network Stabilizing Control Of Single Machine Power System With Control Limits, Wenxin Liu, Jagannathan Sarangapani, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Mariesa Crow Jul 2004

Neural Network Stabilizing Control Of Single Machine Power System With Control Limits, Wenxin Liu, Jagannathan Sarangapani, Ganesh K. Venayagamoorthy, Donald C. Wunsch, Mariesa Crow

Electrical and Computer Engineering Faculty Research & Creative Works

Power system stabilizers are widely used to generate supplementary control signals for the excitation system in order to damp out the low frequency oscillations. This paper proposes a stable neural network (NN) controller for the stabilization of a single machine infinite bus power system. In the power system control literature, simplified analytical models are used to represent the power system and the controller designs are not based on rigorous stability analysis. This work overcomes the two major problems by using an accurate analytical model for controller development and presents the closed-loop stability analysis. The NN is used to approximate the …


Neural Network Controller For Manipulation Of Micro-Scale Objects, Vijayakumar Janardhan, Pingan He, Jagannathan Sarangapani Jan 2004

Neural Network Controller For Manipulation Of Micro-Scale Objects, Vijayakumar Janardhan, Pingan He, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

A novel reinforcement learning-based neural network (RLNN) controller is presented for the manipulation and handling of micro-scale objects in a microelectromechanical system (MEMS). In MEMS, adhesive, surface tension, friction and van der Waals forces are dominant. Moreover, these forces are typically unknown. The RLNN controller consists of an action NN for compensating the unkoown system dynamics, and a critic NN to tune the weights of the action NN. Using the Lyapunov approach, the uniformly ultimate houndedness (UUB) of the closed-loop tracking error and weight estimates are shown by using a novel weight updates. Simulation results are presented to substantiate the …


Distributed Power Control Of Cellular Networks In The Presence Of Channel Uncertainties, Maciej Jan Zawodniok, Q. Shang, Jagannathan Sarangapani Jan 2004

Distributed Power Control Of Cellular Networks In The Presence Of Channel Uncertainties, Maciej Jan Zawodniok, Q. Shang, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

A novel distributed power control (DPC) scheme for cellular networks in the presence of radio channel uncertainties such as path loss shadowing, and Rayleigh fading is presented. Since these uncertainties can attenuate the received signal strength and can cause variations in the received Signal-to-lnterference ratio (SIR), the proposed DPC scheme maintains a target SIR at the receiver provided the uncertainty is slowly varying with time. The DPC estimates the time varying nature of the channel quickly and uses the information to arrive at a suitable transmitter power value . Further, the standard assumption of a constant interference during a link's …


Adaptive Critic Neural Network-Based Object Grasping Control Using A Three-Finger Gripper, Gustavo Galan, Jagannathan Sarangapani Jan 2004

Adaptive Critic Neural Network-Based Object Grasping Control Using A Three-Finger Gripper, Gustavo Galan, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

Grasping of objects has been a challenging task for robots. The complex grasping task can be defined as object contact control and manipulation subtasks. In this paper, object contact control subtask is defined as the ability to follow a trajectory accurately by the fingers of a gripper. The object manipulation subtask is defined in terms of maintaining a predefined applied force by the fingers on the object. A sophisticated controller is necessary since the process of grasping an object without a priori knowledge of the object's size, texture, softness, gripper, and contact dynamics is rather difficult. Moreover, the object has …


Discrete-Time Neural Network Output Feedback Control Of Nonlinear Systems In Non-Strict Feedback Form, Pingan He, Jagannathan Sarangapani Jan 2004

Discrete-Time Neural Network Output Feedback Control Of Nonlinear Systems In Non-Strict Feedback Form, Pingan He, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

An adaptive neural network (NN)-based output feedback controller is proposed to deliver a desired tracking performance for a class of discrete-time nonlinear systems, which is represented in non-strict feedback form. The NN backstepping approach is utilized to design the adaptive output feedback controller consisting of: 1) a NN observer to estimate the system states with the input-output data, and 2) two NNs to generate the virtual and actual control inputs, respectively. The non-causal problem in the discrete-time backstepping design is avoided by using the universal NN approximator. The persistence excitation (PE) condition is relaxed both in the NN observer and …


Decentralized Neural Network Control Of A Class Of Large-Scale Systems With Unknown Interconnection, Wenxin Liu, Jagannathan Sarangapani, Donald C. Wunsch, Mariesa Crow Jan 2004

Decentralized Neural Network Control Of A Class Of Large-Scale Systems With Unknown Interconnection, Wenxin Liu, Jagannathan Sarangapani, Donald C. Wunsch, Mariesa Crow

Electrical and Computer Engineering Faculty Research & Creative Works

A novel decentralized neural network (DNN) controller is proposed for a class of large-scale nonlinear systems with unknown interconnections. The objective is to design a DNN for a class of large-scale systems which do not satisfy the matching condition requirement. The NNs are used to approximate the unknown subsystem dynamics and the interconnections. The DNN is designed using the back stepping methodology with only local signals for feedback. All of the signals in the closed loop (system states and weights estimation errors) are guaranteed to be uniformly ultimately bounded and eventually converge to a compact set.


Adaptive Force-Balancing Control Of Mems Gyroscope With Actuator Limits, Mohammed Hameed, Jagannathan Sarangapani Jan 2004

Adaptive Force-Balancing Control Of Mems Gyroscope With Actuator Limits, Mohammed Hameed, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

This work presents an adaptive force-balancing control (AFBC) scheme with actuator limits for a MEMS Z-axis gyroscope. The purpose of the adaptive force-balancing control is to identify major fabrication imperfections so that they are properly compensated unlike the case of conventional force-balancing controlled gyroscope. The proposed AFBC scheme controls the vibratory modes of the proof mass while ensuring that the control input satisfies the magnitude constraints and the performance of the gyroscope is enhanced in the presence of fabrication uncertainties. Consequently, commonly reported problems of MEMS gyroscope such as quadrature compensation, drive and sense axes frequency tuning are not needed …


Neuro Emission Controller For Minimizing Cyclic Dispersion In Spark Ignition Engines, Pingan He, Jagannathan Sarangapani Jan 2003

Neuro Emission Controller For Minimizing Cyclic Dispersion In Spark Ignition Engines, Pingan He, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

A novel neural network (NN) controller is developed to control spark ignition (SI) engines at extreme lean conditions. The purpose of neurocontroller is to reduce the cyclic dispersion at lean operation even when the engine dynamics are unknown. The stability analysis of the closed-loop control system is given and the boundedness of all signals is ensured. Results demonstrate that the cyclic dispersion is reduced significantly using the proposed controller. The neuro controller can also be extended to minimize engine emissions with high EGR levels, where similar complex cyclic dynamics are observed. Further, the proposed approach can be applied to control …


Rate-Based End-To-End Congestion Control Of Multimedia Traffic In Packet Switched Networks, Mingsheng Peng, S. R. Subramanya, Jagannathan Sarangapani Jan 2003

Rate-Based End-To-End Congestion Control Of Multimedia Traffic In Packet Switched Networks, Mingsheng Peng, S. R. Subramanya, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

This paper proposes an explicit rate-based end-to-end congestion control mechanism to alleviate congestion of multimedia traffic in packet switched networks such as the Internet. The congestion is controlled by adjusting the transmission rates of the sources in response to the feedback information from destination such as the buffer occupancy, packet arrival rate and service rate at the outgoing link, so that a desired quality of service (QoS) can be met. The QoS is defined in terms of packet loss ratio, transmission delay, power, and network utilization. Comparison studies demonstrate the effectiveness of the proposed scheme over New-Reno TCP (a variant …


Adaptive Critic-Based Neural Network Controller For Uncertain Nonlinear Systems With Unknown Deadzones, Pingan He, Jagannathan Sarangapani, S. N. Balakrishnan Jan 2002

Adaptive Critic-Based Neural Network Controller For Uncertain Nonlinear Systems With Unknown Deadzones, Pingan He, Jagannathan Sarangapani, S. N. Balakrishnan

Electrical and Computer Engineering Faculty Research & Creative Works

A multilayer neural network (NN) controller in discrete-time is designed to deliver a desired tracking performance for a class of nonlinear systems with input deadzones. This multilayer NN controller has an adaptive critic NN architecture with two NNs for compensating the deadzone nonlinearity and a third NN for approximating the dynamics of the nonlinear system. A reinforcement learning scheme in discrete-time is proposed for the adaptive critic NN deadzone compensator, where the learning is performed based on a certain performance measure, which is supplied from a critic. The adaptive generating NN rejects the errors induced by the deadzone whereas a …