Open Access. Powered by Scholars. Published by Universities.®

Operations Research, Systems Engineering and Industrial Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 7 of 7

Full-Text Articles in Operations Research, Systems Engineering and Industrial Engineering

An Enhanced Least-Squares Approach For Reinforcement Learning, Hailin Li, Cihan H. Dagli Jan 2003

An Enhanced Least-Squares Approach For Reinforcement Learning, Hailin Li, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

This paper presents an enhanced least-squares approach for solving reinforcement learning control problems. Model-free least-squares policy iteration (LSPI) method has been successfully used for this learning domain. Although LSPI is a promising algorithm that uses linear approximator architecture to achieve policy optimization in the spirit of Q-learning, it faces challenging issues in terms of the selection of basis functions and training samples. Inspired by orthogonal least-squares regression (OLSR) method for selecting the centers of RBF neural network, we propose a new hybrid learning method. The suggested approach combines LSPI algorithm with OLSR strategy and uses simulation as a tool to …


Combining Evolving Neural Network Classifiers Using Bagging, Sunghwan Sohn, Cihan H. Dagli Jan 2003

Combining Evolving Neural Network Classifiers Using Bagging, Sunghwan Sohn, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

The performance of the neural network classifier significantly depends on its architecture and generalization. It is usual to find the proper architecture by trial and error. This is time consuming and may not always find the optimal network. For this reason, we apply genetic algorithms to the automatic generation of neural networks. Many researchers have provided that combining multiple classifiers improves generalization. One of the most effective combining methods is bagging. In bagging, training sets are selected by resampling from the original training set and classifiers trained with these sets are combined by voting. We implement the bagging technique into …


Cooperative Cleaning For Distributed Autonomous Robot Systems Using Fuzzy Cognitive Maps, H. Subramanian, Cihan H. Dagli Jan 2003

Cooperative Cleaning For Distributed Autonomous Robot Systems Using Fuzzy Cognitive Maps, H. Subramanian, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

Cooperative Autonomous Cleaning is a simple challenge that can be implemented with the help of Fuzzy Cognitive Maps (FCM) by simulating the actual thinking process of the human. The human mind organizes its thoughts in priorities and this feature could be exploited well if a priori knowledge of the system exists. This technique has been attempted here for a DARS.


Emergence And Artificial Life, Nil H. Kilicay, Cihan H. Dagli Jan 2003

Emergence And Artificial Life, Nil H. Kilicay, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

This paper focuses on emergent phenomena and the utilization of computer simulations, basically agent-based modeling to understand emergent phenomena. Agent-based simulation models have a promising future in the social sciences, from management to economies, political science, sociology and anthropology. This paper attempts to realize their full scientific potential by reviewing recent applications in engineering management and addresses the set of challenges confronted by this method. Common methodology for constructing an agent-based model is also discussed with the aim of highlighting how artificial life and management can be brought together to develop decision making aid tools.


Web Personalization Using Neuro-Fuzzy Clustering Algorithms, Kartik Menon, Cihan H. Dagli Jan 2003

Web Personalization Using Neuro-Fuzzy Clustering Algorithms, Kartik Menon, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

Different users have different needs from the same web page and hence it is necessary to develop a system which understands the needs and demands of the users. Web server logs have abundant information about the nature of users accessing it. In this paper we discussed how to mine these web server logs for a given period of time using unsupervised and competitive learning algorithm like Kohonen''s self organizing maps (SOM) and interpreting those results using Unified distance Matrix (U-matrix). These algorithms help us in efficiently clustering users based on similar web access patterns and each cluster having users with …


Neuro Emission Controller For Minimizing Cyclic Dispersion In Spark Ignition Engines, Pingan He, Jagannathan Sarangapani Jan 2003

Neuro Emission Controller For Minimizing Cyclic Dispersion In Spark Ignition Engines, Pingan He, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

A novel neural network (NN) controller is developed to control spark ignition (SI) engines at extreme lean conditions. The purpose of neurocontroller is to reduce the cyclic dispersion at lean operation even when the engine dynamics are unknown. The stability analysis of the closed-loop control system is given and the boundedness of all signals is ensured. Results demonstrate that the cyclic dispersion is reduced significantly using the proposed controller. The neuro controller can also be extended to minimize engine emissions with high EGR levels, where similar complex cyclic dynamics are observed. Further, the proposed approach can be applied to control …


Rate-Based End-To-End Congestion Control Of Multimedia Traffic In Packet Switched Networks, Mingsheng Peng, S. R. Subramanya, Jagannathan Sarangapani Jan 2003

Rate-Based End-To-End Congestion Control Of Multimedia Traffic In Packet Switched Networks, Mingsheng Peng, S. R. Subramanya, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

This paper proposes an explicit rate-based end-to-end congestion control mechanism to alleviate congestion of multimedia traffic in packet switched networks such as the Internet. The congestion is controlled by adjusting the transmission rates of the sources in response to the feedback information from destination such as the buffer occupancy, packet arrival rate and service rate at the outgoing link, so that a desired quality of service (QoS) can be met. The QoS is defined in terms of packet loss ratio, transmission delay, power, and network utilization. Comparison studies demonstrate the effectiveness of the proposed scheme over New-Reno TCP (a variant …