Operations Research, Systems Engineering and Industrial Engineering Commons^™

Policy Gradient With Value Function Approximation For Collective Multiagent Planning, Duc Thien Nguyen, Akshat Kumar, Hoong Chuin Lau

Research Collection School Of Computing and Information Systems

Decentralized (PO)MDPs provide an expressive framework for sequential decision making in a multiagent system. Given their computational complexity, recent research has focused on tractable yet practical subclasses of Dec-POMDPs. We address such a subclass called CDec-POMDP where the collective behavior of a population of agents affects the joint-reward and environment dynamics. Our main contribution is an actor-critic (AC) reinforcement learning method for optimizing CDec-POMDP policies. Vanilla AC has slow convergence for larger problems. To address this, we show how a particular decomposition of the approximate action-value function over agents leads to effective updates, and also derive a new way to …

A Selective-Discrete Particle Swarm Optimization Algorithm For Solving A Class Of Orienteering Problems, Aldy Gunawan, Vincent F. Yu, Perwira Redi, Parida Jewpanya, Hoong Chuin Lau

Research Collection School Of Computing and Information Systems

This study addresses a class of NP-hard problem called the Orienteering Problem (OP), which belongs to a well-known class of vehicle routing problems. In the OP, a set of nodes that associated with a location and a score is given. The time required to travel between each pair of nodes is known in advance. The total travel time is limited by a predetermined time budget. The objective is to select a subset of nodes to be visited that maximizes the total collected score within a path. The Team OP (TOP) is an extension of OP that incorporates multiple paths. Another …

Efficient Gate System Operations For A Multipurpose Port Using Simulation Optimization, Ketki Kulkarni, Trong Khiem Tran, Hai Wang, Hoong Chuin Lau

Research Collection School Of Computing and Information Systems

Port capacity is determined by three major infrastructural resources namely, berths, yards and gates. Theadvertised capacity is constrained by the least of the capacities of the three resources. While a lot ofattention has been paid to optimizing berth and yard capacities, not much attention has been given toanalyzing the gate capacity. The gates are a key node between the land-side and sea-side operations in anocean-to-cities value chain. The gate system under consideration, located at an important port in an Asiancity, is a multi-class parallel queuing system with non-homogeneous Poisson arrivals. It is hard to obtaina closed form analytic approach for …

Improving Service Level Of Free-Floating Bike Sharing Systems, Aritra Pal

USF Tampa Graduate Theses and Dissertations

Bike Sharing is a sustainable mode of urban mobility, not only for regular commuters but also for casual users and tourists. Free-floating bike sharing (FFBS) is an innovative bike sharing model, which saves on start-up cost, prevents bike theft, and offers significant opportunities for smart management by tracking bikes in real-time with built-in GPS. Efficient management of a FFBS requires: 1) analyzing its mobility patterns and spatio-temporal imbalance of supply and demand of bikes, 2) developing strategies to mitigate such imbalances, and 3) understanding the causes of a bike getting damaged and developing strategies to minimize them. All of these …

A Decision Support Tool For Building Integrated Renewable Energy Microgrids Connected To A Smart Grid, Damilola A. Asaleye, Michael D. Murphy, Michael Breen

Publications

The objective of this study was to create a tool that will enable renewable energy microgrid (REμG) facility users to make informed decisions on the utilization of electrical power output from a building integrated REμG connected to a smart grid. A decision support tool for renewable energy microgrids (DSTREM) capable of predicting photovoltaic array and wind turbine power outputs was developed. The tool simulated users’ daily electricity consumption costs, avoided CO₂ emissions and incurred monetary income relative to the usage of the building integrated REμG connected to the national electricity smart grid. DSTREM forecasted climate variables, which were used …

Learning Curve Analysis Using Intensive Longitudinal And Cluster-Correlated Data, Xiao Zhong, Zeyi Sun, Haoyi Xiong, Neil Heffernan, Md Monirul Islam

Engineering Management and Systems Engineering Faculty Research & Creative Works

Intensive longitudinal and cluster-correlated data (ILCCD) can be generated in any situation where numerical or categorical characteristics of multiple individuals or study units are observed and measured at tens, hundreds, or thousands of occasions. The spacing of measurements in time for each individual can be regular or irregular, fixed or random, and the number of characteristics measured at each occasion may be few or many. Such data can also arise in situations involving continuous-time measurements of recurrent events. Generalized linear models (GLMs) are usually considered for the analysis of correlated non-normal data, while multivariate analysis of variance (MANOVA) is another …

Design The Capacity Of Onsite Generation System With Renewable Sources For Manufacturing Plant, Xiao Zhong, Md Monirul Islam, Haoyi Xiong, Zeyi Sun

Computer Science Faculty Research & Creative Works

The utilization of onsite generation system with renewable sources in manufacturing plants plays a critical role in improving the resilience, enhancing the sustainability, and bettering the cost effectiveness for manufacturers. When designing the capacity of onsite generation system, the manufacturing energy load needs to be met and the cost for building and operating such onsite system with renewable sources are two critical factors need to be carefully quantified. Due to the randomness of machine failures and the variation of local weather, it is challenging to determine the energy load and onsite generation supply at different time periods. In this paper, …

Combinatorial Auction For Transportation Matching Service: Formulation And Adaptive Large Neighborhood Search Heuristic, Baoxiang Li, Hoong Chuin Lau

Research Collection School Of Computing and Information Systems

This paper considers the problem of matching multiple shippers and multi-transporters for pickups and drop-offs, where the goal is to select a subset of group jobs (shipper bids) that maximizes profit. This is the underlying winner determination problem in an online auction-based vehicle sharing platform that matches transportation demand and supply, particularly in a B2B last-mile setting. Each shipper bid contains multiple jobs, and each job has a weight, volume, pickup location, delivery location and time window. On the other hand, each transporter bid specifies the vehicle capacity, available time periods, and a cost structure. This double-sided auction will be …

Emergency Diesel-Electric Generator Set Maintenance And Test Periodicity, Stephen John Fehr

Engineering Management & Systems Engineering Theses & Dissertations

Manufacturer and industry recommendations vary considerably for maintenance and tests of emergency diesel-electric generator sets in emergency standby duty. There is little consistency among generator sets of similar technology, and manufacturers and their representatives often provide contradictory guidance. As a result, periodicity of emergency diesel-electric generator set maintenance and tests varies considerably in practice. Utilizing the framework proposed and tested by Fehr (2014), this research developed a parametric regression survival model of the reliability of modern diesel-electric generator sets in emergency standby duty as a function of maintenance, age, and cumulative run hours. A survival regression technique leveraging Cox’s (1972) …

Split-Merge Model Of Workunit Replication In Distributed Computing, Alexander Rumyantsev, Srinivas R. Chakravarthy

Industrial & Manufacturing Engineering Presentations And Conference Materials

No abstract provided.

Numerical Methods For Nonlinear Optimal Control Problems And Their Applications In Indoor Climate Control, Runxin He

McKelvey School of Engineering Graduate Student Theses & Dissertations

Efficiency, comfort, and convenience are three major aspects in the design of control systems for residential Heating, Ventilation, and Air Conditioning (HVAC) units. In this dissertation, we study optimization-based algorithms for HVAC control that minimizes energy consumption while maintaining a desired temperature, or even human comfort in a room. Our algorithm uses a Computer Fluid Dynamics (CFD) model, mathematically formulated using Partial Differential Equations (PDEs), to describe the interactions between temperature, pressure, and air flow. Our model allows us to naturally formulate problems such as controlling the temperature of a small region of interest within a room, or to control …

Predictive Power And Validity Of Connectome Predictive Modeling: A Replication And Extension, Michael Wang, Joaquin Goni, Enrico Amico

The Summer Undergraduate Research Fellowship (SURF) Symposium

Neuroimaging, particularly functional magnetic resonance imaging (fMRI), is a rapidly growing research area and has applications ranging from disease classification to understanding neural development. With new advancements in imaging technology, researchers must employ new techniques to accommodate the influx of high resolution data sets. Here, we replicate a new technique: connectome-based predictive modeling (CPM), which constructs a linear predictive model of brain connectivity and behavior. CPM’s advantages over classic machine learning techniques include its relative ease of implementation and transparency compared to “black box” opaqueness and complexity. Is this method efficient, powerful, and reliable in the prediction of behavioral measures …

An Economic Analysis Of Residential Photovoltaic Systems With And Without Energy Storage, Rodney Moses Kizito

Graduate Theses and Dissertations

Residential photovoltaic (PV) systems serve as a source of electricity generation that is separate from the traditional utilities. Investor investment into residential PV systems provides several financial benefits such as federal tax credit incentives for installation, net metering credit from excess generated electricity added back to the grid, and savings in price per kilowatt-hour (kWh) from the PV system generation versus the increasing conventional utility price per kWh. As much benefit as stand-alone PV systems present, the incorporation of energy storage yields even greater benefits. Energy storage (ES) is capable of storing unused PV provided energy from daytime periods of …

Well-Tuned Algorithms For The Team Orienteering Problem With Time Windows, Aldy Gunawan, Hoong Chuin Lau, Pieter Vansteenwegen, Kun Lu

Research Collection School Of Computing and Information Systems

The Team Orienteering Problem with Time Windows (TOPTW) is the extension of the Orienteering Problem (OP) where each node is limited by a predefined time window during which the service has to start. The objective of the TOPTW is to maximize the total collected score by visiting a set of nodes with a limited number of paths. We propose two algorithms, Iterated Local Search and a hybridization of Simulated Annealing and Iterated Local Search (SAILS), to solve the TOPTW. As indicated in multiple research works on algorithms for the OP and its variants, determining appropriate parameter values in a statistical …

Shortest Path Problem Under Trapezoidal Neutrosophic Information, Florentin Smarandache, Said Broumi, Mohamed Talea, Assia Bakali

Branch Mathematics and Statistics Faculty and Staff Publications

In this research paper, a new approach is proposed for computing the shortest path length from source node to destination node in a neutrosophic environment. The edges of the network are assigned by trapezoidal fuzzy neutrosophic numbers. A numerical example is provided to show the performance of the proposed approach.

A Critical Path Problem Using Triangular Neutrosophic Number, Florentin Smarandache, Mai Mohamed, Yongquan Zhou, Mohamed Abdel-Baset

Branch Mathematics and Statistics Faculty and Staff Publications

The Critical Path Method (CPM) is one of several related techniques for planning and managing of complicated projects in real world applications. In many situations, the data obtained for decision makers are only approximate, which gives rise of neutrosophic critical path problem. In this paper, the proposed method has been made to find the critical path in network diagram, whose activity time uncertain. The vague parameters in the network are represented by triangular neutrosophic numbers, instead of crisp numbers. At the end of paper, two illustrative examples are provided to validate the proposed approach.

A Unified Framework For Vehicle Rerouting And Traffic Light Control To Reduce Traffic Congestion, Zhiguang Cao, Siwei Jiang, Jie Zhang, Hongliang Guo

Research Collection School Of Computing and Information Systems

As the number of vehicles grows rapidly each year, more and more traffic congestion occurs, becoming a big issue for civil engineers in almost all metropolitan cities. In this paper, we propose a novel pheromone-based traffic management framework for reducing traffic congestion, which unifies the strategies of both dynamic vehicle rerouting and traffic light control. Specifically, each vehicle, represented as an agent, deposits digital pheromones over its route, while roadside infrastructure agents collect the pheromones and fuse them to evaluate real-time traffic conditions as well as to predict expected road congestion levels in near future. Once road congestion is predicted, …

Ict Adoption And Use In Tanzania Smes, Cuthbert Msuya

Tanzania Journal of Engineering and Technology (TJET)

The purpose of this paper was to establish the status of ICTs adoption and use in Tanzania SMEs. Previously, it was shown that there is a shortage of comprehensive, accurate and up to date data on many aspects of the SMEs sector including the level of ICT adoption and use. This has affected government efforts aimed at development of this important sector in the economic development of the country. Results show that: (i) By year 2014, adoption of ICTs in SMEs had grown from almost non-existence in year 2004 to 80.1% computer technology use, and over 56.6% for use of …

Pedagogical Resources For Industrial Control Systems Security: Design, Implementation, Conveyance, And Evaluation, Guillermo A. Francia Iii, Greg Randall, Jay Snellen

Journal of Cybersecurity Education, Research and Practice

Industrial Control Systems (ICS), which are pervasive in our nation’s critical infrastructures, are becoming increasingly at risk and vulnerable to internal and external threats. It is imperative that the future workforce be educated and trained on the security of such systems. However, it is equally important that careful and deliberate considerations must be exercised in designing and implementing the educational and training activities that pertain to ICS. To that end, we designed and implemented pedagogical materials and tools to facilitate the teaching and learning processes in the area of ICS security. In this paper, we describe those resources, the professional …

Analysis Of A Potential A(H7n9) Influenza Pandemic Outbreak In The U.S., Walter A. Silva Sotillo

USF Tampa Graduate Theses and Dissertations

This dissertation presents a collection of manuscripts that describe development of models and model implementation to analyze impact of potential A(H7N9) pandemic influenza outbreak in the U.S. Though this virus is still only animal-to-human transmittable, it has potential to become human-to-human transmittable and trigger a pandemic. This work is motivated by the negative impact on human lives that this virus has already caused in China, and is intended to support public health officials in preparing to protect U.S. population from a potential outbreak of pandemic scale.

An agent-based (AB) simulation model is used to replicate the social dynamics of the …

Data Analysis And Processing Techniques For Remaining Useful Life Estimations, John Scott Bucknam

Theses and Dissertations

In the field of engineering, it is important to understand different engineering systems and components, not only in how they currently perform, but also how their performance degrades over time. This extends to the field of prognostics, which attempts to predict the future of a system or component based on its past and present states. A common problem in this field is the estimation of remaining useful life, or how long a system or component functionality will last. The well-known datasets for this problem are the PHM and C-MAPSS datasets. These datasets contain simulated sensor data for different turbofan engines …

A Multi-Agent System For Coordinating Vessel Traffic, Teck-Hou Teng, Hoong Chuin Lau, Akshat Kumar

Research Collection School Of Computing and Information Systems

Environmental, regulatory and resource constraints affects the safety and efficiency of vessels navigating in and out of the ports. Movement of vessels under such constraints must be coordinated for improving safety and efficiency. Thus, we frame the vessel coordination problem as a multi-agent path-finding (MAPF) problem. We solve this MAPF problem using a Coordinated Path-Finding (CPF) algorithm. Based on the local search paradigm, the CPF algorithm improves on the aggregated path quality of the vessels iteratively. Outputs of the CPF algorithm are the coordinated trajectories. The Vessel Coordination Module (VCM) described here is the module encapsulating our MAPF-based approach for …

Mapping And Integrating Value Creation Factors With Life-Cycle Stages For Sustainable Manufacturing, P. Bilge, S. Emec, G. Seliger, Ibrahim S. Jawahir

Institute for Sustainable Manufacturing Faculty Publications

Instead of implementing each element individually, engineers must be aware of multiple interactions among all major value creation factors and their life-cycle stages. Interactions are analyzed by a set of factors and hierarchical levels within a production system based on empirical observations and described in analytical models. Such analyses and missing information about the current condition of the system and its parts remain limited to addressing specific aspects of interactions among factors and stages for multiple decision making. To build a case-based scope addressing the interactions among a set of factors and life-cycle stages, a comprehensive approach for mapping and …

A Predictor Analysis Framework For Surface Radiation Budget Reprocessing Using Design Of Experiments, Patricia Allison Quigley

Engineering Management & Systems Engineering Theses & Dissertations

Earth’s Radiation Budget (ERB) is an accounting of all incoming energy from the sun and outgoing energy reflected and radiated to space by earth’s surface and atmosphere. The National Aeronautics and Space Administration (NASA)/Global Energy and Water Cycle Experiment (GEWEX) Surface Radiation Budget (SRB) project produces and archives long-term datasets representative of this energy exchange system on a global scale. The data are comprised of the longwave and shortwave radiative components of the system and is algorithmically derived from satellite and atmospheric assimilation products, and acquired atmospheric data. It is stored as 3-hourly, daily, monthly/3-hourly, and monthly averages of 1°x1° …

Role Of Requirements Engineering In Software Project’S Success, Sujatha Alla

Engineering Management & Systems Engineering Theses & Dissertations

Despite considerable time and resources spent on the initiation phase of software projects, discrepancies often exist between formal project documentation, customer requirements, and final project specifications. Such discrepancies in the requirements management process can have a very negative impact on final project outcomes. A Business Requirements Document (BRD) constitutes the formal software requirements documentation, which typically includes stakeholders’ needs and expectations and project scope while providing a clear project roadmap and project plan. According to IEEE standards, a BRD should be a structured document that includes specific elements such as functional and technical requirements while incorporating certain traits such as …

Multi-Plc Exercise Environments For Training Ics First Responders, Joseph K. Daoud

Theses and Dissertations

When systems are targeted by cyber attacks, cyber first responders must be able to react effectively, especially when dealing with critical infrastructure. Training for cyber first responders is lacking and most existing exercise platforms are expensive, inaccessible or ineffective. This paper presents a mobile training platform which incorporates a variety of programmable logic controllers into a single system which facilitates the development of the unique skills required of cyber first responders operating in the realm of industrial control systems. The platform is modeled after a jail in the northeastern United States and was developed to maximize realism. Example training scenarios …

An Efficient Approach To Model-Based Hierarchical Reinforcement Learning, Zhuoru Li, Akshay Narayan, Tze-Yun Leong

Research Collection School Of Computing and Information Systems

We propose a model-based approach to hierarchical reinforcement learning that exploits shared knowledge and selective execution at different levels of abstraction, to efficiently solve large, complex problems. Our framework adopts a new transition dynamics learning algorithm that identifies the common action-feature combinations of the subtasks, and evaluates the subtask execution choices through simulation. The framework is sample efficient, and tolerates uncertain and incomplete problem characterization of the subtasks. We test the framework on common benchmark problems and complex simulated robotic environments. It compares favorably against the stateof-the-art algorithms, and scales well in very large problems.

Decentralized Planning In Stochastic Environments With Submodular Rewards, Rajiv Ranjan Kumar, Pradeep Varakantham, Akshat Kumar

Research Collection School Of Computing and Information Systems

Decentralized Markov Decision Process (Dec-MDP) providesa rich framework to represent cooperative decentralizedand stochastic planning problems under transition uncertainty.However, solving a Dec-MDP to generate coordinatedyet decentralized policies is NEXP-Hard. Researchershave made significant progress in providing approximate approachesto improve scalability with respect to number ofagents. However, there has been little or no research devotedto finding guarantees on solution quality for approximateapproaches considering multiple (more than 2 agents)agents. We have a similar situation with respect to the competitivedecentralized planning problem and the StochasticGame (SG) model. To address this, we identify models in thecooperative and competitive case that rely on submodular rewards,where we show …

Dynamic Repositioning To Reduce Lost Demand In Bike Sharing Systems, Supriyo Ghosh, Pradeep Varakantham, Yossiri Adulyasak, Patrick Jaillet

Research Collection School Of Computing and Information Systems

Bike Sharing Systems (BSSs) are widely adopted in major cities of the world due to concerns associated with extensive private vehicle usage, namely, increased carbon emissions, traffic congestion and usage of nonrenewable resources. In a BSS, base stations are strategically placed throughout a city and each station is stocked with a pre-determined number of bikes at the beginning of the day. Customers hire the bikes from one station and return them at another station. Due to unpredictable movements of customers hiring bikes, there is either congestion (more than required) or starvation (fewer than required) of bikes at base stations. Existing …

Product Development Resilience Through Set-Based Design, Stephen H. Rapp

Wayne State University Dissertations

Often during a system Product Development program external factors or requirements change, forcing system design change. This uncertainty adversely affects program outcome, adding to development time and cost, production cost, and compromise to system performance. We present a development approach that minimizes the impacts, by considering the possibility of changes in the external factors and the implications of mid-course design changes. The approach considers the set of alternative designs and the burdens of a mid-course change from one design to another in determining the relative value of a specific design. The approach considers and plans parallel development of alternative designs …