Open Access. Powered by Scholars. Published by Universities.®

Operations Research, Systems Engineering and Industrial Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 29 of 29

Full-Text Articles in Operations Research, Systems Engineering and Industrial Engineering

Modeling And Simulation Of Microgrid, Ahmad Alzahrani, Mehdi Ferdowsi, Pourya Shamsi, Cihan H. Dagli Nov 2017

Modeling And Simulation Of Microgrid, Ahmad Alzahrani, Mehdi Ferdowsi, Pourya Shamsi, Cihan H. Dagli

Electrical and Computer Engineering Faculty Research & Creative Works

Complex computer systems and electric power grids share many properties of how they behave and how they are structured. A microgrid is a smaller electric grid that contains several homes, energy storage units, and distributed generators. The main idea behind microgrids is the ability to work even if the main grid is not supplying power. That is, the energy storage unit and distributed generation will supply power in that case, and if there is excess in power production from renewable energy sources, it will go to the energy storage unit. Therefore, the electric grid becomes decentralized in terms of control …


Classification Of Rest And Active Periods In Actigraphy Data Using Pca, Isaac W. Muns, Yogesh Lad, Ivan G. Guardiola, Matthew S. Thimgan Nov 2017

Classification Of Rest And Active Periods In Actigraphy Data Using Pca, Isaac W. Muns, Yogesh Lad, Ivan G. Guardiola, Matthew S. Thimgan

Engineering Management and Systems Engineering Faculty Research & Creative Works

In this paper we highlight a clustering algorithm for the purpose of identifying sleep and wake periods directly from actigraphy signals. The paper makes use of statistical Principal Component Analysis to identify periods of rest and activity. The aim of the proposed methodology is to develop a quick and efficient method to determine the sleep duration of an individual. In addition, a robust method that can identify sleep periods in the accelerometer data when duration, time of day varies by individual. A selected group of 10 individual's sensor data consisting of actigraphy from an accelerometer (3-axis), near body temperature, and …


A General Algorithm For Assessing Product Architecture Performance Considering Architecture Extension In Cyber Manufacturing, Md Monirul Islam, Zeyi Sun, Cihan H. Dagli Nov 2017

A General Algorithm For Assessing Product Architecture Performance Considering Architecture Extension In Cyber Manufacturing, Md Monirul Islam, Zeyi Sun, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

In modern manufacturing, the product architecture design options are usually restricted to those that can be produced with 100% confidence using those proven technologies to satisfy the existing customer requirement. As a result, the inefficiencies of architecture design are considerable due to such limitations. This issue is of particular interests in cyber manufacturing when exploring the tradeoff between generality and feasibility in product design and manufacturing. It can be expected that the improvement and extension of the existing product architecture may be required to meet new customer requirement when new technologies become available. An effective system performance assessment algorithm is …


Energy Consumption Modeling Of Stereolithography-Based Additive Manufacturing Toward Environmental Sustainability, Yiran Yang, Lin Li, Yayue Pan, Zeyi Sun Nov 2017

Energy Consumption Modeling Of Stereolithography-Based Additive Manufacturing Toward Environmental Sustainability, Yiran Yang, Lin Li, Yayue Pan, Zeyi Sun

Engineering Management and Systems Engineering Faculty Research & Creative Works

Additive manufacturing (AM), also referred as three-dimensional printing or rapid prototyping, has been implemented in various areas as one of the most promising new manufacturing technologies in the past three decades. In addition to the growing public interest in developing AM into a potential mainstream manufacturing approach, increasing concerns on environmental sustainability, especially on energy consumption, have been presented. To date, research efforts have been dedicated to quantitatively measuring and analyzing the energy consumption of AM processes. Such efforts only covered partial types of AM processes and explored inadequate factors that might influence the energy consumption. In addition, energy consumption …


Learning Curve Analysis Using Intensive Longitudinal And Cluster-Correlated Data, Xiao Zhong, Zeyi Sun, Haoyi Xiong, Neil Heffernan, Md Monirul Islam Nov 2017

Learning Curve Analysis Using Intensive Longitudinal And Cluster-Correlated Data, Xiao Zhong, Zeyi Sun, Haoyi Xiong, Neil Heffernan, Md Monirul Islam

Engineering Management and Systems Engineering Faculty Research & Creative Works

Intensive longitudinal and cluster-correlated data (ILCCD) can be generated in any situation where numerical or categorical characteristics of multiple individuals or study units are observed and measured at tens, hundreds, or thousands of occasions. The spacing of measurements in time for each individual can be regular or irregular, fixed or random, and the number of characteristics measured at each occasion may be few or many. Such data can also arise in situations involving continuous-time measurements of recurrent events. Generalized linear models (GLMs) are usually considered for the analysis of correlated non-normal data, while multivariate analysis of variance (MANOVA) is another …


Reward/Penalty Design In Demand Response For Mitigating Overgeneration Considering The Benefits From Both Manufacturers And Utility Company, Md Monirul Islam, Zeyi Sun, Cihan H. Dagli Nov 2017

Reward/Penalty Design In Demand Response For Mitigating Overgeneration Considering The Benefits From Both Manufacturers And Utility Company, Md Monirul Islam, Zeyi Sun, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

The high penetration of renewable sources in electricity grid has led to significant economic, environmental, and societal benefits. However, one major side effect, overgeneration, due to the uncontrollable property of renewable sources has also emerged, which becomes one of the major challenges that impedes the further large-scale adoption of renewable technology. Electricity demand response is an effective tool that can balance the supply and demand of the electricity throughout the grid. In this paper, we focus on the design of reward/penalty mechanism for the demand response programs aiming to mitigate the overgeneration. The benefits for both manufacturers and utility companies …


Analysis Of Autonomous Unmanned Aerial Systems Based On Operational Scenarios Using Value Modelling, Akash Vidyadharan, Robert Philpott Iii, Benjamin J. Kwasa, Christina L. Bloebaum Nov 2017

Analysis Of Autonomous Unmanned Aerial Systems Based On Operational Scenarios Using Value Modelling, Akash Vidyadharan, Robert Philpott Iii, Benjamin J. Kwasa, Christina L. Bloebaum

Engineering Management and Systems Engineering Faculty Research & Creative Works

In recent years, the use of UAS (Unmanned Aerial Systems) has moved beyond the realm of military operations and has made its way into the hands of consumers and commercial industries. Although the applications of UAS in commercial industries are virtually endless, there are many issues regarding their operations that need to be considered before these valuable pieces of equipment are allowed for widespread civil use. Currently, UAS operations in the public domain are guided and controlled by the FAA Part 107 rules after overwhelming public pressure caused by the earlier 333 exemption. In order to approach such larger issues, …


Chaotic Behavior In High-Gain Interleaved Dc-Dc Converters, Ahmad Alzahrani, Pourya Shamsi, Mehdi Ferdowsi, Cihan H. Dagli Nov 2017

Chaotic Behavior In High-Gain Interleaved Dc-Dc Converters, Ahmad Alzahrani, Pourya Shamsi, Mehdi Ferdowsi, Cihan H. Dagli

Electrical and Computer Engineering Faculty Research & Creative Works

In this paper, chaotic behavior in high gain dc-dc converters with current mode control is explored. The dc-dc converters exhibit some chaotic behavior because they contain switches. Moreover, in power electronics (circuits with more passive elements), the dynamics become rich in nonlinearity and become difficult to capture with linear analytical models. Therefore, studying modeling approaches and analysis methods is required. Most of the high-gain dc-dc boost converters cannot be controlled with only voltage mode control due to the presence of right half plane zero that narrows down the stability region. Therefore, the need of current mode control is necessary to …


Design The Capacity Of Onsite Generation System With Renewable Sources For Manufacturing Plant, Xiao Zhong, Md Monirul Islam, Haoyi Xiong, Zeyi Sun Nov 2017

Design The Capacity Of Onsite Generation System With Renewable Sources For Manufacturing Plant, Xiao Zhong, Md Monirul Islam, Haoyi Xiong, Zeyi Sun

Computer Science Faculty Research & Creative Works

The utilization of onsite generation system with renewable sources in manufacturing plants plays a critical role in improving the resilience, enhancing the sustainability, and bettering the cost effectiveness for manufacturers. When designing the capacity of onsite generation system, the manufacturing energy load needs to be met and the cost for building and operating such onsite system with renewable sources are two critical factors need to be carefully quantified. Due to the randomness of machine failures and the variation of local weather, it is challenging to determine the energy load and onsite generation supply at different time periods. In this paper, …


Solar Irradiance Forecasting Using Deep Neural Networks, Ahmad Alzahrani, Pourya Shamsi, Cihan H. Dagli, Mehdi Ferdowsi Nov 2017

Solar Irradiance Forecasting Using Deep Neural Networks, Ahmad Alzahrani, Pourya Shamsi, Cihan H. Dagli, Mehdi Ferdowsi

Electrical and Computer Engineering Faculty Research & Creative Works

Predicting solar irradiance has been an important topic in renewable energy generation. Prediction improves the planning and operation of photovoltaic systems and yields many economic advantages for electric utilities. The irradiance can be predicted using statistical methods such as artificial neural networks (ANN), support vector machines (SVM), or autoregressive moving average (ARMA). However, they either lack accuracy because they cannot capture long-term dependency or cannot be used with big data because of the scalability. This paper presents a method to predict the solar irradiance using deep neural networks. Deep recurrent neural networks (DRNNs) add complexity to the model without specifying …


Rethinking The Design Of Low-Cost Point-Of-Care Diagnostic Devices, Faith W. Kimani, Samuel M. Mwangi, Benjamin J. Kwasa, Abdi M. Kusow, Benjamin K. Ngugi, Jiahao Chen, Xinyu Liu, Rebecca Cademartiri, Martin M. Thuo Oct 2017

Rethinking The Design Of Low-Cost Point-Of-Care Diagnostic Devices, Faith W. Kimani, Samuel M. Mwangi, Benjamin J. Kwasa, Abdi M. Kusow, Benjamin K. Ngugi, Jiahao Chen, Xinyu Liu, Rebecca Cademartiri, Martin M. Thuo

Engineering Management and Systems Engineering Faculty Research & Creative Works

Reducing the global diseases burden requires effective diagnosis and treatment. In the developing world, accurate diagnosis can be the most expensive and time-consuming aspect of health care. Healthcare cost can, however, be reduced by use of affordable rapid diagnostic tests (RDTs). In the developed world, low-cost RDTs are being developed in many research laboratories; however, they are not being equally adopted in the developing countries. This disconnect points to a gap in the design philosophy, where parameterization of design variables ignores the most critical component of the system, the point-of-use stakeholders (e.g., doctors, nurses and patients). Herein, we demonstrated that …


Engineering Cyber Physical Systems: Preface, Cihan H. Dagli Oct 2017

Engineering Cyber Physical Systems: Preface, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

Multi-faceted systems of the future will entail complex logic with many levels of reasoning in intricate arrangement. The organization of these systems involves a web of connections and demonstrates self-driven adaptability. They are designed for autonomy and may exhibit emergent behavior that can be visualized.

Complex Adaptive Systems have dynamically changing meta-architectures. Finding an optimal architecture for these systems is a multi-criteria decision making problem often involving many objectives in the order of 20 or more. This creates "Pareto Breakdown" which prevents ordinary multi-objective optimization approaches from effectively searching for an optimal solution; saturating the decision maker with large sets …


Establishing Rules For Self-Organizing Systems-Of-Systems, David M. Curry, Cihan H. Dagli Oct 2017

Establishing Rules For Self-Organizing Systems-Of-Systems, David M. Curry, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

Self-organizing systems-of-systems offer the possibility of autonomously adapting to new circumstances and tasking. This could significantly benefit large endeavors such as smart cities and national defense by increasing the probability that new situations are expediently handled. Complex self-organizing behaviors can be produced by a large set of individual agents all following the same simple set of rules. While biological rule sets have application in achieving human goals, other rules sets may be necessary as these goals are not necessarily mirrored in nature. To this end, a set of system, rather than biologically, inspired rules is introduced and an agent-based model …


Instance Selection Using Genetic Algorithms For An Intelligent Ensemble Trading System, Youngmin Kim, David Lee Enke Oct 2017

Instance Selection Using Genetic Algorithms For An Intelligent Ensemble Trading System, Youngmin Kim, David Lee Enke

Engineering Management and Systems Engineering Faculty Research & Creative Works

Instance selection is a way to remove unnecessary data that can adversely affect the prediction model, thereby selecting representative and relevant data from the original data set that is expected to improve predictive performance. Instance selection plays an important role in improving the scalability of data mining algorithms and has also proven to be successful over a wide range of classification problems. However, instance selection using an evolutionary approach, as proposed in this study, is different from previous methods that have focused on improving accuracy performance in the stock market (i.e., Up or Down forecast). In fact, we propose a …


Time Series Classification Using Deep Learning For Process Planning: A Case From The Process Industry, Nijat Mehdiyev, Johannes Lahann, Andreas Emrich, David Lee Enke, Peter Fettke, Peter Loos Oct 2017

Time Series Classification Using Deep Learning For Process Planning: A Case From The Process Industry, Nijat Mehdiyev, Johannes Lahann, Andreas Emrich, David Lee Enke, Peter Fettke, Peter Loos

Engineering Management and Systems Engineering Faculty Research & Creative Works

Multivariate time series classification has been broadly applied in diverse domains over the past few decades. However, before applying the classification algorithms, the vast majority of current studies extract hand-engineered features that are assumed to detect local patterns in the time series. Therefore, the efficiency and precision of these classification approaches are heavily dependent on the quality of variables defined by domain experts. Recent improvements in the deep learning domain offer opportunities to avoid such an intensive hand-crafted feature engineering which is particularly important for managing the processes based on time-series data obtained from various sensor networks. In our paper, …


Loading Time Flexibility In Cross-Docking Systems, Dincer Konur, Mihalis M. Golias Sep 2017

Loading Time Flexibility In Cross-Docking Systems, Dincer Konur, Mihalis M. Golias

Engineering Management and Systems Engineering Faculty Research & Creative Works

In this study, we investigate truck-to-door assignment problem for loading outgoing trucks in a cross-docking system with flexible handling times. Specifically, a truck's loading time depends on the number of workers assigned to the outbound door, where the truck is being loaded. An optimization problem is formulated to jointly determine the number of workers and the trucks to be loaded at each door. The resulting problem is a nonlinear integer programming model. Due to the complexity of this model, two evolutionary heuristic methods are proposed for solution. First heuristic method is based on truck assignments while the second heuristic is …


Using The Voice Of The Student To Evaluate Learning Management Systems, Elizabeth A. Cudney, Susan L. Murray, Brittany Groner, Katie M. Kaczmarek, Bonnie Wilt, Kamaria Blaney, Julie Phelps Jun 2017

Using The Voice Of The Student To Evaluate Learning Management Systems, Elizabeth A. Cudney, Susan L. Murray, Brittany Groner, Katie M. Kaczmarek, Bonnie Wilt, Kamaria Blaney, Julie Phelps

Engineering Management and Systems Engineering Faculty Research & Creative Works

A learning management system is an educational tool employed in higher education to organize, document, track, report, and deliver courses. Selecting the appropriate learning management system is a critical decision for a university. This study explores the usability of two leading systems, Blackboard and Canvas, from the students’ perspective. The goal is to gather and analyze user preferences in order to select an appropriate learning management system. Data was collected through surveys of student’s experience with the two learning management systems. The survey evaluated the ease of the following tasks: finding course documents, viewing grades, ease of navigation, intuitiveness, and …


Work Zone Simulator Analysis: Driver Performance And Acceptance Of Missouri Alternate Lane Shift Configurations, Suzanna Long, Ruwen Qin, Dincer Konur, Ming-Chuan Leu, S. Moradpour, S. Thind, H. Nadathur Feb 2017

Work Zone Simulator Analysis: Driver Performance And Acceptance Of Missouri Alternate Lane Shift Configurations, Suzanna Long, Ruwen Qin, Dincer Konur, Ming-Chuan Leu, S. Moradpour, S. Thind, H. Nadathur

Engineering Management and Systems Engineering Faculty Research & Creative Works

The objective of this project is to evaluate MoDOT’s alternate lane shift sign configuration for work zones. The single signproposed by MoDOT provides the traveler with enough information to let them know that all lanes are available to shift around thework zone, whereas the MUTCD signs require drivers to see two signs. This research simulation project evaluates the drivers’ laneshifting performance and acceptance of the alternate lane shift sign proposed by MoDOT to be used on work zones as compared tothe MUTCD lane shift signs. Based on the study results, no difference was observed between MUTCD lane shift sign andMoDOT …


Attitudes Towards Face-To-Face Meetings In Virtual Engineering Teams: Perceptions From A Survey Of Defense Projects, Lawrence R. Blenke, Abhijit Gosavi, William Daughton Jan 2017

Attitudes Towards Face-To-Face Meetings In Virtual Engineering Teams: Perceptions From A Survey Of Defense Projects, Lawrence R. Blenke, Abhijit Gosavi, William Daughton

Engineering Management and Systems Engineering Faculty Research & Creative Works

Modes of communication used in virtual defense projects have changed dramatically over the years with tools such as email and video-conferencing dominating face-to-face (FTF) meetings. We conducted a survey at a defense firm with an aim to test current attitudes towards FTF meetings – with respect to significant problems faced, project success, transfer of technical requirements, preference for FTF vis-à-vis virtual meetings, differences between virtual and co-located environments, criticality of various forms of communication, and whether FTF meetings were scheduled as often as desired. Our survey participants, about one hundred in number, were experienced engineers, technicians, and program managers – …


A Practical Approach To Evaluating The Economic And Technical Feasibility Of Led Luminaires, Sean M. Schmidt, Suzanna Long Jan 2017

A Practical Approach To Evaluating The Economic And Technical Feasibility Of Led Luminaires, Sean M. Schmidt, Suzanna Long

Engineering Management and Systems Engineering Faculty Research & Creative Works

LED roadway luminaires are currently under consideration for widespread implementation with departments of transportation, facilities managers, and city planners. This research focuses on a case study in Missouri and presents relevant research findings calculated by the authors as part of a project funded by the Missouri Department of Transportation. Although high-pressure sodium (HPS) luminaires have been the standard product for roadway illumination, advances in LED technologies have led many departments of transportation to consider them as viable options along state routes. For this case study, pilot sites were developed across the state of Missouri in sites assessed as moderately busy, …


Multi-Objective Combinatorial Optimization Problems In Transportation And Defense Systems, Hadi Farhangi Jan 2017

Multi-Objective Combinatorial Optimization Problems In Transportation And Defense Systems, Hadi Farhangi

Doctoral Dissertations

"Multi-objective Optimization problems arise in many applications; hence, solving them efficiently is important for decision makers. A common procedure to solve such problems is to generate the exact set of Pareto efficient solutions. However, if the problem is combinatorial, generating the exact set of Pareto efficient solutions can be challenging. This dissertation is dedicated to Multi-objective Combinatorial Optimization problems and their applications in system of systems architecting and railroad track inspection scheduling. In particular, multi-objective system of systems architecting problems with system flexibility and performance improvement funds have been investigated. Efficient solution methods are proposed and evaluated for not only …


Cognition-Based Approaches For High-Precision Text Mining, George John Shannon Jan 2017

Cognition-Based Approaches For High-Precision Text Mining, George John Shannon

Doctoral Dissertations

"This research improves the precision of information extraction from free-form text via the use of cognitive-based approaches to natural language processing (NLP). Cognitive-based approaches are an important, and relatively new, area of research in NLP and search, as well as linguistics. Cognitive approaches enable significant improvements in both the breadth and depth of knowledge extracted from text. This research has made contributions in the areas of a cognitive approach to automated concept recognition in.

Cognitive approaches to search, also called concept-based search, have been shown to improve search precision. Given the tremendous amount of electronic text generated in our digital …


Micro-Grid Implementation Of A Rooftop Photovoltaic System, Pranav Nitin Godse Jan 2017

Micro-Grid Implementation Of A Rooftop Photovoltaic System, Pranav Nitin Godse

Masters Theses

"In recent years, solar power has been a popular form of renewable energy. This research conducts a cost analysis in implementing a rooftop photovoltaic system as part of an energy management schema for a university campus. The proposed system would be installed on the roof of one of the largest buildings on campus at Missouri University of Science and Technology, Toomey Hall; the objective function of the research involves reducing dependence on conventional energy sources on campus. Toomey Hall houses the Department of Mechanical and Aerospace Engineering (MAE) and is the largest academic unit on campus. Considering the vast expanse …


Data Analysis Of Lane Merge And Lane Shift Sign Configurations In A Freeway Workzone, Satwinder Singh Thind Jan 2017

Data Analysis Of Lane Merge And Lane Shift Sign Configurations In A Freeway Workzone, Satwinder Singh Thind

Masters Theses

"In this study, driver responses to alternative lane shift and lane merge signs are analyzed and compared using a driving simulation system. In particular, driver responses to the lane merge signs proposed by the Missouri Department of Transportation (MoDOT) are compared to the current lane merge signs recommended by the Manual on Uniform Traffic Control Devices (MUTCD) and driver responses to the lane shift signs proposed by MoDOT are compared to current lane shift signs recommended by MUTCD. The driving simulation system is composed of a driving simulator and a PC with data recording program such that the position coordinates, …


A Bounded Actor-Critic Algorithm For Reinforcement Learning, Ryan Jacob Lawhead Jan 2017

A Bounded Actor-Critic Algorithm For Reinforcement Learning, Ryan Jacob Lawhead

Masters Theses

"This thesis presents a new actor-critic algorithm from the domain of reinforcement learning to solve Markov and semi-Markov decision processes (or problems) in the field of airline revenue management (ARM). The ARM problem is one of control optimization in which a decision-maker must accept or reject a customer based on a requested fare. This thesis focuses on the so-called single-leg version of the ARM problem, which can be cast as a semi-Markov decision process (SMDP). Large-scale Markov decision processes (MDPs) and SMDPs suffer from the curses of dimensionality and modeling, making it difficult to create the transition probability matrices (TPMs) …


Shortest-Distance And Minimum-Cost Self-Charging Path Problems: Formulations And Application, Marc Monroe Teeter Jan 2017

Shortest-Distance And Minimum-Cost Self-Charging Path Problems: Formulations And Application, Marc Monroe Teeter

Masters Theses

"In this study, self-charging paths for an electric bus are analyzed. Wireless-power-transfer technologies, when integrated on a road network, enable dynamic charging of electric vehicles. Roads implemented with a wireless-power-transfer technology are referred to as electric-roads in this study. Electric vehicles traversing on electric-roads, therefore, can be dynamically charged. This can further eliminate the need for static charging, i.e., the electric vehicle will not need to stop for charging.

This thesis analyzes the design of transit routes for an electric-bus so that the electric-bus is charged by only electric-roads. Specifically, the focus is on designing a path, which passes through …


Programming Problems On Time Scales: Theory And Computation, Rasheed Basheer Al-Salih Jan 2017

Programming Problems On Time Scales: Theory And Computation, Rasheed Basheer Al-Salih

Doctoral Dissertations

"In this dissertation, novel formulations for several classes of programming problems are derived and proved using the time scales technique. The new formulations unify the discrete and continuous programming models and extend them to other cases "in between." Moreover, the new formulations yield the exact optimal solution for the programming problems on arbitrary isolated time scales, which solve an important open problem. Throughout this dissertation, six distinct classes of programming problems are presented as follows. First, the primal as well as the dual time scales linear programming models on arbitrary time scales are formulated. Second, separated linear programming primal and …


Developing Restoration Schemes For A Road Transportation Network In The Event Of A Disaster, Ebin Antony Jan 2017

Developing Restoration Schemes For A Road Transportation Network In The Event Of A Disaster, Ebin Antony

Masters Theses

"Transportation systems such as rail, road, and waterways are key component of critical infrastructure systems, providing connectivity between other components to enable the production and distribution of goods and services. During large scale disasters such as earth quakes and floods, this connectivity is disrupted, restricting or completely halting the flow of goods and services. To ensure that the connectivity between the different modes of transportation are restored in an aftermath of these disruptions, the interdependence between them and the importance of individual elements to the overall connectivity have to be studied and formulated to develop a system-level restoration plan. This …


A New Reinforcement Learning Algorithm With Fixed Exploration For Semi-Markov Decision Processes, Angelo Michael Encapera Jan 2017

A New Reinforcement Learning Algorithm With Fixed Exploration For Semi-Markov Decision Processes, Angelo Michael Encapera

Masters Theses

"Artificial intelligence or machine learning techniques are currently being widely applied for solving problems within the field of data analytics. This work presents and demonstrates the use of a new machine learning algorithm for solving semi-Markov decision processes (SMDPs). SMDPs are encountered in the domain of Reinforcement Learning to solve control problems in discrete-event systems. The new algorithm developed here is called iSMART, an acronym for imaging Semi-Markov Average Reward Technique. The algorithm uses a constant exploration rate, unlike its precursor R-SMART, which required exploration decay. The major difference between R-SMART and iSMART is that the latter uses, in addition …