Convergence-Based Exploration Algorithm For Reinforcement Learning, 2019 Iowa State University
Convergence-Based Exploration Algorithm For Reinforcement Learning, Ala'eddin Masadeh, Zhengdao Wang, Ahmed E. Kamal
Reinforcement learning (RL) can be defined as a technique for learning in an unknown environment. Through learning, two main modes select actions, exploration and exploitation. The exploration is to investigate unexplored actions. The exploitation is to exploit current best actions. Balancing between exploration and exploitation is a challenge for RL. In this work, an exploration algorithm for RL is designed. This algorithm introduces two parameters for balancing purpose, which are the action-value function convergence error, and the exploration time threshold. The first parameter evaluates actions and selects the best ones based on the convergent values of their action-value functions. The ...
Reinforcement Learning Exploration Algorithms For Energy Harvesting Communications Systems, 2019 Iowa State University
Reinforcement Learning Exploration Algorithms For Energy Harvesting Communications Systems, Ala’Eddin Masadeh, Zhengdao Wang, Ahmed Kamal
Prolonging the lifetime, and maximizing the throughput are important factors in designing an efficient communications system, especially for energy harvesting-based systems. In this work, the problem of maximizing the throughput of point-to-point energy harvesting communications system, while prolonging its lifetime is investigated. This work considers more real communications system, where this system does not have a priori knowledge about the environment. This system consists of a transmitter and receiver. The transmitter is equipped with an infinite buffer to store data, and energy harvesting capability to harvest renewable energy and store it in a finite battery. The problem of finding an ...
Low Cost Vehicular Autonomy Using Radar And Gps, 2019 Cedarville University
Low Cost Vehicular Autonomy Using Radar And Gps, Nathan Jessurun, Ryan Gordon, Danielle Fredette
The Research and Scholarship Symposium
This presentation describes a subset of the systems devised for this year's autonomous golf cart senior design project. Our goal is to explore the possibilities of low cost autonomy using only radar and GPS for environmental sensing and navigation. Although autonomous and semi-autonomous ground vehicles are a relatively new reality, prototypes have been a subject of engineering research for decades, often utilizing an array of sensors and sensor fusion techniques. State of the art autonomous ground vehicle prototypes typically use a combination of LIDAR and other distance sensors (such as radar or sonar) as well as cameras and GPS ...
Sensor Intrusion Detection In Control Systems Using Estimation Theory, 2019 Marquette University
Sensor Intrusion Detection In Control Systems Using Estimation Theory, Jiayi Su
Master's Theses (2009 -)
In this thesis, two different approaches to sensor intrusion detection are presented. In the first approach, an estimation algorithm using a bank of Kalman Filters is designed that is capable of estimating the intrusion signal when sensors are affected in control systems. The mathematical models of the control system will be estabilished and the system measurement will be shown and after that, various false signals, such as constant-type and ramp-type signal, will be selected as the intrusion signal to affect the system output mentioned above. The system measurement will be tested based on a bank of Kalman Filters. The probabilities ...
Investigation Of Electronic And Optical Properties Of 2-Dimensional Semiconductor Tin Selenide (Snse) Thin Films, 2019 Portland State University
Investigation Of Electronic And Optical Properties Of 2-Dimensional Semiconductor Tin Selenide (Snse) Thin Films, Shakila Afrin
Dissertations and Theses
Over the last 5 decades, the semiconductor industry has been well served by Si based technology due to its abundant availability, lower manufacturing cost, large wafer sizes and less complexity in fabrication. Over this period, electronic devices and integrated systems have been miniaturized by downscaling of the transistors. The miniaturization has been guided by the Moore's law where the numbers of transistors have doubled over every two years. However, the trend of transistor miniaturization is fast approaching its limit. Hence, alternate and innovative solutions are necessary to tackle this problem and this propels the research for finding novel materials ...
Wearable Bluetooth Sensors For Capturing Relational Variables And Temporal Variability In Relationships: A Construct Validation Study, James G. Matusik, Ralph Heidl, John R. Hollenbeck, Andrew Yu, Hun W. Lee, Michael D. Howe
The advent of wearable sensor technologies has the potential to transform organizational research by offering the unprecedented opportunity to collect continuous, objective, highly granular data over extended time periods. Recent evidence has demonstrated the potential utility of Bluetooth-enabled sensors, specifically, in identifying emergent networks via colocation signals in highly controlled contexts with known distances and groups. Although there is proof of concept that wearable Bluetooth sensors may be able to contribute to organizational research in highly controlled contexts, to date there has been no explicit psychometric construct validation effort dedicated to these sensors in field settings. Thus, the two studies ...
Religious Devices: A Survey Of Technologies Of Worship., Hugh Davies
Responding to the unannounced spiritual mysticism surrounding contemporary technologies, a religiosity present in the prayer-like devotion of social media piety to the cultish intensity surrounding each iPhone launch, this paper aims to dispel presumptions of the spiritual in opposition to the technological by surveying a range of media devices specifically developed for religious purposes. More than connecting scholarship in technology, media and religion, this survey recommends a new arc in the cultural examination of technology. As curious media artefacts, religious devices are independently worthy of study but they also offer a material past to the so-called “religion of Silicon Valley ...
(Poster) Combining Design And Entrepreneurial Mindset Development: Improved Multifunctional Charging Station, 2019 University of Indianapolis
(Poster) Combining Design And Entrepreneurial Mindset Development: Improved Multifunctional Charging Station, Allison Zwickl, Payton Staman, Evan Parduhn, Jake Smith, David Olawale, Stephen Spicklemire, Rashedul Sarker
ASEE IL-IN Section Conference
It has become imperative to find ways to organize different devices of varying functions and sizes. This problem was introduced to us through customers who believed the current designs on the market could use improvement, or through the lack of organization that they have when charging multiple devices. A solution is a modular concept with a base station that will include a wireless pad and a few charging cords. Additionally customers can purchase specialized add ons that fit into the base station. The housing station will seamlessly charge a plethora of devices including; smart-phones, smart-watches, and speakers in a centralized ...
(Poster) Internal Restoration And Modernization Of A 1948 Wwii Era Jukebox, 2019 University of Indianapolis
(Poster) Internal Restoration And Modernization Of A 1948 Wwii Era Jukebox, Miles Furr, Cristiana Olarinre, Joel Carpenter, Elijah Knox, George Ricco, Paul Talaga, Suranga Dharmarathne
ASEE IL-IN Section Conference
Using Six Sigma guidelines under the sponsorship of The University of Indianapolis in cooperation with the client, Brugh Industrial Engineering, this project is to modernize the functionality and interface of a Rockola Model 1428 Jukebox while maintaining its vintage appeal. The process of modernization includes meeting today's industrial safety standards, incorporating ethernet protocol, and utilizing a programmable logic controller, PLC. The jukebox is a showcase of current automation technology. Lighting has been upgraded from fluorescent and incandescent bulbs to addressable nano pixel LEDs. The amplifier, coin system, and record selection system were revitalized to OEM operation standards. All switches ...
Development Of A Set Of Pre-Class Videos For Electromagnetic Theory, 2019 Anderson University - Indiana
Development Of A Set Of Pre-Class Videos For Electromagnetic Theory, Benjamin Mcpheron, Josiah D. Kunz
ASEE IL-IN Section Conference
One important aspect of experiential learning is allowing students time to reflect on new concepts before the application of the material. Most commonly, this is attempted by assigning readings from a textbook, but research suggests that few students complete these readings. This discouraging fact has prompted the use of other resources, such as videos, to supplement pre-class readings in order to introduce new material. Previous work has been completed by this author to produce pre-class videos for use in an introductory circuits course. This paper extends that work to the development of pre-class videos for a senior level electrical engineering ...
Interactive Simulations In Signals And Systems, 2019 University of Evansville
Interactive Simulations In Signals And Systems, Anthony Richardson
ASEE IL-IN Section Conference
Several interactive simulations that promote a better understanding of concepts traditionally encountered in an undergraduate Signals and Systems course are described. The simulations were developed to support the text “Signals & Systems: Theory and Applications” by Ulaby and Yagle. The text and all simulation programs are available for free download (ss2.eecs.umich.edu) as part of the Free Electrical Engineering Textbook Initiative from the University of Michigan.
All simulations use graphical control elements that allow the student to interact with the simulation. Many of the simulations use either real audio or image data so that the student can vary parameters ...
Course And Exam Statistics In Electrical Engineering, 2019 University of Evansville
Course And Exam Statistics In Electrical Engineering, D Blandford, Mark Randall, Jessica Lofton
ASEE IL-IN Section Conference
This paper examines the course and national exam records for about fifty students in electrical engineering. The data includes the following: SAT/ACT scores, high school math and science grades, high school GPA, high school class rank, and grades for math, science, and engineering courses in the first two years of the major for undergraduates in electrical engineering. The data is analyzed seeking a correlation with success in the major which is measured by the cumulative GPA at or near graduation.
Two types of correlation data are presented. First, correlation with individual data items and success in the major is ...
Efficient Methods For Robust Circuit Design And Performance Optimization For Carbon Nanotube Field Effect Transistors, 2019 Portland State University
Efficient Methods For Robust Circuit Design And Performance Optimization For Carbon Nanotube Field Effect Transistors, Muhammad Ali
Dissertations and Theses
Carbon nanotube field-effect transistors (CNFETs) are considered to be promising candidate beyond the conventional CMOSFET due to their higher current drive capability, ballistic transport, lesser power delay product and higher thermal stability. CNFETs show great potential to build digital systems on advanced technology nodes with big benefits in terms of power, performance and area (PPA). Hence, there is a great need to develop proven models and CAD tools for performance evaluation of CNFET-based circuits. CNFETs specific parameters, such as number of tubes, pitch (spacing between the tubes) and diameter of CNTs determine current driving capability, speed, power consumption and area ...
Demo: A Low-Cost Fleet Monitoring System, 2019 Iowa State University
Demo: A Low-Cost Fleet Monitoring System, Lotfi Ben Othmane, Venecia Alvarez, Kendall Berner, Matthew Fuhrmann, William Fuhrmann, Anthony Guss, Tyler Hartsock
Lotfi ben Othmane
Organizations use fleet monitoring systems for e.g., vehicle tracking, driver behavior analysis, and efficient fleet management. Current systems are designed for commercial use and are of high cost. We present a prototype of a low-cost fleet monitoring system that could be used for non-commercial applications. The system is composed of a device, a service application, and a Web application. The device reads data such as speed and fuel from the internal network of the connected vehicle and the location of the vehicle and sends them to a remote service. The remote service processes and stores the data. The users ...
Details On Csa-Sbl: An Algorithm For Sparse Bayesian Learning Boosted By Partial Erroneous Support Knowledge, 2019 Utah State University
Details On Csa-Sbl: An Algorithm For Sparse Bayesian Learning Boosted By Partial Erroneous Support Knowledge, Mohammad Shekaramiz, Todd K. Moon, Jacob H. Gunther
Electrical and Computer Engineering Faculty Publications
This report provides details on CSA-SBL(VB) algorithm for the recovery of sparse signals with unknown clustering pattern. More specifically, we deal with the recovery of sparse signals with unknown clustering pattern in the case of having partial erroneous prior knowledge on the supports of the signal. In , we provided a modified sparse Bayesian learning model to incorporate prior knowledge and simultaneously learn the unknown clustering pattern. For this purpose, we added one more layer to support-aided sparse Bayesian learning algorithm (SA-SBL) that was proposed in . This layer adds a prior on the shape parameters of Gamma distributions ...
Robustness Evaluation Of Computer-Aided Clinical Trials For Medical Devices, 2019 University of Pennsylvania
Robustness Evaluation Of Computer-Aided Clinical Trials For Medical Devices, Kuk Jin Jang, Yash Vardhan Pant, Bo Zhang, James Weimer, Rahul Mangharam
Real-Time and Embedded Systems Lab (mLAB)
Medical cyber-physical systems, such as the implantable cardioverter defibrillator (ICD), require evaluation of safety and efficacy in the context of a patient population in a clinical trial. Advances in computer modeling and simulation allow for generation of a simulated cohort or virtual cohort which mimics a patient population and can be used as a source of prior information. A major obstacle to acceptance of simulation results as a source of prior information is the lack of a framework for explicitly modeling sources of uncertainty in simulation results and quantifying the effect on trial outcomes.
In this work, we formulate the ...
Detection Of Injection Attacks In In-Vehicle Networks, 2019 Iowa State University
Detection Of Injection Attacks In In-Vehicle Networks, Lotfi Ben Othmane, Lalitha Dhulipala, Moataz Abdelkhalek, Manimaran Govindarasu, Nicholas Multari
Lotfi ben Othmane
There have been several public demonstrations of attacks on connected vehicles showing the ability of an attacker to take control of a targeted vehicle by injecting messages into their Controller Area Network (CAN) bus. In this paper, using injected speed reading and Revolutions Per Minute (RPM) messages, we examined the ability of the Pearson correlation, the k-means clustering, and the Hidden Markov Model (HMM) techniques to differentiate ’no-attack’ and ’under-attack’ states of the given vehicle. We found that the Pearson correlation distinguishes the two states while the k-means fails to distinguish the two states and HMM can successfully detect attacks ...
Open Source Low-Cost Power Monitoring System, 2019 Michigan Technological University
Open Source Low-Cost Power Monitoring System, Shane W. Oberloier, Joshua M. Pearce
Joshua M. Pearce
This study presents an entirely open-source, low-cost power monitoring system capable of many types of measurements including both loads and supplies such as solar photovoltaic systems. In addition, the system can be fabricated using only open source software and hardware. The design revolves around the Digital Universal Energy Logger (DUEL) Node, which is responsible for reading and properly scaling the voltage and current of a particular load, and then serializing it via an on-board ATTiny85 chip. The configuration of the DUEL node allows for custom sensitivity ranges, and can handle up to 50 A and 300 V. Up to 127 ...
Epics: A Framework For Enforcing Security Policies In Composite Web Services, Rohit Ranchal, Bharat Bhargava, Pelin Angin, Lotfi Ben Othmane
Lotfi ben Othmane
With advances in cloud computing and the emergence of service marketplaces, the popularity of composite services marks a paradigm shift from single-domain monolithic systems to cross-domain distributed services, which raises important privacy and security concerns. Access control becomes a challenge in such systems because authentication, authorization and data disclosure may take place across endpoints that are not known to clients. The clients lack options for specifying policies to control the sharing of their data and have to rely on service providers which provide limited selection of security and privacy preferences. This lack of awareness and loss of control over data ...
Progress Report I: Fabrication Of Nanopores In Silicon Nitride Membranes Using Self-Assembly Of Ps-B-Pmma, 2019 Quattrone Nanofabrication Facility
Progress Report I: Fabrication Of Nanopores In Silicon Nitride Membranes Using Self-Assembly Of Ps-B-Pmma, Unnati Joshi, Vishal Venkatesh, Hiromichi Yamamoto
Protocols and Reports
This progress report describes fabrication of silicon nitride membranes from Si wafers using cleanroom techniques, and of nanopore preparation via a self-assembled PS-b-PMMA film. A 36.9 nm thick membrane is successfully prepared by KOH wet etching. The membrane is a layered structure of 36.8 µm thick Si and 116 nm thick silicon nitride. It is also exhibited that in the 47 nm thick PS-b-PMMA film, the nanopore structure is observed in the vicinity of a dust particle, but most of the area indicates lamellar domain structure. The thickness of PS-b-PMMA film will ...