Open Access. Powered by Scholars. Published by Universities.®

Computer Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 4 of 4

Full-Text Articles in Computer Engineering

On The Impact Of Gravity Compensation On Reinforcement Learning In Goal-Reaching Tasks For Robotic Manipulators, Jonathan Fugal, Hasan A. Poonawala, Jihye Bae Mar 2021

On The Impact Of Gravity Compensation On Reinforcement Learning In Goal-Reaching Tasks For Robotic Manipulators, Jonathan Fugal, Hasan A. Poonawala, Jihye Bae

Electrical and Computer Engineering Faculty Publications

Advances in machine learning technologies in recent years have facilitated developments in autonomous robotic systems. Designing these autonomous systems typically requires manually specified models of the robotic system and world when using classical control-based strategies, or time consuming and computationally expensive data-driven training when using learning-based strategies. Combination of classical control and learning-based strategies may mitigate both requirements. However, the performance of the combined control system is not obvious given that there are two separate controllers. This paper focuses on one such combination, which uses gravity-compensation together with reinforcement learning (RL). We present a study of the effects of gravity …


Re-Designing Main Memory Subsystems With Emerging Monolithic 3d (M3d) Integration And Phase Change Memory Technologies, Chao-Hsuan Huang Jan 2021

Re-Designing Main Memory Subsystems With Emerging Monolithic 3d (M3d) Integration And Phase Change Memory Technologies, Chao-Hsuan Huang

Theses and Dissertations--Electrical and Computer Engineering

Over the past two decades, Dynamic Random-Access Memory (DRAM) has emerged as the dominant technology for implementing the main memory subsystems of all types of computing systems. However, inferring from several recent trends, computer architects in both the industry and academia have widely accepted that the density (memory capacity per chip area) and latency of DRAM based main memory subsystems cannot sufficiently scale in the future to meet the requirements of future data-centric workloads related to Artificial Intelligence (AI), Big Data, and Internet-of-Things (IoT). In fact, the achievable density and access latency in main memory subsystems presents a very fundamental …


Designing Novel Hardware Security Primitives For Smart Computing Devices, Amitkumar Degada Jan 2021

Designing Novel Hardware Security Primitives For Smart Computing Devices, Amitkumar Degada

Theses and Dissertations--Electrical and Computer Engineering

Smart computing devices are miniaturized electronics devices that can sense their surroundings, communicate, and share information autonomously with other devices to work cohesively. Smart devices have played a major role in improving quality of the life and boosting the global economy. They are ubiquitously present, smart home, smart city, smart girds, industry, healthcare, controlling the hazardous environment, and military, etc. However, we have witnessed an exponential rise in potential threat vectors and physical attacks in recent years. The conventional software-based security approaches are not suitable in the smart computing device, therefore, hardware-enabled security solutions have emerged as an attractive choice. …


Toward Intelligent Welding By Building Its Digital Twin, Qiyue Wang Jan 2021

Toward Intelligent Welding By Building Its Digital Twin, Qiyue Wang

Theses and Dissertations--Electrical and Computer Engineering

To meet the increasing requirements for production on individualization, efficiency and quality, traditional manufacturing processes are evolving to smart manufacturing with the support from the information technology advancements including cyber-physical systems (CPS), Internet of Things (IoT), big industrial data, and artificial intelligence (AI). The pre-requirement for integrating with these advanced information technologies is to digitalize manufacturing processes such that they can be analyzed, controlled, and interacted with other digitalized components. Digital twin is developed as a general framework to do that by building the digital replicas for the physical entities. This work takes welding manufacturing as the case study to …