Computer Engineering Commons^™

Xylo-Bot: A Therapeutic Robot-Based Music Platform For Children With Autism, Huanghao Feng

Electronic Theses and Dissertations

Children with Autism Spectrum Disorder (ASD) experience deficits in verbal and nonverbal communication skills, including motor control, emotional facial expressions, and eye gaze / joint attention. This Ph.D. dissertation focuses on studying the feasibility and effectiveness of using a social robot, called NAO, and a toy music instrument, xylophone, at modeling and improving the social responses and behaviors of children with ASD. In our investigation, we designed an autonomous social interactive music teaching system to fulfill this mission.

A novel modular robot-music teaching system consisting of three modules is presented. Module 1 provides an autonomous self-awareness positioning system for the …

Deep Siamese Neural Networks For Facial Expression Recognition In The Wild, Wassan Hayale

Electronic Theses and Dissertations

The variation of facial images in the wild conditions due to head pose, face illumination, and occlusion can significantly affect the Facial Expression Recognition (FER) performance. Moreover, between subject variation introduced by age, gender, ethnic backgrounds, and identity can also influence the FER performance. This Ph.D. dissertation presents a novel algorithm for end-to-end facial expression recognition, valence and arousal estimation, and visual object matching based on deep Siamese Neural Networks to handle the extreme variation that exists in a facial dataset. In our main Siamese Neural Networks for facial expression recognition, the first network represents the classification framework, where we …

Facial Action Unit Detection With Deep Convolutional Neural Networks, Siddhesh Padwal

Electronic Theses and Dissertations

The facial features are the most important tool to understand an individual's state of mind. Automated recognition of facial expressions and particularly Facial Action Units defined by Facial Action Coding System (FACS) is challenging research problem in the field of computer vision and machine learning. Researchers are working on deep learning algorithms to improve state of the art in the area. Automated recognition of facial action units has man applications ranging from developmental psychology to human robot interface design where companies are using this technology to improve their consumer devices (like unlocking phone) and for entertainment like FaceApp. Recent studies …

Automated Recognition Of Facial Affect Using Deep Neural Networks, Behzad Hasani

Electronic Theses and Dissertations

Automated Facial Expression Recognition (FER) has been a topic of study in the field of computer vision and machine learning for decades. In spite of efforts made to improve the accuracy of FER systems, existing methods still are not generalizable and accurate enough for use in real-world applications. Many of the traditional methods use hand-crafted (a.k.a. engineered) features for representation of facial images. However, these methods often require rigorous hyper-parameter tuning to achieve favorable results.

Recently, Deep Neural Networks (DNNs) have shown to outperform traditional methods in visual object recognition. DNNs require huge data as well as powerful computing units …

Kernel-Controlled Dqn Based Cnn Pruning For Model Compression And Acceleration, Romancha Khatri

Electronic Theses and Dissertations

Apart from the accuracy, the size of convolutional neural networks (CNN) models is another principal factor for facilitating the deployment of models on memory, power and budget constrained devices. However, conventional model compression techniques require human experts to setup parameters to explore the design space which is suboptimal and time consuming. Various pruning techniques are implemented to gain compression, trading off speed and accuracy. Given a CNN model [11], we propose an automated deep reinforcement learning [9] based model compression technique that can effectively turned off kernels on each layer by observing its significance on decision making. By observing accuracy, …

Past To Present (P2p): Road Thermal Image Colorization, Yuseong Park

Electronic Theses and Dissertations

Thermal image colorization into realistic RGB image is a challenging task. Thermal cameras are easily to detect objects in particular situation (e.g. darkness and fog) that the human eyes cannot detect. However, it is difficult to interpret the thermal image with human eyes. Enhancing thermal image colorization is an important task to improve these areas. The results of the existing colorization method still have color ambiguities, distortion, and blurriness problems. This paper focused on thermal image colorization using pix2pix network architecture based on Generative Adversarial Net (GAN). Pix2pix is a model that transforms thermal image into RGB image, but our …

Semantic Segmentation Using Modified U-Net Architecture For Crack Detection, Michael Sun

Electronic Theses and Dissertations

The visual inspection of a concrete crack is essential to maintaining its good condition during the service life of the bridge. The visual inspection has been done manually by inspectors, but unfortunately, the results are subjective. On the other hand, automated visual inspection approaches are faster and less subjective. Concrete crack is an important deficiency type that is assessed by inspectors. Recently, various Convolutional Neural Networks (CNNs) have become a prominent strategy to spot concrete cracks mechanically. The CNNs outperforms the traditional image processing approaches in accuracy for the high-level recognition task. Of them, U-Net, a CNN based semantic segmentation …

Understanding Depression During The Covid-19 Pandemic Through Social Media Data, Nusrat Armin

Electronic Theses and Dissertations

The COVID-19 pandemic has dramatically affected peoples’ daily lives all over theworld - physically, economically, and emotionally. Due to the virus, many people have died, and many hospitalized. A record number of people have lost their job, and many businesses have closed. The global economy is at risk. People are facing new realities of their lives. Studies have shown that the level of depression is three times higher than before this pandemic. Previous studies have shown that people use social media to express their emotions and feelings. The purpose of this study is to understand the depression during this COVID-19 …

Design And Development Of A Comprehensive And Interactive Diabetic Parameter Monitoring System - Betictrack, Nusrat Chowdhury

Electronic Theses and Dissertations

A novel, interactive Android app has been developed that monitors the health of type 2 diabetic patients in real-time, providing patients and their physicians with real-time feedback on all relevant parameters of diabetes. The app includes modules for recording carbohydrate intake and blood glucose; for reminding patients about the need to take medications on schedule; and for tracking physical activity, using movement data via Bluetooth from a pair of wearable insole devices. Two machine learning models were developed to detect seven physical activities: sitting, standing, walking, running, stair ascent, stair descent and use of elliptical trainers. The SVM and decision …

Cognitive Satellite Communications And Representation Learning For Streaming And Complex Graphs., Wenqi Liu

Electronic Theses and Dissertations

This dissertation includes two topics. The first topic studies a promising dynamic spectrum access algorithm (DSA) that improves the throughput of satellite communication (SATCOM) under the uncertainty. The other topic investigates distributed representation learning for streaming and complex networks. DSA allows a secondary user to access the spectrum that are not occupied by primary users. However, uncertainty in SATCOM causes more spectrum sensing errors. In this dissertation, the uncertainty has been addressed by formulating a DSA decision-making process as a Partially Observable Markov Decision Process (POMDP) model to optimally determine which channels to sense and access. Large-scale networks have attracted …

An Explainable Recommender System Based On Semantically-Aware Matrix Factorization., Mohammed Sanad Alshammari

Electronic Theses and Dissertations

Collaborative Filtering techniques provide the ability to handle big and sparse data to predict the ratings for unseen items with high accuracy. Matrix factorization is an accurate collaborative filtering method used to predict user preferences. However, it is a black box system that recommends items to users without being able to explain why. This is due to the type of information these systems use to build models. Although rich in information, user ratings do not adequately satisfy the need for explanation in certain domains. White box systems, in contrast, can, by nature, easily generate explanations. However, their predictions are less …

Formally Designing And Implementing Cyber Security Mechanisms In Industrial Control Networks., Mehdi Sabraoui

Electronic Theses and Dissertations

This dissertation describes progress in the state-of-the-art for developing and deploying formally verified cyber security devices in industrial control networks. It begins by detailing the unique struggles that are faced in industrial control networks and why concepts and technologies developed for securing traditional networks might not be appropriate. It uses these unique struggles and examples of contemporary cyber-attacks targeting control systems to argue that progress in securing control systems is best met with formal verification of systems, their specifications, and their security properties. This dissertation then presents a development process and identifies two technologies, TLA+ and seL4, that can be …

Normally-Off Computing Design Methodology Using Spintronics: From Devices To Architectures, Arman Roohi

Electronic Theses and Dissertations

Energy-harvesting-powered computing offers intriguing and vast opportunities to dramatically transform the landscape of Internet of Things (IoT) devices and wireless sensor networks by utilizing ambient sources of light, thermal, kinetic, and electromagnetic energy to achieve battery-free computing. In order to operate within the restricted energy capacity and intermittency profile of battery-free operation, it is proposed to innovate Elastic Intermittent Computation (EIC) as a new duty-cycle-variable computing approach leveraging the non-volatility inherent in post-CMOS switching devices. The foundations of EIC will be advanced from the ground up by extending Spin Hall Effect Magnetic Tunnel Junction (SHE-MTJ) device models to realize SHE-MTJ-based …

Heterogeneous Reconfigurable Fabrics For In-Circuit Training And Evaluation Of Neuromorphic Architectures, Ramtin Mohammadizand

Electronic Theses and Dissertations

A heterogeneous device technology reconfigurable logic fabric is proposed which leverages the cooperating advantages of distinct magnetic random access memory (MRAM)-based look-up tables (LUTs) to realize sequential logic circuits, along with conventional SRAM-based LUTs to realize combinational logic paths. The resulting Hybrid Spin/Charge FPGA (HSC-FPGA) using magnetic tunnel junction (MTJ) devices within this topology demonstrates commensurate reductions in area and power consumption over fabrics having LUTs constructed with either individual technology alone. Herein, a hierarchical top-down design approach is used to develop the HSCFPGA starting from the configurable logic block (CLB) and slice structures down to LUT circuits and the …

Leveraging The Intrinsic Switching Behaviors Of Spintronic Devices For Digital And Neuromorphic Circuits, Steven Pyle

Electronic Theses and Dissertations

With semiconductor technology scaling approaching atomic limits, novel approaches utilizing new memory and computation elements are sought in order to realize increased density, enhanced functionality, and new computational paradigms. Spintronic devices offer intriguing avenues to improve digital circuits by leveraging non-volatility to reduce static power dissipation and vertical integration for increased density. Novel hybrid spintronic-CMOS digital circuits are developed herein that illustrate enhanced functionality at reduced static power consumption and area cost. The developed spin-CMOS D Flip-Flop offers improved power-gating strategies by achieving instant store/restore capabilities while using 10 fewer transistors than typical CMOS-only implementations. The spin-CMOS Muller C-Element developed …

Value-Of-Information Based Data Collection In Underwater Sensor Networks, Fahad Khan

Electronic Theses and Dissertations

Underwater sensor networks are deployed in marine environments, presenting specific challenges compared to sensor networks deployed in terrestrial settings. Among the major issues that underwater sensor networks face is communication medium limitations that result in low bandwidth and long latency. This creates problems when these networks need to transmit large amounts of data over long distances. A possible solution to address this issue is to use mobile sinks such as autonomous underwater vehicles (AUVs) to offload these large quantities of data. Such mobile sinks are called data mules. Often it is the case that a sensor network is deployed to …

Classification Of The 4 Stages Of Diabetic Retinopathy Using A Low Complexity Convolutional Neural Network., Zeliha Ogur

Electronic Theses and Dissertations

Diabetic Retinopathy is an eye disease that affects the blood vessels of the retina tissue found in the back of the eye. The blood vessels in the retina discharge fluid or cause hemorrhage when affected by diabetic retinopathy. It leads to loss of eye vision with people with diabetics and also among working adults. The disease may advance in four stages which include Mild nonproliferative, moderate nonproliferative, severe nonproliferative and proliferative diabetic retinopathy. In the mild stage also known as background retinopathy, lumps occur in the blood vessel and distort a little amount of blood. At this stage, you are …

Segmentation And Classification Of Lung Nodules From Thoracic Ct Scans : Methods Based On Dictionary Learning And Deep Convolutional Neural Networks., Mohammad Mehdi Farhangi

Electronic Theses and Dissertations

Lung cancer is a leading cause of cancer death in the world. Key to survival of patients is early diagnosis. Studies have demonstrated that screening high risk patients with Low-dose Computed Tomography (CT) is invaluable for reducing morbidity and mortality. Computer Aided Diagnosis (CADx) systems can assist radiologists and care providers in reading and analyzing lung CT images to segment, classify, and keep track of nodules for signs of cancer. In this thesis, we propose a CADx system for this purpose. To predict lung nodule malignancy, we propose a new deep learning framework that combines Convolutional Neural Networks (CNN) and …

An Explainable Sequence-Based Deep Learning Predictor With Applications To Song Recommendation And Text Classification., Khalil Damak

Electronic Theses and Dissertations

Streaming applications are now the predominant tools for listening to music. What makes the success of such software is the availability of songs and especially their ability to provide users with relevant personalized recommendations. State of the art music recommender systems mainly rely on either Matrix factorization-based collaborative filtering approaches or deep learning architectures. Deep learning models usually use metadata for content-based filtering or predict the next user interaction (listening to a song) using a memory-based deep learning structure that learns from temporal sequences of user actions. Despite advances in deep learning models for song recommendation systems, none has taken …

3d Formation Control In Multi-Robot Teams Using Artificial Potential Fields, Sanjana Reddy Mohan

Electronic Theses and Dissertations

Multi-robot teams find applications in emergency response, search and rescue operations, convoy support and many more. Teams of autonomous aerial vehicles can also be used to protect a cargo of airplanes by surrounding them in some geometric shape. This research develops a control algorithm to attract UAVs to one or a set of bounded geometric shapes while avoiding collisions, re-configuring in the event of departure or addition of UAVs and maneuvering in mission space while retaining the configuration. Using potential field theory, weighted vector fields are described to attract UAVs to a desired formation. In order to achieve this, three …

Optimal Design And Planning Of Hybrid Ac/Dc Microgrid, Hossein Lotfi

Electronic Theses and Dissertations

The traditional approach for microgrid design and deployment has been mainly focused on AC systems. DC microgrids, however, are gaining attention due to numerous advantages they provide over AC microgrids, such as removing the need for synchronization and frequency adjustment as well as appropriateness in supporting DC loads and distributed energy resources (DERs). Moreover, considering that both AC and DC DERs are utilized in microgrids, hybrid microgrids would provide viable and economic solutions as they can potentially eliminate the need for AC-to-DC or DC-to-AC voltage conversions. This dissertation focuses on a hybrid microgrid planning model with the objective of minimizing …

Improvements Of And Extensions To Fsmweb: Testing Mobile Apps, Ahmed Fawzi Al Haddad

Electronic Theses and Dissertations

A mobile application is a software program that runs on mobile device. In 2017, 178.1 billion mobile apps downloaded and the number is expected to grow to 258.2 billion app downloads in 2022 [19]. The number of app downloads poses a challenge for mobile application testers to find the right approach to test apps. This dissertation extends the FSMWeb approach for testing web applications [50] to test mobile applications (FSMApp). During the process of analyzing FSMWeb how it could be extended to test Mobile Apps, a number of shortcomings were detected which we improved upon. We discuss these first. We …

Protection Of High-Voltage Transformer Bushings And Other Brittle Structures Against Impact, Christine Nichole Henderson

Electronic Theses and Dissertations

This dissertation contributes unique approaches to improve the fundamental understanding of the impact behavior of porcelain high-voltage (HV) transformer bushings under high-velocity impact, with a focus on their protection with feasible methods which could be quickly applied in service to prevent vandalism and other undesirable impact situations. The bushings are brittle and pressurized; prone to explosive damage when hit by a high-velocity projectile. Damaged bushings can destroy transformers and entire substations in complex fashions. This can put the power grid at risk for cascading failures and electrical blackouts, affecting consumers. Therefore, suggesting practical approaches which could be used to protect …

A Policy Mechanism For Federal Recommendation Of Security Standards For Mobile Devices That Conduct Transactions, Ariel Huckabay

Electronic Theses and Dissertations

The proliferation of mobile devices in the BRIC countries has prompted them to develop policies to manage the security of these devices. In China, mobile devices are a primary tool for payments. As a result, China instituted in 2017 a cyber security policy that applies to mobile devices giving China broad authority to manage cyber threats. The United States has a similar need for a cyber policy. Mobile devices are likely to become a primary payment tool in the United States soon. DHS has also identified a need for more effective security policy in mobile devices for government operations. This …

Application Of Microgrids In Supporting The Utility Grid, Alireza Majzoobi

Electronic Theses and Dissertations

Distributed renewable energy resources have attracted significant attention in recent years due to the falling cost of the renewable energy technology, extensive federal and state incentives, and the application in improving load-point reliability. This growing proliferation, however, is changing the traditional consumption load curves by adding considerable levels of variability and further challenging the electricity supply-demand balance. In this dissertation, the application of microgrids in effectively capturing the distribution network net load variability, caused primarily by the prosumers, is investigated. Microgrids provide a viable and localized solution to this challenge while removing the need for costly investments by the electric …

Automated Synthesis Of Unconventional Computing Systems, Amad Ul Hassen

Electronic Theses and Dissertations

Despite decades of advancements, modern computing systems which are based on the von Neumann architecture still carry its shortcomings. Moore's law, which had substantially masked the effects of the inherent memory-processor bottleneck of the von Neumann architecture, has slowed down due to transistor dimensions nearing atomic sizes. On the other hand, modern computational requirements, driven by machine learning, pattern recognition, artificial intelligence, data mining, and IoT, are growing at the fastest pace ever. By their inherent nature, these applications are particularly affected by communication-bottlenecks, because processing them requires a large number of simple operations involving data retrieval and storage. The …

Soft-Error Resilience Framework For Reliable And Energy-Efficient Cmos Logic And Spintronic Memory Architectures, Faris Alghareb

Electronic Theses and Dissertations

The revolution in chip manufacturing processes spanning five decades has proliferated high performance and energy-efficient nano-electronic devices across all aspects of daily life. In recent years, CMOS technology scaling has realized billions of transistors within large-scale VLSI chips to elevate performance. However, these advancements have also continually augmented the impact of Single-Event Transient (SET) and Single-Event Upset (SEU) occurrences which precipitate a range of Soft-Error (SE) dependability issues. Consequently, soft-error mitigation techniques have become essential to improve systems' reliability. Herein, first, we proposed optimized soft-error resilience designs to improve robustness of sub-micron computing systems. The proposed approaches were developed to …

Development Of Semantic Scene Conversion Model For Image-Based Localization At Night, Dongyoun Kim

Electronic Theses and Dissertations

Developing an autonomous vehicle navigation system invariant to illumination change is one of the biggest challenges in vision-based localization field due to the fact that the appearance of an image becomes inconsistent under different light conditions even with the same location. In particular, the night scene images have greatest change in appearance compared to the according day scenes. Moreover, the night images do not have enough information in Image-based localization. To deal with illumination change, image conversion methods have been researched. However, these methods could lose the detail of objects and add fake objects into the output images. In this …

Instance Segmentation And Object Detection In Road Scenes Using Inverse Perspective Mapping Of 3d Point Clouds And 2d Images, Chungyup Lee

Electronic Theses and Dissertations

The instance segmentation and object detection are important tasks in smart car applications. Recently, a variety of neural network-based approaches have been proposed. One of the challenges is that there are various scales of objects in a scene, and it requires the neural network to have a large receptive field to deal with the scale variations. In other words, the neural network must have deep architectures which slow down computation. In smart car applications, the accuracy of detection and segmentation of vehicle and pedestrian is hugely critical. Besides, 2D images do not have distance information but enough visual appearance. On …

Development Of Enhanced Weed Detection System With Adaptive Thresholding, K-Means And Support Vector Machine, Dheeman Saha

Electronic Theses and Dissertations

This paper proposes a sophisticated classification process to segment the leaves of carrots from weeds (mostly Chamomile). In the early stages, of the plants’ development, both weeds and carrot leaves are intermixed with each other and have similar color texture. This makes it difficult to identify without the help of the domain experts. Therefore, it is essential to remove the weed regions so that the carrot plants can grow without any interruptions. The process of identifying the weeds become more challenging when both plant and weed regions overlap (inter-leaves). The proposed system addresses this problem by creating a sophisticated means …