Hardware Systems Commons^™

Swvl: A Custom Ai-Powered Face Tracking Camera Gimbal, Alexander J. Anderson-Mcleod, Jakub Jerzmanowski, Michael Laitarovsky, Trevor Allison, Jagger Tanner

Senior Theses

In response to the growing demand for smarter, more responsive face tracking cameras in the post-pandemic world, our team designed SWVL, a custom AI-powered face tracking gimbal meant to address the limitations commonly encountered by the commercial models currently on the market. These commercially available gimbals come with several issues, such as frequently losing track of the person in the frame and requiring manual resets, which we sought to fix with our implementation. We designed a system with fully custom hardware and software including a 3D printed dual-axis camera gimbal driven by stepper motors, a control PCB based around an …

Demo Abstract: Porting And Execution Of Anomalies Detection Models On Embedded Systems In Iot, Bharath Sudharsan, Pankesh Patel, Abdul Wahid, Muhammad Yahya, John G. Breslin, Muhammad Intizar Ali

Publications

In the Industry 4.0 era, Microcontrollers (MCUs) based tiny embedded sensor systems have become the sensing paradigm to interact with the physical world. In 2020, 25.6 billion MCUs were shipped, and over 250 billion MCUs are already operating in the wild. Such low-power, low-cost MCUs are being used as the brain to control diverse applications and soon will become the global digital nervous system. In an Industrial IoT setup, such tiny MCU-based embedded systems are equipped with anomaly detection models and mounted on production plant machines for monitoring the machine’s health/condition. These models process the machine’s health data (from temperature, …

Cognitive Digital Twins For Smart Manufacturing, Muhammad Intizar Ali, Pankesh Patel, John G. Breslin, Ramy Harik, Amit Sheth

Publications

Smart manufacturing or Industry 4.0, a trend initiated a decade ago, aims to revolutionize traditional manufacturing using technology-driven approaches. Modern digital technologies such as the Industrial Internet of Things (IIoT), Big Data Analytics, Augmented/Virtual Reality, and Artificial Intelligence (AI) are the key enablers of new smart manufacturing approaches. The digital twin is an emerging concept whereby a digital replica can be built of any physical object. Digital twins are becoming mainstream; many organizations have started to rely on digital twins to monitor, analyze, and simulate physical assets and processes. The current use of digital twins for smart manufacturing is largely …

Machine Learning Meets Internet Of Things: From Theory To Practice, Bharath Sudharsan, Pankesh Patel

Publications

Standalone execution of problem-solving Artificial Intelligence (AI) on IoT devices produces a higher level of autonomy and privacy. This is because the sensitive user data collected by the devices need not be transmitted to the cloud for inference. The chipsets used to design IoT devices are resource-constrained due to their limited memory footprint, fewer computation cores, and low clock speeds. These limitations constrain one from deploying and executing complex problem-solving AI (usually an ML model) on IoT devices. Since there is a high potential for building intelligent IoT devices, in this tutorial, we teach researchers and developers; (i) How to …

Enabling Machine Learning On The Edge Using Sram Conserving Efficient Neural Networks Execution Approach, Bharath Sudharsan, Pankesh Patel, John G. Breslin, Muhammad Intizar Ali

Publications

Edge analytics refers to the application of data analytics and Machine Learning (ML) algorithms on IoT devices. The concept of edge analytics is gaining popularity due to its ability to perform AI-based analytics at the device level, enabling autonomous decision-making, without depending on the cloud. However, the majority of Internet of Things (IoT) devices are embedded systems with a low-cost microcontroller unit (MCU) or a small CPU as its brain, which often are incapable of handling complex ML algorithms.

In this paper, we propose an approach for the ecient execution of already deeply compressed, large neural networks (NNs) on tiny …