Engineering Commons^™

Deep Learning For Automatic Microscopy Image Analysis, Shenghua He

McKelvey School of Engineering Theses & Dissertations

Microscopy imaging techniques allow for the creation of detailed images of cells (or nuclei) and have been widely employed for cell studies in biological research and disease diagnosis in clinic practices.Microscopy image analysis (MIA), with tasks of cell detection, cell classification, and cell counting, etc., can assist with the quantitative analysis of cells and provide useful information for a cellular-level understanding of biological activities and pathology. Manual MIA is tedious, time-consuming, prone to subject errors, and are not feasible for the high-throughput cell analysis process. Thus, automatic MIA methods can facilitate all kinds of biological studies and clinical tasks. Conventional …

Multiphase Energetic Experiments: Application Of Multiple Object Tracking, Sarah Davis Finch

The Journal of Purdue Undergraduate Research

The process of using computer vision for multiple-objects tracking is incredibly complex. Thus, simulated data was created to mimic the complexities of more realistic data. These test cases would isolate a few of the inaccuracies of real data and allow the researchers to determine what factor of said data is the most detrimental to the object-tracking process. Due to the large quantity of factors at play, Cotter’s method was used to analyze the significance of each factor. The number of detections and the number of centroids were the main dependent results that were utilized to analyze the data. The overall …

Nonlinear Intelligent Model Predictive Control Of Mobile Robots, Benjamin Albia

Theses and Dissertations

This thesis presents a framework for an artificial neural network (ANN) model-based nonlinear model predictive control of mobile ground robots. A computer vision analysis module was first developed to extract quantitative position information from onboard camera feed with respect to a prescribed path. Various strategies were developed to construct nonlinear physical plant models for model predictive control (MPC), including the physics-based model (PBM), the ANN trained on PBM-generated data, the ANN trained on test-captured data, and the ANN initially trained on PBM-generated data and then retrained with captured data. All the models predict physical states and positions of the robot …

Characterization Of Tea (Camellia Sinensis) Granules For Quality Grading Using Computer Vision System, Md Towfiqur Rahman, Sabiha Ferdous, Mariya Sultana Jenin, Tanjina Rahman Mim, Masud Alam, Muhammad Rashed Al Mamun

Department of Biological Systems Engineering: Papers and Publications

Tea (Camellia sinensis) has been found as an important medicinal beverage for human which is consumed all over the world. Primarily, the majority of tea is being cultivated in Asia and Africa, however it is commercially produced by more than 60 countries. Though substantial amount is produced, its processing system is still underdeveloped which leads to decrease in export opportunity as well as low monetary value. Moreover, the traditional method of tea grading and sorting is laborious, inefficient, and costly which ultimately produces the low-quality heterogeneous products. Processing and grading of tea granules after drying is very important …

Visual Navigation And Control For Spacecraft Proximity Operations With Unknown Targets, Wyatt J. Harris

Theses and Dissertations

Many current and future spacecraft missions must conduct rendezvous and proximity operations (RPO) with resident space objects (RSOs). An important subset of spacecraft RPO that is yet to be demonstrated on-orbit involves final approach maneuvers with respect to RSOs where no information (such as geometry, inertia, relative velocity, etc.) is known about the target a priori, and no information is actively provided by the target during maneuvering. Such operation with respect to ‘unknown’ targets represents an important possible mission set for Department of Defense spacecraft and is the subject of this research. Two visual servoing frameworks capable of autonomously controlling …

Visual Cues For Semi-Autonomous Control Of Transradial Prosthetics, Mena S.A. Kamel

Electronic Thesis and Dissertation Repository

Upper-limb prosthetics are typically driven exclusively by biological signals, mainly electromyography (EMG), where electrodes are placed on the residual part of an amputated limb. In this approach, amputees must control each arm joint iteratively, in a proportional manner. Research has shown that sequential control of prosthetics usually imposes a cognitive burden on amputees, leading to high abandonment rates. This thesis presents a control system for upper-limb prosthetics, leveraging a computer vision module capable of simultaneously predicting objects in a scene, their segmentation mask, and a ranked list of the optimal grasping locations. The proposed system shares control with an amputee, …

Passive Method For 3d Reconstruction Of Human Jaw: Theory And Application., Mohamad Ghanoum

Electronic Theses and Dissertations

Oral dental applications based on visual data pose various challenges. There are problems with lighting (effect of saliva, tooth dis-colorization, gum texture, and other sources of specularity) and motion (even inevitable slight motions of the upper/ lower jaw may lead to errors far beyond the desired tolerance of sub-millimeter accuracy). Nowadays, the dental CAM systems have become more compromised and accurate to obtain the geometric data of the jaw from the active sensor (laser scanner). However, they have not met the expectations and the needs of dental professionals in many ways. The probes in these systems are bulky { even …

Material Detection With Thermal Imaging And Computer Vision: Potentials And Limitations, Jared Poe

Graduate Theses and Dissertations

The goal of my masters thesis research is to develop an affordable and mobile infraredbased environmental sensoring system for the control of a servo motor based on material identification. While this sensing could be oriented towards different applications, my thesis is particularly interested in material detection due to the wide range of possible applications in mechanical engineering. Material detection using a thermal mobile camera could be used in manufacturing, recycling or autonomous robotics. For my research, the application that will be focused on is using this material detection to control a servo motor by identifying and sending control inputs based …

Robotic Technologies For High-Throughput Plant Phenotyping: Contemporary Reviews And Future Perspectives, Abbas Atefi, Yufeng Ge, Santosh Pitla, James Schnable

Department of Biological Systems Engineering: Papers and Publications

Phenotyping plants is an essential component of any effort to develop new crop varieties. As plant breeders seek to increase crop productivity and produce more food for the future, the amount of phenotype information they require will also increase. Traditional plant phenotyping relying on manual measurement is laborious, time-consuming, error-prone, and costly. Plant phenotyping robots have emerged as a high-throughput technology to measure morphological, chemical and physiological properties of large number of plants. Several robotic systems have been developed to fulfill different phenotyping missions. In particular, robotic phenotyping has the potential to enable efficient monitoring of changes in plant traits …

Towards Semantic Integration Of Machine Vision Systems To Aid Manufacturing Event Understanding, Kaishu Xia, Clint Saidy, Max Kirkpatrick, Noble Anumbe, Amit Sheth, Ramy Harik

Publications

A manufacturing paradigm shift from conventional control pyramids to decentralized, service-oriented, and cyber-physical systems (CPSs) is taking place in today’s 4th industrial revolution. Generally accepted roles and implementation recipes of cyber systems are expected to be standardized in the future of manufacturing industry. The authors intend to develop a novel CPS-enabled control architecture that accommodates: (1) intelligent information systems involving domain knowledge, empirical model, and simulation; (2) fast and secured industrial communication networks; (3) cognitive automation by rapid signal analytics and machine learning (ML) based feature extraction; (4) interoperability between machine and human. Semantic integration of process indicators is fundamental …

A Quantitative Validation Of Multi-Modal Image Fusion And Segmentation For Object Detection And Tracking, Nicholas Lahaye, Michael J. Garay, Brian D. Bue, Hesham El-Askary, Erik Linstead

Mathematics, Physics, and Computer Science Faculty Articles and Research

In previous works, we have shown the efficacy of using Deep Belief Networks, paired with clustering, to identify distinct classes of objects within remotely sensed data via cluster analysis and qualitative analysis of the output data in comparison with reference data. In this paper, we quantitatively validate the methodology against datasets currently being generated and used within the remote sensing community, as well as show the capabilities and benefits of the data fusion methodologies used. The experiments run take the output of our unsupervised fusion and segmentation methodology and map them to various labeled datasets at different levels of global …

A Brief Bibliometric Survey On Night Vision Bot Using Dynamic Ir And Object Detection, Devesh Abhyankar Mr., Gurumoorty Suresh Mr., Hrithik Sambhaji Karjule Mr., Parth Bhardwaj Mr., Harish Muleva Mr., Anurag Mahajan Dr.

Library Philosophy and Practice (e-journal)

This study aims to analyse the work done in the field of Night Vision Robots using IR and Object Detection from 2011 to 2021, using the bibliometric methods. This paper presents a Scopus database review on "Night Vision Bot using Dynamic IR and Object Detection". The necessity for doing this bibliometric survey is that to know how the technology in the field of mobile robotics and night vision, as well as to object detection, has evolved over the years. This paper shows the importance of Night Vision Robot from the year 2011 and continued up to 2021 April. The database …

Small-Target Detection And Observation With Vision-Enabled Fixed-Wing Unmanned Aircraft Systems, Hayden Matthew Morgan

Theses and Dissertations

This thesis focuses on vision-based detection and observation of small, slow-moving targets using a gimballed fixed-wing unmanned aircraft system (UAS). Generally, visual tracking algorithms are tuned to detect motion of relatively large objects in the scene with noticeably significant motion; therefore, applications such as high-altitude visual searches for human motion often ignore target motion as noise. Furthermore, after a target is identified, arbitrary maneuvers for transitioning to overhead orbits for better observation may result in temporary or permanent loss of target visibility. We present guidelines for tuning parameters of the Visual Multiple Target Tracking (Visual MTT) algorithm to enhance its …

Machine Learning-Based Recognition On Crowdsourced Food Images, Aditya Kulkarni

Honors Scholar Theses

With nearly a third of the world’s population suffering from food-induced chronic diseases such as obesity, the role of food in community health is required now more than ever. While current research underscores food proximity and density, there is a dearth in regard to its nutrition and quality. However, recent research in geospatial data collection and analysis as well as intelligent deep learning will help us study this further.

Employing the efficiency and interconnection of computer vision and geospatial technology, we want to study whether healthy food in the community is attainable. Specifically, with the help of deep learning in …

Using Deep Learning To Analyze Materials In Medical Images, Carson Molder

Computer Science and Computer Engineering Undergraduate Honors Theses

Modern deep learning architectures have become increasingly popular in medicine, especially for analyzing medical images. In some medical applications, deep learning image analysis models have been more accurate at predicting medical conditions than experts. Deep learning has also been effective for material analysis on photographs. We aim to leverage deep learning to perform material analysis on medical images. Because material datasets for medicine are scarce, we first introduce a texture dataset generation algorithm that automatically samples desired textures from annotated or unannotated medical images. Second, we use a novel Siamese neural network called D-CNN to predict patch similarity and build …

Learning To Detect Pedestrian Flow In Traffic Intersections From Synthetic Data, Abhijit Baul

Theses and Dissertations

Detecting pedestrian flow in different directions at at traffic-intersection has always been a challenging task. Challenges include different weather conditions, different crowd densities, occlusions, lack of available data, and so on. The emergence of deep learning and computer vision algorithms has shown promises to deal with these problems. Most of the recent works only focus on either detecting combined pedestrian flow or counting the total number of pedestrians. In this work, we have tried to detect not only combined pedestrian flow but also pedestrian flow indifferent directions. Our contributions are, 1) we are introducing a synthetic pedestrian dataset that we …

Analysis Of Recent Trends In Continuous Sign Language Recognition Using Nlp, Vijayshri Nitin Khedkar, Sonali Kothari Dr, Aarohi Prasad, Arunima Mishra, Varun Saha, Vinay Kumar

Library Philosophy and Practice (e-journal)

Oralism is an ideology and practice that advocates communication that is based solely on speech. This practice is encouraged from a pretty early age in our country. As a consequence, the hard of hearing are constantly forced to negotiate with schools, colleges, organisations, workspaces, and families that don’t acknowledge the need and preference for sign language over oral languages. This results in inconsideration of an entire community for admissions, jobs and general social position. We aim to close that communication gap a little and take a step towards fighting the stigma associated with Sign Language. The aim is to provide …

Stereo Camera Calibrations With Optical Flow, Joshua D. Larson

Theses and Dissertations

Remotely Piloted Aircraft (RPA) are currently unable to refuel mid-air due to the large communication delays between their operators and the aircraft. AAR seeks to address this problem by reducing the communication delay to a fast line-of-sight signal between the tanker and the RPA. Current proposals for AAR utilize stereo cameras to estimate where the receiving aircraft is relative to the tanker, but require accurate calibrations for accurate location estimates of the receiver. This paper improves the accuracy of this calibration by improving three components of it: increasing the quantity of intrinsic calibration data with CNN preprocessing, improving the quality …

Using Motion Capture And Augmented Reality To Test Aar With Boom Occlusion, Vincent J. Bownes

Theses and Dissertations

The operational capability of drones is limited by their inability to perform aerial refueling. This can be overcome by automating the process with a computer vision solution. Previous work has demonstrated the feasibility of automated aerial refueling (AAR) in simulation. To progress this technique to the real world, this thesis conducts experiments using real images of a physical aircraft replica and a motion capture system for truth data. It also compares the error between the real and virtual experiments to validate the fidelity of the simulation. Results indicate that the current technique is effective on real images and that the …

Accelerating Point Set Registration For Automated Aerial Refueling, Ryan M. Raettig

Theses and Dissertations

The goal of AAR is to control the tanker boom to safely refuel a receiving aircraft with no input or aid from the boom operator. To achieve this, the pose of the receiver relative to the tanker must be known. Point set registration is a fundamental issue used to estimate the relative pose of an object in an environment. However, it's likely a computational bottleneck of a vision processing pipeline. In addition, the matching of each sensed point with a closest truth point, nearest neighbor matching, is the most costly portion of the point set registration process. For this reason, …

Methods For Object Tracking With Machine Vision, Zachary Simon Stamler

Dissertations and Theses

As machine learning and deep learning systems continue to find applications in science and engineering, the problem of providing these systems with high-quality data continues to increase in importance. Many of these systems utilize machine vision as their primary source of information, and in order to maximally leverage their abilities it is important to be able to provide them with high quality, accurate data. Unfortunately, many sets of tracking data extracted from video suffer from the problem of missing frames, which can arise from a multitude of causes depending on the system. These missing frames can result in confusion between …

‘Digits’ App - Smartphone Augmented Reality For Hand Telerehabilitation, Hongdao Dong, Edward Ho, Herbert Shin, Tania Banerjee, Geoffrey Masschelein, Jacob Davidson, Sandrine De Ribaupierre, Roy Eagleson, Caitlin Symonette

Electrical and Computer Engineering Publications

Hand telerehabilitation currently has limitations for accurate and remote assessment of range of motion (ROM) in small finger joints. ‘DIGITS’ application utilises the front smartphone camera to measure finger ROM in a reliable and rapid assessment protocol. Our initial beta-phase testing examined the consistency of our software measurements to in-person goniometry. 6 to 9 degrees of difference existed between the smartphone application recorded data versus the in-person measurements. This range is within acceptable 7 to 9 degree tolerance for interrater goniometry measurements. The effect of environmental factors such as hand distance, lightings and hand orientation was evaluated. The intraclass correlation …

Human-Robot Collaboration Enabled By Real-Time Vision Tracking, Travis Deegan

Electronic Theses and Dissertations

The number of robotic systems in the world is growing rapidly. However, most industrial robots are isolated in caged environments for the safety of users. There is an urgent need for human-in-the-loop collaborative robotic systems since robots are very good at performing precise and repetitive tasks but lack the cognitive ability and soft skills of humans. To fill this need, a key challenge is how to enable a robot to interpret its human co-worker’s motion and intention. This research addresses this challenge by developing a collaborative human-robot interface via innovations in computer vision, robotics, and system integration techniques. Specifically, this …

Feature Detection For Hand Hygiene Stages, Rashmi Bakshi, Jane Courtney, Damon Berry, Graham Gavin

Articles

The process of hand washing involves complex hand movements. There are six principal sequential steps for washing hands as per the World Health Organization (WHO) guidelines. In this work, a detailed description of an aluminum rig construction for creating a robust hand-washing dataset is discussed. The preliminary results with the help of image processing and computer vision algorithms for hand pose extraction and feature detection such as Harris detector, Shi-Tomasi and SIFT are demonstrated. The hand hygiene pose- Rub hands palm to palm was captured as an input image for running all the experiments. The future work will focus upon …

Evaluating The Performance Of Transformer Architecture Over Attention Architecture On Image Captioning, Deepti Balasubramaniam

Dissertations

Over the last few decades computer vision and Natural Language processing has shown tremendous improvement in different tasks such as image captioning, video captioning, machine translation etc using deep learning models. However, there were not much researches related to image captioning based on transformers and how it outperforms other models that were implemented for image captioning. In this study will be designing a simple encoder-decoder model, attention model and transformer model for image captioning using Flickr8K dataset where will be discussing about the hyperparameters of the model, type of pre-trained model used and how long the model has been trained. …

Measurement Of Micro Burr And Slot Widths Through Image Processing: Comparison Of Manual And Automated Measurements In Micro‐Milling, Fatih Akkoyun, Ali Ercetin, Kubilay Aslantas, Danil Yurievich Pimenov, Khaled Giasin, Avinash Lakshmikanthan, Muhammad Aamir

Research outputs 2014 to 2021

In this study, the burr and slot widths formed after the micro‐milling process of Inconel 718 alloy were investigated using a rapid and accurate image processing method. The measurements were obtained using a user‐defined subroutine for image processing. To determine the accuracy of the developed imaging process technique, the automated measurement results were compared against results measured using a manual measurement method. For the cutting experiments, Inconel 718 alloy was machined using several cutting tools with different geometry, such as the helix angle, axial rake angle, and number of cutting edges. The images of the burr and slots were captured …

A Deep Transfer Learning Based Model For Automatic Detection Of Covid-19from Chest X-Rays, Prateek Chhikara, Prakhar Gupta, Prabhjot Singh, Tarunpreet Bhatia

Turkish Journal of Electrical Engineering and Computer Sciences

Deep learning in medical imaging has revolutionized the way we interpret medical data, as high computational devices' capabilities are far more than their creators. With the pandemic causing havoc for the second straight year, the findings in our paper will allow researchers worldwide to use and create state-of-the-art models to detect affected persons before it reaches the R number. The paper proposes an automated diagnostic tool using the deep learning models on chest x-rays as an input to reach a point where we surpass this pandemic (COVID-19 disease). A deep transfer learning-based model for automatic detection of COVID-19 from chest …

Bibliometric Review On Image Based Plant Phenotyping, Shrikrishna Ulhas Kolhar, Jayant Jagtap

Library Philosophy and Practice (e-journal)

Plant phenotyping is a quantitative description of structural, physiological and temporal traits of plants resulting from interaction of plant genotypes with the environment. A rapid development is in progress in the field of image-based plant phenotyping. Plant phenotyping has wide range of applications in plant breeding research, plant growth prediction, biotic and abiotic stress analysis, crop management and early disease detection. The main motive is to provide detailed bibliometric review in order to know the available literature and current research trends in the area of plant phenotyping using plant images. The bibliometric analysis is primarily based on Scopus, web of …

Ship Deck Segmentation In Engineering Document Using Generative Adversarial Networks, Mohammad Shahab Uddin, Raphael Pamie-George, Daron Wilkins, Andres Sousa Poza, Mustafa Canan, Samuel Kovacic, Jiang Li

Engineering Management & Systems Engineering Faculty Publications

Generative adversarial networks (GANs) have become very popular in recent years. GANs have proved to be successful in different computer vision tasks including image-translation, image super-resolution etc. In this paper, we have used GAN models for ship deck segmentation. We have used 2D scanned raster images of ship decks provided by US Navy Military Sealift Command (MSC) to extract necessary information including ship walls, objects etc. Our segmentation results will be helpful to get vector and 3D image of a ship that can be later used for maintenance of the ship. We applied the trained models to engineering documents provided …