Bioimaging and Biomedical Optics Commons^™

Untrained Position-Encoded Multilayer Perceptron Network For Structured Illumination Microscopy Reconstruction, Sahil Sharma, Leonidas Zimianitis, Krishnendu Samanta, Balpreet Singh Ahluwalia, Joby Joseph, Dushan N. Wadduwage

Computer Science Faculty Publications

Structured Illumination Microscopy (SIM) enables super-resolution imaging by encoding high-frequency spatial information through patterned light. While traditional Fourier-based reconstruction methods are prone to artifacts under suboptimal conditions, recent deep learning approaches often require large training datasets and lack adaptability across different imaging setups. In this work, we present Position Encoded Multi-Layer Perceptron (PEM) network that leverages implicit neural representations (INRs) and SIM forward-model-driven modeling to reconstruct super-resolved images without any training data. PEM-SIM represents each spatial coordinate as a combination of sinusoidal functions across multiple frequencies, enabling rich encoding of fine spatial detail. A forward model grounded in SIM image …

Multimodal Ai-Driven Biomarker For Early Detection Of Cancer Cachexia, Sabeen Ahmed

USF Tampa Graduate Theses and Dissertations

Cancer cachexia is a metabolic syndrome characterized by substantial skeletal muscle loss, impacting cancer patients' survival and quality of life. Despite its clinical significance, early detection remains a challenge due to the lack of standardized diagnostic criteria and the reliance on indirect markers. This work presents an AI-driven approach to enhance cachexia detection and monitoring by integrating multiple deep learning methodologies. We explore transformer architectures for time-series analysis to model sequential medical data, enabling disease prediction and progression modeling. To ensure robust and reliable decision-making in clinical settings, we explore Bayesian deep neural networks for uncertainty estimation. Additionally, we introduce …

Adaptive Fusion Neural Networks For Sparse-Angle X-Ray 3d Reconstruction, Shaoyong Hong, Bo Yang, Yan Chen, Hao Quan, Shan Liu, Minyi Tang, Jiawei Tian

Electrical & Computer Engineering Faculty Publications

3D medical image reconstruction has significantly enhanced diagnostic accuracy, yet the reliance on densely sampled projection data remains a major limitation in clinical practice. Sparse-angle X-ray imaging, though safer and faster, poses challenges for accurate volumetric reconstruction due to limited spatial information. This study proposes a 3D reconstruction neural network based on adaptive weight fusion (AdapFusionNet) to achieve high-quality 3D medical image reconstruction from sparse-angle X-ray images. To address the issue of spatial inconsistency in multi-angle image reconstruction, an innovative adaptive fusion module was designed to score initial reconstruction results during the inference stage and perform weighted fusion, thereby improving …

Implementing Unmanned Aerial Vehicles To Collect Human Gait Data At Distance And Altitude For Identification And Re-Identification, Donn E. Bartram

Graduate Theses, Dissertations, and Problem Reports (ETD)

Gait patterns are a class of biometric information pertaining to the way a person moves and poses. Gait information is unique to each person and can be used to identify and reidentify people. Historically, this task has been achieved through the use of multiple ground-based imaging sensors. However, as Unmanned Aerial Vehicles (UAVs) advance, they present the opportunity to evolve the process of persons identification and re-identification. Collecting human gait data using UAVs at distances ranging from 20m to 500m and altitudes ranging from 0m to 120m is a challenging task. The current biometric data collection methods, primarily designed for …

Domain Adaptive Federated Learning For Multi-Institution Molecular Mutation Prediction And Bias Identification, W. Farzana, M. A. Witherow, I. Longoria, M. S. Sadique, A. Temtam, K. M. Iftekharuddin

Electrical & Computer Engineering Faculty Publications

Deep learning models have shown potential in medical image analysis tasks. However, training a generalized deep learning model requires huge amounts of patient data that is usually gathered from multiple institutions which may raise privacy concerns. Federated learning (FL) provides an alternative to sharing data across institutions. Nonetheless, FL is susceptible to a few challenges including inversion attacks on model weights, heterogenous data distributions, and bias. This study addresses heterogeneity and bias issues for multi-institution patient data by proposing domain adaptive FL modeling using several radiomics (volume, fractal, texture) features for O6-methylguanine-DNA methyltransferase (MGMT) classification across multiple institutions. The proposed …

Don't Fear The Artificial Intelligence: A Systematic Review Of Machine Learning For Prostate Cancer Detection In Pathology, Aaryn Frewing, Alexander B. Gibson, Richard Robertson, Paul Urie, Dennis Della Corte

Faculty Publications

The adoption of whole slide image (WSI) scanners in clinical practice was accelerated by US Food and Drug Administration approval in 2017, which allowed primary pathologic diagnoses to be made on scanned images. Images in the digital domain allow the application of pathology artificial intelligence (AI), including clinical decision support with algorithms performing specific diagnoses.1,2 These algorithms, if trained properly, could go beyond the ability of human observation to detect and quantify features that are not recognizable by human perception.1,3,4

The Role Of Generative Adversarial Networks In Bioimage Analysis And Computational Diagnostics., Ahmed Naglah

Electronic Theses and Dissertations

Computational technologies can contribute to the modeling and simulation of the biological environments and activities towards achieving better interpretations, analysis, and understanding. With the emergence of digital pathology, we can observe an increasing demand for more innovative, effective, and efficient computational models. Under the umbrella of artificial intelligence, deep learning mimics the brain’s way in learn complex relationships through data and experiences. In the field of bioimage analysis, models usually comprise discriminative approaches such as classification and segmentation tasks. In this thesis, we study how we can use generative AI models to improve bioimage analysis tasks using Generative Adversarial Networks …

Machine Learning And Scalable Informatics Methods To Predict Disease Status From Multimodal Biomedical Data, Hossein Mohammadian Foroushani

McKelvey School of Engineering Graduate Student Theses & Dissertations

Biological understanding of complex diseases such as stroke and obesity is critical for the advancement of medicine. Further knowledge discovery can provide effective biomarkers to improve disease diagnosis and prognosis, identify driver mutations, predict individual genetic susceptibility for early prevention and effective disease management, and facilitate development of personalized drugs. Stroke is the second leading cause of death and long-term disability in the world. Thus, stroke management is a time-sensitive emergency. The initial hours after stroke onset map the trajectory of subsequent neurologic complications. Cerebral edema develops hours to days after acute ischemic stroke and may result in midline shift …

Two-Stage Transfer Learning For Facial Expression Classification In Children, Gregory Hubbard, Megan Witherow, Khan Iftekharuddin

Undergraduate Research Symposium

Studying facial expressions can provide insight into the development of social skills in children and provide support to individuals with developmental disorders. In afflicted individuals, such as children with Autism Spectrum Disorder (ASD), atypical interpretations of facial expressions are well-documented. In computer vision, many popular and state-of-the-art deep learning architectures (VGG16, EfficientNet, ResNet, etc.) are readily available with pre-trained weights for general object recognition. Transfer learning utilizes these pre-trained models to improve generalization on a new task. In this project, transfer learning is implemented to leverage the pretrained model (general object recognition) on facial expression classification. Though this method, the …

Segmentation Of Intracranial Structures From Noncontrast Ct Images With Deep Learning, Evan Porter

Wayne State University Dissertations

Presented in this work is an investigation of the application of artificially intelligent algorithms, namely deep learning, to generate segmentations for the application in functional avoidance radiotherapy treatment planning. Specific applications of deep learning for functional avoidance include generating hippocampus segmentations from computed tomography (CT) images and generating synthetic pulmonary perfusion images from four-dimensional CT (4DCT).A single institution dataset of 390 patients treated with Gamma Knife stereotactic radiosurgery was created. From these patients, the hippocampus was manually segmented on the high-resolution MR image and used for the development of the data processing methodology and model testing. It was determined that …

Using Deep Learning To Analyze Materials In Medical Images, Carson Molder

Computer Science and Computer Engineering Undergraduate Honors Theses

Modern deep learning architectures have become increasingly popular in medicine, especially for analyzing medical images. In some medical applications, deep learning image analysis models have been more accurate at predicting medical conditions than experts. Deep learning has also been effective for material analysis on photographs. We aim to leverage deep learning to perform material analysis on medical images. Because material datasets for medicine are scarce, we first introduce a texture dataset generation algorithm that automatically samples desired textures from annotated or unannotated medical images. Second, we use a novel Siamese neural network called D-CNN to predict patch similarity and build …

An Improved Clipped Sub-Histogram Equalization Technique Using Optimized Local Contrast Factor For Mammogram Image Analysis, Nurshafira Hazim Chan

Student Works (2020-2029)

Mammography has been known worldwide as the most common imaging modalities utilized for early detection of breast cancer. The mammographic images produced are in greyscale, however they often produced poor contrast images, non-uniform illumination, and the image often contain artefacts and noise. These limitations can be overcame during the pre-processing stage by improving the image enhancement process. Therefore, in this research an optimized enhancement framework is developed where the local contrast factor is manipulated to preserve details of the image. This technique aims to improve the overall image visibility without altering histogram of the original image, which will affect the …

Deep Learning-Based Breast Cancer Detection And Classification Using Histopathology Images, Ghulam Murtaza

Student Works (2020-2029)

Cancer disease is drastically increasing worldwide over the past few years. Among all types of cancers in women, breast cancer (BrC) is the main cause of abnormal deaths. For a confident diagnosis of BrC, histopathology (Hp) images are usually suggested by the doctors. BrC detection is a diagnostic test for benign (non-cancerous) and malignant (cancerous) breast tumors (BrT). Once the BrT is diagnosed, then it needs to be classified for subtypes of benign and malignant to start specific treatment. Several studies developed BrC detection and classification models using Hp images. However, the existing models required high computational resources, long training …

Perceptually Improved Medical Image Translations Using Conditional Generative Adversarial Networks, Anurag Vaidya

Honors Theses

Magnetic resonance imaging (MRI) can help visualize various brain regions. Typical MRI sequences consist of T1-weighted sequence (favorable for observing large brain structures), T2-weighted sequence (useful for pathology), and T2-FLAIR scan (useful for pathology with suppression of signal from water). While these different scans provide complementary information, acquiring them leads to acquisition times of ~1 hour and an average cost of $2,600, presenting significant barriers. To reduce these costs associated with brain MRIs, we present pTransGAN, a generative adversarial network capable of translating both healthy and unhealthy T1 scans into T2 scans. We show that the addition of non-adversarial …

Identification Of Microscopy Cell Images By Using Convolutional Neural Network Application, Ajis Norfatin Farisya

Student Works (2020-2029)

Breast cancer has been the major factor of cancer death and the second main cause of women’s deaths in the world. The false positive results of this cancer cell detection during the screening test leads to false treatment and emotional disturbance of the patients. Thus, breast cancer cell lines (MCF7) is used as the microscopy image samples together with the Human Bone Osteosarcoma Epithelial Cells (U2OS), and Human Hepatocyte as control to study the effectiveness of convolutional neural network (CNN) as a method of image recognition. The objectives of this study are to determine the ability of convolutional neural network …

Deep Learning For Digitized Histology Image Analysis, Sudhir Sornapudi

Doctoral Dissertations

“Cervical cancer is the fourth most frequent cancer that affects women worldwide. Assessment of cervical intraepithelial neoplasia (CIN) through histopathology remains as the standard for absolute determination of cancer. The examination of tissue samples under a microscope requires considerable time and effort from expert pathologists. There is a need to design an automated tool to assist pathologists for digitized histology slide analysis. Pre-cervical cancer is generally determined by examining the CIN which is the growth of atypical cells from the basement membrane (bottom) to the top of the epithelium. It has four grades, including: Normal, CIN1, CIN2, and CIN3. In …

Using Feature Extraction From Deep Convolutional Neural Networks For Pathological Image Analysis And Its Visual Interpretability, Wei-Wen Hsu

Electrical & Computer Engineering Theses & Dissertations

This dissertation presents a computer-aided diagnosis (CAD) system using deep learning approaches for lesion detection and classification on whole-slide images (WSIs) with breast cancer. The deep features being distinguishing in classification from the convolutional neural networks (CNN) are demonstrated in this study to provide comprehensive interpretability for the proposed CAD system using the domain knowledge in pathology. In the experiment, a total of 186 slides of WSIs were collected and classified into three categories: Non-Carcinoma, Ductal Carcinoma in Situ (DCIS), and Invasive Ductal Carcinoma (IDC). Instead of conducting pixel-wise classification (segmentation) into three classes directly, a hierarchical framework with the …

Seeing Eye To Eye: A Machine Learning Approach To Automated Saccade Analysis, Maigh Attre

Honors Scholar Theses

Abnormal ocular motility is a common manifestation of many underlying pathologies particularly those that are neurological. Dynamics of saccades, when the eye rapidly changes its point of fixation, have been characterized for many neurological disorders including concussions, traumatic brain injuries (TBI), and Parkinson’s disease. However, widespread saccade analysis for diagnostic and research purposes requires the recognition of certain eye movement parameters. Key information such as velocity and duration must be determined from data based on a wide set of patients’ characteristics that may range in eye shapes and iris, hair and skin pigmentation [36]. Previous work on saccade analysis has …

Quantifying Iron Overload Using Mri, Active Contours, And Convolutional Neural Networks, Andrea Sajewski, Stacey Levine

Undergraduate Research and Scholarship Symposium

Iron overload, a complication of repeated blood transfusions, can cause tissue damage and organ failure. The body has no regulatory mechanism to excrete excess iron, so iron overload must be closely monitored to guide therapy and measure treatment response. The concentration of iron in the liver is a reliable marker for total body iron content and is now measured noninvasively with magnetic resonance imaging (MRI). MRI produces a diagnostic image by measuring the signals emitted from the body in the presence of a constant magnetic field and radiofrequency pulses. At each pixel, the signal decay constant, T2*, can be calculated, …

Abso2luteu-Net: Tissue Oxygenation Calculation Using Photoacoustic Imaging And Convolutional Neural Networks, Kevin Hoffer-Hawlik, Geoffrey P. Luke

ENGS 88 Honors Thesis (AB Students)

Photoacoustic (PA) imaging uses incident light to generate ultrasound signals within tissues. Using PA imaging to accurately measure hemoglobin concentration and calculate oxygenation (sO₂) requires prior tissue knowledge and costly computational methods. However, this thesis shows that machine learning algorithms can accurately and quickly estimate sO₂. absO₂luteU-Net, a convolutional neural network, was trained on Monte Carlo simulated multispectral PA data and predicted sO₂ with higher accuracy compared to simple linear unmixing, suggesting machine learning can solve the fluence estimation problem. This project was funded by the Kaminsky Family Fund and the Neukom Institute.

End-To-End Learning Via A Convolutional Neural Network For Cancer Cell Line Classification, Darlington A. Akogo, Xavier-Lewis Palmer

Electrical & Computer Engineering Faculty Publications

Purpose: Computer vision for automated analysis of cells and tissues usually include extracting features from images before analyzing such features via various machine learning and machine vision algorithms. The purpose of this work is to explore and demonstrate the ability of a Convolutional Neural Network (CNN) to classify cells pictured via brightfield microscopy without the need of any feature extraction, using a minimum of images, improving work-flows that involve cancer cell identification.

Design/methodology/approach: The methodology involved a quantitative measure of the performance of a Convolutional Neural Network in distinguishing between two cancer lines. In their approach, they trained, validated and …

Applications Of Machine Learning In Nuclear Imaging And Radiation Detection, Shaikat Mahmood Galib

Doctoral Dissertations

"The main focus of this work is to use machine learning and data mining techniques to address some challenging problems that arise from nuclear data. Specifically, two problem areas are discussed: nuclear imaging and radiation detection. The techniques to approach these problems are primarily based on a variant of Artificial Neural Network (ANN) called Convolutional Neural Network (CNN), which is one of the most popular forms of 'deep learning' technique.

The first problem is about interpreting and analyzing 3D medical radiation images automatically. A method is developed to identify and quantify deformable image registration (DIR) errors from lung CT scans …

Hierarchical Fusion Based Deep Learning Framework For Lung Nodule Classification, Kazim Sekeroglu

LSU Doctoral Dissertations

Lung cancer is the leading cancer type that causes the mortality in both men and women. Computer aided detection (CAD) and diagnosis systems can play a very important role for helping the physicians in cancer treatments. This dissertation proposes a CAD framework that utilizes a hierarchical fusion based deep learning model for detection of nodules from the stacks of 2D images. In the proposed hierarchical approach, a decision is made at each level individually employing the decisions from the previous level. Further, individual decisions are computed for several perspectives of a volume of interest (VOI). This study explores three different …

Directed Acyclic Graph Continuous Max-Flow Image Segmentation For Unconstrained Label Orderings, John Sh Baxter, Martin Rajchl, A. Jonathan Mcleod, Jing Yuan, Terry M. Peters

Robarts Imaging Publications

Label ordering, the specification of subset–superset relationships for segmentation labels, has been of increasing interest in image segmentation as they allow for complex regions to be represented as a collection of simple parts. Recent advances in continuous max-flow segmentation have widely expanded the possible label orderings from binary background/foreground problems to extendable frameworks in which the label ordering can be specified. This article presents Directed Acyclic Graph Max-Flow image segmentation which is flexible enough to incorporate any label ordering without constraints. This framework uses augmented Lagrangian multipliers and primal–dual optimization to develop a highly parallelized solver implemented using GPGPU. This …

Prediction Of Brain Tumor Progression Using Multiple Histogram Matched Mri Scans, Debrup Banerjee, Loc Tran, Jiang Li, Yuzhong Shen, Frederic Mckenzie, Jihong Wang, Ronald M. Summers (Ed.), Bram Van Ginneken (Ed.)

Electrical & Computer Engineering Faculty Publications

In a recent study [1], we investigated the feasibility of predicting brain tumor progression based on multiple MRI series and we tested our methods on seven patients' MRI images scanned at three consecutive visits A, B and C. Experimental results showed that it is feasible to predict tumor progression from visit A to visit C using a model trained by the information from visit A to visit B. However, the trained model failed when we tried to predict tumor progression from visit B to visit C, though it is clinically more important. Upon a closer look at the MRI scans …

Brain Tumor Progression Assessment Using Multiple Mri Volumes, Yufei Shen

Electrical & Computer Engineering Theses & Dissertations

Predicting and assessing tumor progression is important in brain tumor treatment. We attempt to use machine learning techniques to achieve consistency in assessing brain tumor progression. This thesis presents a prediction method of brain tumor progression by exploring a large MR database, which contains two patients ' complete records covering all their visits in the past two years. All ten MRI series, namely, apparent diffusion coefficient (ADC) , diffusion tensor imaging (DTI) , fractional anisotropy (FA), fluid attenuated inversion recovery (FLAIR), max eigenvalue (MAX), mid eigenvalue (MID), min eigenvalue (MIN) , post-contrast T₁-weighted, T₁- weighted, and …

Level Set Segmentation Of Mr Images For Extraction Of Femur Bone And Tissues, Christina Shanti Nayagam

Student Works (2000-2009)

This research explores a potentially useful segmentation algorithm, known as the level set method. It is suitable for images obtained from the Magnetic Resonance Imaging (MRJ) modality, despite the fact that MR images have low contrast between bone and tissue. The level set method is a numerical technique designed to track the evolution of an interface. The fast marching version of the method is implemented for two-dimensional (2-D) and three-dimensional (3-D) segmentation in this research. Femur segmentation is the main thrust of this thesis, however brain and heart images are also presented. Pre-processing steps are first performed for the 2-0 …