Open Access. Powered by Scholars. Published by Universities.®

2024

Discipline
Institution
Keyword
Publication
Publication Type
File Type

Articles 1321 - 1350 of 1389

Full-Text Articles in Artificial Intelligence and Robotics

Short: Can Citations Tell Us About A Paper's Reproducibility? A Case Study Of Machine Learning Papers, Rochana R. Obadage, Sarah M. Rajtmajer, Jian Wu Jan 2024

Short: Can Citations Tell Us About A Paper's Reproducibility? A Case Study Of Machine Learning Papers, Rochana R. Obadage, Sarah M. Rajtmajer, Jian Wu

Computer Science Faculty Publications

The iterative character of work in machine learning (ML) and artificial intelligence (AI) and reliance on comparisons against benchmark datasets emphasize the importance of reproducibility in that literature. Yet, resource constraints and inadequate documentation can make running replications particularly challenging. Our work explores the potential of using downstream citation contexts as a signal of reproducibility. We introduce a sentiment analysis framework applied to citation contexts from papers involved in Machine Learning Reproducibility Challenges in order to interpret the positive or negative outcomes of reproduction attempts. Our contributions include training classifiers for reproducibility-related contexts and sentiment analysis, and exploring correlations between …


Developing A Framework For Personalized Video-Based Quantum Information Science Education, Nikos Chrisochoides, Norou Diawara, Michail Giannakos Jan 2024

Developing A Framework For Personalized Video-Based Quantum Information Science Education, Nikos Chrisochoides, Norou Diawara, Michail Giannakos

Computer Science Faculty Publications

This is a white paper on Workforce Development for Quantum Information Sciences (QIS) led by the Center for Real-Time Computing at Old Dominion University (ODU). We plan to investigate the potential of video lectures in supporting QIS. Specifically, we focus on following four objectives: (a) design a two-course series for both Master-level and PhD students; b) an upgrade of Experimental Lecture System (ELeSy) to test new, innovative, and transformative approaches for inclusive QIS education; c) design and implementation of a mixed-method systematic empirical study on the effects of video learning styles (in-person flipped classroom and voluntary video use) on graduate …


Enhancing Heart Disease Prediction With Reinforcement Learning And Data Augmentation, Gayathri R., Sangeetha S. K. B., Sandeep Kumar Mathivanan, Hariharan Rajadurai, Benjula Anbu Malar Mb, Saurav Mallik, Hong Qin Jan 2024

Enhancing Heart Disease Prediction With Reinforcement Learning And Data Augmentation, Gayathri R., Sangeetha S. K. B., Sandeep Kumar Mathivanan, Hariharan Rajadurai, Benjula Anbu Malar Mb, Saurav Mallik, Hong Qin

Computer Science Faculty Publications

The study presents a novel method to improve the prediction accuracy of cardiac disease by combining data augmentation techniques with reinforcement learning. The complex nature of cardiac data frequently presents challenges for traditional machine learning models, which results in subpar performance. In response, our fusion methodology improves predictive capabilities by augmenting data and utilizing reinforcement learning's skill at sequential decision-making. Our method predicts cardiac disease with an astounding 94 % accuracy rate, which is an outstanding result. This significant improvement outperforms existing techniques and shows a deeper comprehension of intricate data relationships. The amalgamation of reinforcement learning and data augmentation …


Bayesian Neural Netwok Variational Autoencoder Inverse Mapper (Bnn-Vaim) And Its Application In Compton Form Factors Extraction, Md Fayaz Bin Hossen, Tareq Alghamdi, Manal Almaeen, Yaohang Li Jan 2024

Bayesian Neural Netwok Variational Autoencoder Inverse Mapper (Bnn-Vaim) And Its Application In Compton Form Factors Extraction, Md Fayaz Bin Hossen, Tareq Alghamdi, Manal Almaeen, Yaohang Li

Computer Science Faculty Publications

We extend the Variational Autoencoder Inverse Mapper (VAIM) framework for the inverse problem of extracting Compton Form Factors (CFFs) from deeply virtual exclusive reactions, such as the unpolarized Deeply virtual exclusive scattering (DVCS) cross section. VAIM is an end-to-end deep learning framework to address the solution ambiguity issue in ill-posed inverse problems, which comprises of a forward mapper and a backward mapper to simulate the forward and inverse processes, respectively. In particular, we incorporate Bayesian Neural Network (BNN) into the VAIM architecture (BNN-VAIM) for uncertainty quantification. By sampling the weights and biases distributions of the BNN in the backward mapper …


Enhanced Skin Cancer Diagnosis Through Grid Search Algorithm-Optimized Deep Learning Models For Skin Lesion Analysis, Rudresh Pillai, Neha Sharma, Sheifali Gupta, Deepali Gupta, Sapna Juneja, Saurav Malik, Hong Qin, Mohammed S. Alqahtani, Amel Ksibi Jan 2024

Enhanced Skin Cancer Diagnosis Through Grid Search Algorithm-Optimized Deep Learning Models For Skin Lesion Analysis, Rudresh Pillai, Neha Sharma, Sheifali Gupta, Deepali Gupta, Sapna Juneja, Saurav Malik, Hong Qin, Mohammed S. Alqahtani, Amel Ksibi

Computer Science Faculty Publications

Skin cancer is a widespread and perilous disease that necessitates prompt and precise detection for successful treatment. This research introduces a thorough method for identifying skin lesions by utilizing sophisticated deep learning (DL) techniques. The study utilizes three convolutional neural networks (CNNs)-CNN1, CNN2, and CNN3-each assigned to a distinct categorization job. Task 1 involves binary classification to determine whether skin lesions are present or absent. Task 2 involves distinguishing between benign and malignant lesions. Task 3 involves multiclass classification of skin lesion images to identify the precise type of skin lesion from a set of seven categories. The most optimal …


The Combined Focal Loss And Dice Loss Function Improves The Segmentation Of Beta-Sheets In Medium-Resolution Cryo-Electron-Microscopy Density Maps, Yongcheng Mu, Thu Nguyen, Bryan Hawickhorst, Willy Wriggers, Jiangwen Sun, Jing He Jan 2024

The Combined Focal Loss And Dice Loss Function Improves The Segmentation Of Beta-Sheets In Medium-Resolution Cryo-Electron-Microscopy Density Maps, Yongcheng Mu, Thu Nguyen, Bryan Hawickhorst, Willy Wriggers, Jiangwen Sun, Jing He

Computer Science Faculty Publications

Although multiple neural networks have been proposed for detecting secondary structures from medium-resolution (5–10 Å) cryo-electron microscopy (cryo-EM) maps, the loss functions used in the existing deep learning networks are primarily based on cross-entropy loss, which is known to be sensitive to class imbalances. To monitor and tune the performance of various loss functions for the secondary structure detection problem, we investigated five loss functions: cross-entropy, Focal loss, Dice loss, and two combined loss functions. Using a U-Net architecture in our DeepSSETracer method and a dataset composed of 1,355 box-cropped atomic-structure/density-map pairs, we found that a newly designed loss function …


Disentangling Cyclic Causality: An Instance-Based Framework For Causal Discovery, Chase A. Yakaboski Jan 2024

Disentangling Cyclic Causality: An Instance-Based Framework For Causal Discovery, Chase A. Yakaboski

Dartmouth College Ph.D Dissertations

Correlation does not imply causation" is one of the fundamental principles taught in science, emphasizing that associations between variables do not necessarily indicate causality. Yet, over the past three decades, extensive research has begun to challenge this perspective by developing sophisticated methods to differentiate causal from correlative relationships. This research suggests that correlations often involve a blend of confounded and causal interactions, which, given certain assumptions, can be disentangled to uncover actionable insights and deepen our understanding of physical, biological, and societal systems.

Accurately discovering causal relationships from data amidst cyclic dynamics remains a challenging open problem in causality research. …


Mitigating Safety Issues In Pre-Trained Language Models: A Model-Centric Approach Leveraging Interpretation Methods, Weicheng Ma Jan 2024

Mitigating Safety Issues In Pre-Trained Language Models: A Model-Centric Approach Leveraging Interpretation Methods, Weicheng Ma

Dartmouth College Ph.D Dissertations

Pre-trained language models (PLMs), like GPT-4, which powers ChatGPT, face various safety issues, including biased responses and a lack of alignment with users' backgrounds and expectations. These problems threaten their sociability and public application. Present strategies for addressing these safety concerns primarily involve data-driven approaches, requiring extensive human effort in data annotation and substantial training resources. Research indicates that the nature of these safety issues evolves over time, necessitating continual updates to data and model re-training—an approach that is both resource-intensive and time-consuming. This thesis introduces a novel, model-centric strategy for understanding and mitigating the safety issues of PLMs by …


Scalable Methods For Resource-Constrained Adaptive Sampling, Kizito Masaba Jan 2024

Scalable Methods For Resource-Constrained Adaptive Sampling, Kizito Masaba

Dartmouth College Ph.D Dissertations

As the global community confronts the pressing issues of climate change, the importance of environment monitoring cannot be overstated. This process is essential in identifying and tracking critical environmental trends to facilitate efficient and effective conservation efforts. Traditionally, scientists perform this task using hand-held, in-situ instruments. With the recent robot advancements, this task can be fully automated by applying multi-robot systems to a task referred to as multi-robot adaptive sampling. However, the cost of purchasing and operating robot systems for this application are still prohibitive due to various environmental, technological, and logistical constraints. Some of the outstanding constraints to the …


A Memory Efficient Deep Recurrent Q-Learning Approach For Autonomous Wildfire Surveillance, Jeremy A. Cantor Jan 2024

A Memory Efficient Deep Recurrent Q-Learning Approach For Autonomous Wildfire Surveillance, Jeremy A. Cantor

UNF Graduate Theses and Dissertations

Previous literature demonstrates that autonomous UAVs (unmanned aerial vehicles) have the po- tential to be utilized for wildfire surveillance. This advanced technology empowers firefighters by providing them with critical information, thereby facilitating more informed decision-making processes. This thesis applies deep Q-learning techniques to the problem of control policy design under the objective that the UAVs collectively identify the maximum number of locations that are under fire, assuming the UAVs can share their observations. The prohibitively large state space underlying the control policy motivates a neural network approximation, but prior work used only convolutional layers to extract spatial fire information from …


Feedback Loops: Feedback Machines, Patrick Barry Jan 2024

Feedback Loops: Feedback Machines, Patrick Barry

Articles

Yes, AI raises serious concerns about bias, privacy, copyright infringement, environmental sustainability, and a whole bunch of other important topics. But if you are looking for a positive use case - and a new way to approach professional development - try asking chatgpt or some other AI chatbot for feedback, especially on something you've written.


Transformer-Enabled Deep Reinforcement Learning For Coverage Path Planning, Daniel B. Tiu Jan 2024

Transformer-Enabled Deep Reinforcement Learning For Coverage Path Planning, Daniel B. Tiu

UNF Graduate Theses and Dissertations

Coverage path planning (CPP) is the problem of covering all points in an environment and is a well-researched topic in robotics due to its sheer practical relevance. This paper investigates such an offline CPP problem where the primary objective is to minimize the path length to achieve complete coverage. Furthermore, the literature suggests that taking turns leads to a higher energy use than going straight. To this end, we design a novel objective function that aims to minimize the number of turns as well. We have proposed a deep reinforcement learning (DRL)-based framework that uses a Transformer model. Unlike state-of-the-art …


Media Haze Classification In Retinal Images Using Deep Learning, Jonathan O'Berry Jan 2024

Media Haze Classification In Retinal Images Using Deep Learning, Jonathan O'Berry

UNF Graduate Theses and Dissertations

Media Haze (MH) is a condition that affects an individual’s quality of life by affecting their eyes. Current practice is to detect MH by manually examining retinal fundus (retinal) images. The analysis of images being used as the prevalent technique for identifying the MH condition strongly suggests that automation of this process may be possible. In recent years, machine learning, specifically computer vision, has allowed for the automation of tasks relating to image analysis. This ability to automate has also recently been shown in the medical field for some eye conditions and diseases. This thesis centers around the problem of …


Using Pose Estimation Software To Predict Actions In Sabre Fencing, Micah Edwin Peters Ii Jan 2024

Using Pose Estimation Software To Predict Actions In Sabre Fencing, Micah Edwin Peters Ii

Honors College Theses

Fencing is a combat sport that uses three different swords: epee, foil, and sabre. Due to its fast-paced nature and employment of right of way, sabre fencing is often considered the most difficult of the three to learn. Computer vision and pose estimation software can be used to lower the barrier of entry to sabre fencing by identifying the different actions in sabre fencing. This project focuses on using open-source software to design a program that can identify the sabre parries as well as the main sabre movements. This program could be used to help newer fencers and spectators better …


Ethical Decision-Making In Older Drivers During Critical Driving Situations: An Online Experiment, Amandeep Singh, Sarah Yahoodik, Yovela Murzello, Samuel Petkac, Yusuke Yamani, Siby Samuel Jan 2024

Ethical Decision-Making In Older Drivers During Critical Driving Situations: An Online Experiment, Amandeep Singh, Sarah Yahoodik, Yovela Murzello, Samuel Petkac, Yusuke Yamani, Siby Samuel

Psychology Faculty Publications

The present study examined the impact of aging on ethical decision-making in simulated critical driving scenarios. 204 participants from North America, grouped into two age groups (18–30 years and 65 years and above), were asked to decide whether their simulated automated vehicle should stay in or change from the current lane in scenarios mimicking the Trolley Problem. Each participant viewed a video clip rendered by the driving simulator at Old Dominion University and pressed the space-bar if they decided to intervene in the control of the simulated automated vehicle in an online experiment. Bayesian hierarchical models were used to analyze …


Leveraging Machine Learning To Study How Temperature Scores Predict Pre-Term Birth Status, Erich Seamon, Jennifer A. Mattera, Sarah A. Keim, Esther M. Leerkes, Jennifer L. Rennels, Andrea J. Kayl, Kristy M. Kulhanek, Darcia Narvaez, Sarah M. Sanborn, Jennifer B. Grandits, Christine Dunkel Schetter, Mary Coussons-Read, Amanda R. Tarullo, Sarah J. Schoppe-Sullivan, Mariah E. Thomason, Julie M. Braungart-Rieker, Julie C. Lumeng, Shannon N. Lenze, Lisa M. Christian, Darby E. Saxbe, Laura R. Stroud, Christina M. Rodriguez, Stephanie Anzaman-Frasca Jan 2024

Leveraging Machine Learning To Study How Temperature Scores Predict Pre-Term Birth Status, Erich Seamon, Jennifer A. Mattera, Sarah A. Keim, Esther M. Leerkes, Jennifer L. Rennels, Andrea J. Kayl, Kristy M. Kulhanek, Darcia Narvaez, Sarah M. Sanborn, Jennifer B. Grandits, Christine Dunkel Schetter, Mary Coussons-Read, Amanda R. Tarullo, Sarah J. Schoppe-Sullivan, Mariah E. Thomason, Julie M. Braungart-Rieker, Julie C. Lumeng, Shannon N. Lenze, Lisa M. Christian, Darby E. Saxbe, Laura R. Stroud, Christina M. Rodriguez, Stephanie Anzaman-Frasca

Psychology Faculty Publications

Background

Preterm birth (birth at <37 completed weeks gestation) is a significant public heatlh concern worldwide. Important health, and developmental consequences of preterm birth include altered temperament development, with greater dysregulation and distress proneness.

Aims

The present study leveraged advanced quantitative techniques, namely machine learning approaches, to discern the contribution of narrowly defined and broadband temperament dimensions to birth status classification (full-term vs. preterm). Along with contributing to the literature addressing temperament of infants born preterm, the present study serves as a methodological demonstration of these innovative statistical techniques.

Study design

This study represents a metanalysis conducted with multiple samples (N = 19) including preterm (n = 201) children and (n = 402) born at term, with data combined across investigations to perform classification analyses.

Subjects …


Synthetic Health Data: Real Ethical Promise And Peril, W. Nicholson Price Ii, Daniel Susser Jan 2024

Synthetic Health Data: Real Ethical Promise And Peril, W. Nicholson Price Ii, Daniel Susser

Other Publications

Modern health research and development faces a dilemma. On the one hand, there is more data than ever — in electronic health records, in lab research, in public datasets, and on the internet — from which to extract potentially transformative scientific insights and to use as the basis for developing breakthrough health care technologies. On the other hand, using this data entails various risks: threats to patient privacy, skewed samples and approaches to analysis that can perpetuate demographic and other biases, and uneven access to data about rare conditions and small patient subgroups. Generating synthetic data has emerged as one …


Hack24f: Ai Audio Extractor, David Wu, Tiffany Nham Jan 2024

Hack24f: Ai Audio Extractor, David Wu, Tiffany Nham

Paul English Applied Artificial Intelligence (AI) Institute Publications

I want to make a next.js website locally and then be able to hopefully deploy on Vercel. Within the website I want to be able to use AI to separate the instruments (vocals, piano, guitar, drums, bass, etc.) and also identify which notes are being played. I was thinking that we might be able to use an AI stem splitter to separate the audio tracks and use another AI model for note detection.


Hack24f: Ai Conversations In Healthcare, Patrick Finger, Hannah Neale, Anthony Ferreira, Ayaz Mohammed Jan 2024

Hack24f: Ai Conversations In Healthcare, Patrick Finger, Hannah Neale, Anthony Ferreira, Ayaz Mohammed

Paul English Applied Artificial Intelligence (AI) Institute Publications

Nursing students often complete clinical hours under the supervision of instructors in traditional hospital settings. However, obtaining individualized, consistent feedback from patients about their interactions with nursing students is often not feasible. This limits students' ability to fully understand how their communication skills are perceived and how they can improve. Currently, there are no models that represent realistic real life conversations with patients. Most virtual simulation models used for nursing students provide scripted responses that do not feel genuine.


Hack24f: The Empathy Architects, Michael Rejtig, Ajanee Igharo, Emma Kelminson, Jackson Comeau Jan 2024

Hack24f: The Empathy Architects, Michael Rejtig, Ajanee Igharo, Emma Kelminson, Jackson Comeau

Paul English Applied Artificial Intelligence (AI) Institute Publications

Problem Statement: We want to help patients from underserved communities feel more safe, respected and comfortable in interacting with healthcare providers during the initial in-person encounters while also helping providers build empathy and implement socio-emotionally competent communication behaviors. Solution: Empathy Evolution is an AI-powered role-playing game that helps patients simulate their ideal communication with healthcare providers.


Sub-Band Backdoor Attack In Remote Sensing Imagery, Kazi Aminul Islam, Hongyi Wu, Chunsheng Xin, Rui Ning, Liuwan Zhu, Jiang Li Jan 2024

Sub-Band Backdoor Attack In Remote Sensing Imagery, Kazi Aminul Islam, Hongyi Wu, Chunsheng Xin, Rui Ning, Liuwan Zhu, Jiang Li

Electrical & Computer Engineering Faculty Publications

Remote sensing datasets usually have a wide range of spatial and spectral resolutions. They provide unique advantages in surveillance systems, and many government organizations use remote sensing multispectral imagery to monitor security-critical infrastructures or targets. Artificial Intelligence (AI) has advanced rapidly in recent years and has been widely applied to remote image analysis, achieving state-of-the-art (SOTA) performance. However, AI models are vulnerable and can be easily deceived or poisoned. A malicious user may poison an AI model by creating a stealthy backdoor. A backdoored AI model performs well on clean data but behaves abnormally when a planted trigger appears in …


Domain Adaptive Federated Learning For Multi-Institution Molecular Mutation Prediction And Bias Identification, W. Farzana, M. A. Witherow, I. Longoria, M. S. Sadique, A. Temtam, K. M. Iftekharuddin Jan 2024

Domain Adaptive Federated Learning For Multi-Institution Molecular Mutation Prediction And Bias Identification, W. Farzana, M. A. Witherow, I. Longoria, M. S. Sadique, A. Temtam, K. M. Iftekharuddin

Electrical & Computer Engineering Faculty Publications

Deep learning models have shown potential in medical image analysis tasks. However, training a generalized deep learning model requires huge amounts of patient data that is usually gathered from multiple institutions which may raise privacy concerns. Federated learning (FL) provides an alternative to sharing data across institutions. Nonetheless, FL is susceptible to a few challenges including inversion attacks on model weights, heterogenous data distributions, and bias. This study addresses heterogeneity and bias issues for multi-institution patient data by proposing domain adaptive FL modeling using several radiomics (volume, fractal, texture) features for O6-methylguanine-DNA methyltransferase (MGMT) classification across multiple institutions. The proposed …


Computer-Aided Craniofacial Superimposition Validation Study: The Identification Of The Leaders And Participants Of The Polish-Lithuanian January Uprising (1863–1864), Rubén Martos, Rosario Guerra, Fernando Navarro, Michela Peruch, Kevin Neuwirth, Andrea Valsecchi, Rimantas Jankauskas, Oscar Ibáñez Jan 2024

Computer-Aided Craniofacial Superimposition Validation Study: The Identification Of The Leaders And Participants Of The Polish-Lithuanian January Uprising (1863–1864), Rubén Martos, Rosario Guerra, Fernando Navarro, Michela Peruch, Kevin Neuwirth, Andrea Valsecchi, Rimantas Jankauskas, Oscar Ibáñez

Faculty, Staff and Student Publications

In 2017, a series of human remains corresponding to the executed leaders of the "January Uprising" of 1863-1864 were uncovered at the Upper Castle of Vilnius (Lithuania). During the archeological excavations, 14 inhumation pits with the human remains of 21 individuals were found at the site. The subsequent identification process was carried out, including the analysis and cross-comparison of post-mortem data obtained in situ and in the lab with ante-mortem data obtained from historical archives. In parallel, three anthropologists with diverse backgrounds in craniofacial identification and two students without previous experience attempted to identify 11 of these 21 individuals using …


Ai And Ml-Based Risk Assessment Of Chemicals: Predicting Carcinogenic Risk From Chemical-Induced Genomic Instability, Ajay Vikram Singh, Preeti Bhardwaj, Peter Laux, Prachi Pradeep, Madleen Busse, Andreas Luch, Akihiko Hirose, Christopher J. Osgood, Michael W. Stacey Jan 2024

Ai And Ml-Based Risk Assessment Of Chemicals: Predicting Carcinogenic Risk From Chemical-Induced Genomic Instability, Ajay Vikram Singh, Preeti Bhardwaj, Peter Laux, Prachi Pradeep, Madleen Busse, Andreas Luch, Akihiko Hirose, Christopher J. Osgood, Michael W. Stacey

Biological Sciences Faculty Publications

Chemical risk assessment plays a pivotal role in safeguarding public health and environmental safety by evaluating the potential hazards and risks associated with chemical exposures. In recent years, the convergence of artificial intelligence (AI), machine learning (ML), and omics technologies has revolutionized the field of chemical risk assessment, offering new insights into toxicity mechanisms, predictive modeling, and risk management strategies. This perspective review explores the synergistic potential of AI/ML and omics in deciphering clastogen-induced genomic instability for carcinogenic risk prediction. We provide an overview of key findings, challenges, and opportunities in integrating AI/ML and omics technologies for chemical risk assessment, …


Exacfs - A Cil Method To Mitigate Catastrophic Forgetting, S. Balasubramanian, Sai Subramaniam M., Sai Sriram Talasu, Manepalli Pranav Phanindra Sai, Yedu P. Krishna, Darshan Gera, Ravi Mukkamala Jan 2024

Exacfs - A Cil Method To Mitigate Catastrophic Forgetting, S. Balasubramanian, Sai Subramaniam M., Sai Sriram Talasu, Manepalli Pranav Phanindra Sai, Yedu P. Krishna, Darshan Gera, Ravi Mukkamala

Computer Science Faculty Publications

Deep neural networks (DNNs) excel at learning from static datasets but struggle with continual learning, where data arrives sequentially. Catastrophic forgetting, the phenomenon of forgetting previously learned knowledge, is a primary challenge. This paper introduces EXponentially Averaged Class-wise Feature Significance (EXACFS) to mitigate this issue in the class incremental learning (CIL) setting. By estimating the significance of model features for each learned class using loss gradients, gradually aging the significance through the incremental tasks and preserving the significant features through a distillation loss, EXACFS effectively balances remembering old knowledge (stability) and learning new knowledge (plasticity). Extensive experiments on CIFAR-100 and …


Spatially-Aware Speaker For Vision-And-Language Navigation Instruction Generation, Muraleekrishna Gopinathan, Martin Masek, Jumana Abu-Khalaf, David Suter Jan 2024

Spatially-Aware Speaker For Vision-And-Language Navigation Instruction Generation, Muraleekrishna Gopinathan, Martin Masek, Jumana Abu-Khalaf, David Suter

Research outputs 2022 to 2026

Embodied AI aims to develop robots that can understand and execute human language instructions, as well as communicate in natural languages. On this front, we study the task of generating highly detailed navigational instructions for the embodied robots to follow. Although recent studies have demonstrated significant leaps in the generation of step-by-step instructions from sequences of images, the generated instructions lack variety in terms of their referral to objects and landmarks. Existing speaker models learn strategies to evade the evaluation metrics and obtain higher scores even for low-quality sentences. In this work, we propose SAS (Spatially-Aware Speaker), an instruction generator …


Dilf: Differentiable Rendering-Based Multi-View Image-Language Fusion For Zero-Shot 3d Shape Understanding, Xin Ning, Zaiyang Yu, Lusi Li, Weijun Li, Prayag Tiwari Jan 2024

Dilf: Differentiable Rendering-Based Multi-View Image-Language Fusion For Zero-Shot 3d Shape Understanding, Xin Ning, Zaiyang Yu, Lusi Li, Weijun Li, Prayag Tiwari

Computer Science Faculty Publications

Zero-shot 3D shape understanding aims to recognize “unseen” 3D categories that are not present in training data. Recently, Contrastive Language–Image Pre-training (CLIP) has shown promising open-world performance in zero-shot 3D shape understanding tasks by information fusion among language and 3D modality. It first renders 3D objects into multiple 2D image views and then learns to understand the semantic relationships between the textual descriptions and images, enabling the model to generalize to new and unseen categories. However, existing studies in zero-shot 3D shape understanding rely on predefined rendering parameters, resulting in repetitive, redundant, and low-quality views. This limitation hinders the model’s …


A Chinese Power Text Classification Algorithm Based On Deep Active Learning, Song Deng, Qianliang Li, Renjie Dai, Siming Wei, Di Wu, Yi He, Xindong Wu Jan 2024

A Chinese Power Text Classification Algorithm Based On Deep Active Learning, Song Deng, Qianliang Li, Renjie Dai, Siming Wei, Di Wu, Yi He, Xindong Wu

Computer Science Faculty Publications

The construction of knowledge graph is beneficial for grid production, electrical safety protection, fault diagnosis and traceability in an observable and controllable way. Highly-precision text classification algorithm is crucial to build a professional knowledge graph in power system. Unfortunately, there are a large number of poorly described and specialized texts in the power business system, and the amount of data containing valid labels in these texts is low. This will bring great challenges to improve the precision of text classification models. To offset the gap, we propose a classification algorithm for Chinese text in the power system based on deep …


Identifying Patterns For Neurological Disabilities By Integrating Discrete Wavelet Transform And Visualization, Soo Yeon Ji, Sampath Jayarathna, Anne M. Perrotti, Katrina Kardiasmenos, Dong Hyun Jeong Jan 2024

Identifying Patterns For Neurological Disabilities By Integrating Discrete Wavelet Transform And Visualization, Soo Yeon Ji, Sampath Jayarathna, Anne M. Perrotti, Katrina Kardiasmenos, Dong Hyun Jeong

Computer Science Faculty Publications

Neurological disabilities cause diverse health and mental challenges, impacting quality of life and imposing financial burdens on both the individuals diagnosed with these conditions and their caregivers. Abnormal brain activity, stemming from malfunctions in the human nervous system, characterizes neurological disorders. Therefore, the early identification of these abnormalities is crucial for devising suitable treatments and interventions aimed at promoting and sustaining quality of life. Electroencephalogram (EEG), a non-invasive method for monitoring brain activity, is frequently employed to detect abnormal brain activity in neurological and mental disorders. This study introduces an approach that extends the understanding and identification of neurological disabilities …


Learning Optimal Inter-Class Margin Adaptively For Few-Shot Class-Incremental Learning Via Neural Collapse-Based Meta-Learning, Hang Ran, Weijun Li, Lusi Li, Songsong Tian, Xin Ning, Prayag Tiwari Jan 2024

Learning Optimal Inter-Class Margin Adaptively For Few-Shot Class-Incremental Learning Via Neural Collapse-Based Meta-Learning, Hang Ran, Weijun Li, Lusi Li, Songsong Tian, Xin Ning, Prayag Tiwari

Computer Science Faculty Publications

Few-Shot Class-Incremental Learning (FSCIL) aims to learn new classes incrementally with a limited number of samples per class. It faces issues of forgetting previously learned classes and overfitting on few-shot classes. An efficient strategy is to learn features that are discriminative in both base and incremental sessions. Current methods improve discriminability by manually designing inter-class margins based on empirical observations, which can be suboptimal. The emerging Neural Collapse (NC) theory provides a theoretically optimal inter-class margin for classification, serving as a basis for adaptively computing the margin. Yet, it is designed for closed, balanced data, not for sequential or few-shot …