Artificial Intelligence and Robotics Commons^™

Deep Transfer Learning-Based Bird Species Classification Using Mel Spectrogram Images, Mrinal Kanti Baowaly, Bisnu Chandra Sarkar, Md.Abul Ala Walid, Md. Martuza Ahamad, Bikash Chandra Singh, Eduardo Silva Alvarado, Imran Ashraf, Md. Abdus Samad

School of Cybersecurity Faculty Publications

The classification of bird species is of significant importance in the field of ornithology, as it plays an important role in assessing and monitoring environmental dynamics, including habitat modifications, migratory behaviors, levels of pollution, and disease occurrences. Traditional methods of bird classification, such as visual identification, were time-intensive and required a high level of expertise. However, audio-based bird species classification is a promising approach that can be used to automate bird species identification. This study aims to establish an audio-based bird species classification system for 264 Eastern African bird species employing modified deep transfer learning. In particular, the pre-trained EfficientNet …

Robustsentembed: Robust Sentence Embeddings Using Adversarial Self-Supervised Contrastive Learning, Javad Rafiei Asl, Prajwal Panzade, Eduardo Blanco, Daniel Takabi, Zhipeng Cai

School of Cybersecurity Faculty Publications

Pre-trained language models (PLMs) have consistently demonstrated outstanding performance across a diverse spectrum of natural language processing tasks. Nevertheless, despite their success with unseen data, current PLM-based representations often exhibit poor robustness in adversarial settings. In this paper, we introduce RobustSentEmbed, a self-supervised sentence embedding framework designed to improve both generalization and robustness in diverse text representation tasks and against a diverse set of adversarial attacks. Through the generation of high-risk adversarial perturbations and their utilization in a novel objective function, RobustSentEmbed adeptly learns high-quality and robust sentence embeddings. Our experiments confirm the superiority of RobustSentEmbed over state-of-the-art representations. Specifically, …

A Systemic Mapping Study On Intrusion Response Systems, Adel Rezapour, Mohammad Ghasemigol, Daniel Takabi

School of Cybersecurity Faculty Publications

With the increasing frequency and sophistication of network attacks, network administrators are facing tremendous challenges in making fast and optimum decisions during critical situations. The ability to effectively respond to intrusions requires solving a multi-objective decision-making problem. While several research studies have been conducted to address this issue, the development of a reliable and automated Intrusion Response System (IRS) remains unattainable. This paper provides a Systematic Mapping Study (SMS) for IRS, aiming to investigate the existing studies, their limitations, and future directions in this field. A novel semi-automated research methodology is developed to identify and summarize related works. The innovative …

The Educational Affordances And Challenges Of Chatgpt: State Of The Field, Helen Crompton, Diane Burke

STEMPS Faculty Publications

ChatGPT was released to the public in November 30, 2022. This study examines how ChatGPT can be used by educators and students to promote learning and what are the challenges and limitations. This study is unique in providing one of the first systematic reviews using peer review studies to provide an early examination of the field. Using PRISMA principles, 44 articles were selected for review. Grounded coding was then used to reveal trends in the data. The findings show that educators can use ChatGPT for teaching support, task automation, and professional development. These were further delineated further by axial sub …

Dark Side Of Genai: A Blackbox Analysis Of X, Ahmed El Noshokaty, Tareq Nasralah, Omar El-Gayar, Mohammad A. Al-Ramahi, Abdullah Wahbeh

All Faculty Scholarship (Archived)

Recent advancements in generative artificial intelligence (GenAI) have raised many fears, risks, and concerns (Kim 2023; Okey et al. 2023). To shed light on the dark side of GenAI, we collected 55,916 posts from X (formerly Twitter). Based on the content of these posts, we manually labeled a sample set with the corresponding dark side, then identified a short, comprehensive list of GenAI dark sides. Using this list, we trained the ReadMe classifier, a supervised learning algorithm on Brandwatch (“Crimson Hexagon and Brandwatch” 2020), to classify the remaining posts. Further analysis, including emotion analysis and analysis of professions and interests …

Urban Flood Extent Segmentation And Evaluation From Real-World Surveillance Camera Images Using Deep Convolutional Neural Network, Yidi Wang, Yawen Shen, Behrouz Salahshour, Mecit Cetin, Khan Iftekharuddin, Navid Tahvildari, Guoping Huang, Devin K. Harris, Kwame Ampofo, Jonathan L. Goodall

Civil & Environmental Engineering Faculty Publications

This study explores the use of Deep Convolutional Neural Network (DCNN) for semantic segmentation of flood images. Imagery datasets of urban flooding were used to train two DCNN-based models, and camera images were used to test the application of the models with real-world data. Validation results show that both models extracted flood extent with a mean F1-score over 0.9. The factors that affected the performance included still water surface with specular reflection, wet road surface, and low illumination. In testing, reduced visibility during a storm and raindrops on surveillance cameras were major problems that affected the segmentation of flood extent. …

A Generative Approach For Document Enhancement With Small Unpaired Data, Mohammad Shahab Uddin, Wael Khallouli, Andres Sousa-Poza, Samuel Kovacic, Jiang Li

Engineering Management & Systems Engineering Faculty Publications

Shipbuilding drawings, crafted manually before the digital era, are vital for historical reference and technical insight. However, their digital versions, stored as scanned PDFs, often contain significant noise, making them unsuitable for use in modern CAD software like AutoCAD. Traditional denoising techniques struggle with the diverse and intense noise found in these documents, which also does not adhere to standard noise models. In this paper, we propose an innovative generative approach tailored for document enhancement, particularly focusing on shipbuilding drawings. For a small, unpaired dataset of clean and noisy shipbuilding drawing documents, we first learn to generate the noise in …

Accelerating Markov Chain Monte Carlo Sampling With Diffusion Models, N. T. Hunt-Smith, W. Melnitchouk, F. Ringer, N. Sato, A. W. Thomas, M. J. White

Physics Faculty Publications

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a Metropolis-Hastings algorithm with a diffusion model that can draw global samples with the aim of approximating the posterior. We briefly review diffusion models in the context of image synthesis before providing a streamlined diffusion model tailored towards low-dimensional data arrays. We then present our adapted Metropolis-Hastings algorithm which combines local proposals with global proposals taken from a diffusion model that is regularly trained on the samples produced during the …

Is Infrared-Collinear Safe Information All You Need For Jet Classification?, Dimitrios Athanasakos, Andrew J. Larkoski, James Mulligan, Mateusz Ploskoń, Felix Ringer

Physics Faculty Publications

Machine learning-based jet classifiers are able to achieve impressive tagging performance in a variety of applications in high-energy and nuclear physics. However, it remains unclear in many cases which aspects of jets give rise to this discriminating power, and whether jet observables that are tractable in perturbative QCD such as those obeying infrared-collinear (IRC) safety serve as sufficient inputs. In this article, we introduce a new classifier, Jet Flow Networks (JFNs), in an effort to address the question of whether IRC unsafe information provides additional discriminating power in jet classification. JFNs are permutation-invariant neural networks (deep sets) that take as …

Point Cloud Diffusion Models For The Electron-Ion Collider, Jack Y. Araz, Vinicius Mikuni, Felix Ringer, Nobuo Sato, Fernando Torales Acosta, Richard Whitehill

Physics Faculty Publications

At high-energy collider experiments, generative models can be used for a wide range of tasks, including fast detector simulations, unfolding, searches of physics beyond the Standard Model, and inference tasks. In particular, it has been demonstrated that score-based diffusion models can generate high-fidelity and accurate samples of jets or collider events. This work expands on previous generative models in three distinct ways. First, our model is trained to generate entire collider events, including all particle species with complete kinematic information. We quantify how well the model learns event-wide constraints such as the conservation of momentum and discrete quantum numbers. We …

Advancing Discourse Analysis In Multiparty Meetings: Comprehensive Classification Of Argument And Relation Types, Vishal Vaitla

Master's Projects

In multi-party meetings, accurately analyzing dialogue is crucial for enhancing communication effectiveness and decision-making. However, the informal and dynamic nature of these discussions presents complex challenges for computational analysis. Dialogues in such settings often include non-standard language, interruptions, and rapid topic changes, making it difficult to extract useful information with conventional text analysis tools. To tackle this challenge, two specific methods were developed:

Argument Classification: We use machine learning models like Gradient Boosting to identify and categorize the main points people make in their discussions. This helps us understand what each person is trying to say, making it easier to …

Breaking The Cycle: Countering Popularity Bias For Diverse Content Discovery, Brandon J. Weaver

Master's Projects

The ways most people consume the media have become very much driven by some pre-set algorithms. It is increasingly important to examine the outcome of these artificial intelligence (AI) models and ensure that any potentially dangerous long-term effects are addressed before they have a significant negative impact in our society. Popularity bias is one of these potentially harmful impacts, which stemmed from the shift from human intelligence to AI, or machine intelligence/machine learning (ML), when one explores the media and receives recommendations (often without requesting). In ML, three key steps usually occur; i.e, pre-processing, in-processing, and post- processing steps. The …

Preparing Healthcare Education For An Ai-Augmented Future, Jiajie Zhang, Susan H Fenton

Faculty, Staff and Student Publications

Artificial intelligence (AI) fundamentally transforms healthcare education as a knowledge enterprise, creating a distributed cognitive system composed of the human brain, which remains relatively unchanged, and AI-based knowledge and cognitive functions, which have accelerated exponentially in scale and power. Education must focus on developing skills to collaborate with AI and on achieving outcomes like problems solved and discoveries made. Curriculum and education policies also need to adapt to this transformation.

Ai Trustworthy: Ethical Challenges And Strategies, Jian Liu, Iwan Sandjaja, Donald C. Wunsch

Electrical and Computer Engineering Faculty Research & Creative Works

This paper explores the pivotal role of trust in the widespread application of Artificial Intelligence (AI) across various domains. We review AI applications in sectors like energy, healthcare, and autonomous vehicles and discuss the crisis of human trust they face. This paper introduces a novel framework that delineates the relationship between AI transparency and user trust, highlighting specific industry applications. Through a systematic review of recent literature, we first delve into factors such as emotional response, acceptance, transparency, accuracy, and interpretability that shape human trust in AI. We then underscore the necessity of ethical AI practices and highlight the importance …

Robot-Based 3d Printing, Aaron Hoffman

Williams Honors College, Honors Research Projects

Details of a large-format 3D printer created to print experimental materials, test multi-axis print techniques, and quickly print large objects. The printer consists of a 7-axis robotic arm and pellet extruder, which are controlled by a PC. Experimental materials such as recycled polymers or carbon-fiber reinforced materials can be easily tested with the pellet format of the extruder. The printer can perform different printing techniques and can be used to experiment with material properties when using these techniques with different polymers. The print surface is around 5 times larger than the average commercial 3D printer, and the robotic arm provides …

A Comparison Of Lexical Tokenization Methods, Nathan Culmer

Williams Honors College, Honors Research Projects

The purpose of this project was to compare tokenization methods, or methods of breaking up a text into meaningful parts for use in natural language processing. The effectiveness of several commonly used tokenization methods were investigated, including morpheme tokenization, which takes into account the linguistic features of the language. In addition, I proposed and implemented a new technique to consider the capitalization pattern of a word in the tokenization process, in order to allow this process to include more natural language features. The effectiveness of these methods was compared by using them in a sentiment analysis model for various datasets, …

Security Information And Event Management Optimization Using Deep Federated Learning In Cloud-Based Autonomous Cyber-Physical Systems, Mohamed Mounir Moussa

Wayne State University Dissertations

The integration of cloud-based technologies into Connected and Autonomous Vehicles (CAVs) is reshaping the field by combining Deep Federated Learning (DFL), Security Information and Event Management (SIEM), and cloud-dew computing. This solution leverages cloud-based resource provisioning, which is crucial for allocating scalable and efficient computational resources in a dynamic manner. These resources are essential for managing the intricate data and computing requirements of distributed systems, especially in the intelligent vehicle sector. This provisioning facilitates the efficient control of route mapping and cybersecurity in Connected Autonomous Vehicles (CAVs), guaranteeing the ability to process and make decisions in real-time.The research evaluates the …

28. Creating Constitutions With Chatgpt, Julia M. Gossard

Teaching and Generative AI: Pedagogical Possibilities and Productive Tensions

This chapter explores how students used ChatGPT to construct constitutions in a course on the history of the Age of Revolutions. Student responses, the product, and instructor implications and critiques are included.

19. Wrestling With A.I., Catherine J. Denial

Teaching and Generative AI: Pedagogical Possibilities and Productive Tensions

Generative AI has been sold to us at speed, promising quick resolutions to writing problems for students and demanding nimble responses from faculty. This essay suggests that instead of surrendering to a manufactured sense of urgency we take the time to fully grapple with the meaning of generative AI, and to respond to its challenges. By thinking through the ethical dimensions of AI in the classroom, and by gradually changing our assessment practices, we place humans back at the center of our common educational experiences.

Part Iii: Section 3: Race And Indigenous Studies, Beth Buyserie, Travis N. Thurston

Teaching and Generative AI: Pedagogical Possibilities and Productive Tensions

No abstract provided.

4. Developing Media And Information Literacy Through Dialogues About Ai, Rosa Thornley, Dory Rosenberg

Teaching and Generative AI: Pedagogical Possibilities and Productive Tensions

Inviting students to dialogue about Artificial Intelligence (Al) can help to develop media and information literacy. Instead of establishing restrictive policies, we present a method for instructor-facilitated dialogues to teach students to analyze, evaluate, and interact with generative language models. This recursive inquiry process causes students to critically think about the spectrum of AI capabilities and limitations. Practicing this inquiry habit over time directs students towards intuitively questioning the Al which leads them to govern their own choices when they become rhetorically aware of emerging technologies and how it will affect their own research and writing. For instructors in higher …

1. Navigating The New Frontier Of Generative Ai In Peer Review And Academic Writing, Chris Mayer

Teaching and Generative AI: Pedagogical Possibilities and Productive Tensions

This chapter provides an overview of the current landscape and implications of Generative Al (GenAl) in higher education, particularly focusing on its role in academic writing and peer review. The emergence of GenAl tools such as ChatGPT is a transformative development in education, with widespread adoption at unprecedented speed. Large Language Models such as ChatGPT offer great potential for enhancing education and academic writing but also raise serious ethical concerns and tensions including access and usability, the perpetuation of Standard Academic English, and issues of linguistic justice. There is also the need for new approaches and pedagogies for how to …

14. Indigenous Futures In Generative Artificial Intelligence: The Paradox Of Participation, Rogelio E. Cardona-Rivera, J. Kaleo Alladin, Breanne K. Litts, Melissa Tehee

Teaching and Generative AI: Pedagogical Possibilities and Productive Tensions

As we work toward expanding and diversifying accurate representations of Indigenous peoples in classrooms, we must also consider the role of Native people in the construction of these technologies. Indigenous communities face the following paradox in the Generative Al space: in wanting to be represented by the Generative Al by sharing data representations their ways of knowing and being, they lose the agency to exert their rhetorical, technological, and data sovereignty over whatever is shared into the Generative Al system. Alternatively, not participating in the Generative Al space continues to perpetuate Western-centric biases and systemic racism built into the existing …

Uniform Convergence Of Deep Neural Networks With Lipschitz Continuous Activation Functions And Variable Widths, Yuesheng Xu, Haizhang Zhang

Mathematics & Statistics Faculty Publications

We consider deep neural networks (DNNs) with a Lipschitz continuous activation function and with weight matrices of variable widths. We establish a uniform convergence analysis framework in which sufficient conditions on weight matrices and bias vectors together with the Lipschitz constant are provided to ensure uniform convergence of DNNs to a meaningful function as the number of their layers tends to infinity. In the framework, special results on uniform convergence of DNNs with a fixed width, bounded widths and unbounded widths are presented. In particular, as convolutional neural networks are special DNNs with weight matrices of increasing widths, we put …

Conflict Profiles And Team Outcomes In Cross-Disciplinary Teams: An Integrated Latent Profile Analysis And Natural Language Processing Approach, Francisco Cima, Pilar Pazos

Engineering Management & Systems Engineering Faculty Publications

Team conflict is a naturally emerging phenomenon resulting from individuals' interactions during project execution. Cross-disciplinary teams can experience higher levels of conflict than single-discipline teams because of the increased diversity of knowledge and perspectives. Research has shown that team conflict can emerge from different types of disagreements (cognitive and interpersonal), which have different implications for team functioning. Past empirical research has focused on the impact of both conflict types independent from each other while overlooking their combined effects. This work examines the conflict profiles resulting from the combined levels of interpersonal and cognitive disagreements and their association with team outcomes. …

Improving The Robustness Of Neural Networks To Adversarial Patch Attacks Using Masking And Attribution Analysis, Atandra Mahalder

Honors Undergraduate Theses

Computer vision algorithms, including image classifiers and object detectors, play a pivotal role in various cyber-physical systems, spanning from facial recognition to self-driving vehicles and security surveillance. However, the emergence of real-world adversarial patches, which can be as simple as stickers, poses a significant threat to the reliability of AI models utilized within these systems. To address this challenge, several defense mechanisms such as PatchGuard, Minority Report, and (De)Randomized Smoothing have been proposed to enhance the resilience of AI models against such attacks. In this thesis, we introduce a novel framework that integrates masking with attribution analysis to robustify AI …

Music Recommendation Using Exemplars And Contrastive Learning, Tina Tran

Honors Undergraduate Theses

The popularity of AI audio applications is growing, it is used in chatbots, automated voice translation, virtual assistants, and text-to-speech translation. Audio classification is crucial in today’s world with a growing need to sort and classify millions of existing audio data with increasing amounts of new data uploaded over time. In the area of classification lies the difficult and lucrative problem of music recommendation. Research in music recommendation has trended over time towards collaborative-based approaches utilizing large amounts of user data. These approaches tend to deal with the cold-start problem of insufficient data and are costly to train. We look …

Cross-Layer Design Of Highly Scalable And Energy-Efficient Ai Accelerator Systems Using Photonic Integrated Circuits, Sairam Sri Vatsavai

Theses and Dissertations--Electrical and Computer Engineering

Artificial Intelligence (AI) has experienced remarkable success in recent years, solving complex computational problems across various domains, including computer vision, natural language processing, and pattern recognition. Much of this success can be attributed to the advancements in deep learning algorithms and models, particularly Artificial Neural Networks (ANNs). In recent times, deep ANNs have achieved unprecedented levels of accuracy, surpassing human capabilities in some cases. However, these deep ANN models come at a significant computational cost, with billions to trillions of parameters. Recent trends indicate that the number of parameters per ANN model will continue to grow exponentially in the foreseeable …

Nonuniform Sampling-Based Breast Cancer Classification, Santiago Posso

Theses and Dissertations--Electrical and Computer Engineering

The emergence of deep learning models and their success in visual object recognition have fueled the medical imaging community's interest in integrating these algorithms to improve medical diagnosis. However, natural images, which have been the main focus of deep learning models and mammograms, exhibit fundamental differences. First, breast tissue abnormalities are often smaller than salient objects in natural images. Second, breast images have significantly higher resolutions but are generally heavily downsampled to fit these images to deep learning models. Models that handle high-resolution mammograms require many exams and complex architectures. Additionally, spatially resizing mammograms leads to losing discriminative details essential …

Advancing Household Robotics: Deep Interactive Reinforcement Learning For Efficient Training And Enhanced Performance, Arpita Soni, Sujatha Alla, Suresh Dodda, Hemanth Volikatla

Engineering Management & Systems Engineering Faculty Publications

The market for domestic robots—made to perform household chore, is growing as these robots relieve people of everyday responsibilities. Domestic robots are generally welcomed for their role in easing human labour, in contrast to industrial robots, which are frequently criticised for displacing human workers. But before these robots can carry out domestic chores, they need to become proficient in a number of minor activities, such as recognizing their surroundings, making decisions, and picking up on human behaviours. Reinforcement learning, or RL, has emerged as a key robotics technology that enables robots to interact with their environment and learn how to …