Artificial Intelligence and Robotics Commons^™

Artificial Intelligence And Translation: Exploring Current Applications, Limitations And Future Potential Of Language Models Through Japanese-English Translation, Loklin Elias Nord

Undergraduate Theses, Capstones, and Recitals

This thesis highlights the recent improvements and capabilities of Large Language Models (LLMs), specifically their ability to produce translations between different languages. The continued up-scaling of model sizes has led to breakthroughs in the level of their observed intelligence, allowing them to produce translations that are similar in quality to highly skilled human translators. However, to facilitate the reasoning processes that LLMs now possess, their demand for computational power and the supporting hardware and resources has increased proportionally. Considering the impacts of this technology on the environment, energy resources, and its accessibility, my research explores the possibilities of smaller, highly …

Logupdater: Automated Detection And Repair Of Specific Defects In Logging Statements, Renyi Zhong, Yichen Li, Jinxi Kuang, Wenwei Gu, Yintong Huo, R. Michael Lyu

Research Collection School Of Computing and Information Systems

Developers write logging statements to monitor software runtime behaviors and system state. However, poorly constructed or misleading log messages can inadvertently obfuscate actual program execution patterns, thereby impeding effective software maintenance. Existing research on analyzing issues within logging statements is limited, primarily focusing on detecting a singular type of defect and relying on manual intervention for fixes rather than automated solutions.To address the limitation, we initiate a systematic study that pinpoints four specific types of defects in logging statements (i.e., statement code inconsistency, static dynamic inconsistency, temporal relation inconsistency, and readability issues) through the analysis of real-world log-centric changes. We …

Generative Ai Adoption And Solvers' Popularity On Supply-Driven Crowdsourcing Platforms: The Dual Role Of Price Signals, Zimeng Zhu, Carol Hsu, Fiona Fui-Hoon Nah, Na Liu

Research Collection School Of Computing and Information Systems

Purpose – We investigate the effect of solvers’ adoption of Generative AI (GenAI) on their popularity in a supply-driven crowdsourcing platform. We also examine the impact of price signals as well as their heterogeneous impact based on the solvers’ membership duration on the platform. Design/methodology/approach – Our analysis focuses on solvers who adopt GenAI for design-related gigs on the supply-driven crowdsourcing platform. By combining propensity score matching (PSM) with multi-period difference-in-differences (DID), we examine how GenAI adoption impacts solvers’ popularity and how price signals affect this main effect. Findings – Our findings reveal that solvers who adopt GenAI tend to …

Suicide Ideation Detection Using Social Media Data And Ensemble Machine Learning Model, Erol Kina, Jin Ghoo Choi, Abid Ishaq, Rahman Shafique, Monica Gracia Villar, Eduardo Silva Alvarado, Isabel De La Torre Diez, Imran Ashraf

Research outputs 2022 to 2026

Identifying the emotional state of individuals has useful applications, particularly to reduce the risk of suicide. Users’ thoughts on social media platforms can be used to find cues on the emotional state of individuals. Clinical approaches to suicide ideation detection primarily rely on evaluation by psychologists, medical experts, etc., which is time-consuming and requires medical expertise. Machine learning approaches have shown potential in automating suicide detection. In this regard, this study presents a soft voting ensemble model (SVEM) by leveraging random forest, logistic regression, and stochastic gradient descent classifiers using soft voting. In addition, for the robust training of SVEM, …

Spatialimaginer: Towards Adaptive Visual Imagination For Spatial Reasoning, Yian Li, Yang Jiao, Bin Zhu, Tianwen Qian, Shaoxiang Chen, Jingjing Chen, Yu-Gang Jiang

Research Collection School Of Computing and Information Systems

Spatial intelligence, which refers to the ability to reason about geometric and physical structure from visual observations, remains a core challenge for multimodal large language models. Despite promising performance, recent multimodal large language models (MLLMs) often exhibit fragile reasoning traces in spatial intelligence tasks that involve consistent spatial state recognition. We argue that these failures stem from a mismatch between the spatial recognition mechanism and the text-only reasoning behavior of these MLLMs. Effective spatial reasoning requires low-level geometric structure to be faithfully preserved and updated throughout the reasoning process, whereas textual representations tend to abstract away precisely these critical details. …

Semantic-Structural Decoupling: Disentangling Semantic Attention From Structural Bias In The Attention Manifold, Pengkun Jiao, Bin Zhu, Jingjing Chen, Yu-Gang Jiang

Research Collection School Of Computing and Information Systems

The empirical success of attention mechanism in Multimodal Large Language Models (MLLMs) often obscures its inherent, subtle flaws. Specifically, MLLMs consistently exhibit disproportionate attention toward certain semantically uninformative visual tokens, a phenomenon termed "register" or "Visual Attention Sinks." While existing inference intervention methods attempt to identify these sink tokens and redistribute their attention weights, such approaches typically treat these tokens in isolation and suffer from computational inefficiency. Instead, we reframe this phenomenon as a generalized textual bias exerted over visual features that extends beyond isolated sink tokens. From this perspective, a pervasive structural bias leads to the dilution of the …

Keyframe Selection From Motion Capture Data With Dual-Agent Reinforcement Learning, Kun Hu, Wang, Clinton Mo, Mingyang Ma, Shaohui Mei, Zebin Chen, Zhiyong Wang

Research outputs 2022 to 2026

Animation production workflows centered around motion capture techniques require animators to edit motions based on a set of keyframes. However, most existing keyframe selection methods are optimization-based, which suffer from the issues of flexibility and efficiency. In this paper, a novel deep reinforcement learning method with dual agents are proposed for unsupervised keyframe selection. First, an S-Agent and an R-Agent evaluate the actions of selection and refinement, respectively. A deep spatio-temporal network, namely graph keyframe evaluation network (GKEN), is proposed for the agents. Then, an animation specified reward is devised based on reconstruction, which fulfills three important properties of the …

Ddor: Delta Debugging For Explainable Overrefusal Testing And Repair, Qinyan Zhou, Peixin Zhang, Jun Sun, Haonan Zhang, Dongxia Wang

Research Collection School Of Computing and Information Systems

While safety alignment and guardrails help large language models (LLMs) avoid harmful outputs, they can also induce overrefusal, i.e., unwarranted rejection of benign queries that merely appear risky. We present DDOR (Delta Debugging for OverRefusal), a fully automated and explainable framework for overrefusal testing and repair in a black-box setting, where only model inputs and outputs are accessible and internal safety mechanisms remain opaque. DDOR applies delta debugging to localize minimal refusal-triggering fragments (mRTFs) that provide phrase-level, explainable evidence for why a refusal occurs. Conditioned on these mRTFs, DDOR generates diverse, context-rich prompts and performs multi-oracle validation to filter intrinsically …

Mutation-Based Multi-Agent Test Case Update, Dawei Tian, Jiakun Liu, Yun Peng, Yichen Zhang, Jianlei Chi, Jun Sun, Xiaohong Su

Research Collection School Of Computing and Information Systems

Modern software systems evolve rapidly under CI/CD practices, where tests are critical for quality. However, substantial code changes often render existing test cases obsolete, causing pipeline disruptions, reduced productivity, and compromised quality. Recent automatic test update approaches leverage LLMs to refine test cases via execution feedback and exact-matching context retrieval, prioritizing executability and line coverage but suffering three limitations: (1) neglecting test assertion adequacy, weakening fault detection; (2) relying on coarse line coverage instead of specific uncovered lines/branches; (3) using exact-matching retrieval, which fails for LLM hallucinated queries. To address these, we propose MuMuTestUp, a mutation-guided multi-agent framework with three …

Algorithmic Medicine And The Duty To Disclose: Informed Consent Through The Lens Of Radiology, Lee Rodriguez

Michigan Law Review

Informed consent is the law’s mechanism for protecting patient autonomy by requiring disclosure of facts that bear on the decision to accept or refuse care. Artificial intelligence now helps decide what is medically true for patients, yet informed consent law still assumes that diagnostic judgment is rendered by a human mind whose reasoning is at least in principle communicable. Radiology has become the leading setting for this tension. AI systems triage worklists, flag suspected abnormalities, and anchor first-pass impressions in ways that guide radiologists’ attention and, in practice, can coauthor diagnostic conclusions while remaining invisible to patients. When patients are …

Kanmultisign: Multi-Scale Sequence-Based Pose Animation From Sign Language Notation With Kolmogorov-Arnold Networks, Guanyi Du, Lintao Wang, Kun Hu, Ziyang Wang

Research outputs 2022 to 2026

Sign language production from symbolic notation offers a scalable route to accessible sign animation. We present KANMultiSign, a multi-scale sequence generator that translates HamNoSys notation into two-dimensional human pose sequences. Our framework makes two complementary contributions. First, we introduce a coarse-to-fine generation strategy with multi-scale supervision: the model is first guided by an intermediate body–hand–face scaffold to encourage global structural coherence, and then refines fine-grained hand articulation to improve finger-level detail. Second, we investigate integrating Kolmogorov–Arnold Network modules into a Transformer backbone, using learnable univariate function primitives to model the highly non-linear mapping from discrete phonological symbols to continuous body …

From Data To Decision-Making: The Role Of Local Digital Twins In Cross-Domain Management Within Municipalities – A Research-In-Progress Study In Veenendaal, Diana M.E. Boekman, Koen Smit, Guido Ongena, Rob Peters

Communications of the IIMA

Municipalities are facing increasingly complex, interconnected challenges in areas like housing, climate adaptation, mobility, and social policy. Local Digital Twins (LDTs) are seen as a promising tool to make this complexity more understandable and support decision-making. At the same time, both literature and practice show that few initiatives get past the pilot phase, even though getting through that phase is essential for successful long-term adoption.

This paper presents a research-in-progress study on the development and application of an implementation method for LDT technology within the municipality of Veenendaal, based on human values rather than driven by technological possibilities. Based on …

From Dissertation To Deployment: A Unified Software Platform Operationalizing Clinical-Prediction And Sequential-Security Ai For Healthcare, Olsi Shehu, Damiana Teliti, Jasmin Kevrić, Bekir Karlik

Communications of the IIMA

Advances in machine learning for healthcare are abundant, yet most validated models remain confined to research notebooks and never reach secure, usable clinical software. This paper addresses that deployment gap by presenting a unified, security-hardened software platform that operationalizes two complementary streams of doctoral research inside a single, role-based hospital information system. The first stream contributes a clinical-prediction capability: an ultra-hybrid ensemble that couples a quantum-inspired feature transformation, particle-swarm feature selection, and calibrated soft voting for cancer-outcome prediction (96.41% accuracy, AUC-ROC 0.983 on TCGA-BRCA), survival stratification, multi-cancer generalization, and pharmacogenomic drug-response classification (89.31% mean accuracy across 25 compounds). The second …

Individualized Bayesian Inference Identifies Novel Genetic Variants For Parkinson's Disease, Jin Ren, Yasaman J. Soofi, Md Asad Rahman, Qing Lu, Jinling Liu

Engineering Management and Systems Engineering Faculty Research & Creative Works

Parkinson's disease (PD) is a complex neurodegenerative disorder with a significant genetic component. While genome-wide association studies (GWAS) have been instrumental in identifying genetic variants associated with PD, the reliance on large sample sizes and population-level analyses may overlook variants with lower minor allele frequencies or individual-specific relevance. Individualized Bayesian Inference (IBI) offers a promising method to complement GWAS by identifying and prioritizing candidate genetic markers at both the individual and patients-like-me subgroup levels. This study evaluates the application of IBI to PD genetics, using GWAS as a baseline for comparison. We analyzed genetic data from the Fox Insight online …

Enhancing Programming Productivity For Individuals With Adhd Through Generative Artificial Intelligence: An Inductive Analysis, Lionel Mew

School of Professional and Continuing Studies Faculty Publications

Attention-deficit/hyperactivity disorder (ADHD) significantly impacts computer programmers through challenges in sustained attention, executive functioning, and organizational skills. While traditional intervention strategies have shown varying degrees of success, the emergence of generative artificial intelligence (AI) presents novel opportunities to address ADHD-related programming challenges. This paper presents an inductive analysis synthesizing current research on ADHD's effects on programming, traditional productivity enhancement techniques, and the potential of generative AI tools. Through examination of recent literature and field studies, we propose that generative AI can serve as a transformative intervention by providing personalized cognitive support, reducing executive function demands, and enhancing code generation efficiency. …

Restoring Linguistic Grounding In Vla Models Via Train-Free Attention Recalibration, Ninghao Zhang, Bin Zhu, Shijie Zhou, Jingjing Chen

Research Collection School Of Computing and Information Systems

Vision-Language-Action (VLA) models enable robots to perform manipulation tasks directly from natural language instructions and are increasingly viewed as a foundation for generalist robotic policies. However, their reliability under Out-Of-Distribution (OOD) instructions remains underexplored. In this paper, we reveal a critical failure mode in which VLA policies continue executing visually plausible actions even when the language instruction contradicts the scene. We refer to this phenomenon as linguistic blindness, where VLA policies prioritize visual priors over instruction semantics during action generation. To systematically analyze this issue, we introduce ICBench, a diagnostic benchmark constructed from the LIBERO dataset that probes language–action coupling …

A Statistical Mechanics Approach To Reinforcement Learning, Jacob Adamczyk

Graduate Doctoral Dissertations

Reinforcement learning (RL), the study of optimal decision-making over long timescales in stochastic systems, has recently seen remarkable advances due in large part to the efforts of the deep learning community. RL has witnessed great success in solving problems in video games, robotics, biological control, and language modeling. However, a unified statistical mechanics framework to understand and develop the corresponding algorithms is lacking. To address this issue, we begin by showing that the reinforcement learning problem can be formulated and solved using the tools of statistical mechanics. Drawing on physical principles of free energy minimization and invariance, we address important …

Ai, The Liberal Arts, And Indigenous Languages: Forming Code Into Language, Christina Graebner

Summer Research Showcase

During the Summer, Spanish Professor Adam Coon and I worked on creating an annotated biography on AI and Indigenous languages for the Digital Well at the UMN Morris Library. Through this project, we have dived into conversations and research focusing on using AI as a translator. In recent years, the conversation around AI has created a surge of studies and research around the relationship between Indigenous languages and artificial intelligence. AI will only continue to expand, and it creates new ways to open communication but creates new ethical guidelines needed to be followed. Our project gathers research articles, podcasts, and …

Artificial Intelligence And Social Equities: Navigating The Intersectionalities In A Digital Age (Editorial), Daisuke Akiba, Julie Albright

Publications and Research

This editorial article introduces and synthesizes the Special Issue, “Artificial intelligence and social equities: navigating the intersectionalities in a digital age,” which examines how AI systems intersect with race, ethnicity, and interconnected identity dimensions across global contexts. The eight contributions span healthcare, digital media, higher education, organizational communication, and speculative futures, addressing anti-racist psychiatric algorithms, AI-generated visual disinformation, epistemic injustice between the Global North and South, algorithmically mediated rural–urban divides, culturally untranslated technology transfer, accessibility auditing across the AI lifecycle, and the tension between mechanical objectivity and empathic understanding. Read together, they show that AI is neither inherently …

Nasa’S Ecostress Satellite Reveals Widespread Midday Depression In Ecosystem Evapotranspiration, Jingyi Bu, Jingfeng Xiao, Joshua B. Fisher, Yiqi Luo

Biology, Chemistry, and Environmental Sciences Faculty Articles and Research

Plants often exhibit a midday depression in water use (i.e., transpiration), reflecting a constraint on their ability to sustain maximum water transport, which may occur at the cost of reduced photosynthesis. Eddy covariance observations and geostationary satellites cannot quantify this widespread phenomenon globally while resolving fine-scale spatial variability. Using evapotranspiration measurements from the ECOsystem Spaceborne Thermal Radiometer Experiment on Space Station (ECOSTRESS) and machine learning, we quantify the global distribution of midday depression in evapotranspiration. Midday depression primarily occurs during peak-growing seasons in temperate zones and dry periods in the tropics, with a morning shift of the peak evapotranspiration time …