Artificial Intelligence and Robotics Commons^™

Digital Twin For Shelf Intelligence: Ai-Driven Inventory Management For Minimizing Food Waste, Charlotte Maples, Marvin Velazquez

College of Engineering Summer Undergraduate Research Program

This project aims to develop a solution for improving grocery store inventory management by leveraging AI-driven image recognition. Traditional inventory methods, which rely on manual counting or barcode scanning, are inefficient, labor-intensive, and prone to human error. Over an 8-week period, we designed and developed a basic iPad app capable of identifying specific types of fruit and automatically updating inventory records in real time. By utilizing the iPad’s camera and machine learning algorithms, the app demonstrates the potential to streamline inventory tracking, reduce manual labor, and improve accuracy in managing perishable goods. Future work will focus on expanding the app’s …

Surrogate Models For Stress-Strain Mapping Of Microscale Physics, Samuel Roach, Dr. Eric Ocegueda

College of Engineering Summer Undergraduate Research Program

•Learn the difference between different neural networks within machine learning (ML) •Develop a working understanding of the ML tool Pytorch and machine learning operator: Recurrent Neural Operator •Use MATLAB to create and process time dependent stress/strain matrices to display the hyper-parameters for different RNOs •Apply RNO to train the strain-stress mapping of tri-laminate and granular cases

Enhancing Place-Based Interaction With Emotion Ai And Augmented Reality, Jake Maier, Ivan Martinez

College of Engineering Summer Undergraduate Research Program

This project explores the integration of augmented reality (AR) and Emotion AI technologies to enhance user experiences in physical environments. By seamlessly merging virtual elements with real-world contexts, we aim to deepen individuals’ interactions and perceptions of their surroundings. Leveraging AR technology enables users to access contextual information, engage with interactive content, and navigate spaces with heightened immersion and understanding. Additionally, Emotion AI enhances these experiences by detecting and responding to users’ emotional states, fostering personalized and emotionally resonant interactions. We aim to integrate digital content within physical environments using mixed-reality headsets equipped with eye-tracking capabilities and consumer-grade wireless EEG …

Leveraging Tradespace-Exploration For A Senior Project Team Formation Application, Miguel Saenz

College of Engineering Summer Undergraduate Research Program

This project revolves around the development of an app in MATLAB that leverages the VASSAR rule-based system and a genetic algorithm to form groups of teams for the Mechanical Engineering Senior Design project class. We leveraged the iterative design process to eventually attain a functional app with a reasonable runtime that works provided correctly formatted rulesheets describing student project preference and member preference.

Antitrust After The Coming Wave, Daniel A. Crane

Articles

A coming wave of general-purpose technologies, including artificial intelligence ("AI"), robotics, quantum computing, synthetic biology, energy expansion, and nanotechnology, is likely to fundamentally reshape the economy and erode the assumptions on which the antitrust order is predicated. First, AI-driven systems will vastly improve firms' ability to detect (and even program) consumer preferences without the benefit of price signals, which will undermine the traditional information-producing benefit of competitive markets. Similarly, these systems will be able to determine comparative producer efficiency without relying on competitive signals. Second, AI systems will invert the salient characteristics of human managers, whose intentions are opaque but …

Equipping Future Physicians With Artificial Intelligence Competencies Through Student Associations, Spencer Hopson, Carson Mildon, Kyle Hassard, Paul Urie, Dennis Della Corte

Faculty Publications

Advances in artificial intelligence (AI) in the medical sector necessitate the development of AI literacy among future physicians. This article explores the pioneering efforts of the AI in Medicine Association (AIM) at Brigham Young University, which offers a framework for undergraduate pre-medical students to gain hands-on experience, receive principled education, explore ethical considerations, and learn appraisal of AI models. By supplementing formal, university-organized pre-medical education with a student-led, faculty-supported introduction to AI through an extracurricular academic association, AIM alleviates apprehensions regarding AI in medicine early and empowers students preparing for medical school to navigate the evolving landscape of AI in …

Influence Of Artificial Intelligence (Ai) On Decision-Making For Market-Entry Strategies In Emerging Economies, Tejas Deshpande

Dissertations and Theses Collection (Open Access)

International firms with growth-oriented business models face a complex array of factors when planning to enter emerging markets. These markets are characterized by dynamic socio-economic and geopolitical conditions, often resulting in limited market intelligence and a fragmented understanding of the business ecosystem. To succeed, firms must align their short-term objectives and long-term strategic goals with the specific characteristics of these target markets.

Decision-making in such environments is fraught with uncertainty and is critical in determining the success or failure of market-entry strategies. While business leaders rely on their cognition and heuristics to navigate these challenges, the complexity and volume of …

A Guideline For Open-Source Tools To Make Medical Imaging Data Ready For Artificial Intelligence Applications: A Society Of Imaging Informatics In Medicine (Siim) Survey, Sanaz Vahdati, Bardia Khosravi, Elham Mahmoudi, Kuan Zhang, Pouria Rouzrokh, Shahriar Faghani, Mana Moassefi, Aylin Tahmasebi, Katherine Andriole, Peter Chang, Keyvan Farahani, Mona Flores, Les Folio, Sina Houshmand, Maryellen Giger, Judy Gichoya, Bradley Erickson

Department of Radiology Faculty Papers

In recent years, the role of Artificial Intelligence (AI) in medical imaging has become increasingly prominent, with the majority of AI applications approved by the FDA being in imaging and radiology in 2023. The surge in AI model development to tackle clinical challenges underscores the necessity for preparing high-quality medical imaging data. Proper data preparation is crucial as it fosters the creation of standardized and reproducible AI models while minimizing biases. Data curation transforms raw data into a valuable, organized, and dependable resource and is a fundamental process to the success of machine learning and analytical projects. Considering the plethora …

Etdsuite: A Toolkit To Mine Electronic Theses And Dissertations To Enrich Scholarly Big Data Using Natural Language Processing And Computer Vision, Muntabir Hasan Choudhury

Computer Science Theses & Dissertations

In the past decades, there has been a growing interest in mining scientific documents to obtain domain knowledge automatically. One of the understudied types of scientific documents is Electronic Theses and Dissertations (ETDs), as ETDs have distinct features compared with conference proceedings and journal articles. ETDs usually serve as partial requirements of academic degrees for students pursuing higher education. They are book-length documents (i.e., 100 – 400 pages long), and the topics may shift across chapters, exhibit the significant contribution of a student’s research over the entire degree pursuing period, and have unique metadata schema and page layouts. However, the …

Machine Learning And Simulation Techniques For Detecting Buoys From Lidar Data, Christopher Adolphi

Electrical & Computer Engineering Theses & Dissertations

Maritime autonomy, specifically the use of autonomous and semi-autonomous maritime vessels, is a key enabling technology supporting a set of diverse and critical research areas, including coastal and environmental resilience, assessment of waterway health, ecosystem/asset monitoring and maritime port security. Critical to the safe, efficient and reliable operation of an autonomous maritime vessel is its ability to perceive the external environment through onboard sensors. The main sensor utilized in this research is a LiDAR sensor. This sensor is able to generate point clouds of the surrounding environment, of which a machine learning model is used to label each point in …

An Integrated Theoretical Socio-Technical Framework For Implementing Service Robots’ Integration In Healthcare, Sujatha Alla

Engineering Management & Systems Engineering Theses & Dissertations

Healthcare workers, either clinical or non-clinical, are obligated to serve patients. However, lack of a sufficient number of professionals leads to burnout, severe stress, and, consequently, decreased quality of services. In this context, very few countries have been successful in employing service robots to perform dull, dirty, and/or dangerous tasks related to patient wellbeing/healthcare, while most countries are still skeptical about it. As robotics advances, there is an opportunity for healthcare to take advantage of this technology to reduce personnel workload and to reduce the possibility of exposure to contagious pathogens. However, healthcare is a vulnerable environment and requires critical …

D2sr: Decentralized Detection, De-Synchronization, And Recovery Of Lidar Interference, Darshana Rathnayake, Hemanth Sabbella, Meera Radhakrishnan, Archan Misra

Research Collection School Of Computing and Information Systems

We address the challenge of multi-LiDAR interference, an issue of growing importance as LiDAR sensors are embedded in a growing set of pervasive devices. We introduce a novel approach named D2SR, enabling decentralized interference detection, mitigation, and recovery without explicit coordination among nearby LiDAR devices. D2SR comprises three stages: (a) Detection, which identifies interfered frames, (b) Mitigation, which performs time-shifting of a LiDAR’s active period to reduce interference, and (c) Recovery, which corrects or reconstructs the depth values in interfered regions of a depth frame. Key contributions include a lightweight interference detection algorithm achieving an F1-score of 92%, a simple …

Interactive Example-Based Explanations To Improve Health Professionals’ Onboarding With Ai For Human-Ai Collaborative Decision Making, Min Hun Lee, Renee Bao Xuan Ng, Silvana Xinyi Choo, Shamala Thilarajah

Research Collection School Of Computing and Information Systems

A growing research explores the usage of AI explanations on user’s decision phases for human-AI collaborative decision-making. However, previous studies found the issues of overreliance on ‘wrong’ AI outputs. In this paper, we propose interactive example-based explanations to improve health professionals’ onboarding with AI for their better reliance on AI during AI-assisted decision-making. We implemented an AI-based decision support system that utilizes a neural network to assess the quality of post-stroke survivors’ exercises and interactive example-based explanations that systematically surface the nearest neighborhoods of a test/task sample from the training set of the AI model to assist users’ onboarding with …

Self-Adaptive Fine-Grained Multi-Modal Data Augmentation For Semi-Supervised Muti-Modal Coreference Resolution, Li Zheng, Boyu Chen, Hao Fei, Fei Li, Shengqiong Wu, Lizi Liao, Donghong Ji

Research Collection School Of Computing and Information Systems

Coreference resolution, an essential task in natural language processing, is particularly challenging in multi-modal scenarios where data comes in various forms and modalities. Despite advancements, limitations due to scarce labeled data and underleveraged unlabeled data persist. We address these issues with a self-adaptive fine-grained multi-modal data augmentation framework for semi-supervised MCR, focusing on enriching training data from labeled datasets and tapping into the untapped potential of unlabeled data. Regarding the former issue, we first leverage text coreference resolution datasets and diffusion models,to perform fine-grained text-to-image generation with aligned text entities and image bounding boxes. We then introduce a self-adaptive selection …

Brushbuds: Toothbrushing Tracking Using Earphone Imus, Qiang Yang, Yang Liu, Jake Stuchbury-Wass, Kayla-Jade Butkow, Dong Ma, Cecilia Mascolo

Research Collection School Of Computing and Information Systems

Inadequate toothbrushing habits are a leading cause of oral health problems such as tooth decay. Many individuals are uncertain if they are brushing effectively or over-focusing on specific areas. While high-end electric toothbrushes can address these concerns, manual toothbrushes remain widely used due to their simplicity and affordability. In this paper, we introduce BrushBuds, an earphone-based toothbrushing monitoring system aimed at tracking brushing areas, which leverages the ubiquitous presence of earphones to enhance manual toothbrushing. BrushBuds utilizes Inertial Measurement Units (IMUs) in earphones to detect subtle head movements incurred by toothbrushing. By capturing distinct motion patterns specific to brushing for …

An Empirical Study To Evaluate Aigc Detectors On Code Content, Jian Wang, Shangqing Liu, Xiaofei Xie, Yi Li

Research Collection School Of Computing and Information Systems

Artificial Intelligence Generated Content (AIGC) has garnered considerable attention for its impressive performance, with Large Language Models (LLMs), like ChatGPT, emerging as a leading AIGC model that produces high-quality responses across various applications, including software development and maintenance. Despite its potential, the misuse of LLMs, especially in security and safetycritical domains, such as academic integrity and answering questions on Stack Overflow, poses significant concerns. Numerous AIGC detectors have been developed and evaluated on natural language data. However, their performance on code-related content generated by LLMs remains unexplored. To fill this gap, in this paper, we present an empirical study evaluating …

Risurconv : Rotation Invariant Surface Attention-Augmented Convolutions For 3d Point Cloud Classification And Segmentation, Zhiyuan Zhang, Licheng Yang, Xiang Zhiyu

Research Collection School Of Computing and Information Systems

Despite the progress on 3D point cloud deep learning, most prior works focus on learning features that are invariant to translation and point permutation, and very limited efforts have been devoted for rotation invariant property. Several recent studies achieve rotation invariance at the cost of lower accuracies. In this work, we close this gap by proposing a novel yet effective rotation invariant architecture for 3D point cloud classification and segmentation. Instead of traditional pointwise operations, we construct local triangle surfaces to capture more detailed surface structure, based on which we can extract highly expressive rotation invariant surface properties which are …

Collaborative Cross-Modal Fusion With Large Language Model For Recommendation, Zhongzhou Liu, Hao Zhang, Kuicai Dong, Yuan Fang

Research Collection School Of Computing and Information Systems

Despite the success of conventional collaborative filtering (CF) approaches for recommendation systems, they exhibit limitations in leveraging semantic knowledge within the textual attributes of users and items. Recent focus on the application of large language models for recommendation (LLM4Rec) has highlighted their capability for effective semantic knowledge capture. However, these methods often overlook the collaborative signals in user behaviors. Some simply instruct-tune a language model, while others directly inject the embeddings of a CF-based model, lacking a synergistic fusion of different modalities. To address these issues, we propose a framework of Collaborative Cross-modal Fusion with Large Language Models, termed CCF-LLM, …

Improving Out-Of-Distribution Detection With Disentangled Foreground And Background Features, Choubo Ding, Guansong Pang

Research Collection School Of Computing and Information Systems

Detecting out-of-distribution (OOD) inputs is a principal task for ensuring the safety of deploying deep-neural-network classifiers in open-set scenarios. OOD samples can be drawn from arbitrary distributions and exhibit deviations from in-distribution (ID) data in various dimensions, such as foreground features (e.g., objects in CIFAR100 images vs. those in CIFAR10 images) and background features (e.g., textural images vs. objects in CIFAR10). Existing methods can confound foreground and background features in training, failing to utilize the background features for OOD detection. This paper considers the importance of feature disentanglement in out-of-distribution detection and proposes the simultaneous exploitation of both foreground and …

Zero-Shot Object Counting With Good Exemplars, Huilin Zhu, Jingling Yuan, Zhengwei Yang, Yu Guo, Zheng Wang, Xian Zhong, Shengfeng He

Research Collection School Of Computing and Information Systems

Zero-shot object counting (ZOC) aims to enumerate objects in images using only the names of object classes during testing, without the need for manual annotations. However, a critical challenge in current ZOC methods lies in their inability to identify high-quality exemplars effectively. This deficiency hampers scalability across diverse classes and undermines the development of strong visual associations between the identified classes and image content. To this end, we propose the Visual Association-based Zero-shot Object Counting (VA-Count) framework. VACount consists of an Exemplar Enhancement Module (EEM) and a Noise Suppression Module (NSM) that synergistically refine the process of class exemplar identification …