Open Access. Powered by Scholars. Published by Universities.®

Digital Commons Network™

Open Access. Powered by Scholars. Published by Universities.®

Artificial Intelligence and Robotics

Institution
Keyword
Publication Year
Publication
Publication Type
File Type

Articles 3031 - 3060 of 11692

Full-Text Articles in Entire DC Network

Fail Fast, Fail Small: Designing Resilient Systems For The Future Of Software Engineering, Jill Willard, James Hutson Oct 2024

Fail Fast, Fail Small: Designing Resilient Systems For The Future Of Software Engineering, Jill Willard, James Hutson

Faculty Scholarship

The principles of "fail fast, fail small" have emerged as critical in modern software and system design. By planning for minor, manageable failures instead of catastrophic breakdowns, developers can ensure that systems degrade gracefully, maintaining functionality even when encountering issues. This article delves into strategies for designing resilient systems, beginning with the concept of slow degradation and distributed systems that prioritize core functions while allowing non-critical components to fail without significant user impact. The Netflix recommendation engine serves as a prime example of a system that continues to operate under failure conditions. Chaos engineering, a proactive methodology for stress-testing system …


Bibliography For "Ai: The Next Chapter Display", Arianna Tillman, Isabella Piechota Oct 2024

Bibliography For "Ai: The Next Chapter Display", Arianna Tillman, Isabella Piechota

Library Displays and Bibliographies

A bibliography created to support a display about artificial intelligence at the Leatherby Libraries during Fall 2024 at the Leatherby Libraries at Chapman University.


Gradualreality: Enhancing Physical Object Interaction In Virtual Reality Via Interaction State-Aware Blending, Hyuna Seo, Juheon Yi, Rajesh Krishna Balan, Youngki Lee Oct 2024

Gradualreality: Enhancing Physical Object Interaction In Virtual Reality Via Interaction State-Aware Blending, Hyuna Seo, Juheon Yi, Rajesh Krishna Balan, Youngki Lee

Research Collection School Of Computing and Information Systems

We present GradualReality, a novel interface enabling a Cross Reality experience that includes gradual interaction with physical objects in a virtual environment and supports both presence and usability. Daily Cross Reality interaction is challenging as the user’s physical object interaction state is continuously changing over time, causing their attention to frequently shift between the virtual and physical worlds. As such, presence in the virtual environment and seamless usability for interacting with physical objects should be maintained at a high level. To address this issue, we present an Interaction State-Aware Blending approach that (i) balances immersion and interaction capability and (ii) …


D2sr: Decentralized Detection, De-Synchronization, And Recovery Of Lidar Interference, Darshana Rathnayake, Hemanth Sabbella, Meera Radhakrishnan, Archan Misra Oct 2024

D2sr: Decentralized Detection, De-Synchronization, And Recovery Of Lidar Interference, Darshana Rathnayake, Hemanth Sabbella, Meera Radhakrishnan, Archan Misra

Research Collection School Of Computing and Information Systems

We address the challenge of multi-LiDAR interference, an issue of growing importance as LiDAR sensors are embedded in a growing set of pervasive devices. We introduce a novel approach named D2SR, enabling decentralized interference detection, mitigation, and recovery without explicit coordination among nearby LiDAR devices. D2SR comprises three stages: (a) Detection, which identifies interfered frames, (b) Mitigation, which performs time-shifting of a LiDAR’s active period to reduce interference, and (c) Recovery, which corrects or reconstructs the depth values in interfered regions of a depth frame. Key contributions include a lightweight interference detection algorithm achieving an F1-score of 92%, a simple …


Leveraging Imitation Learning In Agricultural Robotics: A Comprehensive Survey And Comparative Analysis, Siavash Mahmoudi, Amirreza Davar, Pouya Sohrabipour, Ramesh Bahadur Bist, Yang Tao, Dongyi Wang Oct 2024

Leveraging Imitation Learning In Agricultural Robotics: A Comprehensive Survey And Comparative Analysis, Siavash Mahmoudi, Amirreza Davar, Pouya Sohrabipour, Ramesh Bahadur Bist, Yang Tao, Dongyi Wang

Biological and Agricultural Engineering Faculty Publications and Presentations

Imitation learning (IL), a burgeoning frontier in machine learning, holds immense promise across diverse domains. In recent years, its integration into robotics has sparked significant interest, offering substantial advancements in autonomous control processes. This paper presents an exhaustive insight focusing on the implementation of imitation learning techniques in agricultural robotics. The survey rigorously examines varied research endeavors utilizing imitation learning to address pivotal agricultural challenges. Methodologically, this survey comprehensively investigates multifaceted aspects of imitation learning applications in agricultural robotics. The survey encompasses the identification of agricultural tasks that can potentially be addressed through imitation learning, detailed analysis of specific models …


Antitrust After The Coming Wave, Daniel A. Crane Oct 2024

Antitrust After The Coming Wave, Daniel A. Crane

Articles

A coming wave of general-purpose technologies, including artificial intelligence ("AI"), robotics, quantum computing, synthetic biology, energy expansion, and nanotechnology, is likely to fundamentally reshape the economy and erode the assumptions on which the antitrust order is predicated. First, AI-driven systems will vastly improve firms' ability to detect (and even program) consumer preferences without the benefit of price signals, which will undermine the traditional information-producing benefit of competitive markets. Similarly, these systems will be able to determine comparative producer efficiency without relying on competitive signals. Second, AI systems will invert the salient characteristics of human managers, whose intentions are opaque but …


"Deep Learning For Microscope Image Denoising", Nasreen Buhn, Sriya Adunur, Guy Hagen, Jonathan Ventura Oct 2024

"Deep Learning For Microscope Image Denoising", Nasreen Buhn, Sriya Adunur, Guy Hagen, Jonathan Ventura

College of Engineering Summer Undergraduate Research Program

In order to avoid damaging live cells, optical microscope imaging must be conducted under low-excitation light intensity and/or short exposure times, resulting in low signal-to-noise ratios (SNR). Deep learning methods offer an effective solution for removing microscope noise, utilizing algorithms that are able to reconstruct finer features in low SNR images. This research explores the denoising capability of several deep learning methods based on PSNR and SSIM. Tested methods include traditional approaches (BMED), supervised learning (CARE and Restormer), and unsupervised methods (Noise2Fast, N2V, SSD-Unsupervised, and SASSID). The Restormer model, which employs an encoder-decoder transformer architecture and progressive learning, stood out …


Digital Twin For Shelf Intelligence: Ai-Driven Inventory Management For Minimizing Food Waste, Charlotte Maples, Marvin Velazquez Oct 2024

Digital Twin For Shelf Intelligence: Ai-Driven Inventory Management For Minimizing Food Waste, Charlotte Maples, Marvin Velazquez

College of Engineering Summer Undergraduate Research Program

This project aims to develop a solution for improving grocery store inventory management by leveraging AI-driven image recognition. Traditional inventory methods, which rely on manual counting or barcode scanning, are inefficient, labor-intensive, and prone to human error. Over an 8-week period, we designed and developed a basic iPad app capable of identifying specific types of fruit and automatically updating inventory records in real time. By utilizing the iPad’s camera and machine learning algorithms, the app demonstrates the potential to streamline inventory tracking, reduce manual labor, and improve accuracy in managing perishable goods. Future work will focus on expanding the app’s …


Leveraging Tradespace-Exploration For A Senior Project Team Formation Application, Miguel Saenz Oct 2024

Leveraging Tradespace-Exploration For A Senior Project Team Formation Application, Miguel Saenz

College of Engineering Summer Undergraduate Research Program

This project revolves around the development of an app in MATLAB that leverages the VASSAR rule-based system and a genetic algorithm to form groups of teams for the Mechanical Engineering Senior Design project class. We leveraged the iterative design process to eventually attain a functional app with a reasonable runtime that works provided correctly formatted rulesheets describing student project preference and member preference.


Machine Learning And Simulation Techniques For Detecting Buoys From Lidar Data, Christopher Adolphi Oct 2024

Machine Learning And Simulation Techniques For Detecting Buoys From Lidar Data, Christopher Adolphi

Electrical & Computer Engineering Theses & Dissertations

Maritime autonomy, specifically the use of autonomous and semi-autonomous maritime vessels, is a key enabling technology supporting a set of diverse and critical research areas, including coastal and environmental resilience, assessment of waterway health, ecosystem/asset monitoring and maritime port security. Critical to the safe, efficient and reliable operation of an autonomous maritime vessel is its ability to perceive the external environment through onboard sensors. The main sensor utilized in this research is a LiDAR sensor. This sensor is able to generate point clouds of the surrounding environment, of which a machine learning model is used to label each point in …


An Integrated Theoretical Socio-Technical Framework For Implementing Service Robots’ Integration In Healthcare, Sujatha Alla Oct 2024

An Integrated Theoretical Socio-Technical Framework For Implementing Service Robots’ Integration In Healthcare, Sujatha Alla

Engineering Management & Systems Engineering Theses & Dissertations

Healthcare workers, either clinical or non-clinical, are obligated to serve patients. However, lack of a sufficient number of professionals leads to burnout, severe stress, and, consequently, decreased quality of services. In this context, very few countries have been successful in employing service robots to perform dull, dirty, and/or dangerous tasks related to patient wellbeing/healthcare, while most countries are still skeptical about it. As robotics advances, there is an opportunity for healthcare to take advantage of this technology to reduce personnel workload and to reduce the possibility of exposure to contagious pathogens. However, healthcare is a vulnerable environment and requires critical …


Equipping Future Physicians With Artificial Intelligence Competencies Through Student Associations, Spencer Hopson, Carson Mildon, Kyle Hassard, Paul Urie, Dennis Della Corte Oct 2024

Equipping Future Physicians With Artificial Intelligence Competencies Through Student Associations, Spencer Hopson, Carson Mildon, Kyle Hassard, Paul Urie, Dennis Della Corte

Faculty Publications

Advances in artificial intelligence (AI) in the medical sector necessitate the development of AI literacy among future physicians. This article explores the pioneering efforts of the AI in Medicine Association (AIM) at Brigham Young University, which offers a framework for undergraduate pre-medical students to gain hands-on experience, receive principled education, explore ethical considerations, and learn appraisal of AI models. By supplementing formal, university-organized pre-medical education with a student-led, faculty-supported introduction to AI through an extracurricular academic association, AIM alleviates apprehensions regarding AI in medicine early and empowers students preparing for medical school to navigate the evolving landscape of AI in …


Influence Of Artificial Intelligence (Ai) On Decision-Making For Market-Entry Strategies In Emerging Economies, Tejas Deshpande Oct 2024

Influence Of Artificial Intelligence (Ai) On Decision-Making For Market-Entry Strategies In Emerging Economies, Tejas Deshpande

Dissertations and Theses Collection (Open Access)

International firms with growth-oriented business models face a complex array of factors when planning to enter emerging markets. These markets are characterized by dynamic socio-economic and geopolitical conditions, often resulting in limited market intelligence and a fragmented understanding of the business ecosystem. To succeed, firms must align their short-term objectives and long-term strategic goals with the specific characteristics of these target markets.

Decision-making in such environments is fraught with uncertainty and is critical in determining the success or failure of market-entry strategies. While business leaders rely on their cognition and heuristics to navigate these challenges, the complexity and volume of …


Etdsuite: A Toolkit To Mine Electronic Theses And Dissertations To Enrich Scholarly Big Data Using Natural Language Processing And Computer Vision, Muntabir Hasan Choudhury Oct 2024

Etdsuite: A Toolkit To Mine Electronic Theses And Dissertations To Enrich Scholarly Big Data Using Natural Language Processing And Computer Vision, Muntabir Hasan Choudhury

Computer Science Theses & Dissertations

In the past decades, there has been a growing interest in mining scientific documents to obtain domain knowledge automatically. One of the understudied types of scientific documents is Electronic Theses and Dissertations (ETDs), as ETDs have distinct features compared with conference proceedings and journal articles. ETDs usually serve as partial requirements of academic degrees for students pursuing higher education. They are book-length documents (i.e., 100 – 400 pages long), and the topics may shift across chapters, exhibit the significant contribution of a student’s research over the entire degree pursuing period, and have unique metadata schema and page layouts. However, the …


Can Federated Learning Solve Ai’S Data Privacy Problem?: A Legal Analysis, Warren B. Chik, Florian Gamper Oct 2024

Can Federated Learning Solve Ai’S Data Privacy Problem?: A Legal Analysis, Warren B. Chik, Florian Gamper

Research Collection Yong Pung How School Of Law

Federated learning (FL) is a method of training AI systems on different datasets without sharing data. The promise of FL is to enable AI systems to be trained on data, including personal data, while preserving data privacy and confidentiality, and thus, inter alia, facilitate compliance with data protection legislation. FL has generated a considerable interest amongst the computer science community, yet there is a dearth of legal analysis of FL. This is a problem because the question of whether FL facilitates compliance with data protection legislation is a legal question. This article will fill this lacuna by providing a comprehensive …


Trust And Robotics: A Multi-Staged Decision-Making Approach To Robots In Community, Wenxi Zhang, Willow Wong, Mark Findlay Oct 2024

Trust And Robotics: A Multi-Staged Decision-Making Approach To Robots In Community, Wenxi Zhang, Willow Wong, Mark Findlay

Research Collection Yong Pung How School Of Law

With the desired outcome of social good within the wider robotics ecosystem, trust is identified as the central adhesive of the human–robot interaction (HRI) interface. However, building trust between humans and robots involves more than improving the machine’s technical reliability or trustworthiness in function. This paper presents a holistic, community-based approach to trust-building, where trust is understood as a multifaceted and multi-staged looped relation that depends heavily on context and human perceptions. Building on past literature that identifies dispositional and learned stages of trust, our proposed decision to trust model considers more extensively the human and situational factors influencing how …


Constrained Assortment Optimization Under The Cross-Nested Logit Model, Cuong Le, Tien Mai Oct 2024

Constrained Assortment Optimization Under The Cross-Nested Logit Model, Cuong Le, Tien Mai

Research Collection School Of Computing and Information Systems

We study the assortment optimization problem under general linear constraints, where the customer choice behavior is captured by the cross-nested logit model. In this problem, there is a set of products organized into multiple subsets (or nests), where each product can belong to more than one nest. The aim is to find an assortment to offer to customers so that the expected revenue is maximized. We show that, under the cross-nested logit model, the unconstrained assortment problem is NP-hard even when there are only two nests, and the problem is generally NP-hard to approximate to any constant factors. To tackle …


Themis: Automatic And Efficient Deep Learning System Testing With Strong Fault Detection Capability, Dong Huang, Tsz On Li, Xiaofei Xie, Heming Cui Oct 2024

Themis: Automatic And Efficient Deep Learning System Testing With Strong Fault Detection Capability, Dong Huang, Tsz On Li, Xiaofei Xie, Heming Cui

Research Collection School Of Computing and Information Systems

Deep Learning Systems (DLSs) have been widely applied in safety-critical tasks such as autopilot. However, when a perturbed input is fed into a DLS for inference, the DLS often has incorrect outputs (i.e., faults). DLS testing techniques (e.g., DeepXplore) detect such faults by generating perturbed inputs to explore data flows that induce faults. Since a DLS often has infinitely many data flows, existing techniques require developers to manually specify a set of activation values in a DLS’s neurons for exploring fault-inducing data flows. Unfortunately, recent studies show that such manual effort is tedious and can detect only a tiny proportion …


Joint Weakly Supervised Image Emotion Analysis Based On Interclass Discrimination And Intraclass Correlation, Xinyue Zhang, Zhaoxia Wang, Guitao Cao, Seng-Beng Ho Oct 2024

Joint Weakly Supervised Image Emotion Analysis Based On Interclass Discrimination And Intraclass Correlation, Xinyue Zhang, Zhaoxia Wang, Guitao Cao, Seng-Beng Ho

Research Collection School Of Computing and Information Systems

Regional information-based image emotion analysis has recently garnered significant attention. However, existing methods often focus on identifying region proposals through layered steps or merely rely on visual saliency. These approaches may lead to an underestimation of emotional categories and a lack of comprehensive interclass discrimination perception and emotional intraclass contextual mining. To address these limitations, we propose a novel approach named InterIntraIEA, which combines interclass discrimination and intraclass correlation joint learning capabilities for image emotion analysis. The proposed method not only employs category-specific dictionary learning for class adaptation, but also models intraclass contextual relationships and perceives correlations at the channel …


Exploring Conversations Between A Practitioner And A Person With Dementia, Kotaro Hara, Rosiana Natalie, Wei Soon Cheong, Jingjing Gu, Qianli Xu Oct 2024

Exploring Conversations Between A Practitioner And A Person With Dementia, Kotaro Hara, Rosiana Natalie, Wei Soon Cheong, Jingjing Gu, Qianli Xu

Research Collection School Of Computing and Information Systems

In social service centers, practitioners engage in conversations with clients with dementia to facilitate their daily activities and provide support when they are distressed. However, the nature of the care demands the practitioner’s active engagement, which becomes difficult to deliver as the number of people who need care expands. Researchers have been investigating the efficacy of developing agents that assume conversational tasks to alleviate this work. To contribute to the future design of agents for caregiving, we collected and analyzed ten conversations between clients with mild dementia and practitioners who provide care. Our analyses of turn-taking dynamics and dialogue acts …


Improving Out-Of-Distribution Detection With Disentangled Foreground And Background Features, Choubo Ding, Guansong Pang Oct 2024

Improving Out-Of-Distribution Detection With Disentangled Foreground And Background Features, Choubo Ding, Guansong Pang

Research Collection School Of Computing and Information Systems

Detecting out-of-distribution (OOD) inputs is a principal task for ensuring the safety of deploying deep-neural-network classifiers in open-set scenarios. OOD samples can be drawn from arbitrary distributions and exhibit deviations from in-distribution (ID) data in various dimensions, such as foreground features (e.g., objects in CIFAR100 images vs. those in CIFAR10 images) and background features (e.g., textural images vs. objects in CIFAR10). Existing methods can confound foreground and background features in training, failing to utilize the background features for OOD detection. This paper considers the importance of feature disentanglement in out-of-distribution detection and proposes the simultaneous exploitation of both foreground and …


Generative Ai In Software Engineering Must Be Human-Centered: The Copenhagen Manifesto, D. Russo, S. Van Berkel Baltes, Christoph Treude Oct 2024

Generative Ai In Software Engineering Must Be Human-Centered: The Copenhagen Manifesto, D. Russo, S. Van Berkel Baltes, Christoph Treude

Research Collection School Of Computing and Information Systems

The advent of Generative Artificial Intelligence—systems that can produce human-like content such as text, music, visual art, or source code—marks not only a significant leap for Artificial Intelligence (AI) but also a pivotal moment for software practitioners and researchers. The role of software engineering researchers and practitioners in adopting the technologies that shape our world is critical. Historically, the human aspects of developing software have been treated as secondary to more technical innovations. However, the emergence of Generative AI will simultaneously enhance human capabilities while surfacing complex ethical, social, legal, and technical challenges.While primarily aimed at software engineering (SE) researchers …


The Promise And Perils Of Smart (City) Bots As Educational Tools, Thomas Menkhoff, Siew Ning Kan, Shaohui Foong Oct 2024

The Promise And Perils Of Smart (City) Bots As Educational Tools, Thomas Menkhoff, Siew Ning Kan, Shaohui Foong

Research Collection Lee Kong Chian School Of Business

Written from an educator’s perspective, the paper aims to examine the increasing use of chatbot technology capable of answering user queries in various fields such as commerce, public service delivery, urban areas, higher education etc. by simulating human conversation through text messages or voice commands. We analyse why smart bots have become popular technologies in the context smart cities; shed light on different types of bots (chatbots, large language models such as ChatGPT, flying bots); and explain how we use bots as teaching tool in an introductory AI for business course. A key argument putting forward is that smart bots …


Hisoma: A Hierarchical Multi-Agent Model Integrating Self-Organizing Neural Networks With Multi-Agent Deep Reinforcement Learning, Minghong Geng, Shubham Pateria, Budhitama Subagdja, Ah-Hwee Tan Oct 2024

Hisoma: A Hierarchical Multi-Agent Model Integrating Self-Organizing Neural Networks With Multi-Agent Deep Reinforcement Learning, Minghong Geng, Shubham Pateria, Budhitama Subagdja, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Multi-agent deep reinforcement learning (MADRL) has shown remarkable advancements in the past decade. However, most current MADRL models focus on task-specific short-horizon problems involving a small number of agents, limiting their applicability to long-horizon planning in complex environments. Hierarchical multi-agent models offer a promising solution by organizing agents into different levels, effectively addressing tasks with varying planning horizons. However, these models often face constraints related to the number of agents or levels of hierarchies. This paper introduces HiSOMA, a novel hierarchical multi-agent model designed to handle long-horizon, multi-agent, multi-task decision-making problems. The top-level controller, FALCON, is modeled as a class …


Retrofitting A Legacy Cutlery Washing Machine Using Computer Vision, Hua Leong Fwa Oct 2024

Retrofitting A Legacy Cutlery Washing Machine Using Computer Vision, Hua Leong Fwa

Research Collection School Of Computing and Information Systems

Industry 4.0, the digitalization of manufacturing promises to lead to lowered cost, efficient processes and even discovery of new business models. However, many of the enterprises have huge investments in legacy machines which are not 'smart'. In this study, we thus designed a cost-efficient solution to retrofit a legacy conveyor belt-based cutlery washing machine with a commodity web camera. We then applied computer vision (using both traditional image processing and deep learning techniques) to infer the speed and utilization of the machine. We detailed the algorithms that we designed for computing both speed andutilization. With the existing operational constraints of …


Navigating Governance Paradigms: A Cross-Regional Comparative Study Of Generative Ai Governance Processes & Principle, Jose Luna, Ivan Tan, Xiaofei Xie, Lingxiao Jiang Oct 2024

Navigating Governance Paradigms: A Cross-Regional Comparative Study Of Generative Ai Governance Processes & Principle, Jose Luna, Ivan Tan, Xiaofei Xie, Lingxiao Jiang

Research Collection School Of Computing and Information Systems

As Generative Artificial Intelligence (GenAI) technologies evolve at an unprecedented rate, global governance approaches struggle to keep pace with the technology, highlighting a critical issue in the governance adaptation of significant challenges. Depicting the nuances of nascent and diverse governance approaches based on risks, rules, outcomes, principles, or a mix across different regions around the globe is fundamental to discern discrepancies and convergences and to shed light on specific limitations that need to be addressed, thereby facilitating the safe and trustworthy adoption of GenAI. In response to the need and the evolving nature of GenAI, this paper seeks to provide …


Efficient Cascaded Multiscale Adaptive Network For Image Restoration, Yichen Zhou, Pan Zhou, Teck Khim Ng Oct 2024

Efficient Cascaded Multiscale Adaptive Network For Image Restoration, Yichen Zhou, Pan Zhou, Teck Khim Ng

Research Collection School Of Computing and Information Systems

Image restoration, encompassing tasks such as deblurring, denoising, and super-resolution, remains a pivotal area in computer vision. However, efficiently addressing the spatially varying artifacts of various low-quality images with local adaptiveness and handling their degradations at different scales poses significant challenges. To efficiently tackle these issues, we propose the novel Efficient Cascaded Multiscale Adaptive (ECMA) Network. ECMA employs Local Adaptive Module, LAM, which dynamically adjusts convolution kernels across local image regions to efficiently handle varying artifacts. Thus, LAM addresses the local adaptiveness challenge more efficiently than costlier mechanisms like self-attention, due to its less computationally intensive convolutions. To construct a …


Interactive Example-Based Explanations To Improve Health Professionals’ Onboarding With Ai For Human-Ai Collaborative Decision Making, Min Hun Lee, Renee Bao Xuan Ng, Silvana Xinyi Choo, Shamala Thilarajah Oct 2024

Interactive Example-Based Explanations To Improve Health Professionals’ Onboarding With Ai For Human-Ai Collaborative Decision Making, Min Hun Lee, Renee Bao Xuan Ng, Silvana Xinyi Choo, Shamala Thilarajah

Research Collection School Of Computing and Information Systems

A growing research explores the usage of AI explanations on user’s decision phases for human-AI collaborative decision-making. However, previous studies found the issues of overreliance on ‘wrong’ AI outputs. In this paper, we propose interactive example-based explanations to improve health professionals’ onboarding with AI for their better reliance on AI during AI-assisted decision-making. We implemented an AI-based decision support system that utilizes a neural network to assess the quality of post-stroke survivors’ exercises and interactive example-based explanations that systematically surface the nearest neighborhoods of a test/task sample from the training set of the AI model to assist users’ onboarding with …


Self-Adaptive Fine-Grained Multi-Modal Data Augmentation For Semi-Supervised Muti-Modal Coreference Resolution, Li Zheng, Boyu Chen, Hao Fei, Fei Li, Shengqiong Wu, Lizi Liao, Donghong Ji Oct 2024

Self-Adaptive Fine-Grained Multi-Modal Data Augmentation For Semi-Supervised Muti-Modal Coreference Resolution, Li Zheng, Boyu Chen, Hao Fei, Fei Li, Shengqiong Wu, Lizi Liao, Donghong Ji

Research Collection School Of Computing and Information Systems

Coreference resolution, an essential task in natural language processing, is particularly challenging in multi-modal scenarios where data comes in various forms and modalities. Despite advancements, limitations due to scarce labeled data and underleveraged unlabeled data persist. We address these issues with a self-adaptive fine-grained multi-modal data augmentation framework for semi-supervised MCR, focusing on enriching training data from labeled datasets and tapping into the untapped potential of unlabeled data. Regarding the former issue, we first leverage text coreference resolution datasets and diffusion models,to perform fine-grained text-to-image generation with aligned text entities and image bounding boxes. We then introduce a self-adaptive selection …


Brushbuds: Toothbrushing Tracking Using Earphone Imus, Qiang Yang, Yang Liu, Jake Stuchbury-Wass, Kayla-Jade Butkow, Dong Ma, Cecilia Mascolo Oct 2024

Brushbuds: Toothbrushing Tracking Using Earphone Imus, Qiang Yang, Yang Liu, Jake Stuchbury-Wass, Kayla-Jade Butkow, Dong Ma, Cecilia Mascolo

Research Collection School Of Computing and Information Systems

Inadequate toothbrushing habits are a leading cause of oral health problems such as tooth decay. Many individuals are uncertain if they are brushing effectively or over-focusing on specific areas. While high-end electric toothbrushes can address these concerns, manual toothbrushes remain widely used due to their simplicity and affordability. In this paper, we introduce BrushBuds, an earphone-based toothbrushing monitoring system aimed at tracking brushing areas, which leverages the ubiquitous presence of earphones to enhance manual toothbrushing. BrushBuds utilizes Inertial Measurement Units (IMUs) in earphones to detect subtle head movements incurred by toothbrushing. By capturing distinct motion patterns specific to brushing for …