Artificial Intelligence and Robotics Commons^™

Self-Adaptive Fine-Grained Multi-Modal Data Augmentation For Semi-Supervised Muti-Modal Coreference Resolution, Li Zheng, Boyu Chen, Hao Fei, Fei Li, Shengqiong Wu, Lizi Liao, Donghong Ji

Research Collection School Of Computing and Information Systems

Coreference resolution, an essential task in natural language processing, is particularly challenging in multi-modal scenarios where data comes in various forms and modalities. Despite advancements, limitations due to scarce labeled data and underleveraged unlabeled data persist. We address these issues with a self-adaptive fine-grained multi-modal data augmentation framework for semi-supervised MCR, focusing on enriching training data from labeled datasets and tapping into the untapped potential of unlabeled data. Regarding the former issue, we first leverage text coreference resolution datasets and diffusion models,to perform fine-grained text-to-image generation with aligned text entities and image bounding boxes. We then introduce a self-adaptive selection …

Brushbuds: Toothbrushing Tracking Using Earphone Imus, Qiang Yang, Yang Liu, Jake Stuchbury-Wass, Kayla-Jade Butkow, Dong Ma, Cecilia Mascolo

Research Collection School Of Computing and Information Systems

Inadequate toothbrushing habits are a leading cause of oral health problems such as tooth decay. Many individuals are uncertain if they are brushing effectively or over-focusing on specific areas. While high-end electric toothbrushes can address these concerns, manual toothbrushes remain widely used due to their simplicity and affordability. In this paper, we introduce BrushBuds, an earphone-based toothbrushing monitoring system aimed at tracking brushing areas, which leverages the ubiquitous presence of earphones to enhance manual toothbrushing. BrushBuds utilizes Inertial Measurement Units (IMUs) in earphones to detect subtle head movements incurred by toothbrushing. By capturing distinct motion patterns specific to brushing for …

An Empirical Study To Evaluate Aigc Detectors On Code Content, Jian Wang, Shangqing Liu, Xiaofei Xie, Yi Li

Research Collection School Of Computing and Information Systems

Artificial Intelligence Generated Content (AIGC) has garnered considerable attention for its impressive performance, with Large Language Models (LLMs), like ChatGPT, emerging as a leading AIGC model that produces high-quality responses across various applications, including software development and maintenance. Despite its potential, the misuse of LLMs, especially in security and safetycritical domains, such as academic integrity and answering questions on Stack Overflow, poses significant concerns. Numerous AIGC detectors have been developed and evaluated on natural language data. However, their performance on code-related content generated by LLMs remains unexplored. To fill this gap, in this paper, we present an empirical study evaluating …

Risurconv : Rotation Invariant Surface Attention-Augmented Convolutions For 3d Point Cloud Classification And Segmentation, Zhiyuan Zhang, Licheng Yang, Xiang Zhiyu

Research Collection School Of Computing and Information Systems

Despite the progress on 3D point cloud deep learning, most prior works focus on learning features that are invariant to translation and point permutation, and very limited efforts have been devoted for rotation invariant property. Several recent studies achieve rotation invariance at the cost of lower accuracies. In this work, we close this gap by proposing a novel yet effective rotation invariant architecture for 3D point cloud classification and segmentation. Instead of traditional pointwise operations, we construct local triangle surfaces to capture more detailed surface structure, based on which we can extract highly expressive rotation invariant surface properties which are …

Collaborative Cross-Modal Fusion With Large Language Model For Recommendation, Zhongzhou Liu, Hao Zhang, Kuicai Dong, Yuan Fang

Research Collection School Of Computing and Information Systems

Despite the success of conventional collaborative filtering (CF) approaches for recommendation systems, they exhibit limitations in leveraging semantic knowledge within the textual attributes of users and items. Recent focus on the application of large language models for recommendation (LLM4Rec) has highlighted their capability for effective semantic knowledge capture. However, these methods often overlook the collaborative signals in user behaviors. Some simply instruct-tune a language model, while others directly inject the embeddings of a CF-based model, lacking a synergistic fusion of different modalities. To address these issues, we propose a framework of Collaborative Cross-modal Fusion with Large Language Models, termed CCF-LLM, …

Zero-Shot Object Counting With Good Exemplars, Huilin Zhu, Jingling Yuan, Zhengwei Yang, Yu Guo, Zheng Wang, Xian Zhong, Shengfeng He

Research Collection School Of Computing and Information Systems

Zero-shot object counting (ZOC) aims to enumerate objects in images using only the names of object classes during testing, without the need for manual annotations. However, a critical challenge in current ZOC methods lies in their inability to identify high-quality exemplars effectively. This deficiency hampers scalability across diverse classes and undermines the development of strong visual associations between the identified classes and image content. To this end, we propose the Visual Association-based Zero-shot Object Counting (VA-Count) framework. VACount consists of an Exemplar Enhancement Module (EEM) and a Noise Suppression Module (NSM) that synergistically refine the process of class exemplar identification …

Documenting Ethical Considerations In Open Source Ai Models, Haoyu Gao, Mansooreh Zahedi, Christoph Treude, Sarita Rosenstock, Marc Cheong

Research Collection School Of Computing and Information Systems

Background: The development of AI-enabled software heavily depends on AI model documentation, such as model cards, due to different domain expertise between software engineers and model developers. From an ethical standpoint, AI model documentation conveys critical information on ethical considerations along with mitigation strategies for downstream developers to ensure the delivery of ethically compliant software. However, knowledge on such documentation practice remains scarce. Aims: The objective of our study is to investigate how developers document ethical aspects of open source AI models in practice, aiming at providing recommendations for future documentation endeavours. Method: We selected three sources of documentation on …

Self-Supervised Learning For Time Series Analysis : Taxonomy, Progress, And Prospects, Zhang Kexin, Qingsong Wen, Chaoli Zhang, Rongyao Cai, Ming Jin, Yong Liu, James Y. Zhang, Guansong Pang, Guansong Pang, Pan Shirui

Research Collection School Of Computing and Information Systems

Self-supervised learning (SSL) has recently achieved impressive performance on various time series tasks. The most prominent advantage of SSL is that it reduces the dependence on labeled data. Based on the pre-training and fine-tuning strategy, even a small amount of labeled data can achieve high performance. Compared with many published self-supervised surveys on computer vision and natural language processing, a comprehensive survey for time series SSL is still missing. To fill this gap, we review current state-of-the-art SSL methods for time series data in this article. To this end, we first comprehensively review existing surveys related to SSL and time …

Latent Representation Learning For Geospatial Entities, Ween Jiann Lee, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Representation learning has been instrumental in the success of machine learning, offering compact and performant data representations for diverse downstream tasks. In the spatial domain, it has been pivotal in extracting latent patterns from various data types, including points, polylines, polygons, and networked structures. However, existing approaches often fall short of explicitly capturing both semantic and spatial information, relying on proxies and synthetic features. This article presents GeoNN, a novel graph neural network-based model designed to learn spatially-aware embeddings for geospatial entities. GeoNN leverages edge features generated from geodesic functions, dynamically selecting relevant features based on relative locations. It introduces …

Promise And Peril Of Collaborative Code Generation Models : Balancing Effectiveness And Memorization, Zhi Chen, Lingxiao Jiang

Research Collection School Of Computing and Information Systems

In the rapidly evolving field of machine learning, training models with datasets from various locations and organizations presents significant challenges due to privacy and legal concerns. The exploration of effective collaborative training settings, which are capable of leveraging valuable knowledge from distributed and isolated datasets, is increasingly crucial. This study investigates key factors that impact the effectiveness of collaborative training methods in code next-token prediction, as well as the correctness and utility of the generated code, showing the promise of such methods. Additionally, we evaluate the memorization of different participant training data across various collaborative training settings, including centralized, federated, …

The Promise And Perils Of Smart (City) Bots As Educational Tools, Thomas Menkhoff, Siew Ning Kan, Shaohui Foong

Research Collection Lee Kong Chian School Of Business

Written from an educator’s perspective, the paper aims to examine the increasing use of chatbot technology capable of answering user queries in various fields such as commerce, public service delivery, urban areas, higher education etc. by simulating human conversation through text messages or voice commands. We analyse why smart bots have become popular technologies in the context smart cities; shed light on different types of bots (chatbots, large language models such as ChatGPT, flying bots); and explain how we use bots as teaching tool in an introductory AI for business course. A key argument putting forward is that smart bots …

Privacy Risks And Regulatory Challenges In Smart Grids And Renewable Energy Systems, Mikołaj Rajca

internetowy Kwartalnik Antymonopolowy i Regulacyjny (internet Quarterly on Antitrust and Regulation)

Smart grid technologies are central to the global shift towards a more efficient and sustainable energy infrastructure, integrating advanced digital systems with traditional power networks. While these technologies offer significant benefits, including enhanced energy management and the seamless integration of renewable energy sources, they also introduce complex privacy challenges. The extensive data collection and real-time communication capabilities inherent in smart grids raise concerns over consumer privacy, data breaches, and cybersecurity threats. This paper critically examines these privacy risks within the context of evolving regulatory frameworks such as the GDPR, NIS2 Directive, and the forthcoming EU AI Act. The discussion emphasizes …

Robust And Generalizable Representations In The Hippocampus, Hung-Tu Chen

Dartmouth College Ph.D Dissertations

An intelligent system must balance generalizing across similar experiences with maintaining the distinctiveness of each experience. This thesis explores how the hippocampus manages this balance through its neural representations to support adaptive behavior. In Chapter 1, I provide an overview of key hippocampal phenomena that contribute to this process, including remapping, splitter signal, and replay. In Chapter 2, I challenge the concept of random remapping by showing that it is possible to predict, better than chance, how a given experience will be encoded in the hippocampus across different subjects. This suggests that encoding of related experiences, which was previously thought …

A Framework For Human Evaluation Of Large Language Models In Healthcare Derived From Literature Review, Katelyn Polanska, Karleigh R Mccarthy, Hunter Osterhoudt, Xizhi Wu, Shyam Visweswaran, Sunyang Fu, Piyush Mathur, Giovanni E Cacciamani, Cong Sun, Yifan Peng, Yanshan Wang

Faculty, Staff and Student Publications

With generative artificial intelligence (GenAI), particularly large language models (LLMs), continuing to make inroads in healthcare, assessing LLMs with human evaluations is essential to assuring safety and effectiveness. This study reviews existing literature on human evaluation methodologies for LLMs in healthcare across various medical specialties and addresses factors such as evaluation dimensions, sample types and sizes, selection, and recruitment of evaluators, frameworks and metrics, evaluation process, and statistical analysis type. Our literature review of 142 studies shows gaps in reliability, generalizability, and applicability of current human evaluation practices. To overcome such significant obstacles to healthcare LLM developments and deployments, we …

Architecting Standards: Leveraging Ia To Drive Emerging Technology Standards​, Noreen Y. Whysel

Publications and Research

In this talk for the annual meeting of the W3C Information Architecture Community Group, I discuss how standards bodies can learn from the Information Architecture field to improve accessibility and usability. By adopting user-centered design principles and engaging in iterative feedback loops, standards organizations can create more relevant and practical standards that align with real-world applications. Emphasizing collaboration with industry experts and end-users will help ensure that standards evolve along with technological advancements.

In the meantime, key standards are examined, such as ISO 9241, which provides guidelines for usability and user-centered design, and the W3C's Web Content Accessibility Guidelines (WCAG), …

The Limits Of Generative Ai In Administrative Law Research, Susan Azyndar

Journal Articles

The author recounts an administrative law classroom experience using generative AI. She considers the complexities of administrative law, AI training, professional responsibility, and traditional resources.

Revolutionizing Public Safety And Criminal Justice Through Ai, Alan Saquella

Publications

Artificial Intelligence (AI) is rapidly transforming public safety, criminal justice and security by fundamentally changing how crimes are committed, investigated and prevented. As AI tools become increasingly sophisticated, law enforcement and corporate security professionals are utilizing these advancements to enhance their capabilities. However, integrating AI into these sectors also brings significant challenges, including ethical concerns, recruitment difficulties, and the surge in crime rates. This article examines the transformative impact of AI, the ongoing efforts to unify AI applications across public safety and security sectors, and expert advice on overcoming the associated challenges.

Ai In The Health Professions, Heidi Monroe, Carrie Fry, Phillip Baker, Erika Busz

AI and the Future of Work

The aim of this track is to provide health professionals, and those interested in mental health and healthcare careers with an understanding of key aspects of AI use in healthcare. Participants will explore advantages of some recent AI developments and evaluate how they may be effectively leveraged to improve patient care, while addressing potential challenges, limitations, and ethical considerations.

Educating With Ai, Grace Seo, David Wicks

AI and the Future of Work

This conference track explores the integration of AI within teaching and learning, with a focus on practical approaches that leverage AI technologies to optimize teaching practices and enhance students’ learning experience. The topics include the essential AI literacies in educational contexts, collaborative learning with AI, and the use of AI for enhanced learning assessments.

A Generalized Machine Learning Model For Long-Term Coral Reef Monitoring In The Red Sea, Justin J. Gapper, Surendra Maharjan, Wenzhao Li, Erik Linstead, Surya Prakash Tiwari, Mohamed A. Qurban, Hesham El-Askary

Mathematics, Physics, and Computer Science Faculty Articles and Research

Coral reefs, despite covering less than 0.2 % of the ocean floor, harbor approximately 35 % of all known marine species, making their conservation critical. However, coral bleaching, exacerbated by climate change and phenomena such as El Niño, poses a significant threat to these ecosystems. This study focuses on the Red Sea, proposing a generalized machine learning approach to detect and monitor changes in coral reef cover over an 18-year period (2000–2018). Using Landsat 7 and 8 data, a Support Vector Machine (SVM) classifier was trained on depth-invariant indices (DII) derived from the Gulf of Aqaba and validated against ground …