Physical Sciences and Mathematics Commons^™

National Use Of Artificial Intelligence For Eye Screening In Singapore, Dinesh Visva Gunasekeran, Steven Miller, Wynne Hsu, Mong Li, Tym Hon Wong, Mun Tuck Lee, Ecosse Lamoureau, Daniel Shu Wei Ting, Gavin Siew Wei Tan, Tien-Yin Wong

Research Collection School Of Computing and Information Systems

Diabetes is a major health care challenge, affecting 10% of the global population. One third of patients with diabetes have an ocular complication known as diabetic retinopathy (DR). DR progression to manifestations such as vision-threatening diabetic retinopathy (VTDR) remains the leading cause of blindness in working-aged adults. Yearly DR screening is a universally recommended practice in primary care settings for patients with diabetes, but it is often difficult to implement due to a lack of staffing and screening capacity in primary care. This case study highlights our experience with developing a medical artificial intelligence (AI) software-as-a-medical-device (SaMD) solution for DR …

Selective Annotation Via Data Allocation: These Data Should Be Triaged To Experts For Annotation Rather Than The Model, Chen Huang, Yang Deng, Wenqiang Lei, Jiancheng Lv, Ido Dagan

Research Collection School Of Computing and Information Systems

To obtain high-quality annotations under limited budget, semi-automatic annotation methods are commonly used, where a portion of the data is annotated by experts and a model is then trained to complete the annotations for the remaining data. However, these methods mainly focus on selecting informative data for expert annotations to improve the model predictive ability (i.e., triage-to-human data), while the rest of the data is indiscriminately assigned to model annotation (i.e., triage-to-model data). This may lead to inefficiencies in budget allocation for annotations, as easy data that the model could accurately annotate may be unnecessarily assigned to the expert, and …

Beyond Persuasion : Towards Conversational Recommender System With Credible Explanations, Peixin Qin, Chen Huang, Yang Deng, Wenqiang Lei, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

With the aid of large language models, current conversational recommender system (CRS) has gaining strong abilities to persuade users to accept recommended items. While these CRSs are highly persuasive, they can mislead users by incorporating incredible information in their explanations, ultimately damaging the long-term trust between users and the CRS. To address this, we propose a simple yet effective method, called PC-CRS, to enhance the credibility of CRS’s explanations during persuasion. It guides the explanation generation through our proposed credibility-aware persuasive strategies and then gradually refines explanations via post-hoc self-reflection. Experimental results demonstrate the efficacy of PC-CRS in promoting persuasive …

Experience As Source For Anticipation And Planning : Experiential Policy Learning For Target-Driven Recommendation Dialogues, Quang Huy Dao, Yang Deng, Khanh-Huyen Bui, Dung D. Le, Lizi Liao

Research Collection School Of Computing and Information Systems

Target-driven recommendation dialogues present unique challenges in dialogue management due to the necessity of anticipating user interactions for successful conversations. Current methods face significant limitations: (I) inadequate capabilities for conversation anticipation, (II) computational inefficiencies due to costly simulations, and (III) neglect of valuable past dialogue experiences. To address these limitations, we propose a new framework, Experiential Policy Learning (EPL), for enhancing such dialogues. EPL embodies the principle of Learning From Experience, facilitating anticipation with an experiential scoring function that estimates dialogue state potential using similar past interactions stored in long-term memory. To demonstrate its flexibility, we introduce Tree-structured EPL (T-EPL) …

Context-Aware Adapter Tuning For Few-Shot Relation Learning In Knowledge Graphs, Ran Liu, Zhongzhou Liu, Xiaoli Li, Yuan Fang

Research Collection School Of Computing and Information Systems

Knowledge graphs (KGs) are instrumental in various real-world applications, yet they often suffer from incompleteness due to missing relations. To predict instances for novel relations with limited training examples, few-shot relation learning approaches have emerged, utilizing techniques such as meta-learning. However, the assumption is that novel relations in meta-testing and base relations in meta-training are independently and identically distributed, which may not hold in practice. To address the limitation, we propose RelAdapter, a context-aware adapter for few-shot relation learning in KGs designed to enhance the adaptation process in meta-learning. First, RelAdapter is equipped with a lightweight adapter module that facilitates …

Pcqpr : Proactive Conversational Question Planning With Reflection, Shasha Guo, Lizi Liao, Jing Zhang, Cuiping Li, Hong Cheng

Research Collection School Of Computing and Information Systems

In the realm of multi-intent spoken language understanding, recent advancements have leveraged the potential of prompt learning frameworks. However, critical gaps exist in these frameworks: the lack of explicit modeling of dual-task dependencies and the oversight of task-specific semantic differences among utterances. To address these shortcomings, we propose DC-Instruct, a novel generative framework based on Dual-task Inter-dependent Instructions (DII) and Supervised Contrastive Instructions (SCI). Specifically, DII guides large language models (LLMs) to generate labels for one task based on the other task’s labels, thereby explicitly capturing dual-task inter-dependencies. Moreover, SCI leverages utterance semantics differences by guiding LLMs to determine whether …

Balancing Visual Context Understanding In Dialogue For Image Retrieval, Zhaohui Wei, Lizi Liao, Xiaoyu Du, Xinguang Xiang

Research Collection School Of Computing and Information Systems

In the realm of dialogue-to-image retrieval, the primary challenge is to fetch images from a pre-compiled database that accurately reflect the intent embedded within the dialogue history. Existing methods often overemphasize inter-modal alignment, neglecting the nuanced nature of conversational context. Dialogue histories are frequently cluttered with redundant information and often lack direct image descriptions, leading to a substantial disconnect between conversational content and visual representation. This study introduces VCU, a novel framework designed to enhance the comprehension of dialogue history and improve cross-modal matching for image retrieval. VCU leverages large language models (LLMs) to perform a two-step extraction process. It …

Class Name Guided Out-Of-Scope Intent Classification, Chandan Gautam, Sethupathy Parameswaran, Aditya Kane, Yuan Fang, Savitha Ramasamy, Suresh Sundaram, Sunil Kumar Sahu, Xiaoli Li

Research Collection School Of Computing and Information Systems

The paper introduces Semantics of Class Labelbased Unsupervised Out of Scope Intent Detection (SCOOS), a novel method aimed at enhancing out-of-scope (OOS) intent classification in task-oriented dialogue systems. Unlike prior approaches that rely solely on indomain (ID) data features, SCOOS leverages semantic cues embedded in class labels to improve classification accuracy. The method entails forming a compact feature space centered around the semantics of class labels by minimizing losses between ID features and class names. SCOOS achieves this by creating a compact feature space centered around class label semantics, achieved through minimizing losses between in-domain (ID) features and class names. …

Ultra-High Resolution Image Segmentation Via Locality-Aware Context Fusion And Alternating Local Enhancement, Wenxi Liu, Qi Li, Xindai Lin, Weixiang Yang, Shengfeng He, Yuanlong Yu

Research Collection School Of Computing and Information Systems

Ultra-high resolution image segmentation has raised increasing interests in recent years due to its realistic applications. In this paper, we innovate the widely used high-resolution image segmentation pipeline, in which an ultra-high resolution image is partitioned into regular patches for local segmentation and then the local results are merged into a high-resolution semantic mask. In particular, we introduce a novel locality-aware context fusion based segmentation model to process local patches, where the relevance between local patch and its various contexts are jointly and complementarily utilized to handle the semantic regions with large variations. Additionally, we present the alternating local enhancement …

Lr-Auth: Towards Practical Implementation Of Implicit User Authentication On Earbuds, Changshuo Hu, Xiao Ma, Xinger Huang, Yiran Shen, Dong Ma

Research Collection School Of Computing and Information Systems

The increasing use of earbuds in applications like immersive entertainment and health monitoring necessitates effective implicit user authentication systems to preserve the privacy of sensitive data and provide personalized experiences. Existing approaches, which leverage physiological cues (e.g., jawbone structure) and behavioral cues (e.g., gait), face challenges such as limited usability, high delay and energy overhead, and significant computational demands, rendering them impractical for resource-constrained earbuds. To address these issues, we present LR-Auth, a lightweight, user-friendly implicit authentication system designed for various earbud usage scenarios. LR-Auth utilizes the modulation of sound frequencies by the user's unique occluded ear canal, generating user-specific …

From Data To Application: Harnessing Big Spatial Data And Spatially Explicit Machine Learning Model For Landslide Susceptibility Prediction And Mapping, Min Naing Khant, Mei Yi Victoria Grace Ann, Tin Seong Kam

Research Collection School Of Computing and Information Systems

Recent advancements in information and communication technology have significantly enhanced access to extensive geospatial data, presenting a valuable opportunity to leverage big spatial data for improved modeling and predictive capabilities in natural disaster risk assessment. This paper explores the integration of a comprehensive dataset comprising historical landslide events and various geo-environmental variables within a spatially explicit machine learning framework. The study empirically demonstrates that incorporating big spatial data allows a more nuanced understanding of local variations and spatial dependencies. Ultimately, this empirical assessment produces more accurate landslide risk predictions than traditional baseline models. Using Italy’s expansive Valtellina Valley as a …

Eyetraes : Fine-Grained, Low-Latency Eye Tracking Via Adaptive Event Slicing, Argha Sen, Panahetipola Mudiyanselage Nuwan Bandara, Ila Gokarn, Thivya Kandappu, Archan Misra

Research Collection School Of Computing and Information Systems

Eye-tracking technology has gained significant attention in recent years due to its wide range of applications in humancomputer interaction, virtual and augmented reality, and wearable health. Traditional RGB camera-based eye-tracking systems often struggle with poor temporal resolution and computational constraints, limiting their effectiveness in capturing rapid eye movements. To address these limitations, we propose EyeTrAES, a novel approach using neuromorphic event cameras for high-fidelity tracking of natural pupillary movement that shows significant kinematic variance. One of EyeTrAES’s highlights is the use of a novel adaptive windowing/slicing algorithm that ensures just the right amount of descriptive asynchronous event data accumulation within …

Hi3d: Pursuing High-Resolution Image-To-3d Generation With Video Diffusion Models, Haibo Yang, Yang Chen, Yingwei Pan, Ting Yao, Zhineng Chen, Chong-Wah Ngo, Tao Mei

Research Collection School Of Computing and Information Systems

Despite having tremendous progress in image-to-3D generation, existing methods still struggle to produce multi-view consistent images with high-resolution textures in detail, especially in the paradigm of 2D diffusion that lacks 3D awareness. In this work, we present High-resolution Image-to-3D model (Hi3D), a new video diffusion based paradigm that redefines a single image to multi-view images as 3D-aware sequential image generation (i.e., orbital video generation). This methodology delves into the underlying temporal consistency knowledge in video diffusion model that generalizes well to geometry consistency across multiple views in 3D generation. Technically, Hi3D first empowers the pre-trained video diffusion model with 3D-aware …

Multimodal Misinformation Detection By Learning From Synthetic Data With Multimodal Llms, Fengzhu Zeng, Wenqian Li, Wei Gao, Yan Pang

Research Collection School Of Computing and Information Systems

Detecting multimodal misinformation, especially in the form of image-text pairs, is crucial. Obtaining large-scale, high-quality real-world fact-checking datasets for training detectors is costly, leading researchers to use synthetic datasets generated by AI technologies. However, the generalizability of detectors trained on synthetic data to real-world scenarios remains unclear due to the distribution gap. To address this, we propose learning from synthetic data for detecting real-world multimodal misinformation through two model-agnostic data selection methods that match synthetic and real-world data distributions. Experiments show that our method enhances the performance of a small MLLM (13B) on real-world fact-checking datasets, enabling it to even …

Revisiting Conversation Discourse For Dialogue Disentanglement, Bobo Li, Hao Fei, Fei Li, Shengqiong Wu, Lizi Liao, Yinwei Wei, Tat-Seng Chua, Donghong Ji

Research Collection School Of Computing and Information Systems

Dialogue disentanglement aims to detach the chronologically ordered utterances into several independent sessions. Conversation utterances are essentially organized and described by the underlying discourse, and thus dialogue disentanglement requires the full understanding and harnessing of the intrinsic discourse attribute. In this article, we propose enhancing dialogue disentanglement by taking full advantage of the dialogue discourse characteristics. First of all, in feature encoding stage, we construct the heterogeneous graph representations to model the various dialogue-specific discourse structural features, including the static speaker-role structures (i.e., speaker-utterance and speaker-mentioning structure) and the dynamic contextual structures (i.e., the utterance-distance and partial-replying structure). We then …

Scoping Software Engineering For Ai: The Tse Perspective, Sebastián Uchitel, Marsha Chechik, Massimiliano Di Penta, Bram Adams, Nazareno Aguirre, Gabriele Bavota, Domenico Bianculli, Kelly Blincoe, Ana Cavalcanti, Yvonne Dittrich, Filomena Ferrucci, Rashina Hoda, Liguo Huang, David Lo, Et Al.

Research Collection School Of Computing and Information Systems

In recent years, important advances in Artificial Intelligence (AI), and, in particular, in Machine Learning (ML), including Deep Learning (DL) and Large Language Models (LLMs), have caused a substantial increase of submissions to all Software Engineering (SE) venues (conferences and journals) related to SE with and for AI. They are commonly referred to as AI for SE and SE for AI.

Eyegraph : Modularity-Aware Spatio Temporal Graph Clustering For Continuous Event-Based Eye Tracking, Panahetipola Mudiyanselage Nuwan Bandara, Thivya Kandappu, Archan Misra, Ila Gokarn, Archan Misra

Research Collection School Of Computing and Information Systems

Continuous tracking of eye movement dynamics plays a significant role in developing a broad spectrum of human-centered applications, such as cognitive skills (visual attention and working memory) modeling, human-machine interaction, biometric user authentication, and foveated rendering. Recently neuromorphic cameras have garnered significant interest in the eye-tracking research community, owing to their sub-microsecond latency in capturing intensity changes resulting from eye movements. Nevertheless, the existing approaches for event-based eye tracking suffer from several limitations: dependence on RGB frames, label sparsity, and training on datasets collected in controlled lab environments that do not adequately reflect real-world scenarios. To address these limitations, in …

Large Language Models For Software Engineering: A Systematic Literature Review, Xinyi Hou, Yanjie Zhao, Yue Liu, Zhou Yang, Kailong Wang, Li Li, Xiapu Luo, David Lo, John Grundy, Haoyu Wang

Research Collection School Of Computing and Information Systems

Large Language Models (LLMs) have significantly impacted numerous domains, including Software Engineering (SE). Many recent publications have explored LLMs applied to various SE tasks. Nevertheless, a comprehensive understanding of the application, effects, and possible limitations of LLMs on SE is still in its early stages. To bridge this gap, we conducted a Systematic Literature Review (SLR) on LLM4SE, with a particular focus on understanding how LLMs can be exploited to optimize processes and outcomes. We selected and analyzed 395 research articles from January 2017 to January 2024 to answer four key Research Questions (RQs). In RQ1, we categorize different LLMs …

Cirp: Cross‑Item Relational Pre‑Training For Multimodal Product Bundling, Yunshan Ma, Yingzhi He, Wenjun Zhong, Xiang Wang, Roger Zimmermann, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

Product bundling has been a prevailing marketing strategy that is beneficial in the online shopping scenario. Effective product bundling methods depend on high-quality item representations capturing both the individual items' semantics and cross-item relations. However, previous item representation learning methods, either feature fusion or graph learning, suffer from inadequate cross-modal alignment and struggle to capture the cross-item relations for cold-start items. Multimodal pre-train models could be the potential solutions given their promising performance on various multimodal downstream tasks. However, the cross-item relations have been under-explored in the current multimodal pre-train models.To bridge this gap, we propose a novel and simple …

Mm‑Forecast: A Multimodal Approach To Temporal Event Forecasting With Large Language Models, Haoxuan Li, Zhengmao Yang, Yunshan Ma, Yi Bin, Yang Yang, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

We study an emerging and intriguing problem of multimodal temporal event forecasting with large language models. Compared to using text or graph modalities, the investigation of utilizing images for temporal event forecasting has not been fully explored, especially in the era of large language models (LLMs). To bridge this gap, we are particularly interested in two key questions of: 1) why images will help in temporal event forecasting, and 2) how to integrate images into the LLM-based forecasting framework. To answer these research questions, we propose to identify two essential functions that images play in the scenario of temporal event …

The Divergent Responses Of Salinity Generalists To Hyposaline Stress Provide Insights Into The Colonisation Of Freshwaters By Diatoms, Kathryn J. Judy, Eveline Pinseel, Kala M. Downey, Jeffrey A. Lewis, Andrew J. Alverson

Biological Sciences Faculty Publications and Presentations

Environmental transitions, such as the salinity divide separating marine and fresh waters, shape biodiversity over both shallow and deep timescales, opening up new niches and creating opportunities for accelerated speciation and adaptive radiation. Understanding the genetics of environmental adaptation is central to understanding how organisms colonise and subsequently diversify in new habitats. We used time-resolved transcriptomics to contrast the hyposalinity stress responses of two diatoms. Skeletonema marinoi has deep marine ancestry but has recently invaded brackish waters. Cyclotella cryptica has deep freshwater ancestry and can withstand a much broader salinity range. Skeletonema marinoi is less adept at mitigating even mild …

Optimal Har Inference, Liyu Dou

Research Collection School Of Economics

This paper addresses the problem of deriving heteroskedasticity and autocorrelation robust (HAR) inference for a scalar parameter of interest, under the assumption of a known upper bound on data persistence. Finite-sample optimal tests are derived within the Gaussian location model, revealing that robustness-efficiency tradeoffs are primarily determined by the maximal persistence. With a suitable adjustment to the critical value, the equal-weighted cosine (EWC) test emerges as nearly optimal, wherein the long-run variance is estimated through projections onto q type II cosines. This approach establishes a direct link between the choice of q and persistence assumptions, accompanied by adjustments to the …

Mid-Infrared Spectroscopy Determines The Provenance Of Coastal Marine Soils And Their Organic And Inorganic Carbon Content, Lewis Walden, Oscar Serrano, Zefang Shen, Mingxi Zhang, Paul Lavery, Zhongkui Luo, Lei Gao, Raphael A. Viscarra Rossel

Research outputs 2022 to 2026

Vegetated coastal ecosystems (VCE), encompassing tidal marshes, mangroves, and seagrasses, serve as significant ‘blue’ carbon (C) sinks. Improving our understanding of VCE soils and their spatial and temporal dynamics is essential for conservation efforts. Conventional methods to characterise the dynamics and provenance of VCE soils and measure their total organic carbon (TOC) and inorganic carbon (TIC) contents are cumbersome and expensive. We recorded the mid-infrared (MIR) spectra and measured the TOC and TIC content of 323 subsamples across consistent depths from 106 soil core samples. Using the spectra of each VCE, we determined their mineral and organic composition by depth. …

Large-Scale Cosmic-Ray Anisotropies With 19yr Of Data From The Pierre Auger Observatory, A. Abdul Halim, P. Abreu, M. Aglietta, I. Allekotte, K. Almeida Cheminant, A. Almela, B. Fick, K. Nguyen, D. Nitz, Et Al.

Michigan Tech Publications

Results are presented for the measurement of large-scale anisotropies in the arrival directions of ultra–high-energy cosmic rays detected at the Pierre Auger Observatory during 19 yr of operation, prior to AugerPrime, the upgrade of the observatory. The 3D dipole amplitude and direction are reconstructed above 4 EeV in four energy bins. Besides the established dipolar anisotropy in R.A. above 8 EeV, the Fourier amplitude of the 8–16 EeV energy bin is now also above the 5σ discovery level. No time variation of the dipole moment above 8 EeV is found, setting an upper limit to the rate of change of …

A Liquid Crystal-Based Biomaterial Platform For Rapid Sensing Of Heat Stress Using Machine Learning, Prateek Verma, Elizabeth Adeogun, Elizabeth S. Greene, Sami Dridi, Ukash Nakarmi, Karthik Nayani

Poultry Science Faculty Publications and Presentations

Novel biomaterials that bridge the knowledge gap in coupling molecular/protein signatures of disease/stress with rapid readouts are a critical need of society. One such scenario is an imbalance between bodily heat production and heat dissipation which leads to heat stress in organisms. In addition to diminished animal well-being, heat stress is detrimental to the poultry industry as poultry entails fast growth and high yields, resulting in greater metabolic activity and higher body heat production. When stressed, cells overexpress heat shock proteins (such as HSP70, a well-established intracellular stress indicator) and may undergo changes in their mechanical properties. Liquid crystals (LCs, …

Collectively Advancing Deep Learning For Animal Detection In Drone Imagery: Successes, Challenges, And Research Gaps, Daniel Axford, Ferdous Sohel, Mathew A. Vanderklift, Amanda J. Hodgson

Research outputs 2022 to 2026

Drones have emerged as a powerful tool in animal detection, significantly advancing wildlife monitoring, conservation, and management by capturing high-resolution, real-time imagery over areas often inaccessible or challenging for human observers to reach. However, manual analysis of drone imagery for animal detection is labour-intensive and time-consuming. The application of deep learning methods, particularly convolutional neural networks, in automating animal detection from drone imagery has the potential to revolutionise wildlife monitoring, conservation, and management protocols. This review provides a comprehensive overview of the increasing use and prospects of deep learning in animal detection using drone imagery. It explores successful applications of …

Liquid Crystalline Collagen Assemblies As Substrates For Directed Alignment Of Human Schwann Cells, Homa Ghaiedi, Luis Carlos Pinzon-Herrera, Saja Alshafeay, Leonard Harris, Jorge Almodovar, Karthik Nayani

Chemical Engineering Faculty Publications and Presentations

Collagen is a key component of the extracellular matrix (ECM) and well-oriented domains of collagen are important for mimicking the local cell environment in vitro. While there has been significant attention directed towards the alignment of collagen, formation of large-scale oriented domains remains a key challenge. Type I collagen self-assembles to form liquid crystalline (LC) mesophases in acidic conditions at concentrations above 100 mg mL−1. The LC mesophase provides an efficient platform for large-scale alignment and patterning of collagen coated substrates. However, there still exist challenges related to solubilizing and processing of collagen at such high concentrations in order …

Substitution Tilings With Transcendental Inflation Factor, Dirk Frettlöh, Alexey Garber, Neil Mañibo

School of Mathematical & Statistical Sciences Faculty Publications

For any λ>2, we construct a substitution on an infinite alphabet which gives rise to a substitution tiling with inflation factor λ. In particular, we obtain the first class of examples of substitutive systems with transcendental inflation factors. We also show that both the associated subshift and tiling dynamical systems are strictly ergodic, which is related to the quasicompactness of the underlying substitution operator.

Exploring The Human Side Of Math, Mike Janssen

Faculty Work Comprehensive List

"Abstract mathematics is an important way to better understand and marvel at the beauty and intricacy of God’s creation."

Posting about ­­­­­­­­experiences in math research from In All Things, an online hub that offers insight into maintaining and faithful and orthodox Reformed Christian worldview while fearlessly engaging in every aspect of contemporary life – until all is made new.

Exploring the Human Side of Math

Insulator-To-Metal Transition And Isotropic Gigantic Magnetoresistance In Layered Magnetic Semiconductors, Gokul Acharya, Bimal Neupane, Chia-Hsiu Hsu, Xian P. Yang, David Graf, Eun Sang Choi, Krishna Pandey, Md Rafique Un Nabi, Santosh Karki Chhetri, Rabindra Basnet, Sumaya Rahman, Jian Wang, Zhengxin Hu, Bo Da, Hugh O.H. Churchill, Guoqing Chang, M. Zahid Hasan, Yuanxi Wang, Jin Hu

Physics Faculty Publications and Presentations

Magnetotransport, the response of electrical conduction to external magnetic field, acts as an important tool to reveal fundamental concepts behind exotic phenomena and plays a key role in enabling spintronic applications. Magnetotransport is generally sensitive to magnetic field orientations. In contrast, efficient and isotropic modulation of electronic transport, which is useful in technology applications such as omnidirectional sensing, is rarely seen, especially for pristine crystals. Here a strategy is proposed to realize extremely strong modulation of electron conduction by magnetic field which is independent of field direction. GdPS, a layered antiferromagnetic semiconductor with resistivity anisotropies, supports a field-driven insulator-to-metal transition …