Digital Commons Network^™

How People Prompt Generative Ai To Create Interactive Vr Scenes, Setareh Aghel Manesh, Tianyi Zhang, Yuki Onishi, Kotaro Hara, Scott Bateman, Jiannan Li, Anthony Tang

Research Collection School Of Computing and Information Systems

Generative AI tools can provide people with the ability to create virtual environments and scenes with natural language prompts. Yet, how people will formulate such prompts is unclear---particularly when they inhabit the environment that they are designing. For instance, it is likely that a person might say, "Put a chair here,'' while pointing at a location. If such linguistic and embodied features are common to people's prompts, we need to tune models to accommodate them. In this work, we present a Wizard of Oz elicitation study with 22 participants, where we studied people's implicit expectations when verbally prompting such programming …

Certified Robust Accuracy Of Neural Networks Are Bounded Due To Bayes Errors, Ruihan Zhang, Jun Sun

Research Collection School Of Computing and Information Systems

Adversarial examples pose a security threat to many critical systems built on neural networks. While certified training improves robustness, it also decreases accuracy noticeably. Despite various proposals for addressing this issue, the significant accuracy drop remains. More importantly, it is not clear whether there is a certain fundamental limit on achieving robustness whilst maintaining accuracy. In this work, we offer a novel perspective based on Bayes errors. By adopting Bayes error to robustness analysis, we investigate the limit of certified robust accuracy, taking into account data distribution uncertainties. We first show that the accuracy inevitably decreases in the pursuit of …

Multi-Case Study Of Left-Flank Boundaries Within Supercells, Peyton B. Stevenson

Department of Earth and Atmospheric Sciences: Dissertations, Theses, and Student Research

This study investigates the prevalence and significance of forward-flank convergence boundaries (FFCBs) and left-flank convergence boundaries (LFCBs) in shaping the structure and intensity of supercells, using observational data from various field projects. Unlike previous research focusing on individual cases, this study examines a diverse range of cases to provide comprehensive insights into the relationship between these boundaries and supercell characteristics such as intensity, longevity, and tornadogenesis. By analyzing high-resolution surface data, the research addresses the frequency, location, and intensity of these boundaries, and their impact on pseudo vertical vorticity, pseudo convergence, and density gradients. A total of 228 boundary identifications …

Application Of Multilayer Perceptron Artificial Neural Network (Mlp-Ann) Algorithm For Pm2.5 Mass Concentration Estimation During Open Biomass Burning Episodes In Thailand, P. Paluang, W. Thavorntam, W. Phairuang

Research outputs 2022 to 2026

Open biomass burning (OBB) is the main cause of air pollution in Northern Thailand, where PM2.5 concentrations exceed Thailand's air quality standards annually during the January–April (dry season). The air emissions from databases that detail the pollutants discharged into the atmosphere from specific sources of air pollution are crucial for monitoring air pollution. However, this data has been poorly studied in Thailand. This study estimated ground-level PM2.5 concentration in Northern Thailand using the Multilayer Perceptron Artificial Neural Networks (MLP-ANN) model, integrating the in-depth data as input variables. The 10-fold cross-validation approach was applied to validate the model's performance. The meteorological …

Application Of Event Cameras And Neuromorphic Computing To Vslam: A Survey, Sangay Tenzin, Alexander Rassau, Douglas Chai

Research outputs 2022 to 2026

Simultaneous Localization and Mapping (SLAM) is a crucial function for most autonomous systems, allowing them to both navigate through and create maps of unfamiliar surroundings. Traditional Visual SLAM, also commonly known as VSLAM, relies on frame-based cameras and structured processing pipelines, which face challenges in dynamic or low-light environments. However, recent advancements in event camera technology and neuromorphic processing offer promising opportunities to overcome these limitations. Event cameras inspired by biological vision systems capture the scenes asynchronously, consuming minimal power but with higher temporal resolution. Neuromorphic processors, which are designed to mimic the parallel processing capabilities of the human brain, …

Label-Free Surface-Enhanced Raman Spectroscopy Coupled With Machine Learning Algorithms In Pathogenic Microbial Identification: Current Trends, Challenges, And Perspectives, Jia Wei Tang, Quan Yuan, Xin Ru Wen, Muhammad Usman, Alfred Chin Yen Tay, Liang Wang

Research outputs 2022 to 2026

Infectious diseases caused by microbial pathogens remain a primary contributor to global health burdens. Prompt control and effective prevention of these pathogens are critical for public health and medical diagnostics. Conventional microbial detection methods suffer from high complexity, low sensitivity, and poor selectivity. Therefore, developing rapid and reliable methods for microbial pathogen detection has become imperative. Surface-enhanced Raman Spectroscopy (SERS), as an innovative non-invasive diagnostic technique, holds significant promise in pathogenic microorganism detection due to its rapid, reliable, and cost-effective advantages. This review comprehensively outlines the fundamental theories of Raman Spectroscopy (RS) with a focus on label-free SERS strategy, reporting …

Development Of An Algorithm To Identify And Calculate The Amount Of File Slack On An Image Of A Given Drive, Nicholas Flynn

Honors Theses

As society increasingly relies on technology, the rates of cyber crime have been increasing at exponential rates. Cyber criminals are also discovering new ways to hide evidence of their crimes. This study develops a forensic analysis algorithm to evaluate the amount of file slack on an image of a drive. Slack space, leftover drive space on a disk sector after a file has been written, can be exploited to hide data. The algorithm aims to detect and calculate this slack space to help direct forensic investigations. The algorithm was evaluated on a population dataset of 100,000 files with random data …

Contextualizing Interpersonal Data Sharing In Smart Homes, Weijia He, Nathan Reitinger, Atheer Almogbil, Yi-Shyuan Chiang, Timothy J. Pierson, David Kotz

Dartmouth Scholarship

A key feature of smart home devices is monitoring the environment and recording data. These devices provide security via motion-detection video alerts, cost-savings via thermostat usage history, and peace of mind via functions like auto-locking doors or water leak detectors. At the same time, the sharing of this information in interpersonal relationships---though necessary---is currently accomplished on an all-or-nothing basis. This can easily lead to oversharing in a multi-user environment. Although prior work has studied people's perceptions of information sharing with vendors or ISPs, the sharing of household data among users who interact personally is less well understood. Interpersonal situations make …

A Framework For Evaluating The Security And Privacy Of Smart-Home Devices, And Its Application To Common Platforms, Ravindra Mangar, Timothy Pierson, David Kotz

Dartmouth Scholarship

In this article, we outline the challenges associated with the widespread adoption of smart devices in homes. These challenges are primarily driven by scale and device heterogeneity: a home may soon include dozens or hundreds of devices, across many device types, and may include multiple residents and other stakeholders. We develop a framework for reasoning about these challenges based on the deployment, operation, and decommissioning life cycle stages of smart devices within a smart home. We evaluate the challenges in each stage using the well-known CIA triad—Confidentiality, Integrity, and Availability. In addition, we highlight open research questions at each stage. …

Integrating Remote Sensing And Machine Learning To Determine Past, Current And Future Crop Water Use From The Nubian Sandstone Aquifer System, Moaz Ishag

Department of Agricultural and Biological Systems Engineering: Dissertations, Theses, and Student Research

The agriculture sector is a significant consumer of water, and sustainable water use begins with monitoring irrigated land. Delineating irrigated land supports decision-makers and promotes the sustainable use of this crucial resource. This study focuses on the Nubian Sandstone Aquifer System (NSAS), the largest aquifers in the world, which spans Egypt, Sudan, Libya, and Chad. The study aims to: 1) quantify the increase in irrigated hectares (both pivot and non-pivot) from 2000-2001 to 2023-2024; 2) identify major irrigated crop types and their water requirements; and 3) quantify groundwater crop water use from the NSAS using remote sensing via the Google …

Towards Human-Centered Proactive Conversational Agents, Yang Deng, Lizi Liao, Zhonghua Zheng, Grace Hui Yang, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

Recent research on proactive conversational agents (PCAs) mainly focuses on improving the system's capabilities in anticipating and planning action sequences to accomplish tasks and achieve goals before users articulate their requests. This perspectives paper highlights the importance of moving towards building human-centered PCAs that emphasize human needs and expectations, and that considers ethical and social implications of these agents, rather than solely focusing on technological capabilities. The distinction between a proactive and a reactive system lies in the proactive system's initiative-taking nature. Without thoughtful design, proactive systems risk being perceived as intrusive by human users. We address the issue by …

Performance Analysis Of Llama 2 Among Other Llms, Donghao Huang, Zhenda Hu, Zhaoxia Wang

Research Collection School Of Computing and Information Systems

Llama 2, an open-source large language model developed by Meta, offers a versatile and high-performance solution for natural language processing, boasting a broad scale, competitive dialogue capabilities, and open accessibility for research and development, thus driving innovation in AI applications. Despite these advancements, there remains a limited understanding of the underlying principles and performance of Llama 2 compared with other LLMs. To address this gap, this paper presents a comprehensive evaluation of Llama 2, focusing on its application in in-context learning — an AI design pattern that harnesses pre-trained LLMs for processing confidential and sensitive data. Through a rigorous comparative …

Generative Ai For Pull Request Descriptions: Adoption, Impact, And Developer Interventions, Tao Xiao, Hideaki Hata, Christoph Treude, Kenichi Matsumoto

Research Collection School Of Computing and Information Systems

GitHub's Copilot for Pull Requests (PRs) is a promising service aiming to automate various developer tasks related to PRs, such as generating summaries of changes or providing complete walkthroughs with links to the relevant code. As this innovative technology gains traction in the Open Source Software (OSS) community, it is crucial to examine its early adoption and its impact on the development process. Additionally, it offers a unique opportunity to observe how developers respond when they disagree with the generated content. In our study, we employ a mixed-methods approach, blending quantitative analysis with qualitative insights, to examine 18,256 PRs in …

On The Sustainability Of Deep Learning Projects: Maintainers' Perspective, Junxiao Han, Jiakun Liu, David Lo, Chen Zhi, Yishan Chen, Shuiguang Deng

Research Collection School Of Computing and Information Systems

Deep learning (DL) techniques have grown in leaps and bounds in both academia and industry over the past few years. Despite the growth of DL projects, there has been little study on how DL projects evolve, whether maintainers in this domain encounter a dramatic increase in workload and whether or not existing maintainers can guarantee the sustained development of projects. To address this gap, we perform an empirical study to investigate the sustainability of DL projects, understand maintainers' workloads and workloads growth in DL projects, and compare them with traditional open-source software (OSS) projects. In this regard, we first investigate …

Augmenting Decision With Hypothesis In Reinforcement Learning, Minh Quang Nguyen, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Value-based reinforcement learning is the current State-Of-The-Art due to high sampling efficiency. However, our study shows it suffers from low exploitation in early training period and bias sensitiveness. To address these issues, we propose to augment the decision-making process with hypothesis, a weak form of environment description. Our approach relies on prompting the learning agent with accurate hypotheses, and designing a ready-to-adapt policy through incremental learning. We propose the ALH algorithm, showing detailed analyses on a typical learning scheme and a diverse set of Mujoco benchmarks. Our algorithm produces a significant improvement over value-based learning algorithms and other strong baselines. …

Hierarchical Damage Correlations For Old Photo Restoration, Weiwei Cai, Xuemiao Xu, Jiajia Xu, Huaidong Zhang, Haoxin Yang, Kun Zhang, Shengfeng He

Research Collection School Of Computing and Information Systems

Restoring old photographs can preserve cherished memories. Previous methods handled diverse damages within the same network structure, which proved impractical. In addition, these methods cannot exploit correlations among artifacts, especially in scratches versus patch-misses issues. Hence, a tailored network is particularly crucial. In light of this, we propose a unified framework consisting of two key components: ScratchNet and PatchNet. In detail, ScratchNet employs the parallel Multi-scale Partial Convolution Module to effectively repair scratches, learning from multi-scale local receptive fields. In contrast, the patch-misses necessitate the network to emphasize global information. To this end, we incorporate a transformer-based encoder and decoder …

Double Issuer-Hiding Attribute-Based Credentials From Tag-Based Aggregatable Mercurial Signatures, Rui Shi, Yang Yang, Yingjiu Li, Huamin Feng, Guozhen Shi, Hwee Hwa Pang, Robert H. Deng

Research Collection School Of Computing and Information Systems

Attribute-based anonymous credentials offer users fine-grained access control in a privacy-preserving manner. However, in such schemes obtaining a user's credentials requires knowledge of the issuer's public key, which obviously reveals the issuer's identity that must be hidden from users in certain scenarios. Moreover, verifying a user's credentials also requires the knowledge of issuer's public key, which may infer the user's private information from their choice of issuer. In this article, we introduce the notion of double issuer-hiding attribute-based credentials ( DIHAC ) to tackle these two problems. In our model, a central authority can issue public-key credentials for a group …

Explainable Artificial Intelligence: Methods And Evaluation, Gayane Grigoryan

Engineering Management & Systems Engineering Theses & Dissertations

A wide array of techniques within explainable artificial intelligence (XAI) have been developed to measure the importance of features in machine learning models. A notable portion of these methods draws upon principles of cooperative game theory (CGT), with the Shapley value emerging as a widely used solution concept. Despite the rising prominence of the Shapley value, other promising solutions from cooperative game theory—such as the Nucleolus, Banzhaf power index, Shapley-Shubik power index, and solutions to conflicting claims problems—have been comparatively overlooked, even though they hold significant potential. In this dissertation, multiple XAI methods based on these other CGT solutions are …

Privacy-Preserving Deep Learning Framework For Iot Malware Detection, Sabbir Ahmed Khan

Computer Science Theses & Dissertations

Cyberattacks on IoT devices are accelerating at an unprecedented rate, largely driven by IoT malware activities. The IoT malware attacks typically comprise three stages: intrusion, infection, and monetization. Existing IoT malware detection methods fail to identify malicious activities at the intrusion and infection stages and thus cannot stop potential attacks timely. In our research, we have leveraged power side-channel information as input to our deep learning model to identify malware at early stages of intrusion on IoT devices. But, deploying a resource-intensive deep learning model on highly resource-constrained IoT devices is a significant challenge. Consequently, utilizing a Machine Learning as …

Who Wrote The Scientific News? Improving The Discernibility Of Llms To Human-Written Scientific News, Dominik Soós

Computer Science Theses & Dissertations

Large Language Models (LLMs) have rapidly advanced the field of Natural Language Processing and become powerful tools for generating and evaluating scientific text. Although LLMs have demonstrated promising as evaluators for certain text generation tasks, there is still a gap until they are used as reliable text evaluators for general purposes. In this thesis project, I attempted to fill this gap by examining the discernibility of LLMs from human-written and LLM-generated scientific news. This research demonstrated that although it was relatively straightforward for humans to discern scientific news written by humans from scientific news generated by GPT-3.5 using basic prompts, …

Creating And Delivering Audio Descriptions For Videos, Rosiana Natalie

Dissertations and Theses Collection (Open Access)

Despite anti-discrimination regulations mandating the provision of audio descriptions (ADs), the majority of online video content remains inaccessible to blind and low-vision (BLV) individuals. This is because these ADs are either absent or fail to adequately address the diverse and unique needs of the audience. Traditionally, content creators have relied on professionals to author ADs. However, this gold standard may not be accessible for some content creators because this method is still costly and has a long turnaround time. Moreover, when ADs are available, they tend to be static and unalterable, failing to cater to the unique preferences of BLV …

Decentralized Consensus And Governance For Collaborative Intelligence, Huiwen Liu

Dissertations and Theses Collection (Open Access)

The data economy today is becoming increasingly collaborative in nature. Take business intelligence, for example. To unleash the full potential of big data, it is essential to integrate multi-source data depicting entities from a multi-faceted and multi-modal perspective, which, not surprisingly, is not achievable by any company alone. In collaborative intelligence, there are two core issues, namely "trust" and "incentive". The core mechanisms to solve these two problems are consensus and tokenization separately.

To solve the trust problem more effectively, we propose a systematic consensus evaluation framework to investigate whether existing consensus algorithms can do so. After a lot of …

Efficient Machine Learning On Scientific Data Using Bayesian Optimization, Rui Xin

Theses and Dissertations

Deep Learning is pivotal in advancing data analysis across various scientific fields, from genomics to materials discovery. Despite its widespread use, efficiently learning from limited data and operating under resource constraints remains a significant challenge, often limiting its full potential in environments where data is scarce or resources are restricted. This dissertation explores Active Learning and Automated Machine Learning (AutoML) powered by Bayesian Optimization to enhance the efficiency of machine learning across multiple disciplines. It focuses on algorithm optimization and data management through three interconnected studies. In the first study, we investigate how data management technique - active learning helps …

Preregistration And Registration As A New Method For Transparency Of External Validation In Artificial Intelligence And Machine Learning Applications To Address Overfitting, Underspecification, And Shortcut Learning, Marilyn Elaine Gartley

Theses and Dissertations

Statistics has been defined as the study of how information should be employed to reflect on and give guidance for action in a practical situation involving uncertainty. The essence of uncertainty is that there is more than one possible outcome, and the actual outcome is unknown in advance; it is indeterminate. The goal of statistical methods is inference: namely, statistical inference—reaching conclusions about populations or deriving scientific insights from data which are collected from a representative sample of that population through providing a mathematical understanding of inference, quantifying the degree of support that data offer for assertions of knowledge, as …

Attribute-Based Fine-Grained Access Control Using Verifiable Credentials, Srinivasa Dumpa

Student Theses

In the era of digital transformation, ensuring secure and privacy-preserving access control mechanisms is of paramount importance. Traditional identity-based access control systems often fall short in providing granular control and user autonomy over digital identities. This thesis presents a novel approach to access control by leveraging the power of verifiable credentials and attribute-based access control. The proposed system introduces a decentralized and user-centric framework that enables fine-grained access control based on specific attributes encapsulated within verifiable credentials. These tamper-evident digital credentials, stored in a user's digital wallet, contain a rich set of attributes that can be selectively disclosed to grant …

Accelerating The Efficiency Of Multiscale Hybridizable Discontinuos Galerkin Methods For Flows In Heterogeneous Media, Tony Charles Haines

Mathematics & Statistics Theses & Dissertations

A plethora of scientific and engineering problems encountered are multiscale in nature. This multiscale feature often influences simulation efforts wherever large disparities in spatial scales are experienced. Notable examples include composite materials, fluid flow through porous media and turbulent transport in high Reynolds number flow. Although there are promising results from the advancement of modern supercomputer, obtaining direct numerical solution of multiscale problems is very laborious. This difficulty stems from the tremendous amount of computer memory and CPU time required. Parallel computing may be one obvious choice in remedying this issue. However, the complexity and size of the discrete problem …

Leveraging Blockchain For Trust Enhancement In Decentralized Marketplaces: A Reputation System Perspective, Meshari Mohammd Aljohani

Computer Science Theses & Dissertations

Centralized marketplaces provide reliable reputation services through a central authority, but this raises concerns about single points of failure, user privacy, and data security. Decentralized marketplaces have emerged to address these issues by enhancing user privacy and transparency and eliminating single points of failure. However, decentralized marketplaces face the challenge of maintaining user trust without a centralized authority. Current blockchain-based marketplaces rely on subjective buyer feedback. Additionally, the transparency in these systems can deter honest reviews due to fear of seller retaliation. To address these issues, we propose a trust and reputation system using blockchain and smart contracts. Our system …

Comparative Analysis Of Hate Speech Detection: Traditional Vs. Deep Learning Approaches, Haibo Pen, Nicole Anne Huiying Teo, Zhaoxia Wang

Research Collection School Of Computing and Information Systems

Detecting hate speech on social media poses a significant challenge, especially in distinguishing it from offensive language, as learning-based models often struggle due to nuanced differences between them, which leads to frequent misclassifications of hate speech instances, with most research focusing on refining hate speech detection methods. Thus, this paper seeks to know if traditional learning-based methods should still be used, considering the perceived advantages of deep learning in this domain. This is done by investigating advancements in hate speech detection. It involves the utilization of deep learning-based models for detailed hate speech detection tasks and compares the results with …

A Portable Numerical Library For The Calculation Of Multi-Dimensional Integrals, Ioannis Sakiotis

Computer Science Theses & Dissertations

Multi-dimensional numerical integration is a prevalent task in physics and other scientific fields, e.g., in the simulation of particle-beam dynamics and Bayesian parameter estimation. Scientific computing applications that simulate complex phenomena may require the solution to numerous multi-variate integrals. However, functions that have features such as sharp peaks or oscillations in high dimensional spaces, can result in an exorbitant number of computations. For many cases, convergence to accurate results in a reasonable amount of time is infeasible with existing numerical libraries. One approach towards making multi-dimensional integration viable is to parallelize existing algorithms. No commonly available algorithms or libraries exist …

Adopt: An Environmentally-Friendly System For Alerting Drivers To Occluded Pedestrians Traffic, Abrar Abdulrahman Alali

Computer Science Theses & Dissertations

The emergence of sensing technologies and vehicular communications has brought significant opportunities for enhancing pedestrian safety on city streets. However, existing solutions rely on costly technologies such as computer vision and trajectory prediction to detect crossing pedestrians, while they have limits in detecting pedestrians who are occluded by parked cars. Despite the presence of collaborative perception by surrounding vehicles and infrastructure, there is a notable absence of incorporating existing parked cars themselves due to their insufficiency in detecting pedestrians and communicating with other cars while they are turned off. Furthermore, accommodating pedestrians on streets has been linked to an additional …