Open Access. Powered by Scholars. Published by Universities.®

Digital Commons Network™

Open Access. Powered by Scholars. Published by Universities.®

Artificial Intelligence and Robotics

Institution
Keyword
Publication Year
Publication
Publication Type
File Type

Articles 2881 - 2910 of 11655

Full-Text Articles in Entire DC Network

Improvement Of A* Algorithm In Path Planning Of Mobile Robot, Dexin Yao, Hongjun San, Yaru Wang, Haijie Sun, Jiupeng Chen, Xiaoyuan Yang Nov 2024

Improvement Of A* Algorithm In Path Planning Of Mobile Robot, Dexin Yao, Hongjun San, Yaru Wang, Haijie Sun, Jiupeng Chen, Xiaoyuan Yang

Journal of System Simulation

Abstract: To solve the problems of excessively redundant nodes, low search efficiency, and excessive path turning angle in the path search of the traditional A* algorithm, an improved A* algorithm is proposed to plan the optimal path. First, the amount of search neighborhood of the A* algorithm is increased to 24 to obtain a more accurate and comprehensive search field. Second, the angle search algorithm is introduced, eliminating the unnecessary nodes in the path search and making the search more target-oriented. Third, the heuristic function is weighted by the exponential attenuation through the relative position of the current point and …


The Unfairness Of Fair Machine Learning: Leveling Down And Strict Egalitarianism By Default, Brent Mittelstadt, Sandra Wachter, Chris Russell Nov 2024

The Unfairness Of Fair Machine Learning: Leveling Down And Strict Egalitarianism By Default, Brent Mittelstadt, Sandra Wachter, Chris Russell

Michigan Technology Law Review

In recent years, fairness in machine learning (ML), artificial intelligence (AI), and algorithmic decision-making systems has emerged as a highly active area of research and development. To date, most measures and methods to mitigate bias and improve fairness in algorithmic systems have been built in isolation from policymaking and civil societal contexts and lack serious engagement with philosophical, political, legal, and economic theories of equality and distributive justice. Many current measures define “fairness” in simple terms to mean narrowing gaps in performance or outcomes between demographic groups while preserving as much of the original system’s accuracy as possible. This oversimplified …


The Implications Of Chatgpt For Legal Services And Society, Andrew Perlman Nov 2024

The Implications Of Chatgpt For Legal Services And Society, Andrew Perlman

Michigan Technology Law Review

On November 30, 2022, OpenAI released a chatbot called ChatGPT.1 To demonstrate the chatbot’s sophistication and its potential implications, both for legal services and society more generally, most of this paper was generated in about an hour through prompts within ChatGPT. Only this abstract, the preface, the outline headers, the footnotes, the epilogue, and the prompts were written by a person. ChatGPT generated the rest of the text with no human editing. To be clear, the responses generated by ChatGPT were imperfect and at times problematic, and the use of an AI tool for law-related services raises a host of …


Navigating The Ethical Maze: Emerging Technologies And Pedagogies In Higher Education, Harika Rao Nov 2024

Navigating The Ethical Maze: Emerging Technologies And Pedagogies In Higher Education, Harika Rao

Faculty and Staff Publications & Presentations

No abstract provided.


Seshaiyer: Understanding Non-Linear Dynamics Of Interacting Subpopulations And Implicit Human Behavior Using Physics-Informed Neural Networks, Naima Aubry-Romero, Alonso Ogueda-Oliva, Padmanabhan Seshaiyer Nov 2024

Seshaiyer: Understanding Non-Linear Dynamics Of Interacting Subpopulations And Implicit Human Behavior Using Physics-Informed Neural Networks, Naima Aubry-Romero, Alonso Ogueda-Oliva, Padmanabhan Seshaiyer

Annual Symposium on Biomathematics and Ecology Education and Research

No abstract provided.


Predicting And Monitoring Immune Checkpoint Inhibitor Therapy Using Artificial Intelligence In Pancreatic Cancer, Guangbo Yu, Zigeng Zhang, Aydin Eresen, Qiaoming Hou, Farideh Amirrad, Sha Webster, Surya M. Nauli, Vahid Yaghmai, Zhuoli Zhang Nov 2024

Predicting And Monitoring Immune Checkpoint Inhibitor Therapy Using Artificial Intelligence In Pancreatic Cancer, Guangbo Yu, Zigeng Zhang, Aydin Eresen, Qiaoming Hou, Farideh Amirrad, Sha Webster, Surya M. Nauli, Vahid Yaghmai, Zhuoli Zhang

Pharmacy Faculty Articles and Research

Pancreatic cancer remains one of the most lethal cancers, primarily due to its late diagnosis and limited treatment options. This review examines the challenges and potential of using immunotherapy to treat pancreatic cancer, highlighting the role of artificial intelligence (AI) as a promising tool to enhance early detection and monitor the effectiveness of these therapies. By synthesizing recent advancements and identifying gaps in the current research, this review aims to provide a comprehensive overview of how AI and immunotherapy can be integrated to develop more personalized and effective treatment strategies. The insights from this review may guide future research efforts …


Holistic & Socially Just Admissions Procedures In An Artificially Intelligent (Ai) World, Lucinda Bratini, Ali Cunningham Abbott, Tracy N. Baker Nov 2024

Holistic & Socially Just Admissions Procedures In An Artificially Intelligent (Ai) World, Lucinda Bratini, Ali Cunningham Abbott, Tracy N. Baker

Faculty and Staff Publications & Presentations

In our ever-evolving social context, the counseling profession continues to center social justice and decolonial praxis in training programs. Simultaneously, we remain attuned to shifts in machine learning and artificial intelligence (AI) which require us to adjust and grow. This roundtable discussion shares the development of a holistic admissions review (HAR) pilot process, which incorporates relational, diversity and social justice values alongside AI innovations and current CACREP considerations.


Ethical Responsibility In The Design Of Artificial Intelligence (Ai) Systems, David K. Mcgraw Nov 2024

Ethical Responsibility In The Design Of Artificial Intelligence (Ai) Systems, David K. Mcgraw

International Journal on Responsibility

This article aims to provide an overview of the ethical questions surrounding the responsibilities of designers of artificial intelligence (AI) systems. First, the author delves into the philosophical underpinnings of this responsibility, examining various ethical theories to grasp the moral obligations individuals have towards others and society. The author contends that designers of technology bear the responsibility of considering the broader societal implications of their creations. Subsequently, the author scrutinizes the fundamental question of whether AI systems present unique ethical concerns compared to conventional technologies, pinpointing factors such as complexity, opacity, autonomy, unpredictability, uncertainty, and the potential for significant social …


Simplify Workflows: Ai As A Coding Companion, Tiffany Garrett Nov 2024

Simplify Workflows: Ai As A Coding Companion, Tiffany Garrett

Library Scholarship

Artificial Intelligence is on everyone’s minds and has been the topic of the past two Matheson Lectures. But, what is the role of academic health sciences libraries? Moving the theoretical into practical, seven of our colleagues will present real-life case studies. What worked - what didn’t - what would they do differently?

This entry is from one of those case presentations on how a librarian at Roseman University of Health Sciences used AI to complete simple computer programming projects that optimized a few library workflows.


Telu Activation Function For Fast And Stable Deep Learning, Alfredo Fernandez Nov 2024

Telu Activation Function For Fast And Stable Deep Learning, Alfredo Fernandez

USF Tampa Graduate Theses and Dissertations

We propose the Hyperbolic Tangent Exponential Linear Unit (TeLU), a neural network hidden activation function defined as $TeLU(x)=x \cdot tanh(e^x)$. TeLU’s design is grounded in the core principles of key activation functions, achieving strong convergence by closely approximating the identity function in its active region while effectively mitigating the vanishing gradient problem in its saturating region. Its simple formulation enhances computational efficiency, leading to improvements in scalability and convergence speed. Unlike many modern activation functions, TeLU seamlessly combines the simplicity and effectiveness of ReLU with the smoothness and analytic properties essential for learning stability in deep neural networks. TeLU’s ability …


Ai-Enabled Methodological Frameworks To Enhance The Robustness Of Machine Learning Models In Various Domains And Dynamic Environments, Mohammad Noroozi Nov 2024

Ai-Enabled Methodological Frameworks To Enhance The Robustness Of Machine Learning Models In Various Domains And Dynamic Environments, Mohammad Noroozi

USF Tampa Graduate Theses and Dissertations

This dissertation explores novel approaches to address complex challenges in various domains, focusing on ensuring that machine learning (ML) models can reliably detect both the data they are trained on and unseen data. Reliable detection of unfamiliar inputs is critical for deploying models in real-world applications, where performance can degrade when faced with novel or unexpected information. Each domain addressed in this work introduces a set of contributions aimed at enhancing model performance, broadening generalization through diverse training data, and improving robustness against adversarial attacks. Three sets of contributions are presented, each encapsulated in a chapter.

One of the contributions …


Incorporating Ai Literacy Into Music Library Instruction: An Interactive Discussion, Taylor J. Greene Nov 2024

Incorporating Ai Literacy Into Music Library Instruction: An Interactive Discussion, Taylor J. Greene

Library Presentations, Posters, and Audiovisual Materials

Taylor Greene gave a presentation connecting AI Literacy to his work not only as the liaison to the Hall-Musco Conservatory of Music but also more broadly in his role as Chair of Research and Instructional Services. He began by providing an overview of Chapman University’s cautious approach to embracing generative AI and highlighted the library’s role in supporting faculty, staff, librarians, and students in better understanding these technologies and their potential impact on higher education. He summarized the work of the AI Task Force and offered a general overview of the AI Literacy lectures that he and Dr. Doug Dechow …


On The Role Of Prediction In Streaming Hierarchical Learning, Ramy Mounir Nov 2024

On The Role Of Prediction In Streaming Hierarchical Learning, Ramy Mounir

USF Tampa Graduate Theses and Dissertations

In today's world, AI systems need to make sense of large amounts of data as it unfolds in real-time, whether it's a video from surveillance and monitoring cameras, streams of egocentric footage, or sequences in other domains such as text or audio. The ability to break these continuous data streams into meaningful events, discover nested structures, and predict what might happen next at different levels of abstraction is crucial for applications ranging from passive surveillance systems to sensory-motor autonomous learning. However, most existing models rely heavily on large, annotated datasets with fixed data distributions and offline epoch-based training, which makes …


Regulating Adaptive Medical Artificial Intelligence: Can Less Oversight Lead To Greater Compliance?, Jiayi Lai, Liang Xu, Xin Fang, Tinglong Dai Nov 2024

Regulating Adaptive Medical Artificial Intelligence: Can Less Oversight Lead To Greater Compliance?, Jiayi Lai, Liang Xu, Xin Fang, Tinglong Dai

Research Collection Lee Kong Chian School Of Business

As of June 2024, the U.S. Food and Drug Administration (FDA) has approved 950 medical artificial intelligence (AI) devices. The current regulatory framework freezes AI algorithms after approval, requiring new submissions for updates to ensure compliance with Good Machine Learning Practices (GMLP). This approach imposes a significant administrative burden, while hindering the ability of AI algorithms to learn from new data. To address these challenges, the FDA has explored a novel pathway known as Predetermined Change Control Plans (PCCP), allowing developers to outline future changes during initial submissions and exempting approved changes from regulatory review. Yet, the impact of this …


From Biased Data Inputs To Your Discriminatory Diagnosis Outputs: A Review Of Legal Liability For Artificial Intelligence In Healthcare, Amber Bolden Nov 2024

From Biased Data Inputs To Your Discriminatory Diagnosis Outputs: A Review Of Legal Liability For Artificial Intelligence In Healthcare, Amber Bolden

Michigan Technology Law Review

While health disparities in America occur due to non-medical circumstances, certain protected classes experience healthcare disparities due to the biases of medical professionals. Biased diagnoses, both intentional or unintentional, have existed throughout the history of the medical profession. That those biases are becoming data for training algorithms raises concerns as the medical field increasingly incorporates and standardizes artificial and augmented intelligence in patient diagnosis and treatment. Currently unregulated but with lifedetermining potential, artificial intelligence (AI) when used in patient treatment leads to important questions: should the doctor, the provider, or the AI developers be liable, and for what? Section II …


Left, Then Right Internal Carotid Artery Dissection: A Case Report, Jeffrey M. Kalczynski, John Douds, Michael E. Silverman Nov 2024

Left, Then Right Internal Carotid Artery Dissection: A Case Report, Jeffrey M. Kalczynski, John Douds, Michael E. Silverman

SKMC Student Presentations and Publications

INTRODUCTION: We present a unique case of a patient who presented to the emergency department with stroke-like symptoms found to have a spontaneous, left-sided internal carotid artery dissection (ICAD).

CASE REPORT: The patient was treated successfully with thrombectomy and subsequently developed contralateral symptoms caused by a right-sided ICAD. This was managed with a second contra-lateral thrombectomy. The patient's course was complicated by persistent and mild hypotension, postulated to be secondary to bilateral carotid baroreceptor trauma from the dissections.

CONCLUSION: This case highlights the importance of close neurological monitoring for patients, preferably in a neurologic critical care setting, during and after …


Dc-Instruct : An Effective Framework For Generative Multi-Intent Spoken Language Understanding, Bowen Xing, Lizi Liao, Minlie Huang Nov 2024

Dc-Instruct : An Effective Framework For Generative Multi-Intent Spoken Language Understanding, Bowen Xing, Lizi Liao, Minlie Huang

Research Collection School Of Computing and Information Systems

In the realm of multi-intent spoken language understanding, recent advancements have leveraged the potential of prompt learning frameworks. However, critical gaps exist in these frameworks: the lack of explicit modeling of dual-task dependencies and the oversight of task-specific semantic differences among utterances. To address these shortcomings, we propose DC-Instruct, a novel generative framework based on Dual-task Inter-dependent Instructions (DII) and Supervised Contrastive Instructions (SCI). Specifically, DII guides large language models (LLMs) to generate labels for one task based on the other task’s labels, thereby explicitly capturing dual-task inter-dependencies. Moreover, SCI leverages utterance semantics differences by guiding LLMs to determine whether …


Revisiting Conversation Discourse For Dialogue Disentanglement, Bobo Li, Hao Fei, Fei Li, Shengqiong Wu, Lizi Liao, Yinwei Wei, Tat-Seng Chua, Donghong Ji Nov 2024

Revisiting Conversation Discourse For Dialogue Disentanglement, Bobo Li, Hao Fei, Fei Li, Shengqiong Wu, Lizi Liao, Yinwei Wei, Tat-Seng Chua, Donghong Ji

Research Collection School Of Computing and Information Systems

Dialogue disentanglement aims to detach the chronologically ordered utterances into several independent sessions. Conversation utterances are essentially organized and described by the underlying discourse, and thus dialogue disentanglement requires the full understanding and harnessing of the intrinsic discourse attribute. In this article, we propose enhancing dialogue disentanglement by taking full advantage of the dialogue discourse characteristics. First of all, in feature encoding stage, we construct the heterogeneous graph representations to model the various dialogue-specific discourse structural features, including the static speaker-role structures (i.e., speaker-utterance and speaker-mentioning structure) and the dynamic contextual structures (i.e., the utterance-distance and partial-replying structure). We then …


Large Language Models For Software Engineering: A Systematic Literature Review, Xinyi Hou, Yanjie Zhao, Yue Liu, Zhou Yang, Kailong Wang, Li Li, Xiapu Luo, David Lo, John Grundy, Haoyu Wang Nov 2024

Large Language Models For Software Engineering: A Systematic Literature Review, Xinyi Hou, Yanjie Zhao, Yue Liu, Zhou Yang, Kailong Wang, Li Li, Xiapu Luo, David Lo, John Grundy, Haoyu Wang

Research Collection School Of Computing and Information Systems

Large Language Models (LLMs) have significantly impacted numerous domains, including Software Engineering (SE). Many recent publications have explored LLMs applied to various SE tasks. Nevertheless, a comprehensive understanding of the application, effects, and possible limitations of LLMs on SE is still in its early stages. To bridge this gap, we conducted a Systematic Literature Review (SLR) on LLM4SE, with a particular focus on understanding how LLMs can be exploited to optimize processes and outcomes. We selected and analyzed 395 research articles from January 2017 to January 2024 to answer four key Research Questions (RQs). In RQ1, we categorize different LLMs …


Balancing Visual Context Understanding In Dialogue For Image Retrieval, Zhaohui Wei, Lizi Liao, Xiaoyu Du, Xinguang Xiang Nov 2024

Balancing Visual Context Understanding In Dialogue For Image Retrieval, Zhaohui Wei, Lizi Liao, Xiaoyu Du, Xinguang Xiang

Research Collection School Of Computing and Information Systems

In the realm of dialogue-to-image retrieval, the primary challenge is to fetch images from a pre-compiled database that accurately reflect the intent embedded within the dialogue history. Existing methods often overemphasize inter-modal alignment, neglecting the nuanced nature of conversational context. Dialogue histories are frequently cluttered with redundant information and often lack direct image descriptions, leading to a substantial disconnect between conversational content and visual representation. This study introduces VCU, a novel framework designed to enhance the comprehension of dialogue history and improve cross-modal matching for image retrieval. VCU leverages large language models (LLMs) to perform a two-step extraction process. It …


Strength Lies In Differences! Improving Strategy Planning For Non-Collaborative Dialogues Via Diversified User Simulation, Tong Zhang, Chen Huang, Yang Deng, Hongru Liang, Jia Liu, Zujie Wen, Wenqiang Lei, Tat-Seng Chua Nov 2024

Strength Lies In Differences! Improving Strategy Planning For Non-Collaborative Dialogues Via Diversified User Simulation, Tong Zhang, Chen Huang, Yang Deng, Hongru Liang, Jia Liu, Zujie Wen, Wenqiang Lei, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

We investigate non-collaborative dialogue agents, which are expected to engage in strategic conversations with diverse users, for securing a mutual agreement that leans favorably towards the system’s objectives. This poses two main challenges for existing dialogue agents: 1) The inability to integrate user-specific characteristics into the strategic planning, and 2) The difficulty of training strategic planners that can be generalized to diverse users. To address these challenges, we propose TRIP to enhance the capability in tailored strategic planning, incorporating a user-aware strategic planning module and a population-based training paradigm. Through experiments on benchmark non-collaborative dialogue tasks, we demonstrate the effectiveness …


Collectively Advancing Deep Learning For Animal Detection In Drone Imagery: Successes, Challenges, And Research Gaps, Daniel Axford, Ferdous Sohel, Mathew A. Vanderklift, Amanda J. Hodgson Nov 2024

Collectively Advancing Deep Learning For Animal Detection In Drone Imagery: Successes, Challenges, And Research Gaps, Daniel Axford, Ferdous Sohel, Mathew A. Vanderklift, Amanda J. Hodgson

Research outputs 2022 to 2026

Drones have emerged as a powerful tool in animal detection, significantly advancing wildlife monitoring, conservation, and management by capturing high-resolution, real-time imagery over areas often inaccessible or challenging for human observers to reach. However, manual analysis of drone imagery for animal detection is labour-intensive and time-consuming. The application of deep learning methods, particularly convolutional neural networks, in automating animal detection from drone imagery has the potential to revolutionise wildlife monitoring, conservation, and management protocols. This review provides a comprehensive overview of the increasing use and prospects of deep learning in animal detection using drone imagery. It explores successful applications of …


Cas: Fusing Dnn Optimization & Adaptive Sensing For Energy-Efficient Multi-Modal Inference, Dulanga Weerakoon, Vigneshwaran Subbaraju, Joo Hwee Lim, Archan Misra Nov 2024

Cas: Fusing Dnn Optimization & Adaptive Sensing For Energy-Efficient Multi-Modal Inference, Dulanga Weerakoon, Vigneshwaran Subbaraju, Joo Hwee Lim, Archan Misra

Research Collection School Of Computing and Information Systems

Intelligent virtual agents are used to accomplish complex multi-modal tasks such as human instruction comprehension in mixed-reality environments by increasingly adopting richer, energy-intensive sensors and processing pipelines. In such applications, the context for activating sensors and processing blocks required to accomplish a given task instance is usually manifested via multiple sensing modes. Based on this observation, we introduce a novel Commit-and-Switch ( CAS ) paradigm that simultaneously seeks to reduce both sensing and processing energy. In CAS , we first commit to a low-energy computational pipeline with a subset of available sensors. Then, the task context estimated by this pipeline …


Thoughts To Target: Enhance Planning For Target-Driven Conversation, Zhonghua Zheng, Lizi Liao, Yang Deng, Ee-Peng Lim, Minlie Huang, Liqiang Nie Nov 2024

Thoughts To Target: Enhance Planning For Target-Driven Conversation, Zhonghua Zheng, Lizi Liao, Yang Deng, Ee-Peng Lim, Minlie Huang, Liqiang Nie

Research Collection School Of Computing and Information Systems

In conversational AI, large-scale models excel in various tasks but struggle with target-driven conversation planning. Current methods, such as chain-of-thought reasoning and tree-search policy learning techniques, either neglect plan rationality or require extensive human simulation procedures. Addressing this, we propose a novel two-stage framework, named EnPL, to improve the LLMs’ capability in planning conversations towards designated targets, including (1) distilling natural language plans from target-driven conversation corpus and (2) generating new plans with demonstration-guided in-context learning. Specifically, we first propose a filter approach to distill a high-quality plan dataset, ConvPlan1. With the aid of corresponding conversational data and support from …


Ai And Creativity: Effects Of Culture And Task Emotiveness In Human-Ai Collaboration, Choon Ngee Tan Nov 2024

Ai And Creativity: Effects Of Culture And Task Emotiveness In Human-Ai Collaboration, Choon Ngee Tan

Dissertations and Theses Collection (Open Access)

Creativity is the driving force behind innovation, propelling individuals and societies toward progress by generating novel ideas and groundbreaking solutions. The emergence of generative AI models, exemplified by GPT-3, offers opportunities to enhance human creativity. This paper explores the potential for unprecedented breakthroughs through the synergy between human intuition and AI-driven creativity, providing practical guidance on leveraging AI to amplify creative capacities. Study 1 finds that AI models trained on data from the U.S. and Chinese cultures exhibit cultural norms, values and cognition of those cultures. Study 2 finds that when humans and AI models of the same culture collaborate …


The Epistemic Role Of Ai Decision Support Systems: Neither Superiors, Nor Inferiors, Nor Peers, Rand Hirmiz Nov 2024

The Epistemic Role Of Ai Decision Support Systems: Neither Superiors, Nor Inferiors, Nor Peers, Rand Hirmiz

Research Collection School of Social Sciences

Despite the importance of discussions over the epistemic role that artificially intelligent decision support systems ought to play, there is currently a lack of these discussions in both the AI literature and the epistemology literature. My goal in this paper is to rectify this by proposing an account of the epistemic role of AI decision support systems in medicine and discussing what this epistemic role means with regard to how these systems ought to be utilized. In particular, I argue that AI decision support systems are not epistemic superiors, inferiors, or peers. Instead, I recommend that they be classified in …


Against The Substitutive Approach To Ai In Healthcare, Rand Hirmiz Nov 2024

Against The Substitutive Approach To Ai In Healthcare, Rand Hirmiz

Research Collection School of Social Sciences

Paul Bloom has famously argued against the need for empathy in clinicians, while Sally Dalton-Brown has argued that AI need not be capable of empathy to be a good carer. In this paper, the capacity for AI to substitute for human clinicians is assessed from a bioethical perspective, primarily through the evaluation of the arguments put forth by Dalton-Brown and Bloom concerning empathy in healthcare. In opposition to both Bloom and Dalton-Brown, this paper argues that (1) empathy is essential to providing good care or deep care (that is, care that goes beyond the mere fulfilment of medical tasks), (2) …


Ai And Data Science For Public Policy, Kenneth Benoit Nov 2024

Ai And Data Science For Public Policy, Kenneth Benoit

Research Collection School of Social Sciences

Artificial intelligence (AI) and data science are reshaping public policy by enabling more data-driven, predictive, and responsive governance, while at the same time producing profound changes in knowledge production and education in the social and policy sciences. These advancements come with ethical and epistemological challenges surrounding issues of bias, transparency, privacy, and accountability. This special issue explores the opportunities and risks of integrating AI into public policy, offering theoretical frameworks and empirical analyses to help policymakers navigate these complexities. The contributions explore how AI can enhance decision-making in areas such as healthcare, justice, and public services, while emphasising the need …


Food Computing: Domain Adaptation And Causal Inference, Qing Wang Nov 2024

Food Computing: Domain Adaptation And Causal Inference, Qing Wang

Dissertations and Theses Collection (Open Access)

This dissertation addresses two challenges in food computing: food recognition and food image-to-recipe retrieval. The main research ideas are: (1) leveraging Large Language Models (LLMs) to augment food image representations to mitigate the combined challenges of domain gaps and data imbalance in fine-grained food recognition; (2) proposing a causal-theory inspired cross-modal representation learning formulation for reducing the bias caused by the emphasis on certain ingredients for cross-modal recipe retrieval; and (3) extending the framework to incorporate multiple confounding factors, particularly ingredients and cooking actions, allows for more comprehensive modeling of the food image-torecipe retrieval problem.

We first explore the challenges …


Ask-Before-Plan : Proactive Language Agents For Real-World Planning, Xuan Zhang, Yang Deng, Zifeng Ren, See-Kiong Ng, Tat-Seng Chua Nov 2024

Ask-Before-Plan : Proactive Language Agents For Real-World Planning, Xuan Zhang, Yang Deng, Zifeng Ren, See-Kiong Ng, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

The evolution of large language models (LLMs) has enhanced the planning capabilities of language agents in diverse real-world scenarios. Despite these advancements, the potential of LLM-powered agents to comprehend ambiguous user instructions for reasoning and decision-making is still under exploration. In this work, we introduce a new task, Proactive Agent Planning, which requires language agents to predict clarification needs based on user-agent conversation and agent-environment interaction, invoke external tools to collect valid information, and generate a plan to fulfill the user's demands. To study this practical problem, we establish a new benchmark dataset, Ask-before-Plan. To tackle the deficiency of LLMs …