Artificial Intelligence and Robotics Commons^™

The Educational Affordances And Challenges Of Chatgpt: State Of The Field, Helen Crompton, Diane Burke

STEMPS Faculty Publications

ChatGPT was released to the public in November 30, 2022. This study examines how ChatGPT can be used by educators and students to promote learning and what are the challenges and limitations. This study is unique in providing one of the first systematic reviews using peer review studies to provide an early examination of the field. Using PRISMA principles, 44 articles were selected for review. Grounded coding was then used to reveal trends in the data. The findings show that educators can use ChatGPT for teaching support, task automation, and professional development. These were further delineated further by axial sub …

Exploring Instructional Designers' Utilization And Perspectives On Generative Ai Tools: A Mixed Methods Study, Tian Luo, Pauline S. Muljana, Xinyue Ren, Dara Young

STEMPS Faculty Publications

The emergence of generative artificial intelligence (GenAI) has caused significant disruptions on a global scale in various workplace settings, including the field of instructional design (ID). Given the paucity of research investigating the impact of GenAI on ID work, we conducted a mixed methods study to understand instructional designers (IDs)’ perceptions and experiences of utilizing GenAI across a spectrum of ID tasks. A total of 70 IDs completed an online survey, and 13 of them participated in the semi-structured interviews. The survey results indicated IDs’ familiarity with and perceived usability of GenAI tools in performing various ID responsibilities in their …

Feedback Loops: Feedback Machines, Patrick Barry

Articles

Yes, AI raises serious concerns about bias, privacy, copyright infringement, environmental sustainability, and a whole bunch of other important topics. But if you are looking for a positive use case - and a new way to approach professional development - try asking chatgpt or some other AI chatbot for feedback, especially on something you've written.

Societal Impacts Of Artificial Intelligence: Ethics, Legal, And Governance Issues, Yuzhou Qian, Keng Siau, Fiona Fui-Hoon Nah

Research Collection School Of Computing and Information Systems

Artificial intelligence (AI) is quickly changing the way we work and the way we live. The emergence of ChatGPT has thrust AI, especially Generative AI, into the spotlight. The societal impact of AI is on most people's minds. This article presents several research projects on how AI impacts work and society. Three research works are discussed in this article. The first study develops a theoretical framework structuring the legal and ethical objectives that are needed and the means to achieve them. The second study concentrates on bias and discrimination issues embedded in AI applications. It focuses on enhancing the collaboration …

Outsourcing Voting To Ai: Can Chatgpt Advise Index Funds On Proxy Voting Decisions?, Chen Wang

Fordham Journal of Corporate & Financial Law

Released in November 2022, Chat Generative Pre-training Transformer (“ChatGPT”), has risen rapidly to prominence, and its versatile capabilities have already been shown in a variety of fields. Due to ChatGPT’s advanced features, such as extensive pre-training on diverse data, strong generalization ability, fine-tuning capabilities, and improved reasoning, the use of AI in the legal industry could experience a significant transformation. Since small passive funds with low-cost business models generally lack the financial resources to make informed proxy voting decisions that align with their shareholders’ interests, this Article considers the use of ChatGPT to assist small investment funds, particularly small passive …

Perception Of Bias In Chatgpt: Analysis Of Social Media Data, Abdullah Wahbeh, Mohammad A. Al-Ramahi, Omar El-Gayar, Ahmed El Noshokaty, Tareq Nasralah

Computer Information Systems Faculty Publications (Archived)

In this study, we aim to analyze the public perception of Twitter users with respect to the use of ChatGPT and the potential bias in its responses. Sentiment and emotion analysis were also analyzed. Analysis of 5,962 English tweets showed that Twitter users were concerned about six main types of biases, namely: political, ideological, data & algorithmic, gender, racial, cultural, and confirmation biases. Sentiment analysis showed that most of the users reflected a neutral sentiment, followed by negative and positive sentiment. Emotion analysis mainly reflected anger, disgust, and sadness with respect to bias concerns with ChatGPT use.

Vision Paper: Advancing Of Ai Explainability For The Use Of Chatgpt In Government Agencies: Proposal Of A 4-Step Framework, Hui Shan Lee, Shankararaman, Venky, Eng Lieh Ouh

Research Collection School Of Computing and Information Systems

This paper explores ChatGPT’s potential in aiding government agencies, drawing from a case study based on a government agency in Singapore. While ChatGPT’s text generation abilities offer promise, it brings inherent challenges, including data opacity, potential misinformation, and occasional errors. These issues are especially critical in government decision-making.Public administration’s core values of transparency and accountability magnify these concerns. Ensuring AI alignment with these principles is imperative, given the potential repercussions on policy outcomes and citizen trust.AI explainability plays a central role in ChatGPT’s adoption within government agencies. To address these concerns, we propose strategies like prompt engineering, data governance, and …

Exploring Students' Adoption Of Chatgpt As A Mentor For Undergraduate Computing Projects: Pls-Sem Analysis, Gottipati Swapna, Kyong Jin Shim, Shankararaman, Venky

Research Collection School Of Computing and Information Systems

As computing projects increasingly become a core component of undergraduate courses, effective mentorship is crucial for supporting students' learning and development. Our study examines the adoption of ChatGPT as a mentor for undergraduate computing projects. It explores the impact of ChatGPT mentorship, specifically, skills development, and mentor responsiveness, i.e., ChatGPT's responsiveness to students' needs and requests. We utilize PLS-SEM to investigate the interrelationships between different factors and develop a model that captures their contribution to the effectiveness of ChatGPT as a mentor. The findings suggest that mentor responsiveness and technical/design support are key factors for the adoption of AI tools …

Vision Paper: Advancing Of Ai Explainability For The Use Of Chatgpt In Government Agencies: Proposal Of A 4-Step Framework, Hui Shan Lee, Shankararaman, Venky, Eng Lieh Ouh

Research Collection School Of Computing and Information Systems

This paper explores ChatGPT’s potential in aiding government agencies, drawing from a case study based on a government agency in Singapore. While ChatGPT’s text generation abilities offer promise, it brings inherent challenges, including data opacity, potential misinformation, and occasional errors. These issues are especially critical in government decision-making.Public administration’s core values of transparency and accountability magnify these concerns. Ensuring AI alignment with these principles is imperative, given the potential repercussions on policy outcomes and citizen trust.AI explainability plays a central role in ChatGPT’s adoption within government agencies. To address these concerns, we propose strategies like prompt engineering, data governance, and …

Extending The Horizon By Empowering Government Customer Service Officers With Acqar For Enhanced Citizen Service Delivery, Hui Shan Lee, Shankararaman, Venky, Eng Lieh Ouh

Research Collection School Of Computing and Information Systems

A previous study on the use of the Empath library in the prediction of Service Level Agreements (SLA) reveals the quality levels required for meaningful interaction between government customer service officers and citizens. On the other hand, past implementation of the Citizen Question-Answer system (CQAS), a type of Question-Answer model, suggests that such models if put in place can empower government customer service officers to reply faster and better with recommended answers. This study builds upon the research outcomes from both arenas of studies and introduces an innovative system design that allows the officers to incorporate the outputs from Empath …

Evaluating The Efficacy Of Chatgpt In Navigating The Spanish Medical Residency Entrance Examination (Mir): Promising Horizons For Ai In Clinical Medicine., Francisco Guillen-Grima, Sara Guillen-Aguinaga, Laura Guillen-Aguinaga, Rosa Alas-Brun, Luc Onambele, Wilfrido Ortega, Rocio Montejo, Enrique Aguinaga-Ontoso, Paul Barach, Ines Aguinaga-Ontoso

Department of Medicine Faculty Papers

UNLABELLED: The rapid progress in artificial intelligence, machine learning, and natural language processing has led to increasingly sophisticated large language models (LLMs) for use in healthcare. This study assesses the performance of two LLMs, the GPT-3.5 and GPT-4 models, in passing the MIR medical examination for access to medical specialist training in Spain. Our objectives included gauging the model's overall performance, analyzing discrepancies across different medical specialties, discerning between theoretical and practical questions, estimating error proportions, and assessing the hypothetical severity of errors committed by a physician.

MATERIAL AND METHODS: We studied the 2022 Spanish MIR examination results after excluding …

Integrating Human Expert Knowledge With Openai And Chatgpt: A Secure And Privacy-Enabled Knowledge Acquisition Approach, Ben Phillips

College of Engineering Summer Undergraduate Research Program

Advanced Large Language Models (LLMs) struggle to produce accurate results and preserve user privacy for use cases involving domain-specific knowledge. A privacy-preserving approach for leveraging LLM capabilities on domain-specific knowledge could greatly expand the use cases of LLMs in a variety of disciplines and industries. This project explores a method for acquiring domain-specific knowledge for use with GPT3 while protecting sensitive user information with ML-based text-sanitization.

A Gentle Introduction To Chatgpt, Steven W. Holloway

Libraries

A guest lecture on the state of commercial generative transformer technology, mid-2023, to a general audience at Staunton Public Library.

Are We Ready To Embrace Generative Ai For Software Q&A?, Bowen Xu, Thanh-Dat Nguyen, Thanh Le-Cong, Thong Hoang, Jiakun Liu, Kisub Kim, Chen Gong, Changan Niu, Chenyu Wang, David Lo, David Lo

Research Collection School Of Computing and Information Systems

Stack Overflow, the world's largest software Q&A (SQA) website, is facing a significant traffic drop due to the emergence of generative AI techniques. ChatGPT is banned by Stack Overflow after only 6 days from its release. The main reason provided by the official Stack Overflow is that the answers generated by ChatGPT are of low quality. To verify this, we conduct a comparative evaluation of human-written and ChatGPT-generated answers. Our methodology employs both automatic comparison and a manual study. Our results suggest that human-written and ChatGPT-generated answers are semantically similar, however, human-written answers outperform ChatGPT-generated ones consistently across multiple aspects, …

Are We Ready To Embrace Generative Ai For Software Q&A?, Bowen Xu, Thanh-Dat Nguyen, Thanh Le Cong, Thong Hoang, Jiakun Liu, Kisub Kim, Chen Gong, Changan Niu, Chenyu Wang, Xuan-Bach Dinh Le, David Lo

Research Collection School Of Computing and Information Systems

Stack Overflow, the world's largest software Q&A (SQA) website, is facing a significant traffic drop due to the emergence of generative AI techniques. ChatGPT is banned by Stack Overflow after only 6 days from its release. The main reason provided by the official Stack Overflow is that the answers generated by ChatGPT are of low quality. To verify this, we conduct a comparative evaluation of human-written and ChatGPT-generated answers. Our methodology employs both automatic comparison and a manual study. Our results suggest that human-written and ChatGPT-generated answers are semantically similar, however, human-written answers outperform ChatGPT-generated ones consistently across multiple aspects, …

Ai-Supported Academic Advising: Exploring Chatgpt’S Current State And Future Potential Toward Student Empowerment, Daisuke Akiba, Michelle C. Fraboni

Publications and Research

Artificial intelligence (AI), once a phenomenon primarily in the world of science fiction, has evolved rapidly in recent years, steadily infiltrating into our daily lives. ChatGPT, a freely accessible AI-powered large language model designed to generate human-like text responses to users, has been utilized in several areas, such as the healthcare industry, to facilitate interactive dissemination of information and decision-making. Academic advising has been essential in promoting success among university students, particularly those from disadvantaged backgrounds. Unfortunately, however, student advising has been marred with problems, with the availability and accessibility of adequate advising being among the hurdles. The current study …

Ai For Connectivism Learning: Undergraduate Students’ Experiences Of Chatgpt In Advanced Programming Courses, Swapna Gottipati, Kyong Jin Shim, Venky Shankararaman

Research Collection School Of Computing and Information Systems

Advanced programming skills are required for computing courses on merging topics, and students often struggle to develop these skills to solve complex problems. To address this challenge, faculty members provide additional lectures, practice sessions, and educational technology tools. This paper discusses the challenges faced by computer science students in developing advanced programming skills and explores the use of AI chatbots, specifically ChatGPT, as a support tool for learning. We study the engagement and effectiveness of ChatGPT in helping students learn advanced programming skills using two engagement learning frameworks (CIE and MELT) for evaluation. The study involves designing a computing lab …

Generative Artificial Intelligence And Metaverse: Future Of Work, Future Of Society, And Future Of Humanity, Yuxin Liu, Keng Siau

Research Collection School Of Computing and Information Systems

The rapid development of Generative Artificial Intelligence (GenAI) and the emergence of the Metaverse are dynamically reshaping our lives and societies. GenAI can enhance the development of Metaverse and empower the applications in Metaverse. Metaverse is also an excellent environment for GenAI to demonstrate its power and usefulness. This interwoven relationship fuels the potential of integrating GenAI and Metaverse. The paper discusses the integration potential of GenAI and Metaverse from four aspects. We further investigate how GenAI, Metaverse, and the integration of GenAI and Metaverse can reshape our future across the realms of work, society, and humanity. This paper offers …

Using Ai And Chatgpt In Brand Storytelling, Runyu Wang, Keng Siau, Zili Zhang

Research Collection School Of Computing and Information Systems

AI Chatbots, like ChatGPT, have attracted widespread attention for their powerful natural languageprocessing capabilities. Artificial intelligence (AI) chatbots, such as Auto-GPT and ChatGPT, canhelpcompanies create brand stories and communicate with stakeholders to enhance corporate communicationand brand equity. In this extended abstract, we discuss our plan to generate brand messages withvaryinglanguage formality and investigate the effect of informed communicators (i.e., human and AI chatbots) and the language formality of brand stories on individuals' attitudes to the brand and examine the roleof psychological distance. Our findings are expected to contribute to the theoretical fundamentals of usingchatbots like ChatGPT in brand storytelling.

Generative Ai And Chatgpt Impact On Technostress Of Teachers, Xuenan Huo, Keng Siau

Research Collection School Of Computing and Information Systems

Generative AI, such as ChatGPT, is a disruptive technology with significant impacts on education. While it has the potential to transform the delivery and accessibility of education, it can also undermine educational effectiveness by facilitating academic honesty and creating technostress for educators. This study aims to (i) evaluate the extent to which Generative AI, such as ChatGPT, brings technostress to teachers and (ii) how Generative AI changes teachers' professional identities and the technostress that results from such changes. We hypothesize that techno-eustress and techno-distress are determined by three types of self-discrepancies concerning professional identity construction: actual-ought, actual-ideal, and ought-ideal discrepancies. …

Stereotypes And Language Models: Understanding How Language Models Encode Stereotypes, Debiasing Language Models, And Examining How Stereotypes Affect Conversations, Brian C. Wang

Computer Science Senior Theses

This thesis describes a variety of approaches in examining how language models encode stereotypes (understanding stereotypes from a model point-of-view), debiasing language models, and using language models to understand how stereotypes affect conversations (understanding stereotypes from a conversational point-of-view). We present a novel approach for textual clues analysis that makes language models more interpretable, combining the understanding of what stereotypes the internal structures of language models have encoded during their initial training (via attention-based analysis) and understanding what textual clues are most relevant to identifying stereotypes for models trained to detect stereotypes (via SHAP-based analysis). We find that different pre-trained …

Understanding Societal Values Of Chatgpt, Yidan Tang

McKelvey School of Engineering Graduate Student Theses & Dissertations

As Large language models (LLMs) become increasingly pervasive in various domains, it is crucial to ensure that their outputs adhere to societal values and ethical considerations. In this thesis, we investigate the alignment of ChatGPT, a recent state-of-the-art large language model developed by OpenAI, with societal values. Specifically, we define the problem of societal values of LLMs and assemble a representative collection of 7 datasets covering 4 topics related to societal values. In-context learning techniques are applied and appropriate prompts are designed. The performance of each dataset is measured using a standardized evaluation system focused on accuracy. We then display …

Evaluating The Problem Solving Abilities Of Chatgpt, Fankun Zeng

McKelvey School of Engineering Graduate Student Theses & Dissertations

This thesis addresses the need for a fair evaluation of language models' problem solving abilities by presenting a unified evaluation framework for ChatGPT on 16 problem solving datasets (e.g., NaturalQA, HellaSwag, MMLU, etc.). We evaluate the model's performance using F1, exact match, and quasi-exact match metrics and find that ChatGPT is highly accurate in solving tasks that require commonsense and knowledge. However, we also identify truncated text bias and few-shot scenarios as challenges that may impact ChatGPT's performance. Our research highlights the importance of standardizing datasets and developing a unified evaluation system for the fair evaluation of language models. Overall, …

Conversations With Chatgpt About C Programming: An Ongoing Study, James C. Davis, Yung-Hsiang Lu, George K. Thiruvathukal

Computer Science: Faculty Publications and Other Works

AI (Artificial Intelligence) Generative Models have attracted great attention in recent years. Generative models can be used to create new articles, visual arts, music composition, even computer programs from English specifications. Among all generative models, ChatGPT is becoming one of the most well-known since its public announcement in November 2022. GPT means {\it Generative Pre-trained Transformer}. ChatGPT is an online program that can interact with human users in text formats and is able to answer questions in many topics, including computer programming. Many computer programmers, including students and professionals, are considering the use of ChatGPT as an aid. The quality …

Working With (Not Against) The Technology: Gpt3 And Artificial Intelligence (Ai) In College Composition, James Hutson, Daniel Plate

Faculty Scholarship

The use of artificial intelligence (AI) for improvement of writing is commonplace with word-processing software and cloudbased writing assistants such as Grammarly and Microsoft Word. However, more and more options are cropping up that move beyond assistance with grammar, spelling, and punctuation to complete essay generation. The free availability of AI essay generators has led to lamenting the coming death of college writing. But AI has been used in the previously noted examples for decades without such a reaction. In fact, the idea that the use of essay generating software is synonymous with academic dishonesty is as passé as worries …

Chatgpt And The Rise Of Ai, Derek C. Schuurman

University Faculty Publications and Creative Works

Derek C. Schuurman considers the rise of AI from a Christian perspective in January 2023 in a blog post for the Christian Scholar's Review asking questions such as "how are people distinct from machines?" and "how can we discern norms for the responsible use of AI?" This blog post was one of the 2024 Word Awards Winners Honouring the Best of Canadian Christian Writing from 2023.

https://thewordguild.com/wp-content/uploads/2024/09/TWA-2024-Media-Release-Winners-List.pdf

Chatgpt In Higher Education: Considerations For Academic Integrity And Student Learning, Miriam Sullivan, Andrew Kelly, Paul Mclaughlan

Research outputs 2022 to 2026

The release of ChatGPT has sparked significant academic integrity concerns in higher education. However, some commentators have pointed out that generative artificial intelligence (AI) tools such as ChatGPT can enhance student learning, and consequently, academics should adapt their teaching and assessment practices to embrace the new reality of living, working, and studying in a world where AI is freely available. Despite this important debate, there has been very little academic literature published on ChatGPT and other generative AI tools. This article uses content analysis to examine news articles (N=100) about how ChatGPT is disrupting higher education, concentrating specifically on Australia, …

Fabrication And Errors In The Bibliographic Citations Generated By Chatgpt, William H. Walters, Esther Isabelle Wilder

Publications and Research

Although chatbots such as ChatGPT can facilitate cost-effective text generation and editing, factually incorrect responses (hallucinations) limit their utility. This study evaluates one particular type of hallucination: fabricated bibliographic citations that do not represent actual scholarly works. We used ChatGPT-3.5 and ChatGPT-4 to produce short literature reviews on 42 multidisciplinary topics, compiling data on the 636 bibliographic citations (references) found in the 84 papers. We then searched multiple databases and websites to determine the prevalence of fabricated citations, to identify errors in the citations to non-fabricated papers, and to evaluate adherence to APA citation format. Within this set of documents, …

A Structured Narrative Prompt For Prompting Narratives From Large Language Models: Sentiment Assessment Of Chatgpt-Generated Narratives And Real Tweets, Christopher J. Lynch, Erik J. Jensen, Virginia Zamponi, Kevin O'Brien, Erika Frydenlund, Ross Gore

VMASC Publications

Large language models (LLMs) excel in providing natural language responses that sound authoritative, reflect knowledge of the context area, and can present from a range of varied perspectives. Agent-based models and simulations consist of simulated agents that interact within a simulated environment to explore societal, social, and ethical, among other, problems. Simulated agents generate large volumes of data and discerning useful and relevant content is an onerous task. LLMs can help in communicating agents' perspectives on key life events by providing natural language narratives. However, these narratives should be factual, transparent, and reproducible. Therefore, we present a structured narrative prompt …