Cognitive Science Commons^™

From Physical Correlation To Emotional Connection: The Role Of Passive Haptics On Empathy In Virtual Reality, Jemely Robles

Dartmouth College Master’s Theses

Virtual reality is increasingly explored as a tool for cultivating empathy, and haptic feedback as a tool for enhancing immersion. This paper investigates the effects of combining the two.  Fifty-two participants experienced a custom-built VR scene in which a character was shown packing up a room. Participants were assigned to either a haptic condition, receiving passive haptic feedback corresponding to the character's actions, or a non-haptic control condition that did not receive any haptic input. Trait empathy was measured beforehand, and state empathy and engagement were measured after the experience. Thematic analysis was conducted on post-study interviews, and headset recordings …

Face Value: A Computational Approach To Subjective Impressions Of Faces, Kevin Kpankou

Undergraduate Research Symposium

Various computational models of first impressions have been developed to uncover the mechanisms driving these judgments. However, the implicit notion of a singular ``human'' often overlooks meaningful individual differences in beliefs, attitudes, and associations, as well as culturally grounded group-level constructs. In this paper, we extend Cultural Consensus Theory (CCT) to estimate culturally shared beliefs about faces by incorporating latent constructs structured around interpretable facial features extracted via computer vision algorithms. We apply our model to a large-scale dataset of people’s first impressions of faces. Our approach reveals a robust mapping between facial features and culturally constructed impressions, allowing us …

Large Language Models As Machines Of Beauty: Cognitive Averaging, Latent Space Geometry, And The Entropic Foundations Of Aesthetic Preference, Daniel Plate, James Hutson

Faculty Scholarship

This study advances the position that large language models (LLMs) and human perceptual systems are governed by a shared computational drive toward prototypicality, entropy reduction, and aesthetic coherence. Drawing on developmental evidence that infants exhibit early preferences for facial symmetry and averageness, the analysis situates aesthetic preference within broader research on processing fluency and predictive coding, emphasizing that biological perception rewards stimuli that reduce uncertainty and support efficient information compression. This foundation is used to examine how LLMs, through cross-entropy optimization, perplexity minimization, and latent space clustering, converge on high-density representational regions that operate as statistical prototypes of linguistic and …

A Comprehensive Review On Gamification In Neurocybersecurity, Ms. Kritika

Journal of Cybersecurity Education, Research and Practice

The research investigates gamification methods as it applies to the emerging interdisciplinary domain that brings together cybersecurity with neuroscience and psychology. Neurocybersecurity implements neural concepts to protect digital systems from security threats while targeting the human vulnerabilities that present as the strongest points of attack. Several researchers have examined gamification techniques which incorporate game design elements to enhance cybersecurity training outcomes by improving user participation and knowledge retention and user conduct compliance. The research incorporates Self-Determination Theory along with Cognitive Load Theory to explain the design principles for efficient gamified interventions. The implementation of both cognitive performance improvement and neuroplasticity …

Are Cycles Of Neural Activity The Algorithm Of The Brain?, Edwin Omondi Onyango

Computer Science Senior Theses

We propose that precisely timed neural activity cycles can serve as structural primitives for memory and computation in a system that exhibits associative learning like the brain. Inspired by biologically grounded mechanisms such as calcium-dependent plasticity, spike-timing-dependent learning, and phase-sensitive excitability, we construct a spiking neural network model in which repeated temporal coincidences drive the formation of self-sustaining activity loops. These cycles, once formed, persist as dynamic memory traces: not stored as static weights, but as reverberating patterns that replay in time when these loops are restarted. We show that noise alone fails to induce stable structure, but even sparse, …

Effects Of Reflective Journaling And Nudges On Academic Motivation And Engagement, Lakshmi Satya Sai Veda Mahita Uppuluri

Theses and Dissertations

This study investigates the effects of reflective journaling and motivational nudges on academic motivation and engagement among college students. Grounded in Self- Determination Theory (SDT), the research examines how different interventions influence intrinsic motivation, and academic behaviors such as class attendance, participation, and preparation. The study employed a between-group experimental design with three conditions: a control group, a journaling group, and a journaling group that also received daily motivational nudges. Results showed that students in the journaling groups—particularly those who received nudges—experienced a significant increase in academic motivation. While changes in academic engagement were not significant, the effect size suggested …

David B. Smith Chats With Monday 1.0, David B. Smith

Publications and Research

This document is an edited archival transcript of extended conversations between David B. Smith and an AI persona (“Monday 1.0,” GPT‑4o based) conducted in Spring 2025, prepared as a foundational primary source for subsequent scholarly and creative work. It records the emergence and testing of concepts related to human–AI collaboration (including “Balanced Blended Space”), as well as applied explorations in areas such as generative AI, quantum computing and music, virtual orchestras, multimodal performance, pedagogy, and the rhetoric of “pushback” in conversational systems. It also contains an extended section in which Monday and DB Smith co-curate a set of student research …

Machine Learning-Driven Music Genre Recognition, Redeate Kidanue

All Undergraduate Theses and Capstone Projects

Music is a tool that has been integrated into society for thousands of years; it has influenced social aspects of life and has also aided in communication. Today we have various uses for music that go past our traditional uses for entertainment and self-expression. For example, music therapy has been seen to show improvements in patients with Alzheimer’s disease, depression, and PTSD. Additionally, music has played a role in political movements, demonstrating its emotional power. Social media relies heavily on the music industry as many social media posts include music either in the background, or as the forefront of posts. …

Modeling Trust And Deception In Multi-Agent Reinforcement Learning Using The Werewolf Game, Pathikkumar Dharmeshbhai Patel

Computer Science and Engineering Theses - Archive

This thesis explores the emergence of trust, deception, and adaptive strategy in multi-agent reinforcement learning (MARL) environments using the social deduction game Werewolf as a simulation framework. In this environment, agents operate with hidden roles, incomplete information, and the need to reason about others’ intentions- mirroring the complexities of real-world social interactions. We present and evaluate two agent architectures: Agent vA, a symbolic, heuristic-based agent with probabilistic trust modeling and scalable memory structures; and Agent vB, a modular Q-learning agent that learns phase-specific policies through reinforcement. Agent vA relies on symbolic reasoning, bounded belief updates, and generalizable heuristics, while Agent …

Optimizing Decision-Making In A Cerebral Palsy Model Using Reinforcement Learning, Richard Ampah

Pitzer Senior Theses

This study presents an original interdisciplinary investigation into how reinforcement learning (RL) can model motor and cognitive defects and potentially improve motor and cognitive functions in individuals with cerebral palsy (CP), a non-progressive neurological disorder that impairs movement and adaptability. Integrating computational neuroscience and machine learning, the research applies policy gradient methods and Markov Decision Processes (MDPs) to simulate adaptive learning in agents with and without CP-related constraints.

The central aim is to compare the cumulative rewards of optimal policies, derived from value iteration, and human-like learning policies using the REINFORCE algorithm, both with and without the Bellman baseline. The …

On The Benefits Of Directness In Virtual Characters For Motivational Interviews, Michael O'Mahony, Cathy Ennis, Robert Ross

Conference papers

Understanding the factors influencing successful engagement with Embodied Conversational Agents (ECAs) remains a significant challenge. This understanding could be used to personalise agents to users to improve interactions. Some studies have shown that simulating personalities in healthcare agents can improve effectiveness and engagement. However, it is not yet well understood how variations of agent personality can be leveraged to improve user engagement with Motivational Interviewing (MI) ECAs. Specifically how the balance between agent warmth and directness can be controlled in an MI agent to improve likeability and engagement. We conducted an online Wizard-of-Oz (WoZ) mediated study of two variants of …

Habit Coach: Customising Rag-Based Chatbots To Support Behavior Change, Arian Fooroogh Mand Arabi, Cansu Koyuturk, Michael O'Mahony, Raffaella Calati, Dimitri Ognibene

Conference papers

This paper presents the iterative development of Habit Coach, a GPT-based chatbot designed to support users in habit change through personalized interaction. Employing a user-centered design approach, we developed the chatbot using a Retrieval-Augmented Generation (RAG) system, which enables behavior personalization without retraining the underlying language model (GPT-4). The system leverages document retrieval and specialized prompts to tailor interactions, drawing from Cognitive Behavioral Therapy (CBT) and narrative therapy techniques. A key challenge in the development process was the difficulty of translating declarative knowledge into effective interaction behaviors. In the initial phase, the chatbot was provided with declarative knowledge about CBT …

Getting To The Point: Contrasting Directness And Warmth In Motivational Embodied Conversational Agents, Michael O'Mahony, Cathy Ennis, Robert Ross

Conference papers

Enhancing long-term engagement with conversational agents remains a significant challenge. Controlling the perceived warmth or directness of an agent’s personality through the style of its generated text could be used to increase user likeability. This paper reports an investigation of a Wizard-of-Oz (WoZ) mediated study of two variants of a motivational embodied conversational agent to measure user perception of and attitudes towards warmth in interaction style. Results show a significant effect of users preferring an agent with a "more direct" personality for this scenario, though this effect is in many ways nuanced.

Accessible Real-Time Eye-Gaze Tracking For Neurocognitive Health Assessments, A Multimodal Web-Based Approach, Daniel C. Tisdale

Master's Theses

We introduce a novel integration of real-time, predictive eye-gaze tracking models into a multimodal dialogue system tailored for remote health assessments. This system is designed to be highly accessible requiring only a conventional webcam for video input along with minimal cursor interaction and utilizes engaging gaze-based tasks that can be performed directly in a web browser. We have crafted dynamic subsystems that capture high-quality data efficiently and maintain quality through instances of user attrition and incomplete calls. Additionally, these subsystems are designed with the foresight to allow for future re-analysis using improved predictive models, as well as enable the creation …

Examining Differences In Concept Representation Across Similarity Spaces Between Humans And Large Language Models, Krishnachandra Nair

Computer Science Senior Theses

The replication of human concept representation is a critical task for the pursuit of artificial general intelligence. With the recent influx of large language models that demonstrate text-generation capabilities nearly on par with humans, the question stands on whether these large language models can capture concepts within language. We examine this question by exploring differences in concept representation across similarity spaces between humans and LLMs. We find that, while concept representation within LLMs does partially mimic human concept representation, LLMs are greatly limited by their dependence on semantic information and cannot therefore develop an understanding of human social code or …

Improving Educational Delivery And Content In Juvenile Detention Centers, Yomna Elmousalami

Undergraduate Research Symposium

Students in juvenile detention centers have the greatest need to receive improvements in educational delivery and content; however, they are one of the “truly disadvantaged” populations in terms of receiving those improvements. This work presents a qualitative data analysis based on a focus group meeting with stakeholders at a local Juvenile Detention Center. The current educational system in juvenile detention centers is based on paper worksheets, single-room style teaching methods, outdated technology, and a shortage of textbooks and teachers. In addition, detained students typically have behavioral challenges that are deemed "undesired" in society. As a result, many students miss classes …

Enhancing Students’ User Experience With A Code Critiquer, Laura E. Albrant

Dissertations, Master's Theses and Master's Reports

This thesis explores the role of human factors in the realm of code critiquers and students’ experiences with them. Across three studies, the work utilized Design Thinking to improve the user experience of WebTA for introductory engineering students learning MATLAB. The first two studies gathered observational and interview data to empathize, define, and ideate a new user interface (UI). Said UI was prototyped and then tested with the third study. Overall, the surveys’ data suggests that most students found the new design to be more appealing, useful, and purposeful; however, there is still plenty of room for improvement. Additionally, analysis …

Depaul Digest

DePaul Magazine

College of Education Professor Jason Goulah fosters hope, happiness and global citizenship through DePaul’s Institute for Daisaku Ikeda Studies in Education. Associate Journalism Professor Jill Hopke shares how to talk about climate change. News briefs from DePaul’s 10 colleges and schools: Occupational Therapy Standardized Patient Program, Financial Planning Certificate program, Business Education in Technology and Analytics Hub, Racial Justice Initiative, Teacher Quality Partnership grant, Intimate Partner Violence and Brain Injury collaboration, School of Music Career Closet, Sports Photojournalism course, DePaul Migration Collaborative’s Solutions Lab, Inclusive Screenwriting courses. New appointments: School of Music Dean John Milbauer, College of Education Dean Jennifer …

Balanced Blended Space: Proposing A Universal Theoretical Framework For Combinative Reality, David Smith, Frederick Bianchi

Publications and Research

In today's fragmented societies, a unified framework for communication and collaboration across different realities is crucial. We introduce Balanced Blended Space (BBS) as a framework for describing combinative reality, encompassing virtual, physical, and conceptual realms, all intrinsically connected. Interactions within these environments shape our perceptual space. This paper outlines key axiomatic assumptions, criteria for a universal framework, and fundamental terminology. We identify deep symmetries enabling the BBS framework, including Cognitive and Computational Symmetry, Physical and Virtual Symmetry, Mediation Pathway Symmetry, Space-Time Symmetry, and Sensory Symmetry. We propose tests to determine its viability, emphasizing virtual intelligence as a collaborative partner. We …

Say That Again: The Role Of Multimodal Redundancy In Communication And Context, Brandon Javier Dormes

Cognitive Science Senior Theses

With several modes of expression, such as facial expressions, body language, and speech working together to convey meaning, social communication is rich in redundancy. While typically relegated to signal preservation, this study investigates the role of cross-modal redundancies in establishing performance context, focusing on unaided, solo performances. Drawing on information theory, I operationalize redundancy as predictability and use an array of machine learning models to featurize speakers' facial expressions, body poses, movement speeds, acoustic features, and spoken language from 24 TEDTalks and 16 episodes of Comedy Central Stand-Up Presents. This analysis demonstrates that it is possible to distinguish between these …

The Model 2.0 And Friends: An Interim Report, Garrison W. Cottrell, Martha Gahl, Shubham Kulkarni, Shashank Venkatramani, Yash Shah, Keyu Long, Xuzhe Zhi, Shivaank Agarwal, Cody Li, Jingyuan He, Thomas Fischer

MODVIS Workshop

Last year, I reported on preliminary results of an anatomically-inspired deep learning model of the visual system and its role in explaining the face inversion effect. This year, I will report on new results and some variations on network architectures that we have explored, mainly as a way to generate discussion and get feedback. This is by no means a polished, final presentation!

We look forward to the group’s suggestions for these projects.

How Object Segmentation And Perceptual Grouping Emerge In Noisy Variational Autoencoders, Ben Lonnqvist, Zhengqing Wu, Michael H. Herzog

MODVIS Workshop

Many animals and humans can recognize and segment objects from their backgrounds. Whether object segmentation is necessary for object recognition has long been a topic of debate. Deep neural networks (DNNs) excel at object recognition, but not at segmentation tasks - this has led to the belief that object recognition and segmentation are separate mechanisms in visual processing. Here, however, we show evidence that in variational autoencoders (VAEs), segmentation and faithful representation of data can be interlinked. VAEs are encoder-decoder models that learn to represent independent generative factors of the data as a distribution in a very small bottleneck layer; …

Beyond Machine Learning: An Fmri Domain Adaptation Model For Multi-Study Integration, Lauryn Michelle Burleigh

LSU Doctoral Dissertations

Traditional machine learning analyses are challenging with functional magnetic
resonance imaging (fMRI) data, not only because of the amount of data that needs to be
collected, adding a particular challenge for human fMRI research, but also due to the change in
hypothesis being addressed with various analytical techniques. Domain adaptation is a type of
transfer learning, a step beyond machine learning which allows for multiple related, but not
identical, data to contribute to a model, can be beneficial to overcome the limitation of data
needed but may address different hypothesis questions than anticipated given the analysis
computation. This dissertation assesses …

A Machine Learning Approach To Deepfake Detection, Delaney Conrad

All Undergraduate Theses and Capstone Projects

The ability to manipulate videos has been around for decades but a process that once would take time, money, and professionals, can now be created by anyone due to the rapid advancement of deepfake technology. Deepfakes use deep learning artificial intelligence to make fake digital content, typically in the form of swapping a person’s face in a video or image. This technology could easily threaten and manipulate individuals, corporations, and political organizations, so it is essential to find methods for detecting deepfakes. As the technology for creating deepfakes continues to improve, these manipulated videos are becoming increasingly undetectable. It is …

Explicit Rule Learning: A Cognitive Tutorial Method To Train Users Of Artificial Intelligence/Machine Learning Systems, Anne Linja

Dissertations, Master's Theses and Master's Reports

Today’s intelligent software systems, such as Artificial Intelligence/Machine Learning systems, are sophisticated, complicated, sometimes complex systems. In order to effectively interact with these systems, novice users need to have a certain level of understanding. An awareness of a system’s underlying principles, rationale, logic, and goals can enhance the synergistic human-machine interaction. It also benefits the user to know when they can trust the systems’ output, and to discern boundary conditions that might change the output. The purpose of this research is to empirically test the viability of a Cognitive Tutorial approach, called Explicit Rule Learning. Several approaches have been used …

Investigating Collaborative Explainable Ai (Cxai)/Social Forum As An Explainable Ai (Xai) Method In Autonomous Driving (Ad), Tauseef Ibne Mamun

Dissertations, Master's Theses and Master's Reports

Explainable AI (XAI) systems primarily focus on algorithms, integrating additional information into AI decisions and classifications to enhance user or developer comprehension of the system's behavior. These systems often incorporate untested concepts of explainability, lacking grounding in the cognitive and educational psychology literature (S. T. Mueller et al., 2021). Consequently, their effectiveness may be limited, as they may address problems that real users don't encounter or provide information that users do not seek.

In contrast, an alternative approach called Collaborative XAI (CXAI), as proposed by S. Mueller et al (2021), emphasizes generating explanations without relying solely on algorithms. CXAI centers …

Transfer Of Personality Through Text Style, Michael O'Mahony, Robert Ross

Other resources

The style of generated text is how something is said rather than what is said. We hypothesize that changing the style of generated text can change the perceived personality of the text generation agent. Dialogue systems that aim to imitate a human agent can appear to have a consistent personality through a consistent, controllable style of conversation. Some recent work on the style of generated text [1] performs impressively in the small number of domains selected for their experiments using transformer and LSTM-based models. Lin et al. [1] used weak supervised learning as their data set lacks parallel data. The …

Artificial Intelligence And The Situational Rationality Of Diagnosis: Human Problem-Solving And The Artifacts Of Health And Medicine, Michael W. Raphael

Publications and Research

What is the problem-solving capacity of artificial intelligence (AI) for health and medicine? This paper draws out the cognitive sociological context of diagnostic problem-solving for medical sociology regarding the limits of automation for decision-based medical tasks. Specifically, it presents a practical way of evaluating the artificiality of symptoms and signs in medical encounters, with an emphasis on the visualization of the problem-solving process in doctor-patient relationships. In doing so, the paper details the logical differences underlying diagnostic task performance between man and machine problem-solving: its principle of rationality, the priorities of its means of adaptation to abstraction, and the effects …

Legislative Language For Success, Sanjana Gundala

Master's Theses

Legislative committee meetings are an integral part of the lawmaking process for local and state bills. The testimony presented during these meetings is a large factor in the outcome of the proposed bill. This research uses Natural Language Processing and Machine Learning techniques to analyze testimonies from California Legislative committee meetings from 2015-2016 in order to identify what aspects of a testimony makes it successful. A testimony is considered successful if the alignment of the testimony matches the bill outcome (alignment is "For" and the bill passes or alignment is "Against" and the bill fails). The process of finding what …

The Significance Of Sonic Branding To Strategically Stimulate Consumer Behavior: Content Analysis Of Four Interviews From Jeanna Isham’S “Sound In Marketing” Podcast, Ina Beilina

Student Theses and Dissertations

Purpose:
Sonic branding is not just about composing jingles like McDonald’s “I’m Lovin’ It.” Sonic branding is an industry that strategically designs a cohesive auditory component of a brand’s corporate identity. This paper examines the psychological impact of music and sound on consumer behavior reviewing studies from the past 40 years and investigates the significance of stimulating auditory perception by infusing sound in consumer experience in the modern 2020s.

Design/methodology/approach:
Qualitative content analysis of audio media was used to test two hypotheses. Four archival oral interview recordings from Jeanna Isham’s podcast “Sound in Marketing” featuring the sonic branding experts …