Social and Behavioral Sciences Commons^™

Explicit Rule Learning: A Cognitive Tutorial Method To Train Users Of Artificial Intelligence/Machine Learning Systems, Anne Linja

Dissertations, Master's Theses and Master's Reports

Today’s intelligent software systems, such as Artificial Intelligence/Machine Learning systems, are sophisticated, complicated, sometimes complex systems. In order to effectively interact with these systems, novice users need to have a certain level of understanding. An awareness of a system’s underlying principles, rationale, logic, and goals can enhance the synergistic human-machine interaction. It also benefits the user to know when they can trust the systems’ output, and to discern boundary conditions that might change the output. The purpose of this research is to empirically test the viability of a Cognitive Tutorial approach, called Explicit Rule Learning. Several approaches have been used …

Action-Centric Relation Transformer Network For Video Question Answering, Jipeng Zhang, Jie Shao, Rui Cao, Lianli Gao, Xing Xu, Heng Tao Shen

Research Collection School Of Computing and Information Systems

Video question answering (VideoQA) has emerged as a popular research topic in recent years. Enormous efforts have been devoted to developing more effective fusion strategies and better intra-modal feature preparation. To explore these issues further, we identify two key problems. (1) Current works take almost no account of introducing action of interest in video representation. Additionally, there exists insufficient labeling data on where the action of interest is in many datasets. However, questions in VideoQA are usually action-centric. (2) Frame-to-frame relations, which can provide useful temporal attributes (e.g., state transition, action counting), lack relevant research. Based on these observations, we …

Using Ai-Enabled Gaze Tracking System To Understand Comprehension Patterns Of Computer Science Students, Bradley Boswell

Electronic Theses and Dissertations

Academic institutions and instructors lack the ability to accurately assess the moment-to-moment attentiveness of students in classrooms where students’ faces are obscured by computer monitors. This can cause the lectures of Computer Science, Information Technology, or other lab-based courses to be incorrectly-paced, which can lead to students having an overall poorer grasp of the subject material. We propose a system for real-time accurate detection of classroom attentiveness using monitor-mounted webcams and eye trackers, along with a Convolutional Neural Network machine learning model (NiCATS). Through the use of a neural network, we produce an initial attentiveness score based on student webcam …

Eye Movement And Pupil Measures: A Review, Bhanuka Mahanama, Yasith Jayawardana, Sundararaman Rengarajan, Gavindya Jayawardena, Leanne Chukoskie, Joseph Snider, Sampath Jayarathna

Computer Science Faculty Publications

Our subjective visual experiences involve complex interaction between our eyes, our brain, and the surrounding world. It gives us the sense of sight, color, stereopsis, distance, pattern recognition, motor coordination, and more. The increasing ubiquity of gaze-aware technology brings with it the ability to track gaze and pupil measures with varying degrees of fidelity. With this in mind, a review that considers the various gaze measures becomes increasingly relevant, especially considering our ability to make sense of these signals given different spatio-temporal sampling capacities. In this paper, we selectively review prior work on eye movements and pupil measures. We first …

The Stained Glass Of Knowledge: On Understanding Novice Mental Models Of Computing, Briana Christina Bettin

Dissertations, Master's Theses and Master's Reports

Learning to program can be a novel experience. The rigidity of programming can be at odds with beginning programmer's existing perceptions, and the concepts can feel entirely unfamiliar. These observations motivated this research, which explores two major questions: What factors influence how novices learn programming? and How can analogy by more appropriately leveraged in programming education?

This dissertation investigates the factors influencing novice programming through multiple methods. The CS1 classroom is observed as a "whole system", with consideration to the factors present in it that can influence the learning process. Learning's cognitive processes are elaborated to ground exploration into specifically …

Insight Provenance For Spatiotemporal Visual Analytics: Theory, Review, And Guidelines, Andreas Hall, Paula Ahonen-Rainio, Kirsi Virrantaus

Journal of Spatial Information Science

Research on provenance, which focuses on different ways to describe and record the history of changes and advances made throughout an analysis process, is an integral part of visual analytics. This paper focuses on providing the provenance of insight and rationale through visualizations while emphasizing, first, that this entails a profound understanding of human cognition and reasoning and that, second, the special nature of spatiotemporal data needs to be acknowledged in this process. A recently proposed human reasoning framework for spatiotemporal analysis, and four guidelines for the creation of visualizations that provide the provenance of insight and rationale published in …

Three Essays On The Effects Of Appraisal, Cultural, Emotional, And Cognitive Factors On Information Technologies Acceptance And Use, Chun-Lung Huang

Theses and Dissertations

In essay 1, we propose a model, which utilized Lazarus and Folkman’s Cognitive Appraisal Theory of Emotion or Appraisal Theory (1984, 1987) as a structural foundation to lay out the nomological relationships among a person’s personal, cognitive, and emotional factors in predicting technology use behaviors. Emotion, likes many social and psychological factors, is challenging to give a full-consensus definition, and has been treated as a polar counterpart of cognition. Lazarus and Folkman’s Appraisal Theory suggested that when a person is facing a (disruptive) event, he or she appraises the possible outcomes (we suppose that appraising is a form of cognitive …

Visual Expectations: Using Machine Learning To Identify Patterns In Psychological Data, Skyler Place

Honors Theses

The goal of this project was to utilize the tools of machine learning to evaluate the data obtained through experiments in psychology. Advanced pattern finding algorithms are an effective approach to analyzing large sets of data, from any domain of science. Consequently, we have a psychological question and hypothesis, and a separate machine learning technique to assess these claims. The realm of psychology that I focused on is visual cognition, and how an individual's knowledge affects how they see the world. This alteration of visual data is a part of perception -when the brain enhances the data coming in from …