Physical Sciences and Mathematics Commons^™

Differences In Student-Ai Interaction Process On A Drawing Task: Focusing On Students' Attitude Towards Ai And The Level Of Drawing Skills, Jinhee Kim, Yoonhee Ham, Sang-Soog Lee

STEMPS Faculty Publications

Recent advances and applications of artificial intelligence (AI) have increased the opportunities for students to interact with AI in their learning tasks. Although various fields of scholarly research have investigated human-AI collaboration, the underlying processes of how students collaborate with AI in a student-AI teaming scenario have been scarcely investigated. To develop effective AI applications in education, it is necessary to understand differences in the student-AI interaction (SAI) process depending on students' characteristics. The present study attempts to fill this gap by exploring the differences in the SAI process amongst students with varying drawing proficiencies and attitudes towards AI in …

Leveraging Artificial Intelligence For Team Cognition In Human-Ai Teams, Beau Schelble

All Dissertations

Advances in artificial intelligence (AI) technologies have enabled AI to be applied across a wide variety of new fields like cryptography, art, and data analysis. Several of these fields are social in nature, including decision-making and teaming, which introduces a new set of challenges for AI research. While each of these fields has its unique challenges, the area of human-AI teaming is beset with many that center around the expectations and abilities of AI teammates. One such challenge is understanding team cognition in these human-AI teams and AI teammates' ability to contribute towards, support, and encourage it. Team cognition is …

Dispensing With Humans In Human-Computer Interaction Research, Courtni L. Byun

Theses and Dissertations

Machine Learning models have become more advanced than could have been supposed even a few years ago, often surpassing human performance on many tasks. Large language models (LLM) can produce text indistinguishable from human-produced text. This begs the question, how necessary are humans - even for tasks where humans appear indispensable? Qualitative Analysis (QA) is integral to human-computer interaction research, requiring both human-produced data and human analysis of that data to illuminate human opinions about and experiences with technology. We use GPT-3 and ChatGPT to replace human analysis and then to dispense with human-produced text altogether. We find GPT-3 is …

Anatoview: Using Interactive 3d Visualizations With Augmented Reality Support For Laypersons’ Medical Education In Informed Consent Processes, Michelle Chen

Dartmouth College Master’s Theses

AnatoView is an interactive multimedia educational application that visualizes medical procedures in three-dimensional (3D), augmented reality (AR) space. By providing visual and spatial information of medical procedures, AnatoView acts as a learning supplement for laypersons/patients in informed consent (IC) processes — wherein instructional content is traditionally limited to purely spoken explanations that lead to poor patient comprehension. We design a mixed study and conduct a randomized, controlled trial with 15 laypersons as participants: administering a traditional IC process to a control group, and an IC process supplemented by the use of AnatoView to experimental groups. As a primary outcome, medical …

Immersive Learning Environments For Computer Science Education, Dillon Buchanan

Electronic Theses and Dissertations

This master's thesis explores the effectiveness of an educational intervention using an interactive notebook to support and supplement instruction in a foundational-level programming course. A quantitative, quasi-experimental group comparison method was employed, where students were placed into either a control or a treatment group. Data was collected from assignment and final grades, as well as self-reported time spent using the notebook. Independent t-tests and correlation were used for data analysis. Results were inconclusive but did indicate that the intervention had a possible effect. Further studies may explore better efficacy, implementation, and satisfaction of interactive notebooks across a larger population and …

Construction Technology Of Hand Posture Dataset Based On Virtual Simulation Method, Jiaxin Chen, Guohui Zhou, Jianbai Yang

Journal of System Simulation

Abstract: Hand posture is an important carrier of human-computer interaction, and the acquisition and recognition of posture information largely depends on the hand posture dataset. Existing datasets can be divided into two categories, real datasets and synthetic datasets. As real data is limited by equipment, environment, and other factors, the classification of hand posture is insufficient and the annotation is mixed with a lot of manual errors. The existing synthetic data can solve the data scale problem of real data, but the synthetic hand posture volume is limited and with some unreasonable kinematic postures of which the data form are …

Floor Evacuation Simulation Based On Bim And Mr, Zhijie Li, Shuangyu Ma, Changhua Li, Xiao Liang, Jie Zhang

Journal of System Simulation

Abstract: Facing with the problem that the floor evacuation simulation only annotates the floor plan route, which is relatively single and not intuitive, a 3D building evacuation simulation method integrating mixed reality and building information model is proposed. The BIM components are reasonably planned and segmented, and reasonable annotation is performed. The BIM information is routed through the surface area heuristic optimization algorithm based on the bounding volume hierarchy. The evacuation simulation process is imported into the Microsoft Hololens2 hardware platform using the Unity3D development engine. The experimental results show that, compared with the previous evacuation simulation expressed only …

Flextype: Flexible Text Input With A Small Set Of Input Gestures, Dylan Gaines, Mackenzie M. Baker, Keith Vertanen

Michigan Tech Publications

In many situations, it may be impractical or impossible to enter text by selecting precise locations on a physical or touchscreen keyboard. We present an ambiguous keyboard with four character groups that has potential applications for eyes-free text entry, as well as text entry using a single switch or a brain-computer interface. We develop a procedure for optimizing these character groupings based on a disambiguation algorithm that leverages a long-span language model. We produce both alphabetically-constrained and unconstrained character groups in an offline optimization experiment and compare them in a longitudinal user study. Our results did not show a significant …

An Ambiguous Technique For Nonvisual Text Entry, Dylan C. Gaines

Dissertations, Master's Theses and Master's Reports

Text entry is a common daily task for many people, but it can be a challenge for people with visual impairments when using virtual touchscreen keyboards that lack physical key boundaries. In this thesis, we investigate using a small number of gestures to select from groups of characters to remove most or all dependence on touch locations. We leverage a predictive language model to select the most likely characters from the selected groups once a user completes each word.

Using a preliminary interface with six groups of characters based on a Qwerty keyboard, we find that users are able to …

An Empirical Study On The Classification Of Python Language Features Using Eye-Tracking, Jigyasa Chauhan

Department of Computer Science and Engineering: Dissertations, Theses, and Student Research

Python, currently one of the most popular programming languages, is an object-
oriented language that also provides language feature support for other programming
paradigms, such as functional and procedural. It is not currently understood how
support for multiple paradigms affects the ability of developers to comprehend that
code. Understanding the predominant paradigm in code, and how developers classify
the predominant paradigm, can benefit future research in program comprehension as
the paradigm may factor into how people comprehend that code. Other researchers
may want to look at how the paradigms in the code interact with various code smells.
To investigate how …

Investigating Accessibility Challenges And Opportunities For Users With Low Vision Disabilities In Customer-To-Customer (C2c) Marketplaces, Bektur Ryskeldiev, Kotaro Hara, Mariko Kobayashi, Koki Kusano

Research Collection School Of Computing and Information Systems

Inaccessible e-commerce websites and mobile applications exclude people with visual impairments (PVI) from online shopping. Customer-to-customer (C2C) marketplaces, a form of e-commerce where trading happens not between businesses and customers but between customers, could pose a unique set of challenges in the interactions that the platform brings about. Through online questionnaire and remote interviews, we investigate problems experienced by people with low vision disabilities in common C2C scenarios. Our study with low vision participants (N = 12) reveal both previously known general accessibility issues (e.g., web and mobile interface accessibility) and C2C specific accessibility issues (e.g., inability to confirm item …

“I Think I Discovered A Military Base In The Middle Of The Ocean”—Null Island, The Most Real Of Fictional Places, Levente Juhasz, Peter Mooney

GIS Center

This paper explores Null Island, a fictional place located at 0° latitude and 0° longitude in the WGS84 (World Geodetic System 1984) geographic coordinate system. Null Island is erroneously associated with large amounts of geographic data in a wide variety of location-based services, place databases, social media and web-based maps. Whereas it was originally considered a joke within the geospatial community, this article will demonstrate implications of its existence, both technological and social in nature, promoting Null Island as a fundamental issue of geographic information that requires more widespread awareness. The article summarizes error sources that lead to data being …

Effective Immersive Analytics For Everyday Use, Benjamin D. Weidner

Theses and Dissertations

Data visualization is an important field of work that takes in uncountable amounts of indexes to create an easy-to-read interpretation of what was previously unreadable. Immersive analytics is the new field that brings 3D data visualization to virtual reality, immersing users directly into the data. Focusing on bringing humans and computers closer together through natural function can benefit the world of data science. In order to accurately utilize this field to benefit this world, principles must be laid out and observed to see which techniques and methods are best fit for an everyday immersive analytics platform. Our findings show that, …

Interactive Construction Of Scientific Workflow Based On Process Mining, Jun Liu, Yang Gao, Tao Xu, Qing Zhao, Guihua Shan, Xuebin Chi

Journal of System Simulation

Abstract: When dealing with large-scale or complex workflows, the construction efficiency of traditional interactive workflow construction methods is very low. To solve this problem, a workflow construction method based on process mining is proposed. Heuristic methods are used to collect process fragments. The specially designed relation description language is used to record the process description of different levels and aspects in the workflow as text. The text is translated to generate process relational data, which will be output to the process discovery algorithm to generate a sound workflow network. An interactive workflow construction software has been developed and tested in …

Considering The Context To Build Theory In Hci, Hri, And Hmc: Explicating Differences In Processes Of Communication And Socialization With Social Technologies, Andrew Gambino, Bingjie Liu

Human-Machine Communication

The proliferation and integration of social technologies has occurred quickly, and the specific technologies with which we engage are ever-changing. The dynamic nature of the development and use of social technologies is often acknowledged by researchers as a limitation. In this manuscript, however, we present a discussion on the implications of our modern technological context by focusing on processes of socialization and communication that are fundamentally different from their interpersonal corollary. These are presented and discussed with the goal of providing theoretical building blocks toward a more robust understanding of phenomena of human-computer interaction, human-robot interaction, human-machine communication, and interpersonal …

The Illusion Of Agency In Human–Computer Interaction, Michael Madary

College of the Pacific Faculty Articles

This article makes the case that our digital devices create illusions of agency. There are times when users feel as if they are in control when in fact they are merely responding to stimuli on the screen in predictable ways. After the introduction, the second section of the article offers examples of illusions of agency that do not involve human–computer interaction in order to show that such illusions are possible and not terribly uncommon. The third and fourth sections of the article cover relevant work from empirical psychology, including the cues that are known to generate the sense of agency. …

Dynamic Task Allocation And Understanding Of Situation Awareness Under Different Levels Of Autonomy In Closed-Hatch Military Vehicles Using Virtual Reality, Jessie E. Cossitt

Link Foundation Modeling, Simulation and Training Fellowship Reports

The current state of the art in autonomous vehicles is partial autonomy, and to optimize the use of these vehicles, it is essential to understand the interactions between the vehicles and their operators. Partially autonomous vehicles require operators to perform parts of the driving task and to be alert and ready to take over full control of the vehicle at any point. Due to the requirements on the human operator, it is necessary to know how the operators' abilities are impacted by the amount of autonomy present in the system. There are known effects of autonomous systems on performance, cognitive …

Thanatechnology And The Living Dead: New Concepts In Digital Transformation And Human-Computer Interaction, Vural Özdemir, Simon Springer, Arif Ylldlrlm, Sehmus Biçer, Asllgül Kendirci, Semra Sardaş, Hakan Klllç, Nezih Hekim, Tanja Kunej, Kazlm Yalçln Arga, Kevin Dzobo, Wei Wang, Marius Geanta, Angela Brand, Mustafa Bayram

Research outputs 2014 to 2021

In a digital society, shall we be the authors of our own experience, not only during our lifetime but also after we die? We ask this question because dying and bereavement have become even harder, and much less private, in the digital age. New big data-driven digital industries and technologies are on the rise, with promises of interactive 3D avatars and storage of digital memories of the deceased, so they can continue to exist online as the "living dead"in a digital afterlife. Famous rock and roll icons like Roy Orbison, Frank Zappa, Ronnie James Dio, and Amy Winehouse have famously …

5Th Kidrec Workshop: Search And Recommendation Technology Through The Lens Of A Teacher, Monica Landoni, Theo Huibers, Maria Soledad Pera, Jerry Alan Fails

Computer Science Faculty Publications and Presentations

In this past year, the role of technology to support education has been more prominent than ever. This has prompted us to focus the 5^th Edition of the International and Interdisciplinary Perspectives on Children & Recommender and Information Retrieval Systems (KidRec) around a major stakeholder when it comes to technology adoption for the classroom: the teacher. Much like in the previous editions of the workshop, our priority remains understanding what is good when it comes to information retrieval systems for children, this time from the perspectives of teachers. In order to control scope of our discussion and …

Glaze Epochs: Externalizing Material Knowledge Through Tangible Data Records In A Ceramics Studio, Hedieh Moradi

Computer Science and Engineering Theses

The "material turn" in HCI has placed a renewed focus on informing design from the relationships found in material-based interactions. While several ethnographic works provide insight into how practitioners converse with materials, it is less understood how these conversations transform into a skilled practitioner's mental model. I examine the material practice of glazing that gives ceramics its decorative and functional characteristics and involves fusing mixtures of silica, alumina, and flux onto a clay body through kiln firing. This practice evolves over decades, developing from multiple trajectories, including theoretical foundations, systematic experimentation, and happy accidents. This work describes virtual site visits …

Design Of Interactive Visualizations For Next-Generation Ultra-Large Communication Networks, Wenjun Chen, Anwar Haque, Kamran Sedig

Computer Science Publications

© 2013 IEEE. With the increasing size and complexity of next-generation communication networks, it is critical to utilize interactive visualizations to support the monitoring, planning, and management of networks. Effectively visualizing large-scale networks is difficult with traditional methods because of the high link density and complex node relationships. Given the limited screen space, to assist Internet Service Provider's (ISP) network planning and management activities, investigating how to present ultra-large-scale network data efficiently is crucial. This paper presents a real-Time interactive visualization system that combines the design strategies of progressive disclosure and multiple panels to elegantly visualize the large-scale networks and …

Investigating The User Experience With A 3d Virtual Anatomy Application, Winnyanne Kunkle

CCE Theses and Dissertations

Decreasing hours dedicated to teaching anatomy courses and declining use of human cadavers have spurred the need for innovative solutions in teaching anatomy in medical schools. Advancements in virtual reality (VR), 3D visualizations, computer graphics, and medical graphic images have enabled the development of highly interactive 3D virtual applications. Over recent years, variations of interactive systems on computer-mediated environments have been used as supplementary resource for learners. However, despite the growing sophistication of these resources for learning anatomy, studies show that students predominantly prefer traditional methods of learning and hands-on cadaver-based learning over computer-mediated platforms.

There is limited research on …

Towards Location-Independent Eyes-Free Text Entry, Dylan C. Gaines

Dissertations, Master's Theses and Master's Reports

We propose an interface for eyes-free text entry using an ambiguous technique and conduct a preliminary user study. We find that user are able to enter text at 19.09 words per minute (WPM) with a 2.08% character error rate (CER) after eight hours of practice. We explore ways to optimize the ambiguous groupings to reduce the number of disambiguation errors, both with and without familiarity constraints. We find that it is feasible to reduce the number of ambiguous groups from six to four. Finally, we explore a technique for presenting word suggestions to users using simultaneous audio feedback. We find …

Measuring The Perceived Social Intelligence Of Robots, Kimberly A. Barchard, Leiszle Lapping-Carr, R. Shane Westfall, Andrea Fink-Armold, Santosh Balajee Banisetty, David Feil-Seifer

Psychology Faculty Research

Robotic social intelligence is increasingly important. However, measures of human social intelligence omit basic skills, and robot-specific scales do not focus on social intelligence. We combined human robot interaction concepts of beliefs, desires, and intentions with psychology concepts of behaviors, cognitions, and emotions to create 20 Perceived Social Intelligence (PSI) Scales to comprehensively measure perceptions of robots with a wide range of embodiments and behaviors. Participants rated humanoid and non-humanoid robots interacting with people in five videos. Each scale had one factor and high internal consistency, indicating each measures a coherent construct. Scales capturing perceived social information processing skills (appearing …

Visualization Research Lab At Hkust, Yong Wang

Research Collection School Of Computing and Information Systems

HKUST VisLab (http://vis.cse.ust.hk/) is one of the leading research labs in the field of data visualization and human-computer interaction worldwide. The lab is dedicated to conducting cutting-edge research on data visualization and human-computer interaction to facilitate data exploration and analytics in various application domains, including E-learning, urban computing, social media and industry 4.0. Starting from its foundation by Prof. Huamin Qu in August 2004, the mission of HKUST VisLab is to build an excellent visualization research center and foster data visualization research and talent cultivation in Asia, as there were very few visualization researchers in Asia around 2004.

Three-Dimensional Virtual Reassembling For Broken Artifact Fragments Based On Leap Motion, Haoran Lu, Zhang Yu, Miaomiao Niu, Wuyang Shui, Mingquan Zhou

Journal of System Simulation

Abstract: 3D laser scanning technique has been widely used to acquire geometry information of artifacts. The broken relics can be virtually restored with the help of computer technologies. Aiming at solving the problems of the automatic virtual restoration for broken artifact fragments, a new method of semi-automatic reassembly was proposed. The motions of the user’s hands were simulated by using the data captured by Leap Motion. The movement of each fragment model was controlled interactively so that two fragments could be roughly matched. The matching results were fed back to the user in real-time, and the user could optimize …

The Meaning Of Red And Green In User Interfaces For The Color Deficient, Bassel Hamieh

University Honors Theses

Around 108 million web users are color blind which is a problem when the way we communicate over the web or interfaces is through the use of color. Red and green are two colors that are especially heavily used in interface design because of their strong symbolic associations; red being a sign to warn or stop and green being the opposite. This has a large effect on red-green color blind people who are not able to perceive either of those colors correctly. Many solutions exist that aim to help through color differentiation but none take into account color symbolism. With …

Study On Visual Function Of Human Computer Interaction In Parachuting Simulator, Han Liang, Gong Xuan, Jiangyun Wang, Yanghua Du

Journal of System Simulation

Abstract: The parachuting training system consists of software and hardware, to simulate the parachute training through head mounted display and operating equipment, combined with system modeling, kinematic computation, visual display and expert evaluation. Principle methods of head mounted display with human-computer interactive function and exploitation of Vega Prime inventive exploration on the information collection of viewpoint are conducted. It provides a real time training environment through the configuration of environmental effects, scene control, collision detection and driving information.

Serious Game Human-Computer Interaction Design For Rehabilitation Training, Jiajia Wu, Liu Zhen, Huihuang Xu, Tingting Liu, Wang Jin, Yanjie Chai

Journal of System Simulation

Abstract: Constructing a human-computer interaction environment which can effectively enhance users’ experiences of serious game. By integrating the rehabilitation training process into an interactive game story, users can do their mental and body rehabilitation training in the community. The prototype of the game is realized by the game engine. Experimental results showed that using mouse to roam in the system is easier than other interaction method and the somatosensory interaction is convenient for exercising the limb. By designing emoji for virtual characters, it is easy for users to learn other people's emotions and the comfortable distances for others. The results …

Laying A Foundation For Computing In Outdoor Recreation, Zann Benjamin Anderson

Theses and Dissertations

Mobile computing allows individuals to bring computing with them into the outdoors. This creates a new situation in which individuals can stay connected even when trying to "get away from it all." Questions arise from this juxtaposition regarding whether the inclusion of computing in these activities is a positive or a negative. Evidence exists supporting both conclusions. We posit that computing can contribute positively to outdoor recreation without distracting. This dissertation details work undertaken in two phases which explores how computing can accomplish this goal. Phase 1 explored how individuals are already using computing technology in hiking, and culminated with …