Digital Commons Network^™

Understanding Non-Designers' Practices And Processes In A Human-Centered Design Course, Luettamae Lawrence, Saadeddine Shehab, Mike Tissenbaum

Instructional Technology and Learning Sciences Faculty Publications

Human-centered design (HCD) has been identified in the literature as a useful problem-solving approach for learners. However, learning and applying HCD poses several challenges for students who are unfamiliar with this form of learning. In this paper, we analyse how a novice design team worked on a HCD class project to examine how non-designers learn about and integrate HCD practices into their project. We introduce the HCD taxonomy to define the processes and practices that students engage in. The team’s design work is triangulated across multiple data sources and revealed three challenges for engaging non-designers in HCD: 1) the need …

The Path Of Least Resistance: Optimizing Metadata Practices Through User Assessment, Andrea Payant, Liz Woolcott, Paul Daybell, Becky Skeen, Anna-Maria Arnljots

Library Faculty & Staff Publications

As part of a multi-faceted research project examining user engagement with various types of descriptive metadata to improve metadata services, Utah State University Libraries Cataloging and Metadata Services unit investigated user search behavior in library catalog (MARC) records, Encoded Archival Description (EAD) finding aids, and most recently in digital collection metadata. The authors used web log analysis to determine how users interacted with CONTENTdm, categories of search terms used, and where search terms were found in a record. Key findings included that navigation through CONTENTdm using clickable queries (links) is a prominent user search pattern, dates are an important faceting …

How Teachers Conceptualise Shared Control With An Ai Co-Orchestration Tool: A Multiyear Teacher-Centred Design Process, Luettamae Lawrence, Vanessa Echeverria, Kexin Yang, Vincent Aleven, Nikol Rummel

Instructional Technology and Learning Sciences Faculty Publications

Artificial intelligence (AI) can enhance teachers' capabilities by sharing control over different parts of learning activities. This is especially true for complex learning activities, such as dynamic learning transitions where students move between individual and collaborative learning in un-planned ways, as the need arises. Yet, few initiatives have emerged considering how shared responsibility between teachers and AI can support learning and how teachers' voices might be included to inform design decisions. The goal of our article is twofold. First, we describe a secondary analysis of our co-design process comprising six design methods to understand how teachers conceptualise sharing control with …

How Co-Designing Computational Modeling Activities Helped Teachers Implement Responsive Teaching Strategies, Hillary Swanson, Luettamae Lawrence, Jared Arnell, Allisia Dawkins, Bonni Jones, Bruce Sherin, Uri Wilensky

Instructional Technology and Learning Sciences Faculty Publications

In recent years, science education has shifted focus, from content to practice. This is reflected in the NGSS, which advocate learning science concepts through engagement in science and engineering practices. Theory building is a central activity of science and computational modeling is a key practice through which contemporary scientists construct theory. In this paper, we discuss an 8th grade science teacher's implementation of a computational modeling lesson. The teacher had co-designed the computational modeling microworld and lesson with the research team over the preceding summers. We investigate the teacher's activity during a whole-class discussion near the end of the lesson, …

Understanding Computational Thinking In The Gameplay Of The African Songo Board Game, Rebecca Y. Bayeck

Instructional Technology and Learning Sciences Faculty Publications

Computational thinking is a necessary skill for the 21st century. While previously examined in computer-rich settings, researchers are increasingly studying computational thinking in unplugged environments such as board games. Focusing on the African board game Songo, this study shows that computational thinking practices are embedded in Songo board gameplay and interact with the cultural context. The study also reveals a computing practice peculiar to Songo gameplay, songoputation. This paper suggests that researchers can benefit from exploring computational thinking and computing practices beyond board games in western contexts.

Supporting And Sustaining Equitable Steam Activities In High School Classrooms: Understanding Computer Science Teachers’ Needs And Practices When Implementing An E-Textiles Curriculum To Forge Connections Across Communities, Deborah A. Fields, Yasmin B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

While the last two decades have seen an increased interest in STEAM (science, technology, engineering, arts, and mathematics) in K-12 schools, few efforts have focused on the teachers and teaching practices necessary to support these interventions. Even fewer have considered the important work that teachers carry out not just inside classrooms but beyond the classroom walls to sustain such STEAM implementation efforts, from interacting with administrators to recruiting students and persuading parents about the importance of arts and computer science. In order to understand teachers’ needs and practices regarding STEAM implementation, in this paper, we focus on eight experienced computer …

Strengthening Your (Dublin) Core For Stronger User Discoverability (And Possibly Abs), Andrea Payant, Paul Daybell, Liz Woolcott, Becky Skeen

Library Faculty & Staff Presentations

Utah State University Libraries Cataloging and Metadata Services unit investigated user search behavior using web log analysis to determine how users interacted with CONTENTdm, which categories of search terms were used, and where search terms were found in a metadata record. This presentation will discuss the key findings from data analysis and how this will influence metadata practices to improve digital collection user experience.

It's Time For An Ead Glow Up! How To Make Finding Aids More Attractive To Users, Paul Daybell, Liz Woolcott, Kelly Rovegno, Andrea Payant, Becky Skeen, Heather Housley

Library Faculty & Staff Presentations

USU Libraries investigated discoverability of local Encoded Archival Description (EAD) finding aids using different levels of description. The research team created two dueling finding aids of the same collection; one with an MPLP stripped down box level inventory, and the other with a more robust item level of description. Both finding aids were posted online simultaneously and left untouched for over a year. The data was then pulled and assessed for each collection with the more 'glowed up' item level finding aid being, on average, 61x more discoverable than the finding aids described at the file level. Presenters will discuss …

Is Microethnography An Ethnographic Case Study? And/Or A Mini-Ethnographic Case Study? An Analysis Of The Literature, Rebecca Y. Bayeck

Instructional Technology and Learning Sciences Faculty Publications

Selecting the research approach that addresses the research question is often challenging for novice researchers. However, getting a better understanding of the research approaches available in the field, is likely to help novice researchers identify and choose the research approach that fits their situation. In this paper, we discuss microethnography, ethnographic case study, and mini-ethnography case study in order to show that these approaches may have similarities but are different. The author hopes that this discussion will help researchers get a better understanding of these approaches and dissipate the confusion that may exist.

The Predictive Validity Of The Gre Across Graduate Outcomes: A Meta-Analysis Of Trends Over Time, David F. Feldon, Kaylee Litson, Brinleigh Cahoon, Zhang Feng, Andrew Walker, Colby Tofel-Grehl

Instructional Technology and Learning Sciences Faculty Publications

This meta-analysis assesses the predictive validity of the Graduate Record Examination (GRE) across outcome variables, including grade point average, for graduate students. In addition to aggregate effects, this paper also assessed changes in observed effects over time as related to increasing diversity in the graduate student population and as a function of gender and racial/ethnic composition of study samples. Framed using a lens of critical whiteness, this analysis examined n = 1,744 individual effects across k = 208 studies. Overall, 61.6% of reported effects were nonsignificant (i.e. no predictive value of GRE scores on student outcomes). Further, the magnitude of …

None Of Our Business: Critically Examining Power Dynamics And The Role Of Libraries In The Information Industry, Alex Sundt, Stephanie Western, Erica Finch, Becky Thoms

Library Faculty & Staff Presentations

Talk of the prestige economy is cheap, while open access and APCs are big business. Librarians dream of bolder action but are fearful of institutional backlash. How do we find a new path forward?

Apcs And 123s: Estimating How Much Your Faculty Are Spending On Article Processing Charges., Erica Finch, Lindsay Ozburn, Becky L. Thoms

Library Faculty & Staff Presentations

No abstract provided.

Designing Hybrid Human-Ai Orchestration Tools For Individual And Collaborative Activities: A Technology Probe Study, Vanessa Echeverria, Kexin Yang, Luettamae Lawrence, Nikol Rummel, Vincent Aleven

Instructional Technology and Learning Sciences Faculty Publications

Combining individual and collaborative learning is common, but dynamic combinations (which happen as-the-need arises, rather than in pre-planned ways, and may happen on an individual basis) are rare. This work reports findings from a technology probe study exploring alternative designs for classroom co-orchestration support for dynamically transitioning between individual and collaborative learning. The study involved 1) a technology-probe classroom study in an authentic, AI-supported classroom to understand teachers' and students' needs for co-orchestration support over dynamic transitions; and 2) workshops and interviews with students and teachers to get informed feedback about their lived experiences. 118 students and three teachers from …

Analyzing Discoverability In An Mplp World: How Levels Of Description Impact Findability, Anna-Maria Arnljots, Paul Daybell, Kurt Alan Meyer, Andrea Payant, Becky Skeen, Liz Woolcott

Library Faculty & Staff Presentations

Libraries and archives have differing opinions on how much effort to put into content description. Yet, descriptive practices meant to reduce processing time and increase exposure to collections can have unintended impacts on long-term user discovery. This project tests minimal and full description to determine the effects on discoverability.

Positionality: The Interplay Of Space, Context And Identity, Rebecca Y. Bayeck

Instructional Technology and Learning Sciences Faculty Publications

This article considers the way in which positionality shifts and is formed during a cross-cultural study to reveal the complexity of the insider-outsider status. As a researcher in a male-dominated game setting, I reflect on the research process and my interactions with participants to show the interplay of space, context, and identity in shaping a researcher’s status. I discuss the process of gaining access to the research site and participants, and data collection in relation to space, context, and identity. The interaction of my identities with space, and context informed my status at various moments. This interplay constructs a complex …

Level Down To Level Up: The Impact Of Item-Level Description On Finding Aid Discoverability, Paul Daybell, Andrea Payant, Becky Skeen, Liz Woolcott

Library Faculty & Staff Presentations

Utah State University Libraries Cataloging and Metadata Services unit investigated the discoverability of local Encoded Archival Description (EAD) finding aids using different levels of description. The research team created two nearly identical versions of the same finding aid for five collections and posted them online. The only difference in the finding aids was the level to which the collection contents were described. For each collection, one version of the finding aid was described at the file (box or folder) level and the other version was described at the item level. Over a year later the team pulled the analytics for …

Collective And Creative Learning To Enhance Interlibrary Loan, Lars Leon, Carol A. Kochan

Library Faculty & Staff Publications

The resource sharing community has a proud history of sharing knowledge through conferences, workshops, and online resources in support of training and development. People have enjoyed these opportunities and received various levels of benefit depending on access and whether instruction aligns with the methods they learn best. However, it is clear there aren't enough collective actions to meet the needs. We hosted a series of focus groups on training and development to find out from participants what has worked for them, what is still needed, how they learn best, and the types of training and information that will help them …

A Tale Of Two Levels: Analyzing The Discoverability And Impact Of Item-Level Description In Ead Finding Aids, Paul Daybell, Andrea Payant, Liz Woolcott, Becky Skeen, Anna-Maria Arnljots, Kurt Alan Meyer

Library Faculty & Staff Publications

As part of a multi-faceted research project examining user engagement with various types of descriptive metadata, Utah State University Libraries Cataloging and Metadata Services unit (CMS) investigated the discoverability of local Encoded Archival Description (EAD) finding aids. The research team put two versions of the same finding aid online with one described at the file (box or folder) level and the other at the item level. Over a year later, the team pulled the analytics for each guide and assessed which descriptive level was most frequently accessed. The research team also looked at the type of search terms patrons utilized …

Co-Designing Ai-Based Orchestration Tools To Support Dynamic Transitions: Design Narratives Through Conjecture Mapping, Luettamae Lawrence, Boyuan Guo, Kexin Yang, Vanessa Echeverria, Zimmy Kang, Vikrant Bathala, Christina Li

Instructional Technology and Learning Sciences Faculty Publications

Dynamically transitioning between individual and collaborative learning has been hypothesized to have positive effects, such as providing the optimal learning mode based on students’ needs. There are, however, challenges in orchestrating these transitions in real-time while managing a classroom of students. AI-based orchestration tools have the potential to alleviate some of the orchestration load for teachers. In this study, we describe a sequence of three design sessions with teachers where we refine prototypes of an orchestration tool to support dynamic transitions. We leverage design narratives and conjecture mapping for the design of our novel orchestration tool. Our contributions include the …

Ai And Ambitious Learning Practices, Cindy E. Hmelo-Silver, Sadhana Puntambekar, Krista Glazewski, Luettamae Lawrence, Nikol Rummel, Vincent Aleven, Gautam Biswas, Suraj Uttamchandani, Asmalina Saleh, Haesol Bae, Thomas Brush, Bradford Mott, James Lester, William Goss, Dana Gnesdilow, Rebecca Passonneau, Purushartha Singh, Chanmin Kim, Marcelo Worsley

Instructional Technology and Learning Sciences Faculty Publications

This symposium will provide opportunities for discussion about how Artificial Intelligence can support ambitious learning practices in CSCL. To the extent that CSCL can be a lever for educational equitable educational change, AI needs to be able to support the kinds of practices that afford agency to students and teachers. However, AI also brings to the fore the need to consider equity and ethics. This interactive session will provide opportunities to discuss these issues in the context of the examples presented here.

Mapping The Complexities And Benefits Of Research-Design Partnerships, Emma Mercier, Luettamae Lawrence, June Ahn, Christopher Wegemer, Maya Benichou, Yael Kali, Yotam Hod, Marcela Borge, Kimberley Gomez, Ung-Sang Lee, Susan Mckenney, Cindy Poortman, Paula Arce-Trigatti, Britte Haugan Cheng

Instructional Technology and Learning Sciences Faculty Publications

Increasingly our field is recognizing the necessity of close, collaborative relationships with educators, policy makers, students and other potential stakeholders if our design and research work is to have a lasting and more equitable impact on education. However, this work is not easy or quick, and we lack both detailed examples of how it is done and training for new (and current) scholars in how to do it. This symposium brings together a group of scholars who actively engage in RPPs and DBIR in order to highlight the lessons that have been learned and extend our discourse into the realities …

Avoiding A "Level Of Discontent" In Finding Aids: An Analysis Of User Engagement Across Ead Levels, Paul Daybell, Andrea Payant, Becky Skeen, Liz Woolcott

Library Faculty & Staff Presentations

USU Libraries Cataloging and Metadata Services unit investigated the discoverability of local Encoded Archival Description (EAD) finding aids. The research team put two versions of the same finding aid online with one described at the file (box or folder) level and the other described at the item level. Over a year later the team pulled the analytics for each guide and assessed the descriptive level most frequently accessed as well as the search terms patrons utilized and where they were found in finding aid tags. Presenters will discuss the methodology of the project and research outcomes.

None Of Our Business: Examining The Economics And Business Dynamics Of The Library And Information Industry, Jason Folkman, Alex J. Sundt, Robert Heaton, Erica Finch, Stephanie Western, Nick Gittins

Library Faculty & Staff Presentations

Librarians are often referred to as information professionals and talk of the "information industry," but how much do we actually know about the business side of publishing and library vendors? As vendors and publishers continue to consolidate, and costs increase for libraries and our communities, the business side of libraries deserves greater scrutiny from the library community which often shies away from critically examining our role in the greater information industry. Building our awareness and engaging in critical discourse of the library industry is essential for securing our bargaining power, navigating our role as stewards of our collections, and situating …

On Your Marc, Get Set, Code!, Anna-Maria Arnljots, Paul Daybell, Kurt Alan Meyer, Andrea Payant, Becky Skeen, Liz Woolcott

Library Faculty & Staff Presentations

How are MARC records performing in our search environment? This presentation will look at the process and results of a research project that analyzed how users’ search terms matched up with MARC fields, as well as how and where MARC records were displayed in search results lists. Presenters will discuss the process, the results of the project, and outline how attendees can implement similar research projects at their institutions, including tools and techniques they can use to analyze how their own records are surfacing in a search environment.

A Tale Of Five Case Studies: Reflections On Piloting A Case-Based, Problem-Based Learning Curriculum In English Composition, Katie Strand, Rachel Wishkoski, Alex J. Sundt, Deanna Allred

Library Faculty & Staff Publications

Part of a volume about storytelling in academic library contexts, this chapter reflects on the use of case studies in a sequenced information literacy curriculum in ENGL 2010 (Intermediate Writing: Research Writing in a Persuasive Mode). In highly interactive sessions across the semester, students collaboratively researched a case study topic and co-created artifacts that reflected their shared journey as researchers. The chapter is organized into the following sections, consistent with the other chapters in the book: classroom vignette, storytelling goal, audience, delivery, theory, cultural considerations, and practical examples. Readers will learn about things to consider when using case-based problem-based learning …

Marginalia No. 48, Merrill-Cazier Library, Utah State University

Marginalia

• Dear Friends, page 1
• Welcome New Library Employees, page 3
• Research Week Returns to the Library, page 5
• Spring Friends Lecture Explores the Life and Crimes of Infamous Forger and Bomber, Mark Hofmann, page 7
• Returning Home, page 9
• Don't Judge a Book by its Cover, page 10

Marginalia No. 47, Merrill-Cazier Library, Utah State University

Marginalia

• Dear Friends, page 2
• Welcome New Employees, page 3
• Friends of Merrill-Cazier Library Donation Spotlights, page 5
• Outdoor Recreation Archive, page 7
• USU Watershed Sciences Exhibit Travels to the Merrill-Caizer Library, page 8
• Returning Home: Intermountain School Board Talk, page 9
• A Marvelous Work: 2021 Leonard J. Arrington Mormon History Lecture, page 10

The Intersection Of Cultural Context And Research Encounter: Focus On Interviewing In Qualitative Research, Rebecca Yvonne Bayeck

Instructional Technology and Learning Sciences Faculty Publications

This article discusses the influence of the cultural context on the interview process. With literature demonstrating the role of spatial context on interviews, the article contends that similar consideration should be given to cultural contexts of research studies. Focusing on the cultural context where the interview takes place and the interactions during the interview can help researchers understand and analyze interview material. Interview forms such as conversation/interview bombing emerged from the interaction of cultural context with the interview process. This points to the need for qualitative researchers to explore how the cultural context shapes their research encounter. Such focus will …

The Practical And The Aspirational: Managing The Student Employee Experience In Library Publishing Efforts, Rebecca Nelson, Becky L. Thoms

Library Faculty & Staff Publications

Student employees are a critical component in the workforce of academic libraries. While more established library services have the benefit of attracting student employees specifically interested in their work, scholarly communication programs, and library publishing efforts in particular, have more difficulty describing and garnering interest in their work. This article describes the journey of the Digital Initiatives Unit at Utah State University Libraries as we navigated the particular trials that come with library publishing—specifically delving into the work of our institutional repository (IR) and the role of student employees in those efforts. The labor of our program is variable and …

Towards Bringing Human-Centered Design To K-12 And Post-Secondary Education, Saadeddine Shehab, Mike Tissenbaum, Luettamae Lawrence, Daniel Rees Lewis, Matthew Easterday, Spencer Carlson, Adam Royalty, Helen Chen, Sheppard Sheri, Shelley Goldman, Annie Camey Kuo, Kimiko Lange, Melissa Mesinas, Rose K. Pozos, Dhvani Toprani, Mona Alqahtani, Yu Xia, Marcela Borge, Keith Sawyer

Instructional Technology and Learning Sciences Faculty Publications

Human-Centered Design (HCD) is a growing field that has the potential to positively impact students’ learning. A general consensus on the terms, practices, scaffolds, and assessments of HCD can foster its effective implementation in K-12 and post-secondary education. This session brings together researchers whose work is focused on implementing HCD across K-16 classrooms. It aims to develop a coherent definition of HCD, its methods, practices, and assessments, to help frame the field and reduce ambiguity at a critical time in its broader adoption.