Educational Assessment, Evaluation, and Research Commons^™

A Mixed-Method Study Of Mobile Devices And Student Self-Directed Learning And Achievement During A Middle School Stem Activity, Scott Bartholomew

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

With the increasingly ubiquitous nature of mobile devices among K-12 students, many argue for and against the inclusion of these devices in K-12 classrooms. Arguments in favor cite instant access to information and collaboration with others as positive affordances made possible through mobile devices. Self-directed learning, a process where individuals take charge of their learning and decide what they will learn, how they learn it, and how they assess their learning, has been identified as an increasingly important trait for K-12 students. The relationship between mobile device access in K-12 education settings and student self-directed learning has not been explored. …

Coding By Choice: A Transitional Analysis Of Social Participation Patterns And Programming Contributions In The Online Scratch Community, Deborah A. Fields, Yasmin B. Kafai, Michael T. Giang

Instructional Technology and Learning Sciences Faculty Publications

While massive online communities have drawn the attention of researchers and educators on their potential to support active collaborative work, knowledge sharing, and user-generated content, few studies examine participation in these communities at scale. The little research that does exist attends almost solely to adults rather than communities to support youths’ learning and identity development. In this chapter, we tackle two challenges related to understanding social practices that support learning in massive social networking forums where users engage in design. We examined a youth programmer community, called Scratch.mit.edu, that garners the voluntary participation of millions of young people worldwide. We …

A Knowledge Analytic Comparison Of Cued Primitives When Students Are Explaining Predicted And Enacted Motions, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

The Knowledge in Pieces theoretical perspective posits p-prims as an important knowledge element in intuitive reasoning. Because p-prims are a class of knowledge elements developed and abstracted from everyday physical experiences, it seems plausible that immediate physical experiences, both in terms of sensations and actual observations of motion, would cue knowledge in different ways than when those experiences are just discussed as hypotheticals. This paper presents two cases to show that immediate embodied experiences with everyday objects does change which p-prims are cued and how they are deployed by students to explain situations involving motion. These cases come from a …

Opportunistic Uses Of The Traditional School Day Through Student Examination Of Fitbit Activity Tracker Data, Victor R. Lee, Joel R. Drake, Ryan Cain, Jeffrey L. Thayne

Instructional Technology and Learning Sciences Faculty Publications

In large part due to the highly prescribed nature of the typical school day for children, efforts to design new interactions with technology have often focused on less-structured after-school clubs and other out-of-school environments. We argue that while the school day imposes serious restrictions, school routines can and should be opportunistically leveraged by designers and by youth. Specifically, wearable activity tracking devices open some new avenues for opportunistic collection of and reflection on data from the school day. To demonstrate this, we present two cases from an elementary statistics classroom unit we designed that intentionally integrated wearable activity trackers and …

Searching Smart With Standards: Using Curriculum Standards To Find Educational Resources In Digital Libraries, Anne R. Diekama, Sheri Haderlie

Instructional Technology and Learning Sciences Faculty Publications

No abstract provided.

A Blended Professional Development Program To Help A Teacher Learn To Provide One-To-One Scaffolding, Brian Robert Belland, Ryan Burdo, Jiangyue Gu

Instructional Technology and Learning Sciences Faculty Publications

Argumentation is central to instruction centered on socio-scientific issues (Sadler & Donnelly in International Journal of Science Education, 28(12), 1463–1488, 2006. doi:10.1080/09500690600708717). Teachers can play a big role in helping students engage in argumentation and solve authentic scientific problems. To do so, they need to learn one-to-one scaffolding—dynamic support to help students accomplish tasks that they could not complete unaided. This study explores a middle school science teacher’s provision of one-to-one scaffolding during a problem-based learning unit, in which students argued about how to optimize the water quality of their local river. The blended professional development program incorporated three 1.5-h …

Children's Media Making, But Not Sharing: The Potential And Limitations Of Child-Specific Diy Media Websites, Sara Grimes, Deborah A. Fields

Instructional Technology and Learning Sciences Faculty Publications

From drawing pictures to making home movies, children have long produced their own, do-it-yourself (DIY) media at the individual and local scales. Today, children's DIY media creation increasingly takes place online, using digital technologies and tools that allow them to not only produce but also share their ideas with the world. This article relays findings from the first stages of a three-year inquiry project into the opportunities and challenges associated with the rise of children's online DIY media: an extensive media scan to identify websites and an in-depth content analysis of the terms and conditions, privacy policies and overall site …

Combining High-‐‐Speed Cameras And Stop-‐‐Motion Animation Software To Support Students’ Modeling Of Human Body Movement, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

Biomechanics, and specifically the biomechanics associated with human movement,is a potentially rich backdrop against which educators can design innovative science teaching and learning activities. Moreover, the use of technologies associated with biomechanics research, such as high-‐‐speed cameras that can produce high quality slow-‐‐motion video, can be deployed in such a way to support students’ participation in practices of scientific modeling. As participants in classroom design experiment, fifteen fifth-‐‐grade students worked with high-‐‐speed cameras and stop-‐‐motion animation software (SAM Animation) over several days to produce dynamic representations of motion and body movement. The designed series of learning activities involved iterative cycles …

Understanding The Opportunities And Challenges Of Introducing Computational Crafts To Alternative High School Students, Maneksha Dumont, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

In recent years, the integration of computation with crafting has garnered increased attention. Partly spurred by the growth of the “maker movement” and also by recognition of the importance of broadening computational interest and proficiency, computational crafts have become more familiar to educational technologists and designers. For example, computation has been combined with textile design in summer camps for young people (Buechley, Eisenberg, Catchen & Crockett, 2008) and integrated into media as pervasive as paper (Eisenberg, Elumeze, MacFerrin & Buechley, 2009). Additionally, maker spaces are being established in major metropolitan areas, Maker Faires are becoming increasingly ubiquitous (Dougherty, 2012), university …

Students’ Digital Photography Behaviors During A Multiday Environmental Science Field Trip And Their Recollections Of Photographed Science Content, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

Taking photographs to document the experiences of an educational field trip is becoming a common activity for teachers and students alike. Considering the regular creation of photographic artifacts, our goal in this paper is to explore students’ picture taking behavior and their recollections of science content associated with their photographs. In this study, we partnered with a class of fifth-grade students in the United States and provided each student with a digital camera to document their experiences during an environmental science field trip at a national park. We report the frequency of photography behaviors according to which activities were most …

Teaching Information Synthesis, Anne R. Diekama, Kacy Lundstrom, Connie Woxland

Instructional Technology and Learning Sciences Faculty Publications

No abstract provided.

Building On Background Knowledge To Formulate Researchable Questions, Anne R. Diekama, Sheri Haderlie

Instructional Technology and Learning Sciences Faculty Publications

At the recent ALA Midwinter Conference in Seattle, I moderated the AASL-sponsored Hot Topics discussion on “Genre-fying” the collection. Six panelists presented a variety of viewpoints on how to handle an issue that is being widely discussed. A number of librarians have implemented the change, reclassifying their nonfiction titles using letters identifying the genre. Some have used EBSCO’s NoveList as a source for the categories they chose, others have used their own ideas. A few have integrated fiction within the nonfiction. A more limited approach is to “genre-fy” the fiction collection. Those who have made the change point to increased …

More Than Just Plain Old Technology Adoption: Understanding Variations In Teachers' Use Of An Online Planning Tool, Heather Leary, Victor R. Lee, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

This paper examines variability in teachers’ usage patterns as they interacted with an online teacher support tool, the Curriculum Customization Service (CCS), as part of their professional work. The CCS is a web application that supports teachers in planning, adapting, sequencing, and enacting differentiated instruction in Earth science education. By mining the usage log files of over 40 teachers who used the CCS over a yearlong period, we analyzed for variability using a framework developed in marketing research to characterize appropriation of technology. This analysis helped reveal different kinds of teachers’ patterns along two dimensions: frequency and variability of use. …

Becoming Reflective: Designing For Reflection On Physical Performances, Tom Moher, Cynthia Carter Ching, Sara Schaefer, Victor R. Lee, Noel Enyedy, Joshua Danish, Paulo Guerra, Alessandro Gnoli, Priscilla Jimenez, Brenda Lopez-Silva, Leilah Lyons, Anthony Perritano, Brian Slattery, Mike Tissenbaum, James Slotta, Rebecca Cober, Cresencia Fong

Instructional Technology and Learning Sciences Faculty Publications

Learners’ physical performances can serve as focal objects for reflection and insight across a variety of contexts and content areas. This session brings together a set of projects that leverage the physical performances of learners, construct concrete and abstract representations of those performances, and investigate how learners reflect on and understand the relationships between their performances and target content—physics, health and fitness, data literacy and navigation, animal foraging, and climate change. The session will share findings and design principles from each of the studies around constructing technological scaffolds for physical performance reflections. The symposium highlights the various ways performance can …

What's Happening In The "Quantified Self" Movement?, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

Rapid adoption of wearable tracking devices and motion sensitive apps has led to the development of the “Quantified Self” movement (QS). Some in the learning sciences community have begun to take notice and incorporate ideas from QS into the research and design of new learning environments. Yet the QS movement is still new enough that very little is known about it, and there are many open questions about how QS might be of value to the learning sciences. This paper provides some history of the movement and through a qualitative analysis of a public video corpus of QS presentations, identifies …

Keeping Up: Shifting Access To Gateway Resources In A Cycling Community Of Practice, Joel Drake, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

While learning involves changes in one’s participation within a community of practice, changes in participants can also change access to resources key to newcomer participation. This poster presents a case study of a recreational cycling community illustrating how community changes diminished newcomers’ access to resources for drafting.

Examining How Students Make Sense Of Slow-Motion Video, Min Yuan, Nam Ju Kim, Joel Drake, Scott Smith, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

Slow-motion video is starting to appear in science classrooms as a source of data for students to examine. However, seeing important features in such video requires a particular kind of student engagement and supported acts of noticing. This poster reports on an exploratory study of what students noticed and talked about when viewing slow-motion video during a classroom design experiment focused on bodily activity as it relates to motion and animation.

Mixing The Emic And Etic Perspectives: A Study Exploring Development Of Fixed-Answer Questions To Measure In-Service Teachers' Technological Pedagogical Content Knowledge, M. Brooke Robertshaw

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

The purpose of this dissertation study was to develop fixed-answer questions to measure teachers' technological pedagogical content knowledge when teaching with online learning resources. Technological pedagogical content knowledge (TPACK) is a framework to describe the kind of knowledge that teachers use when they are teaching with technology. Online learning resources include text, video, images, and interactive websites that teachers can use to help teach subject matter to their students. Fixed-answer questions are the kinds of questions found on standardized tests like the SAT, and tests that K-12 students take as a part of state and national testing. Many measures have …

A Clinical Interview For Assessing Student Learning In A University-Level Craft Technology Course, Victor R. Lee, Deborah A. Fields

Instructional Technology and Learning Sciences Faculty Publications

This paper describes the design and development of a clinical interview protocol, the “Interactive Toy Interview” (ITI), that was used to assess prior knowledge and resultant learning among undergraduate students enrolled in a new, university-level “Craft Technologies” course. This new course involved several weeks of project work with electronic textiles and soft circuits. The ITI draws on prior work assessing learning with e-textiles, such as circuit diagram drawing tasks and ‘debuggems’, but it is based on use of existing commercial toys and objects. We present excerpts from interviews with a student who reported no prior background with sewing, circuitry, or …

The Quantified Self (Qs) Movement And Some Emerging Opportunities For The Educational Technology Field, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

The Quantified Self (QS) movement is a growing global effort to use new mobile and wearable technologies to automatically obtain personal data about everyday activities. The social and material infrastructure associated with the Quantified Self (QS) movement provides a number of ideas that educational technologists should consider incorporating and using. This article discusses some recent efforts to bring the movement to the practices of the educational technology field and presents some issues to consider in the future.

Cognitive Task Analysis-Based Training: A Metaanalysisof Studies, Colby Tofel-Grehl, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

Cognitive task analysis (CTA) is enjoying growing popularity in both research and practice as a foundational element of instructional design. However, there exists relatively little research exploring its value as a foundation for training through controlled studies. Furthermore, highly individualized approaches to conducting CTA do not permit broadly generalizable conclusions to be drawn from the findings of individual studies. Thus, examining the magnitude of observed effects across studies from various domains and CTA practitioners is essential for assessing replicable effects. This study reports the findings from a meta-analysis that examines the overall effectiveness of CTA across practitioners and settings in …

Examining Relationships Among Student Interim Proficiency, School Environment, And Student End-Of-Year Proficiency, Kathy Janzen

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

Research on variables that are related to student academic proficiency has intensified due to the increased emphasis on high achievement for all students. The purpose of this correlational study was to explore the relative strength of the relationship between the school's learning environment and student achievement, and a literacy benchmark assessment and student achievement. Schools in the state of Utah that administered the Indicators of School Quality (ISQ) survey during the 2010-2011 school year and the Dynamic Indicators of Early Literacy Skills (DIBELS) assessments during the same school year were included in the study.

The study examined a combination of …

Quantified Recess: Design Of An Activity For Elementary Students Involving Analyses Of Their Own Movement Data, Victor R. Lee, Joel R. Drake

Instructional Technology and Learning Sciences Faculty Publications

Recess is often a time for children in school to engage recreationally in physically demanding and highly interactive activities with their peers. This paper describes a design effort to encourage fifth-grade students to examine sensitivities associated with different measures of center by having them analyze activities during recess using over the course of a week using Fitbit activity trackers and TinkerPlots data visualization software. We describe the activity structure some observed student behaviors during the activity. We also provide a descriptive account, based on video records and transcripts, of two students who engaged thoughtfully with their recess data and developed …

Digital Physical Activity Data Collection And Use By Endurance Runners And Distance Cyclists, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

The introduction of sensor technologies to sports has allowed athletes to quantify and track their performance, adding an information-based layer to athletic practices. This information layer is particularly prevalent in practices involving formal competition and high levels of physical endurance, such as biking and running. We interviewed 20 athletes who participated in distance cycling or endurance running and also had experience using these technologies. This paper presents two cases and a number of shorter descriptive examples from these interviews that illustrate the factors salient to the introduction of these athletes to their respective sports, their continued participation in running or …

Knowing And Learning With Technology (And On Wheels!): An Introduction To The Special Issue, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

This special issue of Technology, Knowledge and Learning is dedicated to bicycles and computing. Yes, you read that correctly. The theme of the issue is really and truly bicycles and computing.

The Next Information Literacy Challenge: Partnering To Promote Deeper Engagement With Information And Better Writing, Wendy Holliday, Kacy Lundstrom, Anne R. Diekama, Sheri Haderlie

Instructional Technology and Learning Sciences Faculty Publications

No abstract provided.

Evaluating The Effectiveness Of The Utah Career And Technical Education Introduction Course, Debra Marie Spielmaker

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

The Utah State Office of Education Career and Technical supported this quantitative study that evaluated the gains and outcome evaluations of the compulsory Career and Technical Education (CTE) Introduction course. All public school seventh grade students are required to enroll in this school-year course. The matched pair design used preexisting data to analyze 6,078 pre- and postsurvey responses collected at the beginning of the course and again at the end of the course during the 2011-2012 school year. The evaluation was viewed through a postpositivist lens and used a theory-based evaluation model as the framework for analysis. The research questions …

Searching To Learn : Using Search Results To Build Concept Knowledge, Anne R. Diekama, Sheri Haderlie

Instructional Technology and Learning Sciences Faculty Publications

No abstract provided.

Teacher Design Using Online Learning Resources: A Comparative Case Study Of Science And Mathematics Teachers, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

Using a comparative case study design, this paper explores the impacts of a technology-related professional development (TTPD) design aimed at helping science and mathematics teachers design classroom activities using the wealth of resources available on the Internet. Using the lens of curricular adaption and the notion of teachers’ varying pedagogical design capacity, we analyzed the experiences of four teachers in terms of the kinds of instructional activities teachers designed, how these were supported with online resources, and teachers’ perceptions of impacts on student learning. Findings suggested that participants used a variety of personally relevant design strategies when applying TTPD concepts …

Variable Appropriation Of An Online Resource Discovery And Sharing Tool, Victor R. Lee, Mimi Recker, Tamara Sumner

Instructional Technology and Learning Sciences Faculty Publications

Even when following best practices for participatory design, the appropriation of tools in formal education settings can be hampered by a number of factors. Drawing from a case of a web tool built to help teachers in five school districts find and share free resources in an educational digital library, we describe patterns of tool use and provide some explanations for variability in tool appropriation. We also suggest that future research consider school districts as complex systems of professionals whose interactions and inter-relationships may yield unexpected technology adoption behaviors.