Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research Commons™

Open Access. Powered by Scholars. Published by Universities.®

Instructional Technology and Learning Sciences Faculty Publications

Discipline
Keyword
Publication Year
File Type

Articles 121 - 150 of 179

Full-Text Articles in Educational Assessment, Evaluation, and Research

Collaborative Agency In Youth Online And Offline Creative Production In Scratch, Y. B. Kafai, Deborah A. Fields, R. Roque, W. Q. Burke, A. Monroy-Hernandez Jan 2012

Collaborative Agency In Youth Online And Offline Creative Production In Scratch, Y. B. Kafai, Deborah A. Fields, R. Roque, W. Q. Burke, A. Monroy-Hernandez

Instructional Technology and Learning Sciences Faculty Publications

Few studies have focused on how youth develop agency to organize and participate in online unstructured creative collaborations. This paper describes and analyzes how youth programmers organized collaborative groups in response to a programming “Collab Challenge” in the Scratch Online Community and in an accompanying workshop with high school students. The analyses focused on modalities of online collaborations, determined the breadth of online participation, and examined local teens’ awareness of the online community. The discussion addresses youth’s collaborative agency in these new networked contexts, studied the role that online social awareness plays in completing tasks and makes recommendations for the …


Physical Activity Data Use By Technoathletes: Examples Of Collection, Inscription, And Identification, Victor R. Lee, Joel Drake Jan 2012

Physical Activity Data Use By Technoathletes: Examples Of Collection, Inscription, And Identification, Victor R. Lee, Joel Drake

Instructional Technology and Learning Sciences Faculty Publications

The proliferation of physical activity data monitoring devices had led to an increase in technoathletes—individuals who combine athletic training and performance with the collection and evaluation of personally-relevant data in an effort to better understand their own abilities. We interviewed 20 technoathletes who were actively involved within either cycling or running communities. Qualitative vignettes of technoathletic engagement with data and the practice of data logging, in specific, are discussed and illustrated. Individual relationships that technoathletes have with their data are also examined. Through the examples, we highlight some commonalities in the data that were obtained and how various athletes …


Integrating Physical Activity Data Technologies Into Elementary School Classrooms, Victor R. Lee, Jonathan M. Thomas Dec 2011

Integrating Physical Activity Data Technologies Into Elementary School Classrooms, Victor R. Lee, Jonathan M. Thomas

Instructional Technology and Learning Sciences Faculty Publications

This paper describes an iteration of a design-based research project that involved integrating commercial physical activity data (PAD) sensors, such as heart rate monitors and pedometers, as technologies that could be used in two fifth-grade classrooms. Design-based research involves the development, implementation and study of new learning interventions in real-world contexts with the goal of elaborating principles or guidelines relevant to the design of new technologies and learning experiences. The current project involved the implementation of PAD technology-supported learning activities in two fifth-grade classrooms where students pursued investigations related to the distances that they walk, the relationship between heights and …


Modeling Teacher Ratings Of Online Resources: A Human-Machine Approach To Quality, Mimi Recker, Heather Leary, Andrew Walker, Anne R. Diekama, Philipp Wetzler, Tamara Sumner, James Martin Apr 2011

Modeling Teacher Ratings Of Online Resources: A Human-Machine Approach To Quality, Mimi Recker, Heather Leary, Andrew Walker, Anne R. Diekama, Philipp Wetzler, Tamara Sumner, James Martin

Instructional Technology and Learning Sciences Faculty Publications

In education, the scalable deployment of media-rich online resources supports peer production in ways that promise to radically transform teaching and learning (CRA, 2005; Pea et al., 2008). Online educational repositories such as the Digital Library for Earth Systems Education (DLESE.org) and the National Science Digital Library (NSDL.org) collect and curate online learning resources created for a wide range of educational audiences and subject areas (McArthur & Zia, 2008). Through a simple, web-based authoring tool, called the Instructional Architect (IA.usu.edu) teachers locate and share educational resources and activities in an IA project. These IA projects can then be viewed, copied, …


Collaborative Strategic Board Games As A Site For Distributed Computational Thinking, Matthew Berland, Victor R. Lee Apr 2011

Collaborative Strategic Board Games As A Site For Distributed Computational Thinking, Matthew Berland, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

This paper examines the idea that contemporary strategic board games represent an informal, interactional context in which complex computational thinking takes place. When games are collaborative – that is, a game requires that players work in joint pursuit of a shared goal – the computational thinking is easily observed as distributed across several participants. This raises the possibility that a focus on such board games are profitable for those who wish to understand computational thinking and learning in situ. This paper introduces a coding scheme, applies it to the recorded discourse of three groups of game players, and provides qualitative …


Teaching Use Of Digital Primary Sources For K-12 Settings, Anne R. Diekama, Heather Leary, Sheri Haderlie, Connie Woxland Mar 2011

Teaching Use Of Digital Primary Sources For K-12 Settings, Anne R. Diekama, Heather Leary, Sheri Haderlie, Connie Woxland

Instructional Technology and Learning Sciences Faculty Publications

This paper describes learning outcomes of a three-day workshop on integrating primary sources into K-12 teaching. The short curriculum — intended for teams of teachers and school librarians — combined visits to a museum and a library's special collections with an introduction to significant national and local digital collections of primary sources. The paper draws on focus group data, reflection papers, and a conference presentation by the workshop participants as well as curricular artifacts presented to the workshop instructors. Using their workshop experience, teachers integrated digitized primary sources into their curricula thereby creating quality instructional content that engaged students' interest. …


Negotiating The "Relevant" In Culturally Relevant Mathematics, N. Enyedy, J. Danish, Deborah A. Fields Jan 2011

Negotiating The "Relevant" In Culturally Relevant Mathematics, N. Enyedy, J. Danish, Deborah A. Fields

Instructional Technology and Learning Sciences Faculty Publications

One approach to promoting successful engagement of underrepresented groups in mathematics classrooms is Culturally Relevant Pedagogy (CRP). However, it has been argued that CRP risks essentializing students or watering down academic content. We report our analysis of a case study of a group of three 6th grade students who took part in a 6-week mathematics curriculum. This curriculum used Geographical Information System (GIS) maps to engage students in designing personally meaningful research projects while learning about measures of central tendency (i.e., learning statistics). The case study was chosen as representative of how students in this urban classroom (47 total) successfully …


Understanding Teacher Users Of A Digital Library Service: A Clustering Approach, Beijie Xu, Mimi Recker Jan 2011

Understanding Teacher Users Of A Digital Library Service: A Clustering Approach, Beijie Xu, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

This article describes the Knowledge Discovery and Data Mining (KDD) process and its application in the field of educational data mining (EDM) in the context of a digital library service called the Instructional Architect (IA.usu.edu). In particular, the study reported in this article investigated a certain type of data mining problem, clustering, and used a statistical model, latent class analysis, to group the IA teacher users according to their diverse online behaviors. The use of LCA successfully helped us identify different types of users, ranging from window shoppers, lukewarm users to the most dedicated users, and distinguish the isolated users …


The Uva Bay Game:Complex Systems, Interdisciplinary Collaboration, And Institutional Renewal, J. Plank, David F. Feldon, W. Sherman, J. Elliott Jan 2011

The Uva Bay Game:Complex Systems, Interdisciplinary Collaboration, And Institutional Renewal, J. Plank, David F. Feldon, W. Sherman, J. Elliott

Instructional Technology and Learning Sciences Faculty Publications

Research-intensive universities enjoy—or suffer—a paradoxical reputation: They are thought to be dedicated to both cutting-edge research and to the preservation of the canon. They are seen as broad and diverse communities of scholars with a vibrant collective intellectual life, yet also as silos of disciplinary entrenchment. Most significantly, they are thought of as places where the complex problems of our society are studied intensely but from which solutions are rarely forthcoming.


Aligning Game Activity With Educational Goals: Following A Constrained Design Approach To Instructional Computer Games, Brett E. Shelton, Jon Scoresby Jan 2011

Aligning Game Activity With Educational Goals: Following A Constrained Design Approach To Instructional Computer Games, Brett E. Shelton, Jon Scoresby

Instructional Technology and Learning Sciences Faculty Publications

We discuss the design, creation and implementation of an instructional game for use in a high school poetry class following a commitment to an educational game design principle of alignment. We studied groups of instructional designers and an interactive fiction computer game they built. The game was implemented in a 9th grade English classroom to see if the designed alignments were realized in the classroom. Results from observations and collected design artifacts suggest the alignment theory created extra challenges and rewards for the game designers. They encountered tensions between creating an exciting game-like atmosphere with inventive programming techniques while …


An Exploration Into How Physical Activity Data-Recording Devices Could Be Used In Computer-Supported Data Investigations, Victor R. Lee, Maneksha Dumont Dec 2010

An Exploration Into How Physical Activity Data-Recording Devices Could Be Used In Computer-Supported Data Investigations, Victor R. Lee, Maneksha Dumont

Instructional Technology and Learning Sciences Faculty Publications

There is a great potential opportunity to use portable physical activity monitoring devices as data collection tools for educational purposes. Using one such device, we designed and implemented a weeklong workshop with high school students to test the utility of such technology. During that intervention, students performed data investigations of physical activity that culminated in the design and implementation of their own studies. In this paper, we explore some of the mathematical thinking that took place through a series of vignettes of a pair of students engaged in analyzing some of their own activity data. A personal connection to the …


The Best Test Of Ph.D. Studentsuccess: Response, David F. Feldon, Briana Crotwell Timmerman, Michelle Maher Oct 2010

The Best Test Of Ph.D. Studentsuccess: Response, David F. Feldon, Briana Crotwell Timmerman, Michelle Maher

Instructional Technology and Learning Sciences Faculty Publications

Newquist suggests that students' publications are important predictors of post-degree research effectiveness, due in part to the importance of collaboration in innovative research. We agree that publication record is important and helpful, but the collaborative aspects of writing render publications a noisy metric by which to assess individual growth on specific skills (1). The variable time lags between the execution of an experiment, analysis of its data, and publication of findings [e.g., (2)] further limit the ability to identify direct relationships between experiences in a doctoral program and scholarly growth. Doctoral education's overarching goal is to develop competent researchers capable …


How Different Variants Of Orbit Diagrams Influence Students' Explanations Of The Seasons, Victor R. Lee Oct 2010

How Different Variants Of Orbit Diagrams Influence Students' Explanations Of The Seasons, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

The cause of the seasons is often associated with a very particular alternative conception: that the Earth’s orbit around the sun is highly elongated and the differences in distance result in variations in temperature. It has been suggested that the standard diagrams used to depict the Earth’s orbit may be in some way responsible for the initial appearance and overall maintenance of this incorrect conceptualization; the elongated shape of the orbit is thought of as a conceptualization cue that invites a fairly predictable way of reasoning. To test if that is indeed the case, six variants of diagrams depicting differently …


Why Magic Bullets Don't Work, David F. Feldon Jul 2010

Why Magic Bullets Don't Work, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

We always tell our students that there are no shortcuts, that important ideas are nuanced, and that recognizing subtle distinctions is an essential critical-thinking skill. Mastery of a discipline, we know, requires careful study and necessarily slow, evolutionary changes in perspective. Then we look around for the latest promising trend in teaching and jump in with both feet, expecting it to transform our students, our courses, and our outcomes. Alternatively, we sniff disdainfully at the current educational fad and proudly stand by the instructional traditions of our disciplines or institutions, secure in our knowledge that the “tried and true” has …


Where In The World? Demographic Patterns In Access Data, Mimi Recker, Beijie Xu, Sherry Hsi, Christine Garrard Jun 2010

Where In The World? Demographic Patterns In Access Data, Mimi Recker, Beijie Xu, Sherry Hsi, Christine Garrard

Instructional Technology and Learning Sciences Faculty Publications

Standard webmetrics tools record the IP address of users’ computers, thereby providing fodder for analyses of their geographical location, and for understanding the impact of e-learning and teaching. Here we describe how two web-based educational systems were engineered to collect geo-referenced data. This is followed by a description of joining these data with demographic and educational datasets for the United States, and mapping different datasets using geographic information system (GIS) techniques to visually display their relationships. Results from statistical analyses of these relationships that highlight areas of significance are given.


Peer Production Of Online Learning Resources: A Social Network Analysis, Beijie Xu, Mimi Recker Jun 2010

Peer Production Of Online Learning Resources: A Social Network Analysis, Beijie Xu, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

This work describes methods for collecting user activity data in a peer production educational system, the Instructional Architect (IA), and then takes a social network perspective in analyzing these data. In particular, rather than focusing on content produced, it focuses on the relationship between users (teachers), and how they can be analyzed to identify important users and like-minded user groups. Our analyses and results provide an example for how to select the most important factors in analyzing the dynamics of an online peer production community using social network analysis metrics, such as in-degree, out-degree, betweenness, clique, and community.


Misconstruals Or More? The Interactions Of Orbit Diagrams And Explanations Of The Seasons, Victor R. Lee Apr 2010

Misconstruals Or More? The Interactions Of Orbit Diagrams And Explanations Of The Seasons, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

This paper examines a “misconstrual hypothesis” regarding diagrams of the Earth’s orbit around the sun and how middle school students explain the cause of the seasons. Drawing from 24 semi-structured interviews, I present qualitative analyses of students’ explanations of why temperatures vary in summer and winter and how those are influenced by the elliptical shape of perspective drawings of the Earth’s orbit, common to many science textbooks. The results of the analysis suggest that diagram interpretation does not necessarily follow what has been often predicted in the literature and that conceptualizations can shift quite rapidly as different diagram features are …


Linking Opencoursewares And Open Education Resources: Creating An Effective Search And Recommendation System, Brett E. Shelton, J. Duffin, Y. Wang, J. Ball Jan 2010

Linking Opencoursewares And Open Education Resources: Creating An Effective Search And Recommendation System, Brett E. Shelton, J. Duffin, Y. Wang, J. Ball

Instructional Technology and Learning Sciences Faculty Publications

With a growing number of digital libraries and other open education repositories being made available throughout the world, effective search and retrieval tools are necessary to access the desired materials that surpass the effectiveness of traditional, all inclusive search engines. This paper discusses the design and use of Folksemantic, a platform that integrates OpenCourseWare search, Open Educational Resource recommendations, and social network functionality into a single open source project. The paper describes how the system was originally envisioned, its goals for users, and data that provides insight into how it is actually being used. Data sources include website click-through data, …


Knowing And Throwing Mudballs, Hearts, Pies, And Flowers: A Connective Ethnography Of Gaming Practices, Deborah A. Fields, Y. B. Kafai Jan 2010

Knowing And Throwing Mudballs, Hearts, Pies, And Flowers: A Connective Ethnography Of Gaming Practices, Deborah A. Fields, Y. B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

Little is known concerning how young players learn to participate in various activities in virtual worlds. We use a new integrative approach called connective ethnography that focuses on how a gaming practice spread across a network of youth at an after school club that simultaneously participated in a virtual world, Whyville.net. To trace youth participation in online and offline social contexts, we draw on multiple sources of information: observations, interviews, videos, online tracking and chat data, and hundreds of hours of play in Whyville ourselves. One gaming practice – the throwing of projectiles and its social uses and nuances – …


Stealing From Grandma Or Generating Knowledge? Constestations And Effects Of Cheating In Whyville, Deborah A. Fields, Y. B. Kafai Jan 2010

Stealing From Grandma Or Generating Knowledge? Constestations And Effects Of Cheating In Whyville, Deborah A. Fields, Y. B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

Much research has described the various practices needed of gaining access and participation in multi-user game communities. Cheat sites are a continuation of game communities where players engage in knowledge building about game related challenges. In this paper we analyze the cheat sites created by players for a tween virtual world called Whyville.net, which encourages youth to participate in a range of social activities and play casual science games. Through analysis we created typologies for both the cheats and sites related to science content. Further, a case study of an exemplary cheat site elaborates on how some player generated sites …


Your Second Selves: Avatar Designs And Identity Play, Y. B. Kafai, Deborah A. Fields, M. S. Cook Jan 2010

Your Second Selves: Avatar Designs And Identity Play, Y. B. Kafai, Deborah A. Fields, M. S. Cook

Instructional Technology and Learning Sciences Faculty Publications

Avatars in online games and worlds are seen as players’ key representations in interactions with each other. In this article, we investigate the avatar design and identity play within a large-scale tween virtual world called Whyville.net, with more than 1.5 million registered players of ages 816. One unique feature of Whyville is the players’ ability to customize their avatars with various face parts and accessories, all designed and sold by other players in Whyville. Our findings report on the expressive resources available for avatar construction, individual tween players’ choices and rationales in creating their avatars, and online postings about avatar …


"Blacks Deserve Bodies Too!" Design And Discussion About Diversity And Race In A Tween Virtual World, Y. B. Kafai, M. S. Cook, Deborah A. Fields Jan 2010

"Blacks Deserve Bodies Too!" Design And Discussion About Diversity And Race In A Tween Virtual World, Y. B. Kafai, M. S. Cook, Deborah A. Fields

Instructional Technology and Learning Sciences Faculty Publications

In this paper, we investigate racial diversity in avatar design and public discussions about race within a large-scale tween virtual world called Whyville.net, with more than 1.5 million registered players of ages 8—16. One unique feature of Whyville is the player’s ability to customize their avatars with various face parts and accessories, all designed and sold by other players in Whyville. Our findings report on the racial diversity of available resources for avatar construction and online postings about the role of race in avatar design and social interactions in the community. With the growing interest in player-generated content for online …


Weedsin The Flower Garden: An Exploration Of Plagiarism In Graduate Students' Research Proposalsand Its Connection To Enculturation, Esl, And Contextual Factors, Joanna Gilmore, Denise Strickland, Briana Timmerman, Michelle Maher, David F. Feldon Jan 2010

Weedsin The Flower Garden: An Exploration Of Plagiarism In Graduate Students' Research Proposalsand Its Connection To Enculturation, Esl, And Contextual Factors, Joanna Gilmore, Denise Strickland, Briana Timmerman, Michelle Maher, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

Existing literature provides insight into the nature and extent of plagiarism amongst undergraduate students (e.g., Ellery, 2008; Parameswaran & Devi, 2006; Selwyn, 2008). Plagiarism amongst graduate students is relatively unstudied, however, and the existing data are largely based on self-reports. This study investigated the rates and potential causes of plagiarism amongst graduate students in master’s and doctoral programmes in science, technology, engineering, mathematics, and science or mathematics education by examining actual research proposals written by graduate students. Results indicate that plagiarism is a prevalent issue at each of the three university sites sampled and across all of the investigated disciplines. …


Adaptations And Continuities In The Use And Design Of Visual Representations In Us Middle School Science Textbooks, Victor R. Lee Jan 2010

Adaptations And Continuities In The Use And Design Of Visual Representations In Us Middle School Science Textbooks, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

Visual representations are ubiquitous in modern‐day science textbooks and have in recent years become an object of criticism and scrutiny. This article examines the extent to which changes in representations in textbooks published in the USA over the past six decades have invited those critiques. Drawing from a correlational analysis of a corpus of 34 US middle school physical science textbooks, continuities are established with respect to the purposes that most textbook images serve and the numbers of schematic representations that are used. Changes are observed in the overall total number of representations in textbooks and in the proportion of …


Educational Data Mining Approaches For Digital Libraries, Mimi Recker, Sherry Hsi, Beijie Xu, Rob Rothfarb Nov 2009

Educational Data Mining Approaches For Digital Libraries, Mimi Recker, Sherry Hsi, Beijie Xu, Rob Rothfarb

Instructional Technology and Learning Sciences Faculty Publications

This collaborative research project between the Exploratorium and Utah State's Department of Instructional Technology and Learning Sciences investigates online evaluation approaches and the application of educational data mining to educational digital libraries and services. Much work over the past decades has focused on developing algorithms and methods for discovering patterns in large datasets, known as Knowledge Discovery from Data (KDD). Webmetrics, the application of KDD to web usage mining, is growing rapidly in areas such as e-commerce. Educational Data Mining (EDM) is just beginning to emerge as a tool to analyze the massive, longitudinal user data that are captured in …


Developoing A Review Rubric For Learning Resources In Digital Libraries, Heather Leary, Sarah Giersch, Andrew Walker, Mimi Recker Jun 2009

Developoing A Review Rubric For Learning Resources In Digital Libraries, Heather Leary, Sarah Giersch, Andrew Walker, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

Over the past 10-15 years, educational digital libraries (DLs) have acquired online learning resources of varying levels of granularity (e.g., from images to entire lessons) and of varying sources of authorship (e.g., grant-funded subject matter experts; K12 teachers; graduate students). The challenge is to balance collecting and providing access to online learning resources while maintaining a level of resource quality that distinguishes DLs from internet search engines. In response, many educational DL builders have established review rubrics.


Assessing The Quality Of Doctoral Dissertation Literature Reviews In Instructional Technology, Melynda Harrison Fitt, Andrew Walker, Heather Leary Apr 2009

Assessing The Quality Of Doctoral Dissertation Literature Reviews In Instructional Technology, Melynda Harrison Fitt, Andrew Walker, Heather Leary

Instructional Technology and Learning Sciences Faculty Publications

Assessment of the doctoral dissertation literature review provides insight into a student’s preparation for future work as a researcher. In 2004, efforts to assess the quality of literature reviews in doctoral dissertations were pioneered by Boote & Beile. Their work represents an important response to the call for improved research skills among emerging scholars. The purpose of this study is to replicate their work in a focused area of educational research, specifically Instructional Technology, and to examine the inter-rater reliability of the rubric. The findings suggest that dissertation literature reviews in Instructional Technology show the same need for improvement as …


Expert Versus Novice Tutors: Impacts On Student Outcomes In Problem-Based Learning, Heather Leary, Andrew Walker, Melynda Harrison Fitt, Brett E. Shelton Apr 2009

Expert Versus Novice Tutors: Impacts On Student Outcomes In Problem-Based Learning, Heather Leary, Andrew Walker, Melynda Harrison Fitt, Brett E. Shelton

Instructional Technology and Learning Sciences Faculty Publications

The tutor is an essential part of problem based learning (PBL). However, tutor characteristics and role are inconsistent. Meta-analysis was used to investigate both the role and training of PBL tutors as moderators of student learning. Weighted effect sizes were calculated on student outcomes with a modest favorable overall effect size for PBL; a vote count shows favorable results as well. Results indicate a mixture of peers and instructors do best when compared to peers and instructors alone. Tutor training appears to make a difference by itself, but when considered with tutor background, tutor training does not appear to moderate …


A Problem Based Learning Meta Analysis: Differences Across Problem Types, Implementation Types, Disciplines, And Assessment Levels, Andrew Walker, Heather Leary Jan 2009

A Problem Based Learning Meta Analysis: Differences Across Problem Types, Implementation Types, Disciplines, And Assessment Levels, Andrew Walker, Heather Leary

Instructional Technology and Learning Sciences Faculty Publications

Problem based learning (PBL) in its most current form originated in Medical Education but has since been used in a variety of disciplines (Savery & Duffy, 1995) at a variety of educational levels (Savery, 2006). Although recent meta analyses have been conducted (Dochy, Segers, Van den Bossche, & Gijbels, 2003; Gijbels, Dochy, Van den Bossche, & Segers, 2005) that attempted to go beyond medical education, they found only one study in economics and were unable to explain large portions of the variance across results. This work builds upon their efforts as a meta-analysis that crosses disciplines as well as categorizes …


Developing A Review Rubric For Learning Resources In Digital Libraries, Heather Leary, Sarah Giersch, Andrew Walker, Mimi Recker Jan 2009

Developing A Review Rubric For Learning Resources In Digital Libraries, Heather Leary, Sarah Giersch, Andrew Walker, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

This paper describes the development of a review rubric for learning resources in the context of the Instructional Architect (IA), a web-based authoring tool. We describe the motivation for developing a review rubric, the process for creating it by synthesizing the rubrics of other education-related digital libraries, and the results of testing the rubric with teachers. Analysis of usability and reliability indicates that the review rubric influences how teachers design online learning resources.