Instructional Media Design Commons^™

Misconstruals Or More? The Interactions Of Orbit Diagrams And Explanations Of The Seasons, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

This paper examines a “misconstrual hypothesis” regarding diagrams of the Earth’s orbit around the sun and how middle school students explain the cause of the seasons. Drawing from 24 semi-structured interviews, I present qualitative analyses of students’ explanations of why temperatures vary in summer and winter and how those are influenced by the elliptical shape of perspective drawings of the Earth’s orbit, common to many science textbooks. The results of the analysis suggest that diagram interpretation does not necessarily follow what has been often predicted in the literature and that conceptualizations can shift quite rapidly as different diagram features are …

Linking Opencoursewares And Open Education Resources: Creating An Effective Search And Recommendation System, Brett E. Shelton, J. Duffin, Y. Wang, J. Ball

Instructional Technology and Learning Sciences Faculty Publications

With a growing number of digital libraries and other open education repositories being made available throughout the world, effective search and retrieval tools are necessary to access the desired materials that surpass the effectiveness of traditional, all inclusive search engines. This paper discusses the design and use of Folksemantic, a platform that integrates OpenCourseWare search, Open Educational Resource recommendations, and social network functionality into a single open source project. The paper describes how the system was originally envisioned, its goals for users, and data that provides insight into how it is actually being used. Data sources include website click-through data, …

Knowing And Throwing Mudballs, Hearts, Pies, And Flowers: A Connective Ethnography Of Gaming Practices, Deborah A. Fields, Y. B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

Little is known concerning how young players learn to participate in various activities in virtual worlds. We use a new integrative approach called connective ethnography that focuses on how a gaming practice spread across a network of youth at an after school club that simultaneously participated in a virtual world, Whyville.net. To trace youth participation in online and offline social contexts, we draw on multiple sources of information: observations, interviews, videos, online tracking and chat data, and hundreds of hours of play in Whyville ourselves. One gaming practice – the throwing of projectiles and its social uses and nuances – …

Stealing From Grandma Or Generating Knowledge? Constestations And Effects Of Cheating In Whyville, Deborah A. Fields, Y. B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

Much research has described the various practices needed of gaining access and participation in multi-user game communities. Cheat sites are a continuation of game communities where players engage in knowledge building about game related challenges. In this paper we analyze the cheat sites created by players for a tween virtual world called Whyville.net, which encourages youth to participate in a range of social activities and play casual science games. Through analysis we created typologies for both the cheats and sites related to science content. Further, a case study of an exemplary cheat site elaborates on how some player generated sites …

Your Second Selves: Avatar Designs And Identity Play, Y. B. Kafai, Deborah A. Fields, M. S. Cook

Instructional Technology and Learning Sciences Faculty Publications

Avatars in online games and worlds are seen as players’ key representations in interactions with each other. In this article, we investigate the avatar design and identity play within a large-scale tween virtual world called Whyville.net, with more than 1.5 million registered players of ages 816. One unique feature of Whyville is the players’ ability to customize their avatars with various face parts and accessories, all designed and sold by other players in Whyville. Our findings report on the expressive resources available for avatar construction, individual tween players’ choices and rationales in creating their avatars, and online postings about avatar …

"Blacks Deserve Bodies Too!" Design And Discussion About Diversity And Race In A Tween Virtual World, Y. B. Kafai, M. S. Cook, Deborah A. Fields

Instructional Technology and Learning Sciences Faculty Publications

In this paper, we investigate racial diversity in avatar design and public discussions about race within a large-scale tween virtual world called Whyville.net, with more than 1.5 million registered players of ages 8—16. One unique feature of Whyville is the player’s ability to customize their avatars with various face parts and accessories, all designed and sold by other players in Whyville. Our findings report on the racial diversity of available resources for avatar construction and online postings about the role of race in avatar design and social interactions in the community. With the growing interest in player-generated content for online …

Weedsin The Flower Garden: An Exploration Of Plagiarism In Graduate Students' Research Proposalsand Its Connection To Enculturation, Esl, And Contextual Factors, Joanna Gilmore, Denise Strickland, Briana Timmerman, Michelle Maher, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

Existing literature provides insight into the nature and extent of plagiarism amongst undergraduate students (e.g., Ellery, 2008; Parameswaran & Devi, 2006; Selwyn, 2008). Plagiarism amongst graduate students is relatively unstudied, however, and the existing data are largely based on self-reports. This study investigated the rates and potential causes of plagiarism amongst graduate students in master’s and doctoral programmes in science, technology, engineering, mathematics, and science or mathematics education by examining actual research proposals written by graduate students. Results indicate that plagiarism is a prevalent issue at each of the three university sites sampled and across all of the investigated disciplines. …

Adaptations And Continuities In The Use And Design Of Visual Representations In Us Middle School Science Textbooks, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

Visual representations are ubiquitous in modern‐day science textbooks and have in recent years become an object of criticism and scrutiny. This article examines the extent to which changes in representations in textbooks published in the USA over the past six decades have invited those critiques. Drawing from a correlational analysis of a corpus of 34 US middle school physical science textbooks, continuities are established with respect to the purposes that most textbook images serve and the numbers of schematic representations that are used. Changes are observed in the overall total number of representations in textbooks and in the proportion of …

Educational Data Mining Approaches For Digital Libraries, Mimi Recker, Sherry Hsi, Beijie Xu, Rob Rothfarb

Instructional Technology and Learning Sciences Faculty Publications

This collaborative research project between the Exploratorium and Utah State's Department of Instructional Technology and Learning Sciences investigates online evaluation approaches and the application of educational data mining to educational digital libraries and services. Much work over the past decades has focused on developing algorithms and methods for discovering patterns in large datasets, known as Knowledge Discovery from Data (KDD). Webmetrics, the application of KDD to web usage mining, is growing rapidly in areas such as e-commerce. Educational Data Mining (EDM) is just beginning to emerge as a tool to analyze the massive, longitudinal user data that are captured in …

Expert Versus Novice Tutors: Impacts On Student Outcomes In Problem-Based Learning, Heather Leary, Andrew Walker, Melynda Harrison Fitt, Brett E. Shelton

Instructional Technology and Learning Sciences Faculty Publications

The tutor is an essential part of problem based learning (PBL). However, tutor characteristics and role are inconsistent. Meta-analysis was used to investigate both the role and training of PBL tutors as moderators of student learning. Weighted effect sizes were calculated on student outcomes with a modest favorable overall effect size for PBL; a vote count shows favorable results as well. Results indicate a mixture of peers and instructors do best when compared to peers and instructors alone. Tutor training appears to make a difference by itself, but when considered with tutor background, tutor training does not appear to moderate …

Assessing The Quality Of Doctoral Dissertation Literature Reviews In Instructional Technology, Melynda Harrison Fitt, Andrew Walker, Heather Leary

Instructional Technology and Learning Sciences Faculty Publications

Assessment of the doctoral dissertation literature review provides insight into a student’s preparation for future work as a researcher. In 2004, efforts to assess the quality of literature reviews in doctoral dissertations were pioneered by Boote & Beile. Their work represents an important response to the call for improved research skills among emerging scholars. The purpose of this study is to replicate their work in a focused area of educational research, specifically Instructional Technology, and to examine the inter-rater reliability of the rubric. The findings suggest that dissertation literature reviews in Instructional Technology show the same need for improvement as …

A Problem Based Learning Meta Analysis: Differences Across Problem Types, Implementation Types, Disciplines, And Assessment Levels, Andrew Walker, Heather Leary

Instructional Technology and Learning Sciences Faculty Publications

Problem based learning (PBL) in its most current form originated in Medical Education but has since been used in a variety of disciplines (Savery & Duffy, 1995) at a variety of educational levels (Savery, 2006). Although recent meta analyses have been conducted (Dochy, Segers, Van den Bossche, & Gijbels, 2003; Gijbels, Dochy, Van den Bossche, & Segers, 2005) that attempted to go beyond medical education, they found only one study in economics and were unable to explain large portions of the variance across results. This work builds upon their efforts as a meta-analysis that crosses disciplines as well as categorizes …

Developing A Review Rubric For Learning Resources In Digital Libraries, Heather Leary, Sarah Giersch, Andrew Walker, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

This paper describes the development of a review rubric for learning resources in the context of the Instructional Architect (IA), a web-based authoring tool. We describe the motivation for developing a review rubric, the process for creating it by synthesizing the rubrics of other education-related digital libraries, and the results of testing the rubric with teachers. Analysis of usability and reliability indicates that the review rubric influences how teachers design online learning resources.

Validity And Problem-Based Learning Research: A Review Of Instruments Used To Assess Intended Learning Outcomes, Brian Robert Belland, Brian F. French, Peggy A. Ertmer

Instructional Technology and Learning Sciences Faculty Publications

Problem-based learning (PBL) spread from the medical school to other university and K-12 contexts due, in part, to the stated promise that PBL produces the target outcomes of deep content learning, increased problem-solving ability, and increased self-directed learning (Hmelo-Silver, 2004). However, research results have been unclear. This paper examines how the three target outcomes of PBL were measured in 33 empirical studies. Results indicate that few studies included 1) theoretical frameworks for the assessed variables and constructs, 2) rationales for how chosen assessments matched the constructs measured, or 3) other information required for readers to assess the validity of authors’ …

What Do Students Gain From A Week At Science Camp? Youth Perceptions And The Design Of An Immersive Research-Oriented Astronomy Camp, Deborah A. Fields

Instructional Technology and Learning Sciences Faculty Publications

This study explored American high school students’ perceptions of the benefits of a summer astronomy camp, emphasizing a full cycle of the research process and how the organization of the camp contributed to those perceptions. Semi-structured interviews with students and staff were used to elicit the specific benefits that campers perceived from their experiences and examine them in relation to the stated goals and strategies of camp staff. Among the perceived benefits that students described were peer relationships, personal autonomy, positive relationships with staff, and deepened science knowledge. These perceived benefits appear to influence the kinds of identities students constructed …

A Connective Ethnography Of Peer Knowledge Sharing And Diffusion In A Tween Virtual World, Deborah A. Fields, Y. B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

Prior studies have shown how knowledge diffusion occurs in classrooms and structured small groups around assigned tasks yet have not begun to account for widespread knowledge sharing in more native, unstructured group settings found in online games and virtual worlds. In this paper, we describe and analyze how an insider gaming practice spread across a group of tween players ages 9–12 years in an after-school gaming club that simultaneously participated in a virtual world called Whyville.net. In order to understand how this practice proliferated, we followed the club members as they interacted with each other and members of the virtual …

Problem-Based Educational Games: Connections, Prescriptions, And Assessment, Andrew Walker, Brett E. Shelton

Instructional Technology and Learning Sciences Faculty Publications

The overwhelming success of the commercial game market has brought increased attention to emerging work in educational game design. Much of the existing work in educational games a strong similarity to the field of Problem-Based Learning (PBL), which has a rich history of conceptual literature as well as empirical investigations. Despite apparent similarities between the two fields, there has been no formal effort to explore the connections between them. This conceptual paper examines the basic tenants of PBL with an eye toward making prescriptive recommendations for the design and use of problem-based educational games. Examples within existing educational games are …

Unleashing The Usefulness Of Educational Resources Through Mining Of Educational Metadata, Anne R. Diekama, Jennifer A. Bailey, Blythe A. Bennett, Holly Devaul

Instructional Technology and Learning Sciences Faculty Publications

While there is a strong movement to develop new educational resources to bring students to the competencies represented by educational content standards, it is recognized that there are vast repositories of educational resources already developed that are suitable to address those competencies. However, these resources need to be indexed by national and state standards to make them accessible for teachers who are increasingly required to teach to certain educational standards (Diekema and Chen, 2005). In the early 1980s, a perceived a crisis in the American education system encouraged the creation of national standards by professional subject-area organizations such as the …

The Design And Use Of Simulation Computer Games In Education, Brett E. Shelton, David A. Wiley

Instructional Technology and Learning Sciences Faculty Publications

This book, edited by Brett Shelton and David Wiley, is a view of models and simulations for education and research.

Table of Contents

1. In Praise of Epistemology - David Shaffer

2. Six Ideas in Search of a Discipline - Richard Van Eck

3. Building Bridges Between Serious Game Design and Instructional Design - Jamie Kirkley, Sonny Kirkley and Jerry Heneghan

4. Layered Design in an Instructional Simulation - Andrew S. Gibbons and Stefan Sommer

5. Designing Educational Games for Activity-Goal Alignment - Brett E. Shelton

6. "The Peripatos Could Not have Looked Like That," and Other Educational Outcomes From …

The Underutilization Of Internet And Communication Technology-Assisted Collaborative Project-Based Learning Among International Educators: A Delphi Study, Barry S. Kramer, Andrew Walker, Jennifer M. Brill

Instructional Technology and Learning Sciences Faculty Publications

This study explores the barriers associated with teachers implementing Internet and Communication Technology-assisted Collaborative Project-based Learning (ICTCPrjBL) as a classroom teaching methodology with students. We used a Web-based Delphi method to engage experienced educators in anonymous consensus building consisting of three rounds of surveys. The Round 1 analysis yielded 51 barriers. The Round 2 analysis produced descriptive statistics (range, mean, and standard deviation) on the importance of each barrier. The Round 3 analysis confirmed 16 of the 51 (31.4%) barriers as “moderately significant” to “very significant” to implementing ICTCPrjBL. Important contributions of this study include: (a) identification of barriers to …

Pedagogical Agents As Social Models To Influence Learner Attitudes, Yanghee Kim, A. Baylor

Instructional Technology and Learning Sciences Faculty Publications

Based on social-cognitive theory, we describe the role of pedagogical agents as “social models.” In several experimental studies we have found that pedagogical agents as social models can effectively persuade and motivate learners. We briefly describe two on-going projects where agents as social models are employed to enhance young women’s motivation and attitudes toward math and engineering.

Text Categorization For Aligning Educational Standards, O. Yilmazel, N. Balasubramanian, S. C. Harwell, J. Bailey, Anne R. Diekama, E. D. Liddy

Instructional Technology and Learning Sciences Faculty Publications

Standard alignment (where standards describing similar concepts are correlated) is a necessary task in providing full access to educational resources. Manual alignment is time consuming and expensive. We propose an automatic alignment system, using machine learning techniques utilizing natural language processing. In this paper we discuss our experiments on text categorization for automatic alignment. We explore the role of relevant vocabulary sets in automatic alignment.

Desirable Characteristics Of Learning Companions, Yanghee Kim

Instructional Technology and Learning Sciences Faculty Publications

This study investigated the desirable characteristics of anthropomorphized learning-companion agents for college students. First, interviews with six undergraduates explored their concepts of desirable learning companions. The interviews yielded agent competency, agent personality, and interaction control. Next, a controlled experiment examined whether learner competency (strong vs. weak) would relate directly to agent competency (high vs. low) and to interaction control (agent-control vs. learner-control). The dependent measures included learners' perceptions of agent functionality, their self-efficacy beliefs in the task, and their learning. The results indicated that academically strong students perceived the high-competent agent higher than the lowcompetent agent and showed higher self-efficacy …

Designing Educational Games For Activity-Goal Alignment, Brett E. Shelton

Instructional Technology and Learning Sciences Faculty Publications

What indeed, can we expect from our newest trend in education, implementing moving pictures and conversations with instruction through simulation games? Lewis Carroll's familiar narratives Alice's Adventures in Wonderland and Alice Through the Looking Glass provide helpful imagery for many of the queries, explorations and assumptions we currently make about this latest Wonderland of academia. So what are the goals for the designers and researchers of educational games, or perhaps more importantly, what should be the goals?

Perspectives On Teachers As Digital Library Users: Consumers, Contributors, And Designers, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

"...freed of the constraints of physical space and media, digital libraries can be more adaptive and reflective of the communities they serve. They should be collaborative, allowing users to contribute knowledge to the library, either actively through annotations, reviews, and the like, or passively through their patterns of resource use. In addition, they should be contextual, expressing the expanding web of inter-relationships and layers of knowledge that extend among selected primary resources. In this manner, the core of the digital library should be an evolving information base, weaving together professional selection and the 'wisdom of crowds.'" (Lagoze, Krafft, Payette, & …

The Competencies And Characteristics Required Of An Effective Project Manager: A Web-Based Delphi Study, Jennifer M. Brill, M. J. Bishop, Andrew Walker

Instructional Technology and Learning Sciences Faculty Publications

This study explores the competencies required for a project manager to be effective in the workplace. We used a Web-based Delphi method to lead experienced project managers through an anonymous consensus-building process consisting of two rounds of surveys. The Round I analysis of 147 respondents, all with 20 or more years of project management experience, yielded 117 project management success factors, 78 of which were identified as “trainable” competencies. The Round II analysis confirmed 42 of the 78 competencies (53.8%) as “very important” to “extremely important” to project manager success. Important contributions of this study include: (a) reporting on project …

A Design-Based Research Strategy To Promote Scalability For Educational Innovations, Jody Clarke-Midura, C. Dede, D. J. Ketelhut, B. Nelson, C. Bowman

Instructional Technology and Learning Sciences Faculty Publications

This article offers insights into how the design of innovations can enhance their “scalability”: the ability to adapt an innovation to effective usage in a wide variety of contexts, including settings where major conditions for success are absent or attenuated. We are implementing the River City MUVE curriculum, a technology-based innovation designed to enhance engagement and learning in middle school science, in a range of educational contexts. Based on our studies of these scaling up activities, we offer examples of design strategies for scalability and describe our plan to develop a “scalability index.”

Perceptions Of The Value Of Problem-Based Learning Among Students With Special Needs And Their Teachers, Brian Robert Belland, P. A. Ertmer, K. D. Simons

Instructional Technology and Learning Sciences Faculty Publications

While problem-based learning (PBL) has been found to be effective with gifted and average students (Hmelo-Silver, 2004), little is known about its impact on students with special needs. This study examines the perceptions of middle-school students with mild, moderate, and severe disabilities and of their teachers regarding the value of participating in a PBL unit. The unit focused on the physical accessibility of a low-SES, rural community where the students’ school was located.We used the constant comparative method (Glaser & Strauss, 1967) to analyze interview data, and used observation data and artifacts to triangulate interview comments. Among the noteworthy findings …

Methodological Challenges For Identifying And Coding Diverse Knowledge Elements In Interview Data, Victor R. Lee, Moshe Krakowski, Bruce Sherin, Megan Bang, Gregory Dam

Instructional Technology and Learning Sciences Faculty Publications

This paper, as part of a symposium on the analysis of clinical interview data and the development of a framework for analyzing students' intuitive science knowledge, identifies and discusses methodological challenges encountered when specifying the knowledge elements and resources are invoked dynamically during a clinical interview. Drawing from interviews with middle school students about the seasons and an analysis of knowledge in terms of 'nodes', two classes of problems are identified: those associated with identification of nodes and those associated with their application as codes to a transcript-based data corpus. We posit that these challenges are common ones associated with …

Design-Based Research Strategies For Developing A Scientific Inquiry Curriculum In A Multi-User Virtual Environment, B. Nelson, D. J. Ketelhut, Jody Clarke-Midura, C. Bowman, C. Dede

Instructional Technology and Learning Sciences Faculty Publications

This National Science Foundation funded project is studying graphical multi-user virtual environments (MUVEs) to investigate whether using this interactive medium in classroom settings can simulate real-world experimentation and can provide students with engaging, meaningful learning experiences that enhance scientific literacy. In the project's River City curriculum, teams of middle school students are asked to collaboratively solve a digital 19th century city's problems with illness, through interaction with digital artifacts, tacit clues, and computer-based 'agents' acting as mentors and colleagues in a virtual community of practice. This article describes the design-based research strategy by which we are currently extending an educational …