Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 28 of 28

Full-Text Articles in Educational Assessment, Evaluation, and Research

An Exploration Into How Physical Activity Data-Recording Devices Could Be Used In Computer-Supported Data Investigations, Victor R. Lee, Maneksha Dumont Dec 2010

An Exploration Into How Physical Activity Data-Recording Devices Could Be Used In Computer-Supported Data Investigations, Victor R. Lee, Maneksha Dumont

Instructional Technology and Learning Sciences Faculty Publications

There is a great potential opportunity to use portable physical activity monitoring devices as data collection tools for educational purposes. Using one such device, we designed and implemented a weeklong workshop with high school students to test the utility of such technology. During that intervention, students performed data investigations of physical activity that culminated in the design and implementation of their own studies. In this paper, we explore some of the mathematical thinking that took place through a series of vignettes of a pair of students engaged in analyzing some of their own activity data. A personal connection to the …


The Best Test Of Ph.D. Studentsuccess: Response, David F. Feldon, Briana Crotwell Timmerman, Michelle Maher Oct 2010

The Best Test Of Ph.D. Studentsuccess: Response, David F. Feldon, Briana Crotwell Timmerman, Michelle Maher

Instructional Technology and Learning Sciences Faculty Publications

Newquist suggests that students' publications are important predictors of post-degree research effectiveness, due in part to the importance of collaboration in innovative research. We agree that publication record is important and helpful, but the collaborative aspects of writing render publications a noisy metric by which to assess individual growth on specific skills (1). The variable time lags between the execution of an experiment, analysis of its data, and publication of findings [e.g., (2)] further limit the ability to identify direct relationships between experiences in a doctoral program and scholarly growth. Doctoral education's overarching goal is to develop competent researchers capable …


Interaction Online: Above And Beyond The Requirements Of Assessment, Meg O'Reilly, Diane Newton Oct 2010

Interaction Online: Above And Beyond The Requirements Of Assessment, Meg O'Reilly, Diane Newton

Dr Meg O'Reilly

Today’s literature is filled with new paradigms for learning, specifically in relation to the increasing adoption of computer-mediated techniques for interactive learning. In many cases, learning may now be enhanced through the experience of a shared online environment for critical discussion, knowledge building and the establishment of supportive social communities. Research data obtained from social science students at Southern Cross University over two semesters reveals students’ perceptions of the importance of online discussion whether these are assessable or not. This paper presents some findings and explores the impact of the emergence of a student-centred social learning environment.


Using Cross-Disciplinary Action Learning Sets When Designing Online Assessment, Meg O'Reilly Oct 2010

Using Cross-Disciplinary Action Learning Sets When Designing Online Assessment, Meg O'Reilly

Dr Meg O'Reilly

The drive to find appropriate ways to integrate online technologies into assessment has come about within Australian higher education as a consequence of widely held aspirations to remain competitive in the global marketplace. An action research initiative at Southern Cross University reported in this paper suggests both extrinsic and intrinsic reasons why academics considering online assessment may or may not follow through with immediate implementation. More specifically, a crossdisciplinary action learning set in the case study presented has shown benefits in approaching educational design as a cyclical, collegial, creative and reflexive process for planning, implementing and evaluating online assessment.


Educational Design As Transdisciplinary Partnership: Supporting Assessment Design For Online, Meg O'Reilly Oct 2010

Educational Design As Transdisciplinary Partnership: Supporting Assessment Design For Online, Meg O'Reilly

Dr Meg O'Reilly

The design of student assessment for the online context can be a disquieting experience without the support of colleagues and a group of peers from across a range of disciplines with whom to share ideas. This paper reports on interviews conducted with academic “peak performers” as well as some educational design practitioners about the current practices of designing for online assessment. A transdisciplinary approach to educational design is proposed for further exploration.


Resource Directory For Assessing Learners Online, Meg O'Reilly Oct 2010

Resource Directory For Assessing Learners Online, Meg O'Reilly

Dr Meg O'Reilly

To address the need for critical research, and to target access to the wide range of resources in the field of online assessment practices in higher education now published on the Internet itself, a research project has recently commenced at Southern Cross University. This project aims to improve the online assessment practices of academic staff through reflective practice and action research. An accompanying website is under development to provide a directory of resources including examples of the practices and theories pertaining to assessment online, as well as links to published literature. The poster presentation will provide access to this resource …


Educational Design As Transdisciplinary Partnership: Supporting Assessment Design For Online, Meg O'Reilly Oct 2010

Educational Design As Transdisciplinary Partnership: Supporting Assessment Design For Online, Meg O'Reilly

Dr Meg O'Reilly

The design of student assessment for the online context can be a disquieting experience without the support of colleagues and a group of peers from across a range of disciplines with whom to share ideas. This paper reports on interviews conducted with academic “peak performers” as well as some educational design practitioners about the current practices of designing for online assessment. A transdisciplinary approach to educational design is proposed for further exploration.


How Different Variants Of Orbit Diagrams Influence Students' Explanations Of The Seasons, Victor R. Lee Oct 2010

How Different Variants Of Orbit Diagrams Influence Students' Explanations Of The Seasons, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

The cause of the seasons is often associated with a very particular alternative conception: that the Earth’s orbit around the sun is highly elongated and the differences in distance result in variations in temperature. It has been suggested that the standard diagrams used to depict the Earth’s orbit may be in some way responsible for the initial appearance and overall maintenance of this incorrect conceptualization; the elongated shape of the orbit is thought of as a conceptualization cue that invites a fairly predictable way of reasoning. To test if that is indeed the case, six variants of diagrams depicting differently …


Scaffolding Information Literacy With Problem-Based Learning In An Asynchronous Online Environment, Anne Diekema, Wendy Holliday, Heather Leary Sep 2010

Scaffolding Information Literacy With Problem-Based Learning In An Asynchronous Online Environment, Anne Diekema, Wendy Holliday, Heather Leary

Heather Leary, Ph.D.

No abstract provided.


Why Magic Bullets Don't Work, David F. Feldon Jul 2010

Why Magic Bullets Don't Work, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

We always tell our students that there are no shortcuts, that important ideas are nuanced, and that recognizing subtle distinctions is an essential critical-thinking skill. Mastery of a discipline, we know, requires careful study and necessarily slow, evolutionary changes in perspective. Then we look around for the latest promising trend in teaching and jump in with both feet, expecting it to transform our students, our courses, and our outcomes. Alternatively, we sniff disdainfully at the current educational fad and proudly stand by the instructional traditions of our disciplines or institutions, secure in our knowledge that the “tried and true” has …


Thinkfinity Grant Mid- Project Status Report: Differentiations, Roberta Wiener Jun 2010

Thinkfinity Grant Mid- Project Status Report: Differentiations, Roberta Wiener

Cornerstone 1 Reports : Expansion and Enhancements of the Thinkfinity Platform

No abstract provided.


Peer Production Of Online Learning Resources: A Social Network Analysis, Beijie Xu, Mimi Recker Jun 2010

Peer Production Of Online Learning Resources: A Social Network Analysis, Beijie Xu, Mimi Recker

Instructional Technology and Learning Sciences Faculty Publications

This work describes methods for collecting user activity data in a peer production educational system, the Instructional Architect (IA), and then takes a social network perspective in analyzing these data. In particular, rather than focusing on content produced, it focuses on the relationship between users (teachers), and how they can be analyzed to identify important users and like-minded user groups. Our analyses and results provide an example for how to select the most important factors in analyzing the dynamics of an online peer production community using social network analysis metrics, such as in-degree, out-degree, betweenness, clique, and community.


Interaction, Internet Self-Efficacy, And Self-Regulated Learning As Predictors Of Student Satisfaction In Distance Education Courses, Yu-Chun Kuo May 2010

Interaction, Internet Self-Efficacy, And Self-Regulated Learning As Predictors Of Student Satisfaction In Distance Education Courses, Yu-Chun Kuo

All Graduate Theses and Dissertations, Spring 1920 to Summer 2023

Online learning research is largely devoted to comparisons of the learning gains between face-to-face and distance students. While student learning is important, comparatively little is known about student satisfaction when engaged in online learning and what contributes to or promotes student satisfaction. Emerging research suggests there are a few strong predictors of student satisfaction, and other predictors that may or may not predict student satisfaction. None of the existing research examines predictors together, or statistically controls for course differences. This study examines the influence of various factors on student satisfaction including three types of interaction, Internet self-efficacy, and self-regulated learning. …


A Meta-Analysis Of Problem-Based Learning Corrected For Attenuation, And Accounting For Internal Threats, Brian Belland, Andrew Walker, Heather Leary, Yu-Chun Kuo, Gulfidan Can Apr 2010

A Meta-Analysis Of Problem-Based Learning Corrected For Attenuation, And Accounting For Internal Threats, Brian Belland, Andrew Walker, Heather Leary, Yu-Chun Kuo, Gulfidan Can

Heather Leary, Ph.D.

No abstract provided.


Rich Visual Media Meta-Analyses For Learning: An Approach At Meta-Synthesis, Heather Leary, Brett Shelton, Andrew Walker Apr 2010

Rich Visual Media Meta-Analyses For Learning: An Approach At Meta-Synthesis, Heather Leary, Brett Shelton, Andrew Walker

Heather Leary, Ph.D.

No abstract provided.


Misconstruals Or More? The Interactions Of Orbit Diagrams And Explanations Of The Seasons, Victor R. Lee Apr 2010

Misconstruals Or More? The Interactions Of Orbit Diagrams And Explanations Of The Seasons, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

This paper examines a “misconstrual hypothesis” regarding diagrams of the Earth’s orbit around the sun and how middle school students explain the cause of the seasons. Drawing from 24 semi-structured interviews, I present qualitative analyses of students’ explanations of why temperatures vary in summer and winter and how those are influenced by the elliptical shape of perspective drawings of the Earth’s orbit, common to many science textbooks. The results of the analysis suggest that diagram interpretation does not necessarily follow what has been often predicted in the literature and that conceptualizations can shift quite rapidly as different diagram features are …


Interaction Online: Above And Beyond The Requirements Of Assessment, Meg O'Reilly, Diane Newton Jan 2010

Interaction Online: Above And Beyond The Requirements Of Assessment, Meg O'Reilly, Diane Newton

Dr Meg O'Reilly

Today’s literature is filled with new paradigms for learning, specifically in relation to the increasing adoption of computer-mediated techniques for interactive learning. In many cases, learning may now be enhanced through the experience of a shared online environment for critical discussion, knowledge building and the establishment of supportive social communities. Research data obtained from social science students at Southern Cross University over two semesters reveals students’ perceptions of the importance of online discussion whether these are assessable or not. This paper presents some findings and explores the impact of the emergence of a student-centred social learning environment.


Assessing Technology Literacy: The Case For An Authentic, Project-Based Learning Approach, Jonathan D. Becker, Cherise A. Hodge, Mary W. Sepelyak Jan 2010

Assessing Technology Literacy: The Case For An Authentic, Project-Based Learning Approach, Jonathan D. Becker, Cherise A. Hodge, Mary W. Sepelyak

Educational Leadership Publications

This whitepaper takes a comprehensive look at the research, policies, and practices of technology literacy in K-12 settings in the United States. It builds a research-based case for the central importance of "doing" as part of technology literacy, meaning more than just being able to answer canned questions on a test. It also explores the current approaches to develop meaningful assessment of student technology literacy at a national, state, and local level, including TechYES.


"Blacks Deserve Bodies Too!" Design And Discussion About Diversity And Race In A Tween Virtual World, Y. B. Kafai, M. S. Cook, Deborah A. Fields Jan 2010

"Blacks Deserve Bodies Too!" Design And Discussion About Diversity And Race In A Tween Virtual World, Y. B. Kafai, M. S. Cook, Deborah A. Fields

Instructional Technology and Learning Sciences Faculty Publications

In this paper, we investigate racial diversity in avatar design and public discussions about race within a large-scale tween virtual world called Whyville.net, with more than 1.5 million registered players of ages 8—16. One unique feature of Whyville is the player’s ability to customize their avatars with various face parts and accessories, all designed and sold by other players in Whyville. Our findings report on the racial diversity of available resources for avatar construction and online postings about the role of race in avatar design and social interactions in the community. With the growing interest in player-generated content for online …


Confidence-Based Assessment In Moodle: Insights From Teachers, Administrators, And Programmers, Timothy P. Florian Jan 2010

Confidence-Based Assessment In Moodle: Insights From Teachers, Administrators, And Programmers, Timothy P. Florian

Walden Dissertations and Doctoral Studies

Critical thinking is a skill that school systems are trying to develop in their student populations. Numerous studies have been conducted on developing critical thinking skills such as self-regulation, interpretation, and analysis. However, available data on the use of learning management systems (LMS) as a means to develop critical-thinking skills have been opaque. This study examined the perceptions of local stakeholders and the impact of confidence-based assessment (CBA) on secondary students at one high school. The conceptual framework guiding the study represented a synthesis of theoretical perspectives on critical thinking and its development with the current research on the pedagogical …


Weedsin The Flower Garden: An Exploration Of Plagiarism In Graduate Students' Research Proposalsand Its Connection To Enculturation, Esl, And Contextual Factors, Joanna Gilmore, Denise Strickland, Briana Timmerman, Michelle Maher, David F. Feldon Jan 2010

Weedsin The Flower Garden: An Exploration Of Plagiarism In Graduate Students' Research Proposalsand Its Connection To Enculturation, Esl, And Contextual Factors, Joanna Gilmore, Denise Strickland, Briana Timmerman, Michelle Maher, David F. Feldon

Instructional Technology and Learning Sciences Faculty Publications

Existing literature provides insight into the nature and extent of plagiarism amongst undergraduate students (e.g., Ellery, 2008; Parameswaran & Devi, 2006; Selwyn, 2008). Plagiarism amongst graduate students is relatively unstudied, however, and the existing data are largely based on self-reports. This study investigated the rates and potential causes of plagiarism amongst graduate students in master’s and doctoral programmes in science, technology, engineering, mathematics, and science or mathematics education by examining actual research proposals written by graduate students. Results indicate that plagiarism is a prevalent issue at each of the three university sites sampled and across all of the investigated disciplines. …


Adaptations And Continuities In The Use And Design Of Visual Representations In Us Middle School Science Textbooks, Victor R. Lee Jan 2010

Adaptations And Continuities In The Use And Design Of Visual Representations In Us Middle School Science Textbooks, Victor R. Lee

Instructional Technology and Learning Sciences Faculty Publications

Visual representations are ubiquitous in modern‐day science textbooks and have in recent years become an object of criticism and scrutiny. This article examines the extent to which changes in representations in textbooks published in the USA over the past six decades have invited those critiques. Drawing from a correlational analysis of a corpus of 34 US middle school physical science textbooks, continuities are established with respect to the purposes that most textbook images serve and the numbers of schematic representations that are used. Changes are observed in the overall total number of representations in textbooks and in the proportion of …


Ia Quality Guide, Sarah Giersch, Heather Leary, Mimi Recker Jan 2010

Ia Quality Guide, Sarah Giersch, Heather Leary, Mimi Recker

Instructional Technology and Learning Sciences Research

This is a quality guide geared for the projects in the Instructional Architect. It is used for assessing the quality of the projects created.


Linking Opencoursewares And Open Education Resources: Creating An Effective Search And Recommendation System, Brett E. Shelton, J. Duffin, Y. Wang, J. Ball Jan 2010

Linking Opencoursewares And Open Education Resources: Creating An Effective Search And Recommendation System, Brett E. Shelton, J. Duffin, Y. Wang, J. Ball

Instructional Technology and Learning Sciences Faculty Publications

With a growing number of digital libraries and other open education repositories being made available throughout the world, effective search and retrieval tools are necessary to access the desired materials that surpass the effectiveness of traditional, all inclusive search engines. This paper discusses the design and use of Folksemantic, a platform that integrates OpenCourseWare search, Open Educational Resource recommendations, and social network functionality into a single open source project. The paper describes how the system was originally envisioned, its goals for users, and data that provides insight into how it is actually being used. Data sources include website click-through data, …


Stealing From Grandma Or Generating Knowledge? Constestations And Effects Of Cheating In Whyville, Deborah A. Fields, Y. B. Kafai Jan 2010

Stealing From Grandma Or Generating Knowledge? Constestations And Effects Of Cheating In Whyville, Deborah A. Fields, Y. B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

Much research has described the various practices needed of gaining access and participation in multi-user game communities. Cheat sites are a continuation of game communities where players engage in knowledge building about game related challenges. In this paper we analyze the cheat sites created by players for a tween virtual world called Whyville.net, which encourages youth to participate in a range of social activities and play casual science games. Through analysis we created typologies for both the cheats and sites related to science content. Further, a case study of an exemplary cheat site elaborates on how some player generated sites …


Your Second Selves: Avatar Designs And Identity Play, Y. B. Kafai, Deborah A. Fields, M. S. Cook Jan 2010

Your Second Selves: Avatar Designs And Identity Play, Y. B. Kafai, Deborah A. Fields, M. S. Cook

Instructional Technology and Learning Sciences Faculty Publications

Avatars in online games and worlds are seen as players’ key representations in interactions with each other. In this article, we investigate the avatar design and identity play within a large-scale tween virtual world called Whyville.net, with more than 1.5 million registered players of ages 816. One unique feature of Whyville is the players’ ability to customize their avatars with various face parts and accessories, all designed and sold by other players in Whyville. Our findings report on the expressive resources available for avatar construction, individual tween players’ choices and rationales in creating their avatars, and online postings about avatar …


Knowing And Throwing Mudballs, Hearts, Pies, And Flowers: A Connective Ethnography Of Gaming Practices, Deborah A. Fields, Y. B. Kafai Jan 2010

Knowing And Throwing Mudballs, Hearts, Pies, And Flowers: A Connective Ethnography Of Gaming Practices, Deborah A. Fields, Y. B. Kafai

Instructional Technology and Learning Sciences Faculty Publications

Little is known concerning how young players learn to participate in various activities in virtual worlds. We use a new integrative approach called connective ethnography that focuses on how a gaming practice spread across a network of youth at an after school club that simultaneously participated in a virtual world, Whyville.net. To trace youth participation in online and offline social contexts, we draw on multiple sources of information: observations, interviews, videos, online tracking and chat data, and hundreds of hours of play in Whyville ourselves. One gaming practice – the throwing of projectiles and its social uses and nuances – …


Author Rights: Knowing Is More Than Half The Battle, Heather Leary, Preston Parker Dec 2009

Author Rights: Knowing Is More Than Half The Battle, Heather Leary, Preston Parker

Heather Leary, Ph.D.

No abstract provided.