Educational Assessment, Evaluation, and Research Commons^™

Educational Technology : A Review Of The Research, Ann Thompson, Michael R. Simonson, Connie Hargrave

Constance P. Hargrave

Educational Technology: A Review of the Research, 2nd Edition was written with the teacher, trainer, graduate student, professor, and media specialist in mind. It provides a brief, yet comprehensive, overview of the theories and research that support the use of technology in teaching and learning. In addition to including a historical perspective on the research and theory foundations of the profession of educational technology, Educational Technology: A Review of the Research, 2nd Edition presents current research that constitutes the basis for use of newer technologies.

Tablets As Powerful Tools For University Research: Teaching The Relevant Skills, Robin Canuel, Chad Crichton, Maria Savova

Maria Savova

The increasing popularity of tablet computers in recent years is beginning to transform the way that library users, and in particular postsecondary students and faculty, find and engage with digital content. In response to these changes, university librarians are tailoring information literacy instruction to highlight the advantages of these technologies to their constituencies and to ensure that their users understand the myriad issues involved in effectively leveraging these advantages to improve the efficiency and effectiveness of their research. Chapter 6 of Library Technology Reports (vol. 48, no. 8) “Rethinking Reference and Instruction with Tablets” examines the creation of university library …

Examination Of An Emerging Community Of Practice For Instructional Designers: A Descriptive Case Study In A Midwestern University, Jiaqi Yu, Connie Hargrave

Constance P. Hargrave

This study examined the functioning of a group of instructional designers (IDs) in higher education through the lens of Communities of Practice (CoPs). The study particularly focused on whether and how the grouping of experienced and novice IDs operated as an effective CoP from the perspective of novices. The findings indicated that a group of IDs working in a midwestern university was able to cultivate a CoP within a clearly defined domain, a well-established community, and the shared practice with a specific body of knowledge. Particularly from the perspectives of novices, they highlighted the positive impact while participating in the …

A Study Of Video-Mediated Opportunities For Self-Directed Learning In Required Core Curriculum, Debra T. Bourdeau, Donna Roberts, Beverly Wood, Johnelle Korioth

Beverly Wood

Improving a required course in our curriculum that has proven to be a challenge for our students was the focus of this study. Surveys of both students and instructors attempted to identify specific problem areas. Using the information from these surveys, the researchers developed a series of videos to explain vital course concepts and deployed these into the course sections. The purpose of the videos is to provide consistency across the multiple modalities in which we offer our courses (including online, classroom and via videoconferencing) and to improve overall student understanding. This project seeks to determine how supplemental content focusing …

Problems And Promises Of Using Lms Learner Analytics For Assessment, Valerie Beech, Eric A. Kowalik

Eric A. Kowalik

Session J: Assessment In Interactive Learning Environments, Michael Timms, Jason Lodge

Dr Michael J Timms

There is an increasing interest in using digital technologies to create interactive learning environments (ILEs) that both teach and assess student skills that are hard or impossible to assess using ‘static’ items such as traditional, multiple-choice questions. These interactive learning environments try to do two things simultaneously: firstly, to monitor the learning of the student in real time, providing feedback to help the student progress through the learning task; and secondly, to use the information gathered during the learning to make judgements about where the student is in learning of the topic. Essentially, ILEs draw upon the same source of …

Meeting The Challenge Of Teaching The Millennial Nursing Student In A Neuman-Based Program, Cheryl Bruick Sorge, Becky A. Salmon

Becky A Salmon

No abstract provided.

Meeting The Challenge Of Teaching The Millennial Nursing Student In A Neuman-Based Program, Cheryl Bruick Sorge, Becky A. Salmon

Cheryl L Bruick-Sorge

No abstract provided.

More Than Just Plain Old Technology Adoption: Understanding Variations In Teachers' Use Of An Online Planning Tool, Heather Leary, Victor R. Lee, Mimi Recker

Heather Leary, Ph.D.

This paper examines variability in teachers’ usage patterns as they interacted with an online teacher support tool, the Curriculum Customization Service (CCS), as part of their professional work. The CCS is a web application that supports teachers in planning, adapting, sequencing, and enacting differentiated instruction in Earth science education. By mining the usage log files of over 40 teachers who used the CCS over a yearlong period, we analyzed for variability using a framework developed in marketing research to characterize appropriation of technology. This analysis helped reveal different kinds of teachers’ patterns along two dimensions: frequency and variability of use. …

More Than Just Plain Old Technology Adoption: Understanding Variations In Teachers' Use Of An Online Planning Tool, Heather Leary, Victor R. Lee, Mimi Recker

Heather Leary, Ph.D.

This paper examines variability in teachers’ usage patterns as they interacted with an online teacher support tool, the Curriculum Customization Service (CCS), as part of their professional work. The CCS is a web application that supports teachers in planning, adapting, sequencing, and enacting differentiated instruction in Earth science education. By mining the usage log files of over 40 teachers who used the CCS over a yearlong period, we analyzed for variability using a framework developed in marketing research to characterize appropriation of technology. This analysis helped reveal different kinds of teachers’ patterns along two dimensions: frequency and variability of use. …

Standards For Educational, Edutainment, And Developmentally Beneficial Computer Games, R. Peterson, I. Verenikina, J. Herrington

I. Verenikina

The results of a comprehensive review of the body of research concerning the developmental and educational value of computer gaming for children is reported. Based on the review, design criteria are proposed for educational and edutainment computer games. In addition, a hierarchy of educational, edutainment, and entertainment game categories is introduced. It is argued that a standard educational labeling system is needed to assist parents and teachers with selecting computer games. A gap in the research is highlighted with regard to the affordances of computer games to facilitate the development of young children’s higher order thinking. It is recommended that …

Facilitating Teachers’ Thinking About Pedagogy And Technology With An Online Curriculum Planning Tool, Kirsten R. Butcher, Heather Leary, James Foster, Holly Devaul

Heather Leary, Ph.D.

The current study analyzed the impact of a year-long adoption of an online curriculum planning tool on teachers’ thinking about content and pedagogy, as well as their use of technology in the classroom. The online planning tool was adopted district-wide following professional development training with the purpose of supporting teachers’ development of differentiated, student-centered instruction with digital resources. Structured interviews with high school science teachers were used to determine how teachers’ thinking about key concepts and instruction changed during the course of technology adoption. Verbal protocol analysis was used to code interviews, using comprehension theory and national reform approaches in …

A Critical Examination Of Food Technology, Innovation And Teacher Education : A Technacy Genre Theory Perspective, Angela Frances Turner

Dr Angela Turner

There are many and varied forces that shape food technology curriculum, but two that emerge as significant and of specific interest to this research are the perceptions of food technology education and economic trends that influence food technology. The broad goal was to examine the extent to which food technology in secondary schooling is well placed to meet emerging policy and economic demand for food innovation expertise in the industry. With both the school sector and the professional sector each asserting that their respective perceptions of Food Technology was correct, a method for clarifying and classifying the nature of the …

Session N - Simscientists : An Example Of How Technology Can Support Differentiated Instruction In The Classroom, Michael Timms

Dr Michael J Timms

Concurrent Session Block 3

Self-Directed Learning In Problem-Based Learning: A Meta-Analysis, Heather Leary, Andrew Walker, Brett E. Shelton

Heather Leary, Ph.D.

This paper presents a meta-analysis focused on self-directed learning in problem-based learning when compared with a traditional learning approach. A total of 75 outcomes from 38 studies were used in the analysis which resulted in a statistically significant overall medium effect size of g = 0.45, favoring problem-based learning. Subgroup analyses conducted focused on four aspects of self-directed learning. Both personal autonomy (g = 0.51, z(47) = 6.4, p = 0.01) and independent pursuit of learning (g = 0.66, z(2) = 3.49, p = 0.01) report statistically significant positive effect sizes. Three of eight disciplines reported statistically significant effect sizes …

Comparing Technology-Related Teacher Professional Development Designs: A Multilevel Study Of Teacher And Student Impacts, Andrew Walker, Mimi Recker, Lei Ye, Linda Sellers, Heather Leary, M. Brooke Robertshaw

Heather Leary, Ph.D.

No abstract provided.

Integrating Technology And Problem-Based Learning: A Mixed Methods Study Of Two Teacher Professional Development Designs, Andrew Walker, Mimi Recker, M. Brooke Robertshaw, Jeffrey Osen, Heather Leary, Lei Ye, Linda Sellers

Heather Leary, Ph.D.

This article describes two consecutive enactments of technology-oriented teacher professional development designs, aimed at helping teachers find high-quality online learning resources and use them in designing effective problem-based learning (PBL) activities for their students. To align with current professional development prescriptions, in the first enactment, teachers learned PBL design skills concurrently with technology skills. Following aspects of design-based research, the professional development theory, participant feedback, and results from the first enactment informed the design of the second. In this second enactment, technology skills were separated and presented prior to learning about PBL. Results from a mixed-methods study of impact indicated …

Instructional Architect Teacher Professional Development Handouts, Mimi Recker, Andrew Walker, M. Brooke Robertshaw, Linda Sellers, Heather M. Leary

Linda Sellers

Three handouts for the teacher professional development workshops on the Instructional Architect (IA). Starting spring 2009 the face-to-face workshop was changed to be three different days of learning about how to use the IA, inquiry based and problem based learning, evaluation of IA projects with a rubric, and creating IA projects.

School Librarians And Technology: Integrating Online Resources For Teaching, Linda Sellers, Heather Leary

Heather Leary, Ph.D.

No abstract provided.

Teaching Use Of Digital Primary Sources For K-12 Settings, Anne R. Diekema, Heather Leary, Sheri Haderlie, Cheryl D. Walters

Heather Leary, Ph.D.

This paper describes learning outcomes of a three-day workshop on integrating primary sources into K-12 teaching. The short curriculum — intended for teams of teachers and school librarians — combined visits to a museum and a library's special collections with an introduction to significant national and local digital collections of primary sources. The paper draws on focus group data, reflection papers, and a conference presentation by the workshop participants as well as curricular artifacts presented to the workshop instructors. Using their workshop experience, teachers integrated digitized primary sources into their curricula thereby creating quality instructional content that engaged students' interest. …

Modeling Teacher Ratings Of Online Resources: A Human-Machine Approach To Quality, Mimi Recker, Heather Leary, Andrew Walker, Anne Diekema, Philipp Wetzler, Tamara Sumner, James Martin

Heather Leary, Ph.D.

In education, the scalable deployment of media-rich online resources supports peer production in ways that promise to radically transform teaching and learning (CRA, 2005; Pea et al., 2008). Online educational repositories such as the Digital Library for Earth Systems Education (DLESE.org) and the National Science Digital Library (NSDL.org) collect and curate online learning resources created for a wide range of educational audiences and subject areas (McArthur & Zia, 2008). Through a simple, web-based authoring tool, called the Instructional Architect (IA.usu.edu) teachers locate and share educational resources and activities in an IA project. These IA projects can then be viewed, copied, …

Developing And Using A Review Rubric To Assess Learning Resource Quality In Educational Digital Libraries, Heather Leary, Sarah Giersch, Andrew Walker, Mimi Recker

Heather Leary, Ph.D.

No abstract provided.

Interaction Online: Above And Beyond The Requirements Of Assessment, Meg O'Reilly, Diane Newton

Dr Meg O'Reilly

Today’s literature is filled with new paradigms for learning, specifically in relation to the increasing adoption of computer-mediated techniques for interactive learning. In many cases, learning may now be enhanced through the experience of a shared online environment for critical discussion, knowledge building and the establishment of supportive social communities. Research data obtained from social science students at Southern Cross University over two semesters reveals students’ perceptions of the importance of online discussion whether these are assessable or not. This paper presents some findings and explores the impact of the emergence of a student-centred social learning environment.

Using Cross-Disciplinary Action Learning Sets When Designing Online Assessment, Meg O'Reilly

Dr Meg O'Reilly

The drive to find appropriate ways to integrate online technologies into assessment has come about within Australian higher education as a consequence of widely held aspirations to remain competitive in the global marketplace. An action research initiative at Southern Cross University reported in this paper suggests both extrinsic and intrinsic reasons why academics considering online assessment may or may not follow through with immediate implementation. More specifically, a crossdisciplinary action learning set in the case study presented has shown benefits in approaching educational design as a cyclical, collegial, creative and reflexive process for planning, implementing and evaluating online assessment.

Educational Design As Transdisciplinary Partnership: Supporting Assessment Design For Online, Meg O'Reilly

Dr Meg O'Reilly

The design of student assessment for the online context can be a disquieting experience without the support of colleagues and a group of peers from across a range of disciplines with whom to share ideas. This paper reports on interviews conducted with academic “peak performers” as well as some educational design practitioners about the current practices of designing for online assessment. A transdisciplinary approach to educational design is proposed for further exploration.

Resource Directory For Assessing Learners Online, Meg O'Reilly

Dr Meg O'Reilly

To address the need for critical research, and to target access to the wide range of resources in the field of online assessment practices in higher education now published on the Internet itself, a research project has recently commenced at Southern Cross University. This project aims to improve the online assessment practices of academic staff through reflective practice and action research. An accompanying website is under development to provide a directory of resources including examples of the practices and theories pertaining to assessment online, as well as links to published literature. The poster presentation will provide access to this resource …

Educational Design As Transdisciplinary Partnership: Supporting Assessment Design For Online, Meg O'Reilly

Dr Meg O'Reilly

The design of student assessment for the online context can be a disquieting experience without the support of colleagues and a group of peers from across a range of disciplines with whom to share ideas. This paper reports on interviews conducted with academic “peak performers” as well as some educational design practitioners about the current practices of designing for online assessment. A transdisciplinary approach to educational design is proposed for further exploration.

Interaction Online: Above And Beyond The Requirements Of Assessment, Meg O'Reilly, Diane Newton

Dr Meg O'Reilly

Today’s literature is filled with new paradigms for learning, specifically in relation to the increasing adoption of computer-mediated techniques for interactive learning. In many cases, learning may now be enhanced through the experience of a shared online environment for critical discussion, knowledge building and the establishment of supportive social communities. Research data obtained from social science students at Southern Cross University over two semesters reveals students’ perceptions of the importance of online discussion whether these are assessable or not. This paper presents some findings and explores the impact of the emergence of a student-centred social learning environment.

A Problem Based Learning Meta Analysis: Differences Across Problem Types, Implementation Types, Disciplines, And Assessment Levels, Andrew Walker, Heather Leary

Heather Leary, Ph.D.

Problem based learning (PBL) in its most current form originated in Medical Education but has since been used in a variety of disciplines (Savery & Duffy, 1995) at a variety of educational levels (Savery, 2006). Although recent meta analyses have been conducted (Dochy, Segers, Van den Bossche, & Gijbels, 2003; Gijbels, Dochy, Van den Bossche, & Segers, 2005) that attempted to go beyond medical education, they found only one study in economics and were unable to explain large portions of the variance across results. This work builds upon their efforts as a meta-analysis that crosses disciplines as well as categorizes …

Using Cross-Disciplinary Action Learning Sets When Designing Online Assessment, Meg O'Reilly

Dr Meg O'Reilly

The drive to find appropriate ways to integrate online technologies into assessment has come about within Australian higher education as a consequence of widely held aspirations to remain competitive in the global marketplace. An action research initiative at Southern Cross University reported in this paper suggests both extrinsic and intrinsic reasons why academics considering online assessment may or may not follow through with immediate implementation. More specifically, a crossdisciplinary action learning set in the case study presented has shown benefits in approaching educational design as a cyclical, collegial, creative and reflexive process for planning, implementing and evaluating online assessment.