Educational Assessment, Evaluation, and Research Commons^™

Virtual Education: Not Yet Ready For Prime Time?, Michael K. Barbour

Education Faculty Publications

The field of K–12 online and blended learning is varied and growing. Regardless of whether a student is enrolled in a brick-and-mortar school and taking one or two courses online, or if they are completing all of their education from a cyber school, more and more students are enrolled in online and blended learning opportunities each school year. Over the past decade, there have been successive legislative and regulatory changes in jurisdiction after jurisdiction designed to encourage this growth in K–12 online and blended learning. Many of these changes have been spurred by proponent claims that K–12 online and blended …

A Global Measure Of Digital And Ict Literacy Skills, John Ainley, Wolfram Schulz, Julian Fraillon

ICT - Digital Literacy

Digital and ICT literacy is considered an important competence for full participation in a knowledge economy and an information society. Consequently, interest at national and international level has emerged to explore the best ways of measuring the extent to which, and how equitably, competence in this area is being achieved. This paper reviews the definitions of digital and ICT literacy that have been adopted in cross-national studies, investigates the approaches to the assessment of digital and ICT literacy that have been employed in those studies and articulates the criteria that should guide the development of a global measure of digital …

Developing A Challenging Online Doctoral Course Using Backward And Three-Phase Design Models, Jan G. Neal, Steven Hampton

Journal of Aviation/Aerospace Education & Research

Current Practices and Future Trends in Aviation (DAV 735)—one of 19 online courses in the Ph.D. in Aviation program at Embry-Riddle Aeronautical University—has run five times since 2011. A team of one instructional designer and one professor were responsible for its initial design, development, and ongoing improvement. This continuity provided the opportunity for a longitudinal, descriptive case study reporting on three wicked instructional design challenges: (a) doctoral student body comprised largely of multidisciplinary aviation professionals, (b) no seminal textbook on the course topics, and (c) unforeseen usability problems with Internet technologies. This case analysis has significance because of the lack …

Pedagogical Considerations For Effectively Teaching Qualitative Research To Students In An Online Environment, Sara Bender, Karlie Hill

All Faculty Scholarship for the College of the Sciences

Qualitative research aims to understand both individual meaning as well as complex systemic interactions as they apply to social problems or individual experiences. This method of research is both inductive and flexible, allowing for a holistic approach that facilitates a rich understanding of the content examined. Past research identifies a number of challenges associated with teaching qualitative methodology to undergraduate students, including: the research skills and values maintained by the instructor, the prestige associated with qualitative research in particular, as well as a number of other interpersonal and environmental factors. These challenges are further complicated, it seems, when extended into …

Developing Distance Education Content Using The Tappa Process, Robert L. Moore

STEMPS Faculty Publications

The proliferation of distance education has occurred alongside the emerging technologies of the Web 2.0 and Web 3.0 environments, changing the way instructors approach, design, and deliver their instructional materials. In the past, instructional design (ID) practitioners relied on instruction system design (ISD) models that focused primarily on macroinstruction. It is now important for these practitioners to use microinstruction strategies to keep pace with the technology evolution. This case study describes the TAPPA (Target, Accomplishment, Past, Prototype, Artifact) Process which was created using the Generic Model for Design Research (GMDR) proposed by McKenney and Reeves (2012) and uses selected ID …

Rn-Bsn Program: On-Demand, Online, Competency-Based Modules, Ladonna Michelle Mcclave

Morehead State Theses and Dissertations

A capstone submitted in partial fulfillment of the requirements for the degree of Doctor of Education in the College of Education at Morehead State University by Ladonna Michelle McClave on December 10, 2015.

Motivating Factors And Barriers To The Online Faculty Professional Development, Kathryn L. Miller

Morehead State Theses and Dissertations

A capstone submitted in partial fulfillment of the requirements for the degree of Doctor of Education in the College of Education at Morehead State University by Kathryn L. Miller on April 16, 2015.

A Phenomenological Study Of The Impact On Collaboration As Perceived By Educators While Using Software To Manage Individualized Education Programs, Vaughn Hammond

Doctoral Dissertations and Projects

The purpose of this qualitative phenomenological study was to gain a deeper, richer understanding of how educators’ use of software to manage individualized education programs (IEPs) impact collaboration in the IEP process. Research questions included: (a) What are the challenges identified by educators when using software to manage IEPs? (b) What are the benefits identified by educators when using software to manage IEPs? (c) What are educators’ perceptions on the impact using software to manage IEPs has on the collaboration among the IEP team? (d) What are educators’ perceptions of the use of software on increasing collaboration skills? Educators from …

Job Satisfaction, Organizational Commitment, And Turnover Intention Of Online Teachers In The K-12 Setting, Ingle M. Larkin

Doctor of Education in Instructional Technology Dissertations

The purpose of this study was to measure and explore factors influencing K-12 online teacher job satisfaction, organizational commitment, and turnover intentions K-12 online education. Using Maslow’s Hierarchy of Needs (1954), Herzberg’s Two-Factor Theory of Satisfaction (1959, 1968), Meyer and Allen’s measure of Organizational Commitment (1997), and Fishbein and Ajzen’s Theory of Reasoned Action and Planned Behavior (1975), this mixed-methods study was conducted in public, private, charter, for-profit, and not-for-profit K-12 online schools in a single Southeastern state. The researcher used a sequential explanatory design by collecting and analyzing quantitative data and then qualitative data in two consecutive phases. Using …

Deaf Children’S Science Content Learning In Direct Instruction Versus Interpreted Instruction, Kim B. Kurz, Brenda Schick, Peter C. Hauser

Journal of Science Education for Students with Disabilities

This research study compared learning of 6-9th grade deaf students under two modes of educational delivery – interpreted vs. direct instruction using science lessons. Nineteen deaf students participated in the study in which they were taught six science lessons in American Sign Language. In one condition, the lessons were taught by a hearing teacher in English and were translated in ASL via a professional and certified interpreter. In the second condition, the lessons were taught to the students in ASL by a deaf teacher. All students saw three lessons delivered via an interpreter and three different lessons in direct ASL; …

What I Taught My Stem Instructor About Teaching: What A Deaf Student Hears That Others Cannot, Annemarie Ross, Randy K. Yerrick

Journal of Science Education for Students with Disabilities

Overall, science teaching at the university level has remained in a relatively static state. There is much research and debate among university faculty regarding the most effective methods of teaching science. But it remains largely rhetoric. The traditional lecture model in STEM higher education is limping along in its march toward inclusion and equity. The NGSS and Common Core reform efforts do little to help university science teachers to change their orientation from largely lecture-driven practice with laboratory supplements. While it is impossible to address all diverse student groups, the need for accommodations tend to be overlooked. As a Deaf …

National Assessment Program : Ict Literacy Years 6 & 10 Report 2014, Julian Fraillon, Wolfram Schulz, Eveline Gebhardt, John Ainley

ICT - Digital Literacy

Literacy in information and communication technology (ICT) is critical to students as they progress through schooling and enter a world in which information technology will be ubiquitous. Work, health care, family finances, learning and social interaction will all depend on competence in ICT. To assess progress in this crucial part of student learning, ACARA conducts a National Assessment Program (NAP) aimed at measuring ICT literacy. Every three years since 2005, a sample of Year 6 and Year 10 students from across Australia have been tested to determine their ICT knowledge, understanding and skills and their ability to use ICT creatively, …

A Needs Analysis For Social Media At A Southern Postsecondary Campus, Sheri Burnett

Morehead State Theses and Dissertations

A capstone submitted in partial fulfillment of the requirements for the degree of Doctor of Education in the College of Education At Morehead State University by Sheri Burnett on October 26, 2015.

Hacking Assessment, Phillip Dawson

2009 - 2019 ACER Research Conferences

Hackers exploit weaknesses in a system to achieve their own goals. In this paper I argue that hacking presents a significant threat to the growing world of online assessment. This threat needs to be addressed through a variety of means; technological anti-hacking approaches will not be sufficient. The most effective ways to prevent hacking may be changes to the assessment tasks themselves to make hacking less tempting; these approaches also have a range of positive side effects in terms of authenticity, transparency of criteria, and ensuring tasks involve work beyond the exam. I conclude with a brief exploration of the …

Stealth Assessment In Video Games, Val Shute

2009 - 2019 ACER Research Conferences

Games can be powerful vehicles to support learning, but their success in education hinges on getting the assessment part right. In this presentation, I will explore how games can use stealth assessment to measure and support the learning of competencies critical for the future. I will discuss what stealth assessment is, why it is important, and how to develop and accomplish it. I will also provide examples within the context of a game called Physics Playground that I designed and developed with my team. I’ll share what has been learned by recent research on stealth assessments in games, including: Does …

Assessment In Interactive Learning Environments, Michael Timms, Jason Lodge

2009 - 2019 ACER Research Conferences

There is an increasing interest in using digital technologies to create interactive learning environments (ILEs) that both teach and assess student skills that are hard or impossible to assess using ‘static’ items such as traditional, multiple-choice questions. These interactive learning environments try to do two things simultaneously: firstly, to monitor the learning of the student in real time, providing feedback to help the student progress through the learning task; and secondly, to use the information gathered during the learning to make judgements about where the student is in learning of the topic. Essentially, ILEs draw upon the same source of …

New Measures For An Old Friend: A Learning Progression For Ict Literacy, Mark Wilson

2009 - 2019 ACER Research Conferences

This workshop will present new thinking and new results from the work of the Assessment and Teaching of 21st-Century Skills (ATC21S) project, on the learning progression for information and communications technology literacy — learning in digital networks. This project, initially sponsored by Cisco, Intel and Microsoft, aimed to help educators around the world enable students with the skills to succeed in future career and college goals. The workshop will be structured to show the how the development of the new ideas and measures for ICT literacy followed the logic of the assessment system developed by the Berkeley Evaluation and Assessment …

Acer Research Conference Proceedings (2015), Acer

2009 - 2019 ACER Research Conferences

It is indeed timely that Research Conference 2015 addresses the theme Learning Assessments: Designing the future. It is six years since our Research Conference considered issues in assessment, and the landscape is being significantly transformed. Not only is Australia’s school curriculum changing, but related issues of teaching quality and assessment practice are hot topics here and in many other countries. This transforming landscape includes changes in thinking about the fundamental purposes of assessment; growing demands for the assessment of a broader range of student skills and capabilities; and new technologies that allow us to gather and visualise information about student …

Australian Students In A Digital World, Sue Thomson

Policy Insights

This century has seen continued exponential growth in the use of digital technologies. In Australia, the proportion of students having access to a computer at home rose from about 91 per cent in 2000 to over 99 per cent in 2013, and access to the internet grew from 67 per cent in 2000 to 98 per cent in 2013. According to the 2013 report on the International Association for the Evaluation of Education Achievement’s (IEA) International Computer and Information Literacy Study (ICILS), Australia had the highest percentage of students who used computers at school at least once a week (81%), …

Individual Differences In Digital Badging: Do Learner Characteristics Matter?, Joey R. Fanfarelli, Thomas Rudy Mcdaniel

Faculty Scholarship and Creative Works

Badge use has rapidly expanded in recent years and has benefited a variety of applications. However, a large portion of the research has applied a binary useful or not useful approach to badging. Few studies examine the characteristics of the user and the impact of those characteristics on the effectiveness of the badging system. This study takes preliminary steps toward that cause, examining the effectiveness of a badging system across two web-based university courses in relation to the individual differences of the learners. Individual differences are examined through the lens of Long-Dziuban reactive behavior types and traits. Results revealed differences …

From The Co-Editors, Todd Pagano

Journal of Science Education for Students with Disabilities

We continue to work diligently to improve JSESD. One of the largest challenges to the journal remains the solicitation of manuscript submissions. As such, we are asking the journal’s readership to assist us in advertising the journal. If you are familiar with individuals who might be interested in submitting a manuscript, please pass along the JSESD author link provided above. We are especially interested in articles on science education for students with varying types of disabilities and at a full range of grade levels (K-12 and postsecondary).

A Historical Perspective On The Revolution Of Science Education For Students Who Are Blind Or Visually Impaired In The United States, Cary A. Supalo Dr.

Journal of Science Education for Students with Disabilities

The following was an invited presentation given by Dr. Cary A. Supalo to the National Federation of the Blind of Illinois annual state convention that was held in Chicago, Illinois on Saturday, October 28, 2011. These remarks were slightly modified for the Journal of Science Education for Students with Disabilities.

Cary A. Supalo

What does the term Revolution mean? To some it can simply mean change. To others, it can mean drastic change, and still to others, revolution is no more than a descriptor for something else. In this context, I believe revolution refers to a time of significant change.1 …

Differentiation In The Classroom Using Chromebooks And Google Applications, Allison Carney

Honors Projects

The purpose of this research was to differentiate using Chromebook and Google technology to improve engagement and grades in the classroom. Chromebooks have been implemented into classrooms all over the country, but the use of Google applications in order to differentiate instruction and assessment is not as prominent in schools. I created four assignments on the Chromebooks that differentiated instruction and assessment based on interest and ability levels. I used a total of six applications and differentiated for forty-four students in a sixth grade math and science classroom. I found that differentiating using Chromebooks and Google applications boosted student engagement, …

The Relationship Between Social Presence, Student Satisfaction And Academic Achievement In Fully Online Asynchronous Courses, Martin Rodriguez

Theses and Dissertations - UTB/UTPA

The purpose of the study was to describe the strength and direction of the relationship between social presence and student success as measured by student satisfaction and academic achievement in fully online asynchronous courses. A correlational research design was utilized to study the relationship between social presence, student satisfaction, and academic achievement. The participants in this study are a convenience sample of 104 undergraduate level students enrolled in fully online asynchronous courses at The University of Texas at Brownsville from August to December 2014. The data for the participants’ perception of social presence and student satisfaction were elicited through two …

The Global Health "Interactive Curricula Experience (Ice) Platform & App": Technology That Enables Inter-Professional Innovation, Martha Langley Ankeny M.Ed., Janice M. Bogen, James Plumb Md, Mph, Lucille B. Pilling Edd, Mph, Rn, Ellen J. Plumb Md, Louis N. Hunter Pt, Dpt, Nicholas Leon Pharmd, Amy Earle Bfa

Academic Commons and Scott Memorial Library Staff Papers and Presentations

Global Health Initiatives Committee (GHIC)

Serves the Jefferson community as the premier point of engagement for students & faculty interested in medical and public health issues that transcend national boundaries

Creates an institutional focus on preparing students for public service careers in population health and public policy at local, national, and global levels

To enable all TJU faculty to:

- Deliver global health education, in a friendly, interactive format - Does not require an expert to deliver - Can be used in very small or large pieces depending on your needs

Innovative Public Education Or Glorified Homeschooling: Funding Full-Time K-12 Online Learning, Michael K. Barbour

Education Faculty Publications

While there has been some improvement in what is known about supplemental K-12 online learning, there continues to be a lack of evidence to guide the practice of full-time K-12 online learning. This paper examines the literature and research into the funding of full-time K-12 online learning programs. As one of the few areas where a reasonable body of literature exists, and where both progress and neo-liberal groups have reach relative agreement. It concludes that full-time K-12 online learning costs less than traditional brick-and-mortar, and that policymakers should consider the nature of instruction when determining funding for full-time K-12 online …

Schools In The U.S. 2015: Politics, Performance, Policy, And Research Evidence, Alex Molnar Ed., Luis Huerta, Sheryl Rankin Shafer, Michael K. Barbour, Gary Miron, Charisse Gulosino

Education Faculty Publications

This report is the third of a series of annual reports by the National Education Policy Center (NEPC) on virtual education in the U.S. The NEPC reports contribute to the existing evidence and discourse on virtual education by providing an objective analysis of the evolution and performance of full-time, publicly funded K-12 virtual schools. Specifically, the NEPC reports: analyze the universe of proposed state bills related to virtual education; assess the research evidence that bears on K-12 virtual teaching and learning; describe the policy issues raised by available evidence; analyze the growth and performance of full-time virtual schools; and, offer …

The Effect Of Web-Based Learning On Retention Of Non-Traditional Students In A Rural Comprehensive University, Treva Gail Macy

Online Theses and Dissertations

This study examined the effects web-based courses effect retention of nontraditional students. Gender, student classification, first generation, and ACT composite scores were used as predictor variables for the purpose of this study. Data were collected from the university's BANNER system. The analysis of the results revealed that the retention rates of students who participated in online courses were higher than their in-person counterparts. Recommendations for policy and implications for future research are provided.

The Disconnect Between Policy And Research: Examining The Research Into Full-Time K-12 Online Learning, Michael K. Barbour

Education Faculty Publications

While there has been some improvement in what is known about supplemental K-12 online learning, there continues to be a lack of evidence to guide the practice of full-time K-12 online learning. This paper concludes that despite considerable enthusiasm for full-time virtual education in some quarters, there is little high quality research to support the practice or call for expanding this form of virtual schools.

A Model Modality: Assessing The Educational Integrity Of The Blended Basic Course, Michael G. Strawser

Theses and Dissertations--Communication

The creation of a hybrid/blended basic course aligns with university goals and may increase viable curricular options for student success. If universities offer hybrid courses, they ought to do so based on data-driven evidence confirming that face-to-face (F2F) and hybrid courses are comparable. Thus, the purpose of this study was to assess the learning outcome achievement of students enrolled in a blended (hybrid) version of the basic course. More specifically, a comparative analysis of student affective, cognitive, and behavioral learning outcome achievement in face-to-face sections and hybrid sections was conducted. This study also examined affect for course delivery format for …