Education Commons^™

Full Issue: Journal On Empowering Teaching Excellence, Volume 7, Issue 2, Fall 2023

Journal on Empowering Teaching Excellence

The full-length Fall 2023 issue (Volume 7, Issue 2) of the Journal on Empowering Teaching Excellence

Access the online Pressbooks version (with downloadable EPUB format) here.

The Fall 2023 issue presents research and guidance on topics related to educational adaptation. The first article by C. Farrell describes an adaptation of the interteaching method to the hybrid delivery method. The second article by C. C. Loose and R. Jagielo-Manion describes a study of modules on personalized learning to preservice teachers and its impact on their comfort level and preparation to implement personalized learning in their classrooms. The third article by B. …

Teaching And Assessing With Taxonomies, Tony Shannon

International Journal for Business Education

The development of taxonomies which articulate learning outcomes are necessary to disconnect the silos among educators, employers and learners (Mathews, 2019; Uranis et al.) What are taxonomies? A taxonomy is a systematic classification of objects. Why do they matter? Without systematic classification and coding it is difficult to compare or combine objects. How are they relevant to teaching and learning? In the years after the Second World War, educational psychologists saw the progress made in the biological sciences with taxonomies and started to apply them in education. Among the first to appear in the mid-50s was the work of Bloom.

A 5-Week Personalized Training Workshop To Assess And Evaluate Faculty Members Teaching Online, Felix O. Quayson, Christopher Zirkle

Journal of Research Initiatives

The authors developed the Skills of Inquiry (SoI) model accompanied by a logic model to assess and evaluate faculty members teaching online. The Skills of Inquiry is based on faculty members’ abilities to understand the online environments, skills development pertaining to online teaching, and acquisition of specific online skills. The Skills of Inquiry model was used to personalize a 5-week workshop training and development module specifically for faculty members teaching online. The training workshop is effective in training faculty members to acquire specific online teaching skills through customized and individualized professional development learning. The training is a self-paced asynchronous online …

Ungrading An Online Counseling Course, Leah K. Clarke

Journal of Technology in Counselor Education and Supervision

Ungrading, or alternative assessment, is an educational practice that is growing in use and can be effective in online counselor education. Alternative assessment aligns with social justice, competency-based, and community of learning educational philosophies. Assessment that is meaningful for teachers and learners can increase engagement, openness to feedback, and intrinsic motivation for counselors-in-training. A counselor educator describes how one online course was ungraded.

Examinees’ Affective Preference For Online Speaking Assessment: Synchronous Vs Asynchronous, Yuxiao Du, Fangzheng Zhang

Chinese Language Teaching Methodology and Technology

With technological advancement and the COVID pandemic, online speaking assessment is increasingly used in language teaching. Two modes are developed: online synchronous testing (direct human-to-human interview) and online asynchronous testing (semi-direct human-to-machine interview). Ample literature has explored how each of the two online modes differs from traditional face-to-face speaking assessments. However, few studies have investigated the differences between the two modes, especially in terms of examinees’ affective preferences. This study, therefore, compares the extent to which each mode is accepted and favored by test takers and explores why such an affective preference emerges. The participants are 46 college students enrolled …

Lessons Learned: Curriculum Map As An Assessment Tool, Paul Antonellis

Academic Chairpersons Conference Proceedings

During this session, participants will learn about the steps taken to use curriculum mapping as an assessment tool, what worked well, challenges encountered, and recommendations going forward at the graduate and undergraduate level. The program will demonstrate how the program curriculum map can be linked to the general educational outcomes and aligned with intuition outcomes (Banta, 2014; Hundley & Kahn, 2019). Curriculum mapping will reveal program strengths and weaknesses before beginning the assessment process, avoiding costly mistakes in the assessment process. The mapping process will assist in determining which outcomes are assessed, when the outcome is assessed, and in which …

My First Time Ungrading: Approach Used And Reflections, Heather Leslie

Feminist Pedagogy

A few months ago, I began devouring information about ungrading with a fervent appetite. I started with the book Ungrading: Why Rating Students Undermines Learning (and What To Do Instead) edited by Susan Blum and listened to just about every podcast where she was interviewed about this topic. I then read other books she recommended like Wad-Ja-Get: The Grading Game in American Education by Howard Kirschenbaum and Punished By Rewards: The Trouble with Gold Stars, Incentive Plans, A’s, and Praise by Alfie Kohn. Recently, I have become much more dialed into the ungrading movement by reading articles from Teachers Going …

The Implementation Of Oral Assessment In An Introduction To Proof Course Using Multiple Assessment, Nurul Wahyuni Schraeder, Nicole Engelke Infante, Ben Davies

Graduate Student Scholarship

This study investigated how four assessors implemented an oral assessment when a little direction was provided to the assessors. We focused on the interrater reliability of oral grading and the types of follow-up questions asked. We observed three interaction types during oral assessment: no follow-up, follow-up related to the problem, and follow-up not directly related to the problem. As expected, assessors differed on several aspects of the assessment, including grading standards and follow-up experiences for students. Our findings revealed interrater reliability of oral grading with three-point scale was excellent, but not so much when six-point scale was implemented. Moreover, we …

Does Instructor Quality Affect Student Grades?, Emily Faulconer, John C. Griffith, Bobby Mcmasters

Publications

High quality instructors positively influence student outcomes.

• Course design with strong organization
• Feedback
• Community of inquiry presences
• Cultural responsiveness

Pedagogical Methods And Advances For Synchronous/Asynchronous Instruction Of Laboratories In Engineering Technology Programs, Nestor Escobales, Alok Verma

Engineering Technology Faculty Publications

Significant research has been done on the subject of distance learning (DL) instruction for many academic disciplines. However, when it comes to engineering technology (ET) programs, particularly, engineering laboratory work, limited studies are available. It is unquestionable that engineering laboratory work is essential for the successful preparation of individuals enrolled in ET programs. The focus of ET programs is on the correct use and application of engineering principles with a direct focus on practical application rather than on theory alone. The difficulties increase significantly when laboratories are offered in DL mode, particularly for ET programs. It is well known that …

Assessment As A Learning Opportunity: Feedforward With Multiple Attempts, Emily Faulconer

Publications

High quality feedback is well-known to provide multiple student benefits, especially if students are provided the opportunity to apply the feedback. It reasons, then, that we can support student success on summative assessments by combining multiple attempts with high-quality immediate feedback. This study explores student behaviors, performance, and perspectives regarding this strategy.

When You Can’T R.I.O.T., R.I.O.: Tele-Assessment For School Psychologists, Michael R. Hass, Brian P. Leung

Education Faculty Articles and Research

The acronym R.I.O.T., record review, interview, observation, and test, is a well-known tool for conceptualizing a comprehensive assessment. With COVID-19 and the need to provide school psychological services virtually, it is important to reconsider R.I.O.T. in light of the limitations of virtual assessment. We describe the limitations of virtual assessment and argue that in spite of these barriers, the first three elements of R.I.O.T., record review, interviews, and observations, when used systematically, can provide useful comprehensive assessment data. Specific recommendations are provided for implementing assessment virtually.

Fa 2020 About This Issue: The Power In Slowing Down

Journal on Empowering Teaching Excellence

Whether it be videotaping, guided classroom conversations, lecture-based, or written, feedback is the backbone of educational excellence. We use it to mentor beginning undergraduates, writers, readers, explorers, and experimenters. And, if we are thoughtful, feedback becomes a loop by which we slow down learning, we engage reading, writing and exploring, and we collaborate our way to becoming better.

Full Issue: Journal On Empowering Teaching Excellence, Volume 4, Issue 2

Journal on Empowering Teaching Excellence

The full Fall 2020 issue (Volume 4, Issue 2) of the Journal on Empowering Teaching Excellence.

Effects Of Pre-Tests And Feedback On Performance Outcomes In Massive Open Online Courses:What Works And What Doesn’T?, Maria Janelli

Dissertations, Theses, and Capstone Projects

This experimental study examined the effects of pre-tests and feedback on learning outcomes in a five-week massive open online course (MOOC). The participants (N = 399) were adults from around the world who self-enrolled in the American Museum of Natural History’s (AMNH) climate change MOOC (called Our Earth’s Future) offered on the Coursera platform. Participants were randomly assigned to one of four conditions. Learners in the first treatment group took pre-tests without receiving feedback. Learners in the second treatment group took pre-tests and received basic (correct/incorrect) feedback. Learners in the third treatment group took pre-tests and received elaborate feedback. The …

Does Class Size Matter?: An Exploration Into Faculty Perceptions Of Teaching High-Enrollment Online Courses, Patrick R. Lowenthal, Rob Nyland, Eulho Jung, Joanna C. Dunlap, Jennifer Kepka

Educational Technology Faculty Publications and Presentations

Class size has been a popular topic for decades. There is renewed interest in this topic now with the growth of online learning. Online courses can accommodate hundreds, if not thousands, of students in a single course. Very little research, though, has been conducted recently on class size in online courses and the research that has been conducted is mixed. As the demand for online courses increases, so likely will class size. In this exploratory study, we investigated the perceptions and experiences of 37 faculty teaching high-enrollment online courses. In the following article, we report the results of our inquiry, …

Improving The Rigor Of Online Education: Exploring Characteristics Of Faculty And Syllabi Within An Online Program Assessment Process, Brad J. Hamel

All NMU Master's Theses

As online course enrollments grow, overall perception of rigor still lags compared to that of traditional face-to-face education. The purpose of this research was to tie faculty and syllabi characteristics to the rigor of online courses. This study explored the relationship between faculty and syllabi characteristics and performance on an online entry-level course design quality assurance assessment (pass, pass with concern, or fail). A decision tree analysis was used to predict the relationship of the independent (faculty and syllabi characteristics) and the dependent (entry-level course design assessment) variables. Findings suggest that faculty rank and writing intensive are key characteristics predictive …

An Explorative Case-Study Of The Use Of Peerwise To Foster Student Centred, And Peer Supported, Learning In A First-Year Business Module, Anna Dynan, Barry J. Ryan

Irish Business Journal

Peer based learning is not a new concept in business studies in higher education; however, the integration of technology enabled and asynchronous peer learning has limited reported use and even less evidence based evaluation. In this explorative case study, the online tool PeerWise was used to scaffold and support an asynchronous peer-learning environment for a group of 212 first year business studies students. Students were required to create, answer and rate multiple choice questions on topics aligned to their curriculum within the peer constructed PeerWise question database. While there was no statistically significant correlation between PeerWise engagement and final module …

How To Create A Stunning Video Orientation By Hand, Rachel S. Evans

Articles, Chapters and Online Publications

This article describes the multi-faceted approach UGA Law Library took with their fall 2018 first year student orientation. It describes the process of the creating a virtual tour experience, pairing it with a hybrid face-to-face event, and assessing the impact of all aspects of the orientation. The creation of the video itself involved a multi-media approach using a combination of visual arts and technology to animate a product that has a longer expiration than traditional video or in-person library orientations offer.

The Effects Of Formative And Summative Assessment On Student's Connectedness, Satisfaction, Learning And Academic Performance Within An Online Healthcare Course, Thomas J. Wing

Boise State University Theses and Dissertations

The quantitative study presented here evaluates the effects of formative and summative assessment on student’s connectedness, satisfaction, learning and academic performance within a university three-credit 400 level online healthcare course. Literature exploring the role that formative assessment plays within an online environment is currently lacking. Additionally, understanding how assessment practices can help support the goals of online healthcare education is vitally important given the rise in popularity of this delivery format.

This study investigated student outcomes in the form of connectedness, satisfaction, learning and academic performance. Four cohorts of students were included in this study. Two cohorts were provided with …

Problems And Promises Of Using Lms Learner Analytics For Assessment, Valerie Beech, Eric A. Kowalik

Eric A. Kowalik

The Iterative Development And Use Of An Online Problem-Based Learning Module For Preservice And Inservice Teachers, Peter Rillero, Laurie Camposeco

Interdisciplinary Journal of Problem-Based Learning

Teachers’ problem-based learning knowledge, abilities, and attitudes are important factors in successful K–12 PBL implementations. This article describes the development and use of a free, online module entitled Design a Problem-Based Learning Experience. The module production, aligned with theories of andragogy, was a partnership between the recipients of a grant using PBL to enhance English language learner education and the Sanford Inspire Program. A multistage evaluation design was used in the iterative process of module creation. Starting with an initial white paper, the module’s conceptualization, development, pilot testing, and refinement are described, along with the current use statistics. The URL …

The Challenge Of Providing High-Quality Feedback Online: Building A Culture Of Continuous Improvement In An Online Course For Adult Learners, Emily Hodge, Susan Chenelle

Department of Educational Leadership Scholarship and Creative Works

Scholars of online learning have acknowledged the additional challenges an online format poses to relationship building and providing effective feedback. This article describes the authors’ experiences providing feedback to adult learners in an online educational leadership course, the challenges they encountered in providing this feedback in a timeframe and manner to which students were receptive, and their research into how to build a culture of continuous improvement in an online course for adult learners. The authors conclude that effective online feedback occurs when course projects are sequenced to provide opportunities for students to receive and engage with feedback formatively, when …

The Online Student Experience: An Exploration Of First-Year University Students’ Expectations, Experiences And Outcomes Of Online Education, Melanie Henry

Theses: Doctorates and Masters

Online higher education presents a critical opportunity to extend and diversify the student body. The Online Student Experience (OSE), and online student outcomes, however, remain shrouded in ambiguity. The literature presents conflicting reports of online education (OE) quality, confounded by a lack of appreciation for potential differences between online and on-campus education, and a diversity of interpretations for what constitutes OE. The present research conceptualises OE as representing university courses that require students to interact with instructors and course materials via the internet, with no expectation of attending a university campus. A broad student-centred perspective is notably lacking from the …

Assessment Online: Informing Teaching And Learning, Geoff N. Masters

Teacher columnist – Geoff Masters

Online assessments are capable of providing significantly improved feedback to teaching and learning. Experience in schools is demonstrating the potential of online assessment – provided the foundations are right.

The advantages of online assessment are often described in terms of its administrative convenience, efficiency and lower costs. However, well-constructed online assessments also are capable of providing more timely, more instructionally useful feedback to teaching and learning. For a number of years ACER has been investigating ways to enhance the educational value of online assessments.

Quality Assurance In Online Graduate Education: Program Review Processes And Assessment Techniques Used In Higher Education, Lindsay N. Turner

Graduate Theses and Dissertations

The purpose for conducting the study was to form an understanding of the online program assessment and assessment processes in higher education, and how program review processes were adopted and implemented through institutional policies in regard to industry quality assurance standards. The study looked at institutions classified as very high, high, or research universities by the Carnegie Classifications, and which offered online masters programs focused on preparing students for positions in educational administration or leadership roles. The study used an electronic survey and content analysis through institutional policy and quality assurance documents to develop a recommendation for institutional level quality …

Session J: Assessment In Interactive Learning Environments, Michael Timms, Jason Lodge

Dr Michael J Timms

There is an increasing interest in using digital technologies to create interactive learning environments (ILEs) that both teach and assess student skills that are hard or impossible to assess using ‘static’ items such as traditional, multiple-choice questions. These interactive learning environments try to do two things simultaneously: firstly, to monitor the learning of the student in real time, providing feedback to help the student progress through the learning task; and secondly, to use the information gathered during the learning to make judgements about where the student is in learning of the topic. Essentially, ILEs draw upon the same source of …

Assessment In Interactive Learning Environments, Michael Timms, Jason Lodge

2009 - 2019 ACER Research Conferences

There is an increasing interest in using digital technologies to create interactive learning environments (ILEs) that both teach and assess student skills that are hard or impossible to assess using ‘static’ items such as traditional, multiple-choice questions. These interactive learning environments try to do two things simultaneously: firstly, to monitor the learning of the student in real time, providing feedback to help the student progress through the learning task; and secondly, to use the information gathered during the learning to make judgements about where the student is in learning of the topic. Essentially, ILEs draw upon the same source of …

Down The Rabbit Hole: An Initial Typology Of Issues Around The Development Of Moocs, Apostolos Koutropoulos, Panagiotis Zaharias

Current Issues in Emerging eLearning

MOOCs have experienced an unprecedented explosion of publicity. This publicity indicates both optimism that they may be the panacea for whatever ails higher education, as well as caution and trepidation that this may in-fact be some sort of new fad in higher education. In this wave of optimism, and subsequent wave of pessimism, we believe that there is something good to examine about MOOCs and that they do hold potential for certain educational arenas. That said, we don’t want to blindly dive into the MOOC optimism camp. We have critically examined the literature, from both academic peer-reviewed and academic press …

The Tools That Matter: Assessing Online Resources, Valeriana Colon

Graduate Research Posters

In the age of technology, educators are encouraged to incorporate online resources into their teaching, but the impact of these resources on learning is rarely considered. To create a foundation for assessment, this poster reviews theories and research on how students learn across oral, written, and online modes of communication. It then reviews methods of assessing various elements of online resources. Lastly, this poster suggests an implementation approach to enhance the use of resources.