Educational Assessment, Evaluation, and Research Commons^™

Comparing Online And Traditional Assessment Practices In Middle School Mathematics, Maxwell Krueger, Kathy Enger

Dissertations, Theses, and Projects

As a result of the COVID-19 pandemic, teachers across the world have been forced to explore different modalities of assessment, many of them virtual. Now that many of the most restricting policies for schools due to pandemic have been lifted, the use of these virtual assessments remain. Due to the recent nature of their use though means that not many studies have looked into the implications of these assessments on students let alone middle school students. This study aims to help fill in some of the gaps in this research. In this study, students will take one of two assessments …

Mathematical Mindsets: Fostering Student Engagement And Positive Mindsets Through The Use Of Challenging Tasks, Alison Hall

2021-2030 ACER Research Conferences

This paper explores the planned use of challenging mathematical tasks. These tasks provide the opportunity for students to improve mathematical thinking by working on problems that they do not yet know how to answer. This research involved a heterogeneous class of year 3 students from a Catholic parish primary school in the northern suburbs of Melbourne. A rubric was also developed to use in conjunction with these tasks, to support discussions with students, broaden their strategies in finding solutions and thereby improve their conceptual understanding. These pedagogical approaches were found to support the improvement of both students’ conceptual understanding in …

Assessment Is Coming And The Early Childhood Sector Must Lead The Way, Dan Cloney

2021-2030 ACER Research Conferences

Assessment is a core component of quality early childhood practice. It is explicitly highlighted in the new Early Years Leaning Framework V2.0 and is a standard within Quality Area 1 of the National Quality Standard. In everyday early childhood education and care (ECEC) settings, and in initial teacher education, assessment is often limited to observational and narrative-driven approaches. Recent reviews of the literature highlight that there are few other assessment tools readily available to educators. What assessment looks like in early childhood is changing. The Commonwealth, as part of the Preschool Reform Funding Agreement, is developing, trialling, and implementing a …

Research Conference 2023: Becoming Lifelong Learners. Proceedings And Program, Kylie Burns (Ed.)

2021-2030 ACER Research Conferences

We know learning in the early years sets the foundations for people’s ongoing academic, cognitive and socio-emotional development. Education across those formative first 12 years is currently segmented, with children often starting fresh in new systems. How can each of us make learning in the early childhood and primary years more effective? Research Conference 2023 will examine research around how we can improve the continuity of learning from birth to 12 years. It will bring together leading international and Australian researchers to provide insights into the best ways to identify, conceptualise, develop and assess these new linkages for learning.

The Lived Experiences Of Secondary Teachers Who Give Grades And Feedback: A Phenomenological Study, Brandon Miles Moore

Doctoral Dissertations and Projects

The purpose of this hermeneutic phenomenological study was to understand the lived experiences of secondary teachers who grade student work, including their grading beliefs, decisions, and feedback practices at Discovery Hills Unified School District. The theory that guided this study was self-determination theory as it helps explain the motivation, both intrinsic and extrinsic, for teacher grading practices and the impact of teacher feedback on students. The central question was: What are secondary teachers’ lived experiences with grading student work? Sub questions were used to explore the beliefs, decisions, and practices secondary teachers employ when grading student work or providing feedback. …

Using A Bayesian Estimation To Examine Attribute Hierarchies Of The 2007 Timss Mathematics Test: A Demonstration Using R Packages, Chia-Ling Hsu, Yi-Hsin Chen, Yi-Jhen Wu

Practical Assessment, Research, and Evaluation

Correct specifications of hierarchical attribute structures in analyses using diagnostic classification models (DCMs) are pivotal because misspecifications can lead to biased parameter estimations and inaccurate classification profiles. This research is aimed at demonstrating DCM analyses with various hierarchical attribute structures via Bayesian estimation using freely available R packages, including CDM and R2jags. We illustrated a step-by-step procedure in R with an eighth-grade mathematics test from the 2007 Trends in International Mathematics and Science Study (TIMSS).

Long-Term Outcomes Of Early Adult 4-H Alumni, Nicole Marshall-Wheeler, Roshan Nayak, Anne Iaccopucci, Steven M. Worker

The Journal of Extension

Very little has been published reporting on long-term outcomes experienced by young adults (aged 19 to 34 years old) who participated in 4-H youth development programs. We adopted Gambone et al.’s (2002) framework advancing three long-term outcomes for early adulthood: economic stability, health and well-being, and community involvement. With cross-sectional survey methods, we compared long-term impacts between 693 California 4-H young adult alumni and 373 young adults in a U.S. general population sample who had not participated in 4-H. The results demonstrated that 4-H alumni report more positive long-term outcomes than the U.S. general population sample. The study contributes to …

Effects Of Transition From Closed-Book To Open-Book Assessment On Students’ Scores In A Pharmacokinetics Course, Reza Mehvar, Richard Beuttler

Pharmacy Faculty Articles and Research

Closed-book summative assessment of student learning, common in pharmacy education, is challenging to administer in a remote setting due to the need for costly and intrusive monitoring technology. Therefore, open-book assessments without monitoring have been considered an alternative in remote settings. The present study investigated the effects of the transition from in-person closed-book to remote open-book format on the students’ scores in different assessment categories in a Pharmacokinetics course. The students’ performances in the transition cohort (Transition, n = 96) during the in-person and remote periods were compared with those of an in-person cohort (Control, n = 85) during the …

Ensuring Quality In Qualitative Research: A Researcher's Reflections, Niroj Dahal

The Qualitative Report

This reflective paper is the outcome of my qualitative research engagement aligned with quality standards. I began with autoethnography in my master's research in mathematics education (see Dahal, 2013), then moved on to narrative inquiry in my MPhil research (see Dahal, 2017), and collaborative autoethnography in my doctoral research (see Dahal, 2023). With the above, this paper aims to clarify the quality criteria used in autoethnography, narrative inquiry, and collaborative autoethnography based on my experiences to evaluate the robustness of qualitative research from various ontological and epistemological vantage points. Likewise, this article offers a comprehensive overview of the key elements …

International K-12 Schools Seeking U.S. Accreditation: An Analysis Of The Rationales Involved In Earning Accreditation Through The Western Association Of Schools And Colleges, Kerri Knapp

Capstone Collection

The international K-12 school market is growing fast, and new international schools are opening every year. Hundreds of those international K-12 schools seek out accreditation to help validate their institution’s authenticity. Accreditation allows potential students and families to trust that the education provided is legitimate according to a set of principles and standards provided by the accreditation organization. Colleges and universities, particularly those in the United States, where thousands of international students strive to be accepted, typically require students to matriculate from an accredited school. With this market growth comes a need for accountability, and therein lies accreditation. The United …

Seeking The Real Reliability: Why The Traditional Estimators Of Reliability Usually Fail In Achievement Testing And Why The Deflation-Corrected Coefficients Could Be Better Options, Jari Metsämuuronen

Practical Assessment, Research, and Evaluation

Traditional estimators of reliability such as coefficients alpha, theta, omega, and rho (maximal reliability) are prone to give radical underestimates of reliability for the tests common when testing educational achievement. These tests are often structured by widely deviating item difficulties. This is a typical pattern where the traditional Pearson correlation between items and score (Rit) may be radically deflated. Because Rit is embedded in the traditional estimators of reliability, this causes deflation in the estimates of reliability, and the magnitude of deflation may be remarkable. Within achievement testing, deflation-corrected estimators of reliability (DCER) would be better options. Instead …

Evaluating The Feasibility And Impact Of A Well-Being Retreat For Physicians And Advanced Practice Providers, Amanda K. Bailey, Amanda T. Sawyer, Hong Tao, Leila Durr, Alexandra Lajeunesse, Ravindran Sabapathy, Tyon Hall

Journal of Wellness

Introduction: Work stress experienced by physicians and advanced practice providers (APPs) can have a detrimental psychological and physical impact. Targeted interventions that focus on self-awareness, peer connection, and intentional self-care may reduce stress and improve well-being and professional fulfillment.

Methods: This is a summative program evaluation of a two-day well-being retreat for physicians and APPs employed at a healthcare system headquartered in Florida. Led by mental health professionals in May 2022, this retreat combined facilitator-led workshops and experiential practice activities with opportunities for peer connection and designated time with family members. The retreat objectives were to facilitate social …

The Evaluation Of "The Wrong Answer Project" As Validity Evidence For The Social Consequences Of Testing, Darius D. Taylor

Doctoral Dissertations

The use of educational tests for making high stakes decisions has had societal consequences for decades. Parents, teachers, and administrators have been willing to pay off, lie, cheat, and steal so that their children, students, and they themselves would not fall prey to the negative consequences of subpar performance on educational assessments. Respected psychometric scholars have supported Samuel Messick’s claim over the years, but their advocacy has caught minimal traction. I founded an initiative in 2019 – The Wrong Answer Project – that shows promise as a vehicle for collecting validity evidence based on the social consequences of testing and …

The Impact Of Special Education Status And Text-To-Speech On Test-Taker Engagement, Maura O'Riordan

Doctoral Dissertations

If a student is not engaged during a test, their test score will not be an accurate representation of what they are capable of. This is a concern because of the possible negative impact on the validity of test score interpretations and decisions being made based on such test scores that are not in the best interest of the student. If this is negatively impacting an entire subgroup of students, such as special education students, differentially, there may be larger-scale impact. To date, limited research has examined the relationship between test-taker engagement and special education status. The purpose of this …

Building A World-Class Learning System: Insights From Some Top-Performing School Systems, Geoff N. Masters

School and system improvement

The result of a multi-year study, this book explores how five school systems - British Columbia, Estonia, Finland, Hong Kong and South Korea - have been rethinking and reforming their schools systems. It addresses questions including: What policies need to be in place for every child to experience an engaging and supportive learning environment that motivates not only high performance but a desire to keep learning? What do students really need to know and be able to do to thrive in a changing world? How can systems engage in ongoing improvement while also cultivating innovation? The book provides a framework …

Standardized Testing And Stress In Teachers And Students, Gretchen L. Spoelman-Delong

Culminating Experience Projects

This project demonstrates the relationship between standardized testing and increased stress in both teachers and students. The emphasis placed on standardized testing and therefore potential for increased anxiety and stress for teachers and students is important because stressed and anxious teachers are not going to be teaching to their full potential. Likewise, stressed and anxious students are not going to be able to rise to their full learning potential (Gonzalez et al., 2017). The purpose of this project is to decrease the amount of stress and anxiety that students and teachers feel. This can be accomplished by informing school personnel, …

Understanding Administrators' Perceptions Of Gifted Ell Students, Abigail Eaton

Masters Theses & Specialist Projects

Students with gifts and talents are identified in school districts across the nation. However, there is severe underrepresentation of minority groups in gifted education programs, specifically students with ELL backgrounds. This issue is important because students from diverse backgrounds are the fastest growing group of the K-12 population. If the issue is not addressed, many talents will be overlooked and underdeveloped (Peters & Engerrand, 2016). The purpose of this study was to analyze administrators’ perceptions of gifted ELL students.

Participants in this study include six administrators from a small, rural district in Southcentral Kentucky. All of the administrators participated in …

Cross-Cutting Skills: The Role Of Major, Maureen Snow Andrade, Eugene Seeley, Ron Miller

International Journal for Business Education

Employers want recent college graduates prepared with skills that cut across majors, such as written and oral communication, teamwork, ethical decision-making, critical thinking, and applying knowledge in real-life situations. What is largely unknown is if some fields of study lend themselves to producing these desired skills over others. This is particularly relevant to schools of business, which strive to help students develop professional career skills and often emphasize a range of practical, hands-on, engaged learning activities. This study focused on obtaining the insights of hiring managers about desired skills and areas of study that prepare students with these skills. Survey …

Ctl Impact Report (Fy23), Center For Teaching & Learning

CTL Publications

The Sacred Heart University CTL was founded in 2022 as an integrated scaffold of teaching and learning support. Its founding brought together instructional development for SHU faculty with academic support services for SHU undergraduate and graduate students. In this report, we share our center’s reach and impact during FY23 (July 1, 2022 – June 30, 2023), marking the first full academic year in which the CTL has operated in its current model.

Equalizing Community Voice In An International Service-Learning Project: A Narrative Inquiry Of A Social Entrepreneurial Peruvian Women's Group, Monica D. Hernandez

Theses & Dissertations

Traditionally, international service-learning (ISL) programs are created and led by host groups, which frequently overlook the international communities’ learning process and perspectives and the long-term impact of service missions on the community. Fundamentally, ISL is meant to address community needs. With the principal focus being on enriching students’ learning, community voice is often eclipsed. The research aim was to investigate the empowerment and efficacy of an ISL project to strengthen relationships between engaged scholars and international communities and improve future service-learning trips. Using a qualitive narrative research design, I investigated a 2021-2022 ISL Based Photovoice Project applying Kolb’s Experiential Learning …