Educational Assessment, Evaluation, and Research Commons^™

Annual Activity Report Center For Advancing Faculty Excellence: Fall 2020-Spring 2021, Missouri University Of Science And Technology

CAFE Annual Activity Reports

No abstract provided.

Teaching And Learning International Survey, Australian Council For Educational Research

Assessment GEMS

The Teaching and Learning International Survey (TALIS) gathers data about school teaching environments from teachers and school leaders, in close to 50 countries in its most recent cycle. TALIS is a tool to assist educational reformers to improve the quality of teaching. TALIS data is based on the opinions, perceptions, beliefs and accounts of teachers and school leaders, as reported by them in a self-completion questionnaire. This publication, presents an overview of TALIS and covers its origins and context, purpose, measurement objectives, background information collection, target population and sampling methodology, assessment administration, reporting and dissemination and influence.

Identification Of Phosphorus Index Improvements Through Model Comparisons Across Topographic Regions In A Small Agricultural Watershed In Vermont, Amy S. Collick

Faculty Research at Morehead State University

Many U.S. states require farmers to evaluate the risk of P loss from farm fields using P site assessment tools, such as the Phosphorus Index (P-Index). The simplicity of the P-Index allows for users with various backgrounds to utilize the tool; however, the P-Index may be limited in its ability to reliably predict P losses across variable farm terrain, for instance where saturation-excess runoff generation dominates. The objective of this study was to identify potential improvements that could be made to the Vermont P-Index (VT P-Index) by comparing VT P-Index predictions of P loss with those of a model that …

Information Technology Creativity And Economic Growth: A Case Of Korea, Hiawook Choi, Hae-Yeon Choi

Faculty Research at Morehead State University

This paper examines the contributing factors of information technology (IT) creativity and whether IT creativity can explain the economic growth in Korea. We empirically test college students’ perception and attitudes on educational quality, work environment, social preparedness on tolerance, and government-initiated IT policy. We also test whether creative capital theory, which states creativity as the major driver ofregional and national economic development– is working in Korea. We apply structural equation modeling (SEM) to analyze the survey data collected from college students in five different regions in Korea. SEM analysis indicates that all endogenous constructs, except education quality, provide a statistically …

The Southeast Asia Primary Learning Metrics Program, Australian Council For Educational Research

Assessment GEMS

The Southeast Asia Primary Learning Metrics Program (SEA-PLM) is a regional assessment of Grade 5 students in six Southeast Asian countries. SEA-PLM was initiated in 2012 by the Southeast Asian Ministers of Education Association (SEAMEO) and the United Nations Children’s Fund (UNICEF). The first main cycle of SEA-PLM was implemented in 2019, with future cycles intended. All member countries of SEAMEO can choose to participate in SEA-PLM. The first six participating countries were: Cambodia, Lao PDR, Malaysia, Myanmar, Philippines and Viet Nam. SEA-PLM measures curricula and cross-curricula knowledge, skills and understanding in the domains of mathematics, reading, writing and global …

Exploring Critical Media Literacy Skills Of Adults On Twitter During The Coronavirus (Covid-19) Pandemic In The United States In The Spring And Summer Of 2020, Renee Thomas Woods

Dissertations

This study explores the self-directed learning behaviors of adult users of the social media vehicle, Twitter, through the lens of Coronavirus (COVID-19) in the United States during the spring and summer of 2020. The objective was to identify Twitter usage patterns to determine adults’ awareness and use of media literacy and critical media literacy skills with social media content they consume. This study, informed by two focus groups and six individual interviews, is based on a qualitative research design using a constructivist approach. The central question is how do adults use critical media literacy on social media when gathering information …

Ungrading Uncovered: How Going Gradeless Can Support Learner Diversity In Higher Education, Shaun Ferns, Robert Hickey, Helen Williams

Other resources

The awarding of grades or marks to student work is traditionally considered a fundamental feature of assessment. Traditional grades, the awarding of numeric values to student work, date back to the 1600s where Harvard used exit grades to measure and categorize students (Smallwood, 1935). Grades became more widely established in the education sector at the beginning of the twentieth century to deal with increased numbers of students and as a means of communication between educational institutions and third parties, a form of universal measurement. Although becoming ubiquitous across most educational spectrums in the second half of the twentieth century, there …

Towards Bringing Human-Centered Design To K-12 And Post-Secondary Education, Saadeddine Shehab, Mike Tissenbaum, Luettamae Lawrence, Daniel Rees Lewis, Matthew Easterday, Spencer Carlson, Adam Royalty, Helen Chen, Sheppard Sheri, Shelley Goldman, Annie Camey Kuo, Kimiko Lange, Melissa Mesinas, Rose K. Pozos, Dhvani Toprani, Mona Alqahtani, Yu Xia, Marcela Borge, Keith Sawyer

Instructional Technology and Learning Sciences Faculty Publications

Human-Centered Design (HCD) is a growing field that has the potential to positively impact students’ learning. A general consensus on the terms, practices, scaffolds, and assessments of HCD can foster its effective implementation in K-12 and post-secondary education. This session brings together researchers whose work is focused on implementing HCD across K-16 classrooms. It aims to develop a coherent definition of HCD, its methods, practices, and assessments, to help frame the field and reduce ambiguity at a critical time in its broader adoption.

A Journey Towards Cultural Proficiency: Lessons Learned From Africa, Corinne Brion

Educational Leadership Faculty Publications

This autoethnography tells my story as a French American woman who lives in the United States and worked with hundreds of school leaders in five African countries over a period of six years. Using a cultural proficiency continuum, I illustrate my learning and changing frames of references pertaining to cultural differences. Movement along the continuum indicates an alteration in thinking that progresses from marginalization to inclusivity. My experiences, mistakes, and lessons learned contribute to the discourse on cultural difference. For six years, I spent more time on the African continent than in my American home. These extended stays allowed me …

Examining The Influence Of Instructor Interventions On Group Collaboration, Luettamae Lawrence, Taylor Tucker, Emma Mercier

Instructional Technology and Learning Sciences Faculty Publications

Collaborative problem solving is often used in STEM higher education courses to support conceptual knowledge and teamwork. However, course teaching assistants (TAs) often lack the collaborative pedagogical knowledge necessary to orchestrate this form of learning. In this paper, we examine TAs’ orchestration strategies and technology used to understand how these factors influence groups’ collaboration. Contributions from this paper describe the interplay among technology, strategies, and groups’ collaboration toward understanding how to support collaboration in these courses.

Refugee Higher Education And Participatory Action Research Methods: Lessons Learned From The Field, Hadas Yanay

Dissertations, Theses, and Capstone Projects

Refugee access to higher education is devastatingly low. Recognizing the complex barriers facing refugee learners, global educational initiatives are innovating flexible learning models which promote blended online and in-person learning modalities. This article describes the implementation of a five month, online-based internship pilot offered to 21 refugee participants in qualitative and quantitative research methods, through a participatory action research (PAR) framework in five different countries -- Malawi, Kenya, South Africa, Rwanda, and Lebanon. The internship is part of the Global Education Movement (GEM), which brings refugees accredited online college degree and career development opportunities. Through direct engagement, observation of the …

Coalition And Creativity On The Bridges And Fringes With Immigrant Student-Contributors In Nonprofit Adult Education, Katherine E. Entigar

Dissertations, Theses, and Capstone Projects

The nonprofit education of adult immigrants is an under-researched aspect of U.S. education. Adult immigrants, often perceived as passive and quiescent, bring voices and contributions to learning in powerful yet unheard ways. This research agenda invokes a new critical lens in education scholarship to uplift and center these contributions as a coalitional, dialogical project. Drawing upon critical sociocultural, women of color feminist, and poststructual theories, critical intersectional epistemology, and Bakhtinian dialogical thinking, this research project pursues inductive, recursive meaning making as an innovative exploration. A multiphase, sequential study including surveys and two focus groups foregrounds the complex, fluid ways adult …

Citizen-Led Assessments: A Model For Evidence-Based Advocacy And Action To Improve Learning, Suman Bhattacharjea, Sehar Saeed, Rajib Timalsina, Syeed Ahamed

Assessment and Reporting

Designed as household-based assessments, citizen-led assessments (CLAs) are implemented by local organizations who assess children in their homes, thus reaching the most marginalized children, families, and communities, often in remote areas. CLAs add an essential piece of information for truly monitoring progress and help realistically represent the learning levels of all children – at national, regional, and global levels. By using simple tools and easy-to-understand reports, CLAs engage parents and community members in discussions about learning and help foster understanding of the importance of ensuring quality education through civil action. In this publication, members from organizations conducting CLAs in India, …

Improving Gifted Talent Development Can Help Solve Multiple Consequential Real-World Problems, Jonathan Wai, Benjamin J. Lovett

Education Reform Faculty and Graduate Students Publications

Fully developing the talents of all students is a fundamental goal for personal well-being and development and ultimately for global societal innovation and flourishing. However, in this paper we focus on what we believe is an often neglected and underdeveloped population, that of the gifted. We draw from the cognitive aptitude and gifted education research literatures to make the case that solutions to consequential real-world problems can be greatly enhanced by more fully developing the talents of the intellectually gifted population, which we operationalize in this paper as roughly the top 5% of cognitive talent. Should well-supported high achievers choose …

An Evaluation Of One School's Reading Program To Support Struggling Readers Through The Use Of Data, Gabrielle Jones

Dissertations

ABSTRACT

The purpose of this study is to evaluate the efficacy of one school’s reading intervention program, and its impact on struggling readers reading performance. Participants in this study included administrators, Grades 3 through 5instructional staff that directly impact student learning in reading through reading instruction. I collected survey data and analyzed it to determine teachers’ ability to instruct struggling readers with high expectations for student learning. As a result, this evaluation exhibit teachers require more quality planning time to prepare effective reading intervention lessons that includes strategies attained from strategically designed professional development structured to increase students’ reading ability. …

Leader Development Of The Health Information Management (Him) Professional, Theresa Jones

Dissertations

This study contributes to the body of knowledge in leader development by examining how higher education programs in a female dominated profession assist learners in developing person-related characteristics that support leader development. A ten-part online survey was sent to directors of health information management (HIM) programs accredited by the Commission on Accreditation for Health Informatics and Information Management (CAHIIM). Results suggest an opportunity for improvement in the curriculum for development of person-related characteristics critical for leadership positions. In the interest of the progression of women these results should be taken into consideration.

Making Online Learning More Satisfying: The Effects Of Online-Learning Self-Efficacy, Social Presence And Content Structure, Jun Rong Nigel Lim, Sonny Rosenthal, Ye Jun Marcius Sim, Zhao-Yi Lim, Kai Rong Oh

Research Collection College of Integrative Studies

This study examines the effects of instructor presence and online learning self-efficacy on learning satisfaction, and how the effect of social presence may depend on content structure. In this study, undergraduate students in Singapore rated their online learning self-efficacy. Then they rated their learning satisfaction after watching each of four video lectures in a 2 (low versus high instructor presence) × 2 (low versus high content structure) repeated measures experiment. Findings show that learning satisfaction is related to instructor presence and online learning self-efficacy and that the effect of instructor presence is stronger for unstructured than for structured content. This …

Rethinking Thinking About Thinking: Against A Pedagogical Imperative To Cultivate Metacognitive Skills, Lauren R. Alpert

Dissertations, Theses, and Capstone Projects

In summaries of “best practices” for pedagogy, one typically encounters enthusiastic advocacy for metacognition. Some researchers assert that the body of evidence supplied by decades of education studies indicates a clear pedagogical imperative: that if one wants their students to learn well, one must implement teaching practices that cultivate students’ metacognitive skills.

In this dissertation, I counter that education research does not impose such a mandate upon instructors. We lack sufficient and reliable evidence from studies that use the appropriate research design to validate the efficacy of metacognitive skill-building interventions (not just evaluate their relationship to learning outcomes). I argue …

Authentic Assessment Framework May 2021 Version, Jen Harvey, Derek Dodd

Reusable Resources

The TU Dublin Authentic Assessment (AA) framework was designed to be used as a general guide.for staff undertaking assessment redesigns as part of a University Initiative under the IMPACT SATLE 1 funding call.

The Framework builds on the work of Gulikers et al, (2006) and Villerarroel et al (2020) and is structured across four dimensions: ‘Realism’, ‘Cognitive challenge’, ‘metacognition’, and ‘feedback processes’.

The resource provides a set of ideas that can be used to build the four dimensions into programme based Authentic Assessment strategies and practices.

A Training Intervention For Middle School Teachers On Culturally Relevant Instruction And Culturally Relevant Classroom Management Strategies, Vivian Yakpo Newton

Theses and Dissertations

A Training Intervention for Middle School Teachers on Culturally Relevant Instruction and Culturally Relevant Classroom Management Strategies.

Vivian Yakpo Newton, 2020: Applied Dissertation, Nova Southeastern University, Abraham S. Fischler College of Education and School of Criminal Justice.

Keywords: Culturally Relevant Education, Cultural Diversity, Classroom Environment, Middle School Teachers, Cultural Awareness This applied dissertation was designed to determine the effectiveness of the Middle School Teacher Training Intervention on the application of culturally relevant instruction and classroom management instructions by teachers in a Title I middle school in the southeastern United States.

This school lacked culturally relevant instruction and behavior management, despite …

Faculty Perceptions Of Dyadic Advising Relationships, Power, And Cultural Consciousness On College Student Learning Outcomes, Hind Albana

Seton Hall University Dissertations and Theses (ETDs)

Abstract

Academic advising in institutions of higher education lack consistent assessment and evaluation of practices impairing the ability to define the role, objectives, and methods utilized. Over-reliance on student satisfaction surveys for evaluating advising reinforces this phenomenon. To break the cycle, this study used survey responses from a nationwide sample (N = 156) of faculty advisors from public and private 4-year colleges and universities to examine the relationship between and among the constructs of a working relationship, shared power, cultural consciousness, and student learning outcomes. The questionnaire instrument score produced a Cronbach's alpha of .927, illustrating substantially strong internal consistency. …

Assessment Of Challenges And Prospects Of E-Marketing In The Development Of Nigerian Universities’ Education Lecturers In South-South, Nigeria, Patience Ewomaogene Okoro

Library Philosophy and Practice (e-journal)

This research paper examined the role of e-Marketing for sustainable growth and development in Nigeria. It determined e-Marketing strategies, especially online marketing strategies for sustainable growth and development in Nigeria. The simple random sampling method was used to draw the sample for the study. The total sample used was 600 entrepreneurs of which 586 copies of the questionnaires were retrieved. The instrument for data collection for this study was a questionnaire with a four-point Likert-scale format of Strongly Agreed 4 points (SA), Agreed 3 points (A), Disagreed 2 points(D), and Strongly Disagreed 1 point (SD). Data collected were analyzed using …

Measuring The Impact Of A Girls Education Program In Zambia

International Developments

The Zambian Girls 2030: Realizing My Potential program was initiated in 2016 through a partnership between the Ministry of General Education (MoGE) and UNICEF. The program aims to ensure better educational and employment outcomes for Zambian girls through various educational interventions at the secondary school level. The ACER evaluation will shed light on the results achieved against the targeted objectives and the potential for expansion of the program.

Nepal Shifts To The Testing Of Higher Order Skills

International Developments

An overhaul of the examination system in Nepal focuses on standardisation of exams and assessing higher order thinking skills at the end of basic education.

Integrative Principles In Preparation Of Future Foreign Language Teachers For Pedagogical Practice, Ravshan Sayfulin Teacher, Dilafruz Sandibaeva Teacher

Central Asian Journal of Education

The article discusses that improving the quality of teaching foreign languages in higher education on the basis of integrated approach is an important component of successful socialization of the individual and development in the world community, the mechanisms of which are implemented in the educational process. Particular attention is paid to organizing the educational process at the level of international standards on the basis of integrated approaches, ensuring the quality of educational content in harmony with the culture of the country where the language is studied, and expanding pedagogical and didactic opportunities.

Volume And Content Of Educational Materials Used In The Educational Process, Nigora Shuxratovna Ruzikulova Phd

Central Asian Journal of Education

This article addresses the issues of developing a methodological system for the use of teaching materials in the educational process, didactic aspects of their use, selection and description of teaching materials by size and content on the basis of harmonization with international assessment programs.

Understanding High School Assistant Principals’ Perspective Of Standardized Testing Policy For English Language Learners In Maryland, Jae Won Hwang

Seton Hall University Dissertations and Theses (ETDs)

Given federal and state mandates, school administrators in the United States are often held responsible for enacting standardized testing policies in their school settings. Standardized testing requirements apply for all students attending school including ELL (English Language Learner) students. However, a review of the literature finds that standardized testing for ELL students is problematic when schools interpret testing scores as some indication of content knowledge mastery. At the current time, content-area standardized testing policies and practices in public schools are not consistent with what we know about second language development. What is missing in the existing research is an examination …

Seeking Universal Education: From Singapore’S Educational Success, Gulnar Rzayeva

Master's Projects and Capstones

According to the Universal Declaration of Human Rights, education is considered a fundamental human right. However, this right is not accessible for every child. Not all education systems are capable of providing quality education. There are various reasons behind this issue. Based on the OECD and PISA records, Singapore has a successful education system with multiple ethnicities and religions. This study intends to discover some characteristics of Singapore's education system and the feasibility of achieving similar success in other practices. In the methodology part, based on a literature review on the education policy and the education system of Singapore, content …

Building Research Capacity Through An Academic Community Of Practice: A Design Case Study, Olga Koz, Anissa Lokey-Vega

Faculty Articles

Purpose – The study’s purpose was to examine the faculty-driven organization’s design and development that supports faculty research needs, track the emergence of the community of practice (CoP) and provide greater insight into continued organizational design iterations.

Design/methodology/approach – In this longitudinal design case study, the authors employed different methods to collect and analyze archival, quantitative, and qualitative data to capture the phenomenon’s complexity.

Findings – The findings challenge the assumption that only formal organizational structures and top-down management approaches stimulate research and build research capacity in universities and propose a new sustainable and agile informal organizational structure and strategies …

Pediatric Residency Academic Rotation Improves Self-Rated Proficiency In Quality Improvement Skills, Maria Heubeck, Rebecca Craig, Taylor Ford, Lanier Lopez, Grace Mccauley, Elizabeth Yakes Jimenez

Quality Improvement/Patient Safety Symposium

Category: In-progress research

Title: Pediatric Residency Academic Rotation Improves Self-Rated Proficiency in Quality Improvement Skills

Maria Heubeck, MD; Rebecca Craig, MD; Taylor, Ford, MD; Lanier Lopez, MD; Grace McCauley, MPH; Elizabeth Yakes Jimenez, PhD, RDN, LD

Introduction: As of July 2020, all second-year pediatric residents participate in a one-month academic rotation. The rotation focuses on quality improvement (QI), research, education and leadership skills and experience. This project aims to assess the impact of the rotation on residents’ self-reported QI proficiency, self-rated motivation to pursue scholarly activities, and competency based on ACGME milestones.

Methods: Pediatric residents participating in the academic rotation …