Educational Assessment, Evaluation, and Research Commons^™

Fitting The Aqf For The Future: Revising The Aqf Architecture And Taxonomy, Anita Roberts, Louise Wignall, Daniel Edwards

Vocational, adult and professional education research

ACER has been contracted by the Australian Government Department of Education to explore potential revisions to the Australian Qualifications Framework (AQF) based on recommendations of the AQF Review, which was conducted in 2019. During a range of consultations for the project, the team have presented some options for the architecture and taxonomy of the AQF that would introduce changes suggested by the Review. The slides attached here form the ‘consultation pack’ that have guided the discussions in relation to this project.

Informing The Community-Based Learning Experience With Harold Mcnaron And August White, Harold Mcnaron, August White

PDXPLORES Podcast

In this episode of PDXPLORES, Harold McNaron and August White discuss how a collaboration with the American Association of Colleges and Universities will provide new information on how students experience community-based learning at PSU. The data provided by the project will support the University's efforts to improve racial and social justice through community and service-based learning opportunities. This project is supported by the University's Community Engaged Research Academy.

Click on the "Download" button to access the audio transcript.

Analysis Of Educational Eportfolio Use And Discussion On Its Implementation In Chinese Teaching, Peng Zhang, Rui Yang

Chinese Language Teaching Methodology and Technology

Numerous studies have explored e-portfolio implementation research in-depth; it has grown in popularity and become widespread. This study conducted a comprehensive review of the current secondary literature on the use of e-portfolios in education in order to narrow down the considerable volume of research, develop new knowledge, and further offer implications in Chinese teaching. This study synthesized the secondary articles from 2011 to 2021 and analyzed the retrieved data using the SWOT framework. A keyword search for e-portfolio and reviews generated 636 review articles. These papers were then scrutinized to see whether they fit the criteria, and 12 review articles …

Examinees’ Affective Preference For Online Speaking Assessment: Synchronous Vs Asynchronous, Yuxiao Du, Fangzheng Zhang

Chinese Language Teaching Methodology and Technology

With technological advancement and the COVID pandemic, online speaking assessment is increasingly used in language teaching. Two modes are developed: online synchronous testing (direct human-to-human interview) and online asynchronous testing (semi-direct human-to-machine interview). Ample literature has explored how each of the two online modes differs from traditional face-to-face speaking assessments. However, few studies have investigated the differences between the two modes, especially in terms of examinees’ affective preferences. This study, therefore, compares the extent to which each mode is accepted and favored by test takers and explores why such an affective preference emerges. The participants are 46 college students enrolled …

Mindfulness Of Basicpublic-School Principals In The Hashemite Kingdom Of Jordan And Its Relation To Risk Management From Teachers' Perspective, Ghadeer Abdul Hadi Saleh Al-Lraqbh, Khawla Husain Alaiwa

Journal of the Association of Arab Universities for Research in Higher Education مجلة اتحاد الجامعات العربية للبحوث في التعليم العالي

The study aimed at finding out the mindfulness of basic public-school principals in the Hashemite Kingdom of Jordan and its relationship with the risk management from teachers' prespective. The descriptive correlational methodology was used in this study. The sample of the study consisted of (385) male and female teachers in basic public- schools. A questionnaire was used as a mean of collecting data, after verifying its validity and reliability. The results of the study showed that the degree of availability of mindfulness among the principals of Jordanian basic public-schoolprincipals was high. The implementation of the Jordanian basic governmental school principals …

The Effectiveness Of The Eper Program And Its Relationship To Job Satisfaction Among Teachers Of Unrwa Schools / Jordan Field, Asma’ Yousef Awad, Khawla Husain Alaiwa

Journal of the Association of Arab Universities for Research in Higher Education مجلة اتحاد الجامعات العربية للبحوث في التعليم العالي

The study aimed to identify the effectiveness of the EPER program and in sight of the job satisfaction of teachers in the schools of the UNRWA/ Jordan Field. The study population consisted of (4049) male and female teachers, a sample of (533) teachers were selected in the region (North Amman, South Amman, Irbid, Zarqa). The researchers followed the descriptive correlative approach. A questionnaire was developed consisting of (38) items to measure the effectiveness of the EPER program, distributed over four areas, and (25) items for the job satisfaction tool.

The results of the study showed that the effectiveness of the …

Smart University Requirements And The Degree Of Availability In Jordanian Universities From The Students' Perspective, Mahasen A. Al Hassan, Ali Hussein Houriah

Journal of the Association of Arab Universities for Research in Higher Education مجلة اتحاد الجامعات العربية للبحوث في التعليم العالي

The study aimed to identify the requirements of the smart university and the degree of their availability in Jordanian universities from the students' perspective. The study used the descriptive approach, and a questionnaire was developed that was distributed to the sample of (385) students who were chosen by random method. The results of the study showed that the arithmetic averages of the axes of the degree of availability of smart university requirements in Jordanian universities came to a medium degree. It also found statistically significant differences because of gender on the responses of the study sample on the availability of …

Cognitive Conflict Levels Between Middle School Students With Learning Disabilities And Students Without Learning Disabilities, Stephanie Elizabeth Randall

Doctoral Dissertations and Projects

The purpose of this quantitative, causal comparative study was to measure differences in the level of cognitive conflict among middle school science students utilizing independent t-tests. This study supports increasing knowledge for middle school science educators and potentially contributes to improved curriculum design and delivery. This quantitative study examined levels of cognitive conflict within a sample size of 28 middle school science students with learning disabilities, with an individual education plan (IEP) or a 504 Plan, compared to a sample size of 28 students without learning disabilities, without an IEP or 504 Plan. This study related social cognitive learning among …

How Teachers' Level Of Technology Use Affects Minority Students' Map Scores: A Causal-Comparative Study, Darron Hannah

Doctoral Dissertations and Projects

This causal-comparative study sought to assess group differences between teachers’ level of technology usage and minority students’ (i.e., Black and Hispanic) Measure of Academic Progress (MAP) scores in grades 6-8 in Georgia public schools. This study adds to the body of literature that indicates academic gains from using digital technology in the classrooms and ensuring that digital technology interconnects with quality instruction to drive academic performance for minority students. The current study analyzed Teachers’ Attitude Towards Computers (TAC) and students’ examination scores from the 2021 to 2022 English, Reading, and Math MAP assessment to determine whether teachers’ technology usage level …

An Exploratory Multiple Case Study Of Discipline Practices In A Major Metropolitan Public School District: A Look Into The School To Prison Pipeline, Neil French, Kristin Calvert-French, Phyllis Jackson, Erin King

Dissertations

The school to prison pipeline is a phenomenon fed by exclusionary discipline practices that increase the likelihood that a student will have an interaction with the juvenile or criminal justice system at some time in their life; this phenomenon disproportionately affects Black students. Understanding the problem is key to slowing down the school to prison pipeline. This study of a school district in Missouri explores questions about how interpersonal relationships, implicit bias awareness, and school policies influence the learning environment, and how those factors relate to school discipline, which ultimately can lead to the school to prison pipeline. Drawing data …

Overview Of The Proceedings Of The 2021 Inclusion In Science, Learning A New Direction, Conference On Disability (Island), Cary Supalo, Jasodhara Bhattacharya, Daniel Steinberg

Journal of Science Education for Students with Disabilities

No abstract provided.

Possible Causes Of Leaks In The Transfer Pipeline: Student Views At The 19 Colleges Of The City University Of New York, A. W. Logue, Yoshiko Oka, David Wutchiett, Kerstin Gentsch, Stephanie Abbeyquaye

Publications and Research

Only 11% of community college (associate’s-degree) students transfer vertically and obtain a bachelor’s degree within six years, despite over 80% originally intending to do so. These leaks in the transfer pipeline disproportionately affect students from underrepresented groups, who are more likely to attend community colleges and to leak out of the pipeline. To obtain insights about how to decrease these leaks, a survey was distributed to all City University of New York undergraduates; 31,511 responded. The survey concerned students’ life and academic circumstances, as well as their information about and views on transfer. Analyses particularly compared responses of never-transferred associate’s …

State Of The Methods: Leveraging Design Possibilities Of Qualitatively Oriented Mixed Methods Research, Cheryl N. Poth, Peggy Shannon-Baker

Curriculum, Foundations & Reading: Faculty Publications

No abstract provided.

The Influence Of A Learning Management System (Lms) And Microblogging On Social Presence, Sense Of Community, And User Interface Satisfaction In A Distance Education Course, Andrew G. Leach

Organization, Information and Learning Sciences ETDs

The impact of social media on everyday life is undeniable. Social media has transcended its initial purpose of connectivity and branched into other sociocultural aspects. Educators must create a rich and active learning environment where students can actively engage with their educational curriculum. This study used a mixed methods approach to investigate the influence that learning management systems (LMS) and microblogging (social media) have on key elements of distance education design. These elements include social presence, sense of community, and overall user interface design. Students’ perceptions of these elements were collected from students enrolled in a graduate course during summer …

Publication Dynamics: What Can Be Done To Eliminate Barriers To Publishing Full Manuscripts By The Postgraduate Trainees Of A Low-Middle Income Country?, Hafsa Majid, Lena Jafri, Sibtain Ahmed, Muhammad Abbas Abid, Mohammad Aamir, Aamir Ijaz, Aysha Habib Khan, Imran Siddiqui

Department of Pathology and Laboratory Medicine

Objectives: This study aimed to determine the publication rate of free paper abstracts presented by the postgraduate (PG) trainees and determine the reasons for non-publication. A mixed methods study was conducted. PG trainees presenting free papers at the at the Pakistan Society of Chemical Pathologist conferences from 2012 to 2018 were included. Three databases were searched to identify if the abstracts were published or not. The PG trainee authors of abstracts not published as full manuscript, were surveyed to determine the barriers and challenges in publishing a manuscript.
Results: The average rate of full manuscript publication was 51.8% (n = …

Scholarly Activity In Residency: A Needs Assessment Of Challenges And Proposed Solutions, Jonathan Hall, Jana L. Wardian Phd, Jasmine R. Marcelin

Graduate Medical Education Research Journal

Introduction

Resident physician participation in scholarly activity is associated with significant benefits ranging from trainees’ personal development to improved quality of patient care. Residency programs have taken varied approaches to improve resident engagement in scholarship, though interventions have demonstrated mixed results regarding objective measures of scholarly productivity. Concerns regarding waining interest in scholarship amongst internal medicine residents prompted a department-wide needs assessment to evaluate opportunities for scholarship and challenges preventing resident participation.

Methods

A web-based survey was developed and distributed to Department of Internal Medicine faculty and residents at the PGY2 level or higher and recent graduates within the last …

Exploring Ungrading In An Elementary Writing Methods Course, Jen Mcconnel

Teaching/Writing: The Journal of Writing Teacher Education

In this reflective piece, I discuss what I learned when I began to implement ungrading practices in my institution's elementary writing methods course. Based on this ongoing experiment, I offer three suggestions for other teacher educators who are intrigued by ungrading but not sure where to start.

Remote Learning - The Future Of Education: Effective Instructional Strategies Used By Parent Educators And Recommendations For Building Capacity, Raelene Ferguson Haugen

Dissertations

Purpose: The purpose of this mixed methods Delphi study was to identify the remote learning instructional strategies used by expert Southern California parent educators for implementing the anticipatory set, modeling, checking for understanding, and guided practice elements of Madeline Cheek Hunter’s Instructional Theory Into Practice (ITIP) framework. The study sought to identify how expert Southern California parent educators rated the effectiveness of the remote learning instructional strategies in the aforementioned elements of Hunter’s ITIP framework. Additionally, the purpose was to generate recommendations from expert Southern California parent educators to build capacity in the identified effective instructional strategies.

Methodology: The classical …

Book Review: Going Gradeless, Grades 6–12: Shifting The Focus To Student Learning, Ana De Jesús, Alesia Mickle Moldavan

Excelsior: Leadership in Teaching and Learning

This book review of Going Gradeless, Grades 6–12: Shifting the Focus to Student Learning by E. Burns and D. Frangiosa (2021) provides an alternative pedagogical method to assessment that uses a “gradeless” approach to learning for purposes of removing the stress and negative impacts of traditional grading practices while maintaining accountability with equity in mind. In this review, we describe the foundational underpinnings that frame the book and summarize some of the observed benefits as well as challenges faced by the authors who implemented this approach. We provide an overview of the chapters situated in four major takeaways guiding this …

Shared Voices Of Indonesian Teacher-Educators From Virtual Research-Workshop-Series: Reflections On Covid-19 Pandemic Driven Professional Development, Dyah Sunggingwati, Sudarman Sudarman, Abdul Hakim, Haviluddin Haviluddin

The Qualitative Report

This study aims to explore the perceptions and experiences of Teacher-Educators (TEs) who participated in virtual research-workshop-series as professional development programs. Six TEs, three from natural science and three from social science, participated in a nine-month virtual research workshop series organized by the faculty. In the frame of a case study, the data were gathered from in-depth interviews and a set of questions. The findings revealed that TEs had sufficient research knowledge as they were able to identify good quality of research, read relevant reading research, and signified the importance of research as part of their professional identity. Completion of …

Understanding Student Perspective’S Around Diversity, Equity, And Inclusion Within The School Of Social Work, Anna Yelick, Dee Sherwood

Assessment Grants

Diversity, equity, and inclusion (DEI) has become a prominent fixture within the social work profession, with educational and professional organizations paying closer attention to issues related to DEI. The Council on Social Work Education (CSWE), the governing body for accrediting social work education programs, has required social work programs to demonstrate a commitment to DEI in their implicit curriculum. Therefore, the School of Social Work is interested in understanding student perspectives and experiences of DEI efforts particularly within the implicit curriculum.

Curriculum Re-Mapping For Fashion Merchandising Program, Zee-Sun Yun, Kelly Weathers, Chitra Singh

Assessment Grants

This project was the re-mapping of the Fashion Merchandising major (FMEJ) curriculum to improve the program curriculum and meet the standards of Textile and Apparel Programs Accreditation Commission (TAPAC) curricula and learning outcomes. The review feedback from diverse professional sources (i.e., the TAPAC committee, program faculty, industry professional, and expert) guided our decision to revise the FMEJ curriculum by proposing new courses, the proper sequencing of fashion merchandising courses, the degree to which the curriculum supports student learning, and the extent to which learning outcomes are appropriately addressed.

Educators’ Perceptions Of Middle Level Education In A State Without A Middle Level Teacher Credential, Ben Seipel, Rong-Ji Chen, Erika B. Daniels, Acacia M. Warren, Roxanne Greitz Miller

Education Faculty Articles and Research

The Association for Middle Level Education (AMLE) presents a framework of middle level education and defines five essential attributes and 18 characteristics of successful middle schools (Bishop & Harrison, 2021). Young adolescents’ unique cognitive, moral, socio-emotional, and identity development is at the center of this framework. Several empirical studies suggest that middle school teachers with specialized preparation performed better in many key areas than their counterparts with elementary or secondary licensure (Mertens et al., 2005; Ochanji et al., 2016). Despite researchers’ calls for specialized preparation of middle grades teachers. California does not offer a middle level teacher credential. The purpose …

Creating A Culture Of Assessment: Building A Sustainable Model For Communicating Results To Guide Change, Amy Heath, Carrie Barrett

Assessment Grants

The Doctor of Physical Therapy (DPT) has been an active program at Western Michigan University for three years. Using data from the first cohort that completed the DPT program, the Curriculum and Program Evaluation and Assessment Committee (CPEAC) is reviewing the DPT course content and sequencing within the curriculum for efficiency and effectiveness. This grant will fund a model comprised of (a) data analysis and (b) a retreat to discuss results with faculty instructors. The model will improve best-practice in higher level education curricular assessment, engage faculty, assess student outcomes, and provide a curricular assessment blueprint for other university departments.

Creation And Assessment Of Inclusive Pedagogical Materials In The Spanish Program, Germán Zárate-Sández

Assessment Grants

Data compiled in the Department of Spanish showed that Black students at Western begin Spanish education at high rates but are less likely to advance to upper-level courses and more likely to obtain lower final grades than other groups. Assuming that part of this issue derives from current materials that do not represent Black students, the goal of this mini grant is to develop Spanish learning materials that are more inclusive and representative of the Black experience in Hispanic communities. The materials are expected to be a contribution to improving retention and academic achievement of Black students in the Spanish …

Celcis Assessment Plan/Process Revision, Eva Copija

Assessment Grants

This project will involve revising CELCIS assessment plan/process to make it more meaningful, measurable and manageable and to follow the guidelines of the Commission on English Program Accreditation (CEA), which recommended such revision in response to our 5-year interim report. The steps will include: revising learning outcomes for four kinds of courses at four different levels: elementary, intermediate, pre-advanced and advanced to make them more specific and measurable; aligning evaluation instruments with the learning outcomes; updating our model syllabi to make them reflect the correspondence between the learning outcomes and evaluation instruments, and redesigning progress reports given to students.

Establishing Content Validity For Wmu’S Special Education Key Assessments, Rena Vanderwall, Kate Lalonde

Assessment Grants

This project seeks to validate the content in the key assessments used in three special education programs at WMU. The purpose of key assessments is to assess student performance and drive ongoing program improvement. Shared key assessments across WMU’s teacher education programs have been validated, but those specific to special education have not been. Establishing content validity includes gathering evidence to demonstrate that the assessment content fairly and adequately represents a defined domain of knowledge or performance. Validation of these assessments will lead to stronger assessment of teacher candidates’ performance and continual improvement of these programs.

Helping Utah Landowners Reduce Pesticide Use Through A Statewide Ipm Program, Nick Volesky, Mair Murray

Outcomes and Impact Quarterly

The Utah Integrated Pest Management (IPM) program provides outreach and education to Utahns to reduce pesticide use and ultimately protect human and environmental health. In 2022, the IPM program responded to stakeholders’ needs by partnering with county Extension offices to deliver eight (8) in-person workshops across the state. The workshops connected Extension specialists and county faculty with managers of home landscapes and farms. The objective of the workshops was to provide participants with IPM skills to identify, monitor, and manage pest problems in preparation for the upcoming growing season.

Developing And Piloting A Design Guide For Outdoor Classrooms In Utah, Derek Jenson, Jake Powell, David T. Anderson, Rose Judd-Murray

Outcomes and Impact Quarterly

The outdoor classroom design guide can help applicants successfully apply for the Utah Outdoor Classroom Grant introduced by the Office of Outdoor Recreation (OOR) in 2021. The design guide includes case studies, design resources, and critical information for community involvement from statewide locations and will serve as a free public resource.

It’S All About To Change: Implications Of Reforming Grading & Assessment Within A Public School District, Divonna M. Stebick, Megan L. Pilarcik, Daniel W. Hartman

Education Faculty Publications

Calls to reform grading systems and other assessment practices have been growing for several decades. There is consensus among many educators that grading and assessment practices that have been traditionally accepted as good practice are at best ineffective and at worst have a negative impact on raising achievement. Consequently, there is no single solution or methodology for grading that has emerged as the best practice. A variety of contemporary grading approaches have gained widespread popularity in recent years, typically being referred to as standards-based grading, standards-referenced grading, proficiency-based grading, or competency-based learning. A challenge, however, is that different school districts …