Educational Assessment, Evaluation, and Research Commons^™

Faculty Achievements Report, September 2022, Otterbein University

Faculty Achievement Reports

No abstract provided.

Qa Manual 2022 - 23, Cct College Dublin

Quality Assurance Manuals

The Quality Assurance Manual for CCT College Dublin, September 2022

Teaching Euclidean Geometry Using Proof And Dynamic Geometry Software, Cheryl Stoddard

Mathematics Graduate Theses

This paper examines incorporating proofs and dynamic geometry software when teaching Euclidean geometry to produce deeper understanding of geometric relationships for middle and secondary level students. The utilization of technology through classroom investigations and activities has shown to have an impact on the achievement scores on posttests and in the development of mathematical proof.

Local Norms And Gifted/Talented Identification In Arkansas, Sarah C. Mckenzie, Josh B. Mcgee, Bich Tran, Kathryn Barnes, Charlene A. Reid

Policy Briefs

In this brief, we summarize recent research from OEP examining if using school- or district-level norms from state assessments would increase the racial and programmatic diversity of Arkansas students identified as Gifted and Talented (G/T). Using ten years of administrative data to analyze the outcomes of a local norms approach compared to the current G/T identification strategies, we find no consistent evidence that using a local norms approach for G/T identification would improve racial or programmatic diversity.

The Lack Of Representation In Leadership At Predominantly White Institutions In The United States: A Qualitative Analysis On The Executive Leadership Pathway For African American Males, Eric Pulley

All Theses And Dissertations

This qualitative phenomenological study examined the lived experiences of Black men in the United States who have overcome barriers to advance to leadership positions at predominantly White institutions (PWI). The qualitative phenomenological approach was used to examine three research questions that addressed the factors that encouraged Black men on their paths to pursue executive leadership positions, the obstacles they encountered, and how identifying as a Black male at a PWI affected their career pursuits. Social support theory (SST) guided the theorical framework and critical race theory (CRT) guided the conceptional framework. Interviews from six participants were used. During the interviews, …

Readiness, Response, And Recovery: The Impacts Of Covid-19 On Education Systems In Asia, Anna Dabrowski, Yung Nietschke, Syeda Kashfee Ahmed, Amy Berry, Maya Conway

Monitoring Learning

This review provides insights into COVID-19 responses in educational systems in Asia, and to understand which policies and practices were already in place to contribute to system readiness and resilience. Although the evidence base remains scarce, reflecting on the different system and school-level responses in Asia provides opportunity to identify gaps in current policies and research, and consider new ways in which countries in Asia can strengthen their educational systems into the future. It considers what makes an education system resilient, and the importance of school level practices. It uses an analytical framework to review readiness, response and recovery, and …

Practical Leadership In Implementing Online Education Programs, Felix O. Quayson, Christopher Zirkle

Journal of Research Initiatives

The growing presence of online education can become a challenge for academic leaders and institutions to lead, manage, and explore in higher education. Online education can be complex when considering the social presence (Keast, 2022; Quayson, 2022), course development (Martin et al., 2019; Orlando, 2019), and economic outcomes (Burnett & Conley, 2013; Rubin, 2013; Seaman et al., 2019). However, unraveling the fundamentals of practical leadership can help educational leaders to facilitate, maintain, and implement online education programs. The study found published research studies that helped us to extricate the fundamentals of practical leadership in implementing online education programs in the …

Trauma-Informed Practices For Test-Taking Anxiety At The Elementary Grade Level, Kate Campbell, Shalini Mathew

Journal of Research Initiatives

Test -Taking Anxiety (TTA) is a challenging experience for children of all ages. Childhood exposure to trauma and adverse experience has been increasing. Fortunately, trauma-informed practices, such as mindfulness activities have become more widespread in schools throughout the last few years. Existing school counseling literature offers limited perspectives on how school counselors can support elementary students for TTA. This conceptual article explores the effects of trauma-informed practices on elementary-age students' test anxiety and overall academic success in schools and offers implications for practice.

Parent Survey 2022, Sarah C. Mckenzie, Josh B. Mcgee, Charlene A. Reid

Arkansas Education Reports

In late 2021, the Office for Education Policy at the University of Arkansas administered a survey about education topics to a representative sample of 500 Arkansas parents of school-aged children. The students of these parents attended traditional public schools (66%), public charter schools (10%), public magnet schools (4%), and private schools (7%). Eleven percent of parents reported that their child was homeschooled, and 2% reported that their child attended school through a virtual platform.

Arkansas Parent Survey 2022, Sarah C. Mckenzie

Arkansas Education Reports

The Office for Education Policy at the University of Arkansas administered a survey on education topics to a representative sample of 500 Arkansas parents of school-aged children in late 2021 and addressed a variety of education-related topics.

Pre-Service Teachers’ Perceptions Of Problem-Based Learning For Developing Their Mathematics Teaching Pedagogy, David A. Martin, Romina Jamieson-Proctor

Research outputs 2022 to 2026

The study reported in this paper was part of a larger study that explored pre-service teachers’ perceptions of the effectiveness of a problem-based learning (PBL) teaching approach for developing their mathematics pedagogical content knowledge (PCK) and their ability to enact their PCK in a tertiary mathematics education subject. This paper reports the qualitative semi-structured interviews used to capture the student voice with respect to the impact of the PBL approach used on the development of their mathematics PCK in comparison to their previous experiences with teacher-directed instruction. Overall, responses from the interviews revealed the pre-service teachers considered the PBL method …

Improving Language Teaching And Learning Process With Dual Coding Theory Approaches, Citra Kurniawan, Shirly Rizki Kusumaningrum, Kee-Fui Turner Lam, Ence Surahman

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

Dual coding theory (DCT) allows students to process information based on stimuli in the form of visual-verbal signals. This study aims to measure the relationship between the implementation of DCT on the process of Teaching & Learning. An experimental approach involving 101 students was used. The results showed that the DCT theoretical approach can be used to improve the language learning process. The research findings also showed that the learning strategies correlation coefficient is positive 0.826** which means that DCT has a very strong relationship with learning outcomes. In addition, the variables of gender and learning strategies demonstrated a positive …

‘Freedom To Learn-Independent Campus’And Pre-Service Teachers Proffesional Identity Development, Lemmuela Alvita Kurniawati, Vinanda Kristianti

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

In response to the implementation of Merdeka Belajar (Freedom to Learn)- Kampus Merdeka (Independent Campus), this study aimed to investigate the perceived impacts of Freedom to Learn-Independent Campus (henceforth FLIC), on pre-service Teacher Professional Identity (henceforth, TPI) development. A qualitative research method by using a thematic analysis was used to analyze the data. Homogeneous online focus group discussions with three different groups of participants joining FLIC program were conducted to collect the data. There were twelve pre-service teachers who joined FLIC program involved in this study. The findings were elaborated under three themes. The themes were becoming and being didactical …

Physical Education: Study Of Different Perceptions Of Students On The Concept Of Physical Education In First Middle School And Vocational Middle School, Mu’Arifin Mu’Arifin, Mashud Mashud, Zsolt Nemeth

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

This research aims to measure the truth level of the perception of the students on the physical education concept, and to figure out the difference perception between male and female students at the junior high school and vocational high school levels. Method used is survey with the use of closed inventory questionnaire. This study is conducted on two populations, that are 3700 students of X class at Vocational High School in the Regency of Banyuwangi and 750 students of VIII class at Junior High School in the Regency of Pacitan. Study sample is taken by purposive so that it is …

Penguatan Karakter Bernalar Kritis Berbasis Integratif Moral Untuk Siswa Sekolah Dasar Dalam Program Kampus Mengajar Di Indonesia, Nursalam Nursalam, Suardi Suardi

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

The research objective is to produce a model for strengthening character education based on critical reasoning moral integration for elementary school students in campus teaching activities in Makassar City. This research uses mixed research methods, using questionnaires, observations, interviews and documentation, then analyzed qualitatively and quantitatively. The results showed that strengthening the character of critical reasoning based on moral integrative and social collaboration was in the very frequent category at all stages of moral knowing, feeling, sinverbal, action, habitus and culture from various campus teaching activities such as task assignment, giving direction, thinking together, and carry out tasks according to …

Integrating Electronic Portfolio Assessment Into Teaching Materials: An Exploratory Study On Speaking Course Syllabus Development, Moh. Taufik, Nur Mukminatien, Suharyadi Suharyadi, Sari Karmina, Bambang Yudi Cahyono, Tengku Intan Suzila Bt Tengku Sharif

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

The ICT advancement provokes the possibility of developing speaking skill through portfolio assessment which was commonly attributable mostly to writing skill. Hence, an exploratory study adopting ADDIE model was conducted to develop an electronic portfolio assessment integrated into teaching materials. A triangulated technique of data collection: questionnaire respondents, interviews and data from evaluation sheets was gathered. Statistical descriptive analysis, discourse and content analysis were conducted and positive possibilities were found to ffacilitate the development of speaking skills through electronic portfolio assessment.

Developing Intercultural Communicative Competence In Foreign Language Classrooms: A Study Of Efl Learners In China, Li Liu, Bo Jiang, Ziwei Guo

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

Intercultural communicative competence (ICC) has been accentuated with the wave of globalization. Universities in China have highlighted ICC in language classrooms. Following Byram’s (1997) ICC model (including knowledge, skills and attitudes), this study focuses on the efficacy of explicit instruction in developing ICC among EFL (English as a Foreign Language) learners in classrooms in China, and to discover how this development is related to the English proficiency. This research therefore has two purposes: (1) to use a mix of quantitative and qualitative methods to assess ICC including questionnaire through self and others after explicit instruction. And (2) to investigate the …

Identifying Basic Aircraft Structures Using Project-Based Learning In Esp Context: Is It Effective?, Dewanti Ratna Pertiwi, Ndaru Atmi Purnami

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

English for specific purposes (ESP) is a branch of English instruction prepared to facilitate the students master English used in a particular field. In aerospace field, one of the objectives of ESP is mastering basic aircraft structures as the fundamental knowledge for further development such as aircraft maintenance and management. Mastering a number of technical terms in aerospace is challenging since they are not commonly used in daily life. Thus, a strategy is needed. Project-based learning (PBL) is proposed as an appropriate technique for engineering students due to its advantages; facilitating communication, creativity, collaboration, and critical thinking. Nevertheless, identifying whether …

The Dominant Soft Skills That Affect Readiness Of Vocational Graduate In Entering Construction Labor Market, Nathanael Sitanggang, Putri Lynna Adelinna Luthan, Felix Andika Dwiyanto, Satrio Dwi Sanjaya

Jurnal Pendidikan: Teori, Penelitian, dan Pengembangan

This study aims to recognize the dominant soft skills factors that influence the readiness of vocational education graduates to enter the job market in the field of construction. The method used is survey study including samples that consisted of 40 workers graduated from State University of Medan civil engineering diploma 3. The instruments used were the soft skills and the competence readiness questionnaire with reliability coefficients of 0.93 and 0.98. Furthermore, the multiple regression analysis techniques is used to test the hypothesis. The results shows that the soft skills readiness influencing 74% the vocational education skills readiness in entering the …

Evidence Based Practice: Assessing The Educational Outcome, Michelle Brady Dr., Des Gallagher

Pacific Journal of Health

Healthcare providers and patients strive for optimal outcomes with a growing trend to embed the principles of evidence-based practice (EBP) into mainstream care delivery by practicing dentists. The foundations of future best practice are built at dental school. How do we evaluate the outcome of an EBP syllabus?

This study describes the use of the KACE assessment tool to assess the learning outcomes of final year DDS students who had completed an EBP program. The use of a validated instrument to measure four dimensions, knowledge, attitudes about it, familiarity with sources for accessing evidence and confidence in critical appraisal skills …

More Work, Less Reward: The Minority Tax On Us Medical Students, Marija Kamceva, Baffour Kyerematen, Sabina Spigner, Samuel Bunting, Simiao Li-Sauerwine, Jane Yee, Michael Gisondi

Journal of Wellness

Introduction: Minority tax is defined as the burden of time and resources placed on minority persons to represent and advocate for their communities. We determined whether medical students underrepresented in medicine (URM) or from historically excluded (HE) populations experience a minority tax and characterized its effects.

Methods: This cross-sectional survey of US medical students occurred November 2020 - June 2021. We used Mann-Whitney U tests to compare metrics between URM and HE participants and their peers. The primary outcome was time invested in activism/diversity initiatives versus other work. Secondary outcomes included measures of microaggressions, discrimination, institutional culture, anxiety/depression, …

Teachers’ Assessment Literacy And Design Competence Framework, Sladana Krstic, Sarah Manlove, Sarah Richardson

2021-2030 ACER Research Conferences

Teachers play a central role in facilitating learning and empowering learners (Pastore & Andrade, 2019). They must possess a high level of assessment literacy to properly fulfil their role of implementing teaching and facilitating students’ learning (Hattie, 2009). Without it, the quality of educational provision can be impacted (Looney et al., 2018). The expectations placed on teachers in relation to their assessment knowledge and skills tend to focus on their ability to design and implement assessment with students, and to use assessment data to inform teaching practices (Brookhart, 2011). Much of the emphasis in the literature is on the mechanical …

Assessing Reading: How Assessment Can Be Used To Target Teaching And Enhance Understanding Of Reading Comprehension, Sandra Knowles

2021-2030 ACER Research Conferences

The skills demonstrated by a proficient reader are not easy to untangle. Current research acknowledges that reading comprehension is a highly complex area of ability, one that needs to be understood as the coordination of several integrated processes. Using example test questions and data, this presentation explores how assessment can help us make sense of reading comprehension in a way that curricula and commonly used teaching strategies cannot. Assessment is evidence that informs us about the skills involved in the reading process, how they relate to each other, and how they develop in complexity. When assessment is understood in this …

Evidence-Informed Early Language And Literacy Practice: Implementation Of A New Formative Assessment For Early Language And Literacy Development, Sarah Groom, Mary-Ruth Mendel, Eric Brace, Philippa Pryor

2021-2030 ACER Research Conferences

With one in five Australian children starting school developmentally vulnerable, there is a need in this critical period for visibility over children’s oral language and early literacy development. The Australian Literacy and Numeracy Foundation (ALNF) partnered with a Northern Territory primary school to implement the Early Language and Literacy Development Index (ELLDI), a newly-created valid and reliable assessment which places children on a progression scale for oral language and early literacy development and provides meaningful, accessible recommendations for educational practice. Twenty-three children in the school’s transition cohort were measured using the ELLDI at the beginning and end of the school …

Making Learning Visible: Moving From Nouns To Verbs, Diane Debacker

2021-2030 ACER Research Conferences

This presentation focuses on the need to make learning visible for all constituents – learners, educators, employers, policymakers and future employees – with a focus on the work of the Center for Certification and Competency-Based Education (C3Be) at the University of Kansas (USA). As K–12 and higher education move to a post-pandemic world, it’s imperative we find different ways to identify learner outcomes and evaluate learning. By moving from nouns to verbs; by moving from course titles to competencies; by moving from transcripts to learner outcomes, learning becomes visible. International educator and founding director of C3Be, Dr Diane DeBacker shows …

Assessment Moderation: Is It Fit For Purpose?, Lenore Adie

2021-2030 ACER Research Conferences

This presentation outlines the different practices and purposes of assessment moderation and analyses the benefits and issues of these. Two projects are presented; each seeks to improve teacher judgement. Both attempt to redefine what we mean by moderation and how moderation can be conducted to reach diverse and dispersed groups. The first draws on a current Australian Research Council project that is exploring the development of scaled exemplars, the use of commentaries of judgement decisions, and the use of digital platforms to support teachers grading student work. The second draws on the work of the Graduate Teacher Performance Assessment (GTPA) …

The Transformational Change Of Adaptive Assessment, Jarrod Hingston, Toby Newton

2021-2030 ACER Research Conferences

Organisational change theory often discusses the differences between adaptive change and transformational change; adaptive change being the process of incremental shifts that are intended to drive improvement, while transformational change requires major alterations in processes. In 2019, ACER embarked on a mission to develop a new adaptive testing and reporting system, with the goal of delivering an assessment that would improve the precision of results for every student. While the intention was to introduce an adaptive change in the assessments, the project truly transformed the way that ACER delivers assessments and reports results, a result recognised by the project being …

Sharing And Securing Learners' Performance Standards Across Schools, Richard Kimbell

2021-2030 ACER Research Conferences

Assessing learners’ performance makes very different demands upon teachers depending on the purpose and the context of the assessment. But common to all assessment is some sense of what ‘quality’ looks like. Most often teachers engage in formative assessments in the classroom, and the familiar standards of the classroom are adequate for this purpose. However if teachers are to undertake external, nationally regulated assessment then some sense of a national standard of quality is required. But there are very limited mechanisms by which teachers can acquire this understanding, so they use their best judgement, and standards vary from school to …

An Innovative Method For Teachers To Formatively Assess Writing Online, Dr Sandy Heldsinger, Stephen Humphry

2021-2030 ACER Research Conferences

Assessment is an integral component of effective teaching and a teacher’s professional judgement influences all routine aspects of their work. In the last 20 years, there has been considerable work internationally to support teachers in using assessment to improve student learning. However, there is a pressing issue that impedes teacher professional judgement being exploited to its full potential. The issue relates to teacher assessments in the context of extended performances such as essays and arises from the complexity of obtaining reliable or consistent teacher assessments of students’ work. Literature published in the United States, England and Australia details evidence of …

Using Pat Data To Inform Teaching And Learning, Marc Kralj, Rachel Felgate, Shani Sniedze, Caithlin Power, Grant Barclay, Darren Leech

2021-2030 ACER Research Conferences

ACER works with thousands of Australian schools to set up Progressive Achievement Test (PAT) functionality, assign and administer tests, and to assist teachers to understand and interrogate the resulting test data and act upon findings. This session provides participants with an opportunity to hear about a school’s journey, and discuss this with the ACER team and our PAT school guest. ACER researchers have evaluated and documented assessment implementation and professional development opportunities, observing this school’s ability to track student and educator progress over time, which is a critical element in ACER’s Progressive Achievement approach. ACER’s educational consultants will demonstrate how …