Education Commons^™

Implication Of Item And Test Differential Functioning In Criterion-Referenced Tests, Xiaojie Hu

Dissertations

In a compensatory criterion referenced test (CRT) it is common that the test developer maximizes the test information at or near the cut score location. This is believed to produce the highest classification accuracy. However, a recent study showed that the optimal location to maximize test information for highest classification accuracy (CA) and consistency (CC) also depends on factors such as test length, cut score location, the examinee ability distribution, and the test model applied for latent trait estimation (Wyse & Babcock, 2016). Moreover, when unintentional secondary dimensions are also measured (nuisance dimension caused by test construction, test standardization, or …

Review Of The Piaac Numeracy Assessment Framework: Final Report, Dave Tout, Diana Coben, Vince Geiger, Lynda Ginsburg, Kees Hoogland, Terry Maguire, Sue Thomson, Ross Turner

David (Dave) Tout

The Programme for the International Assessment of Adult Competencies (PIAAC) is an international assessment of the proficiency of adults (aged 16-65 years) in key information processing skills (reading, numeracy and Problem Solving in Technology-Rich Environments). The PIAAC Survey of Adult Skills has revealed that a considerable number of adults in OECD countries possess only limited literacy and numeracy skills. The OECD is currently reviewing the content of the frameworks and cognitive assessment instruments for the 2nd cycle of PIAAC ready for delivery in 2021-22. This report is the result of a review of the numeracy construct and assessment in PIAAC. …

Measuring Teacher Expectations: A Generalizability Study, Wallis Malone

Graduate Theses, Dissertations, and Capstones

For the last fifty years, researchers have studied teacher expectations and their impact on student achievement. A large body of research supports the hypothesis that teachers form expectations for students, (Brophy & Good, 1970; Dusek & O’Connell, 1973; O’Connell, Dusek & Wheeler, 1974; Rist, 1970), these expectations cause teachers to behave differently, (Braun, 1976; Brophy & Good, 1970; Rothbart, Dalfen, & Barrett, 1971, Good & Nichols, 2001) and the differential treatment can affect student achievement (Brophy & Good, 1970; Jussim & Eccles, 1992; Alvidrez & Weinstein, 1999; Goldenberg, 1992, Madon, Jussim, & Eccles, 1997).

Although teacher expectancy theory is widely …

Application Of The Fusion Model For Cognitive Diagnostic Assessment With Non-Diagnostic Algebra-Geometry Readiness Test Data, Robert H. Fay

USF Tampa Graduate Theses and Dissertations

This study retrofitted a Diagnostic Classification Model (DCM) known as the Fusion model onto non-diagnostic test data from of the University of Chicago School Mathematics Project (UCSMP) Algebra and Geometry Readiness test post-test used with Transition Mathematics (Third Edition, Field-Trial Version). The test contained 24 multiple-choice middle school math items, and was originally given to 95 advanced 6th grade and 293 7th grade students. The use of these test answers for this study was an attempt to show that by using cognitive diagnostic analysis techniques on test items not constructed for that purpose, highly predictable multidimensional cognitive attribute profiles for …

Final Report: Development Of An Online Engagement Scale, Darren Matthews, Ling Tan, Daniel Edwards

Dr Daniel Edwards

The Commonwealth Department of Education and Training commissioned the Australian Council for Educational Research (ACER) to review the Learner Engagement Scale (LES), a key measure of student experience. It is administered as part of the Student Experience Survey, an annual survey of a sample of the 400 000 first and final year undergraduates studying at Australian Higher Education institutions – 80 per cent on-campus and around 8 per cent off-campus. Over the years, LES results have consistently shown substantially lower engagement levels in off-campus students – far in excess of the variation between teaching modes that might be expected – …

The Unesco Institute For Statistics Reporting Scales: Concept Note, Australian Council For Educational Research (Acer)

Monitoring Learning

Measurement of learning achievement is essential to monitor how well education systems are delivering on the promise of universal quality education. This promise is reflected in the United Nations Sustainable Development Goal (SDG) Number 4 (Target 4.1): By 2030, ensure that all girls and boys complete free, equitable and quality primary and secondary education leading to relevant and effective learning outcomes. Goal 4 can only be meaningful if there is a shared global understanding of quality education, and relevant and effective learning. The various indicators associated with SDG Target 4.1 attempt to translate its key constructs into measurable outcomes against …

Is Setting Higher Standards The Answer?, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

Raising the expected performance standard in each year of school and holding all teachers and students accountable for achieving these higher standards may not be the most effective way to improve levels of performance in Australian schools.

A Different Way To Organise The School Curriculum, Geoff N. Masters Ao

Teacher columnist – Geoff Masters

There are good reasons to rethink how we organise the school curriculum. An alternative would be to structure the curriculum as a sequence of proficiency levels unrelated to age or year level.