Education Commons^™

Factors That Influence The Difficulty Of Problem Solving Items, Dara Ramalingam, Ray Philpot

Ray Philpot

Computer-based assessment of problem solving allows problems of both static and interactive natures to be posed. Examples of static problems are scheduling and logic puzzles in which all relevant information is available to the solver at the outset. Problems of an interactive nature, on the other hand, require exploration of the situation to acquire additional knowledge needed to solve the problem. Examples include discovering how to use an unfamiliar mobile telephone or automatic vending machine. This study used data from the 2011 Field Trial of the PISA 2012 computer-based assessment of problem solving which comprised 34 static and 45 interactive …

The Pisa Item Formats & The Development Of The Pisa Marking Guides, Joy Mcqueen, Juliette Mendelovits, Gayl O'Connor, Margaret Wu

Juliette Mendelovits

No abstract provided.

Performing Well In Timss And Pisa Mathematics And Science, Ray Philpot

Ray Philpot

Workshops delivered to department heads of participating schools to help schools utilise the released items in TIMSS and PISA by: educating participants about the cognitive skills and processes assessed by TIMSS and PISA in the domains of Mathematics and Science; demonstrating to participants ways that content skills are assessed in TIMSS and PISA items; demonstrating to participants some of the item types and provide recommendations for how teachers can introduce these item types to students; and enabling participants to provide training/orientation to teachers within their schools.

Pisa Reading Literacy Framework, Juliette Mendelovits

Juliette Mendelovits

No abstract provided.

Evaluation Of Booklet Effect In Pisa Mathematics Across Countries, Luc Le

Dr Luc Tu Le

In PISA 2003, 13 main linked test booklets were constructed by item cluster rotation design. Each student was randomly assigned one of the test booklets. Each of the selected clusters was located in four of the test booklets in different positions. There were seven mathematics clusters with a total of 85 items. Booklet effect was identified and was used to adjust the measure of student performance in PISA (see PISA 2003 technical report; OECD, 2004). This study was designed to explore which factors could account for this booklet effect in mathematics across 41 PISA countries. A three-faceted partial credit model …

Pisa And The ‘Latest Model’: Can An International Survey Have Anything Useful To Say To Canberra’S Mathematics Teachers?, Ross Turner

Ross Turner

Identifying Cognitive Processes Important To Mathematics Learning But Often Overlooked, Ross Turner

Ross Turner

Ameliorating Culturally Based Extreme Response Tendencies To Attitude Items, Maurice Walker

Maurice Walker

No abstract provided.

The Influence Of Equating Methodology On Reported Trends In Pisa, Eveline Gebhardt, Ray Adams

Prof Ray Adams

In 2005 PISA published trend indicators that compared the results of PISA 2000 and PISA 2003. This paper explores the extent to which the outcomes of these trend analyses are sensitive to the choice of test equating methodologies, the choice of regression models and the choice of linking items. To establish trends, PISA equated its 2000 and 2003 tests using a methodology based on Rasch Modelling that involved estimating linear transformations that mapped 2003 Rasch-scaled scores to the previously established PISA 2000 Rasch-scaled scores. This paper compares the outcomes of this approach with an alternative, which involves the joint Rasch …

Application Of Multivariate Rasch Models In International Large-Scale Educational Assessments, Ray Adams, Margaret Wu, C Carstensen

Prof Ray Adams

In large-scale educational assessments, such as the Programme for International Student Assessment (PISA) and the Trends in International Mathematics and Science Study (TIMSS), a primary concern is with the estimation of the population-level characteristics of a number of latent variables and the relationships between latent variables and other variables. Typically these studies are undertaken in contexts in which there are constraints on sample size and individual student response time, yet there are high expectations with regard to the breadth of content coverage. These demands and constraints have resulted in such studies using rotated-booklet designs, with each student responding to a …

Response To 'Cautions On Oecd's Recent Educational Survey (Pisa), Ray Adams

Prof Ray Adams

This paper refers to the work of S J Prais who questioned the outcomes of the Organisation for Economic Cooperation and Development's PISA survey of the reading, mathematics and science attainments of fifteen year-olds. Prais suggested that methodological flaws in Programme for International Student Assessment (PISA) had resulted in an apparent improvement in the attainment of British students, particularly when compared to their Swiss and German counterparts. This paper responds to Prais's criticisms, noting that when Prais's conjectures are tested with empirical data they are not supported. The author argues that many of Prais's criticisms are due to an incomplete …

The Pisa Item Formats & The Development Of The Pisa Marking Guides, Joy Mcqueen, Juliette Mendelovits, Gayl O'Connor, Margaret Wu

Gayl O'Connor

No abstract provided.

International Student Assessment For The New Millennium, Ray Adams

Prof Ray Adams

The author briefly describes the OECD initiated project, 'Program for International Student Assessment' (PISA), in which over 100,000 15 year old students from 4000 schools in 26 countries will participate. A major focus of the project is the assessment of wider knowledge, skills and competencies in literacy, mathematics and science areas.