Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 30 of 34

Full-Text Articles in Education

Reduce Randomly Guessing Effects In A University Generic Skills Test, Luc T. Le Jun 2018

Reduce Randomly Guessing Effects In A University Generic Skills Test, Luc T. Le

Dr Luc Tu Le

There frequent concern of guessing with multiple-choice questions (MCQ) in item response theory (IRT), particularly with the Rach model where a guessing parameter is not included.  A practical solution is done post-hoc by removing responses to items too hard for a low ability examinee (see Andrich, et al., 2011; RUMM 2030, Andrich et al., 2012; Winsteps, Linacre, 2012). This study is used data from The Special Tertiary Admissions Test (STAT) to explore whether such responses from lower ability candidates to a hard item in a real test could be considered as randomly guessing and how Rasch item difficulty estimates improve …


Effect Of Trial Items On Candidate Performances In A Large-Scale Postgraduate Medical Selection Test, Luc T. Le Jun 2018

Effect Of Trial Items On Candidate Performances In A Large-Scale Postgraduate Medical Selection Test, Luc T. Le

Dr Luc Tu Le

The Graduate Australian Medical School Admissions Test (GAMSAT) is a cognitive test developed by the Australian Council for Educational Research (ACER) for the Consortium of Graduate-entry Medical Schools. GAMSAT consists of two writing tasks and two multiple-choice (MC) sections: Reasoning in Humanities and Social Sciences (75 items), and Reasoning in Biological and Physical Sciences (110 items). In each administration, each of the two MC sections includes different test booklets with the same cored items but different sets of trialled items. The trial item sets have been aimed to be equivalent in contents and difficulty levels across the test booklets. This …


Evaluate Item Dependency In An Aptitude Reasoning Test, Luc T. Le Jun 2016

Evaluate Item Dependency In An Aptitude Reasoning Test, Luc T. Le

Dr Luc Tu Le

The Special Tertiary Admissions Test (STAT), developed by the Australian Council for Educational Research (ACER), is as an alternate method of gaining entry into Australian university courses, for people who do not hold a recent Year 12 certificate in Australia. The test compromises 64 scored multiple-choice items, half of which are Verbal Reasoning questions and the other half, Quantitative Reasoning questions. Items were designed in testlets, where they could share the same stimulus (example, text paragraph). A natural question here was if the local independency assumption was violated in any sets of the items of the testlets. To investigate the …


Investigating Stability Of Item Parameters In One And Two-Parameter Partial Credit Models On Pisa Science Cognitive Data, Luc T. Le Aug 2015

Investigating Stability Of Item Parameters In One And Two-Parameter Partial Credit Models On Pisa Science Cognitive Data, Luc T. Le

Dr Luc Tu Le

This study focuses on investigating the stability of item parameter estimates from partial credit model (PCM) and generalised partial credit model (GPCM) respectively, by the test form booklets across the country and language groups used in the PISA study (Programme for International Student Achievement). From that, it could suggest whether the item discrimination parameter should be needed in the item calibration model for large and heterogeneous samples of an international test like PISA, particularly for PISA Science 2015.


Gamsat: A 10-Year Retrospective Overview, With Detailed Analysis Of Candidates¿ Performance In 2014, Annette Mercer, Brendan Crotty, Louise Alldridge, Luc Le, Veronica Vele Mar 2015

Gamsat: A 10-Year Retrospective Overview, With Detailed Analysis Of Candidates¿ Performance In 2014, Annette Mercer, Brendan Crotty, Louise Alldridge, Luc Le, Veronica Vele

Dr Luc Tu Le

Background: The Graduate Australian Medical Schools Admission Test (GAMSAT) is undertaken annually in centres around Australia and a small number of overseas locations. Most Australian graduate entry medical schools also use Grade Point Average and interview score for selection. The aim of this study was to review the performance of the GAMSAT over the last 10 years; the study provides an analysis of the impact of candidates’ gender, age, language background, level of academic qualification and background discipline on performance; and details on the performance of higher-scoring candidates. These analyses were undertaken on the 2014 data; and trends in the …


Evaluation Of Item Parameter Recovery Estimation By Acer Conquest Software, Luc T. Le, Ray Adams Aug 2014

Evaluation Of Item Parameter Recovery Estimation By Acer Conquest Software, Luc T. Le, Ray Adams

Dr Luc Tu Le

ACER ConQuest (Adams, Wu, and Wilson, 2012) has been popularly used for analysing testing and assessment data. Two of the most common estimation methods for Rasch measurement models (Rasch, 1960/1980) are available in this software, marginal maximum likelihood estimation (MML) and joint maximum likelihood estimation (JML). This study is concerned with item parameter recovery for the dichotomous Rasch model. Our primary focus is on comparing JML and MML when the assumptions of MML are violated, that is the abilities are not sampled from the distribution that is assumed in the estimation.


Accuracy Of Rasch Model Item Parameter Estimation, Luc Le, Ray Adams Aug 2013

Accuracy Of Rasch Model Item Parameter Estimation, Luc Le, Ray Adams

Dr Luc Tu Le

This study used Monte Carlo simulations to evaluate the item parameter recovery from ACER ConQuest 3 software (Adams, Wu, & Wilson, 2012) for the dichotomous Rasch model. The authors’ primary focus was the comparison of its estimation methods, joint maximum likelihood (JML), marginal maximum likelihood (MML) with a normal distribution assumption and MML with a discrete distributions assumption when the populations were in fact non-normal. The simulation data sets were generated with two test lengths (10 and 50 items) and four alternative true population distributions for the abilities: normal, bimodal, uniform, and chi-square. As expected, results showed that MML-Normal was …


Impact Of Different Item Location In Common-Item Test Equating, Luc Le Jun 2013

Impact Of Different Item Location In Common-Item Test Equating, Luc Le

Dr Luc Tu Le

This study used real data and simulation data to investigate the impacts of different item location in common-item test equating. The real data set included responses of about 150 000 students to a generic skills test from a university survey in Columbia in 2011, where each student was assigned randomly to one of four linked test forms. Each form consisted of two of three Critical Reasoning clusters and two of three Quantitative Reasoning clusters (20 items in each cluster). The results of an analysis using Item Response Theory clearly showed that items could become more difficult when located towards the …


Cognitive Skills Testing Program (Cstp) 2010 Pilot Test Summary Report, Hamish Coates, Daniel Edwards, Chris Freeman, Luc Le, Sam Hambur, Philip Brown Aug 2012

Cognitive Skills Testing Program (Cstp) 2010 Pilot Test Summary Report, Hamish Coates, Daniel Edwards, Chris Freeman, Luc Le, Sam Hambur, Philip Brown

Dr Luc Tu Le

No abstract provided.


Evaluation Of The Criterion Validity Of Unitest And Stat, Hamish Coates, Tim Friedman, S Ball, Luc Le Aug 2012

Evaluation Of The Criterion Validity Of Unitest And Stat, Hamish Coates, Tim Friedman, S Ball, Luc Le

Dr Luc Tu Le

Published by the Department of Education, Employment and Workplace Relations.


Evaluation Of Booklet Effect In Pisa Mathematics Across Countries, Luc Le Jun 2012

Evaluation Of Booklet Effect In Pisa Mathematics Across Countries, Luc Le

Dr Luc Tu Le

In PISA 2003, 13 main linked test booklets were constructed by item cluster rotation design. Each student was randomly assigned one of the test booklets. Each of the selected clusters was located in four of the test booklets in different positions. There were seven mathematics clusters with a total of 85 items. Booklet effect was identified and was used to adjust the measure of student performance in PISA (see PISA 2003 technical report; OECD, 2004). This study was designed to explore which factors could account for this booklet effect in mathematics across 41 PISA countries. A three-faceted partial credit model …


Graduate Skills Assessment : Stage One Validity Study, Sam Hambur, Ken Rowe, Luc Le Feb 2012

Graduate Skills Assessment : Stage One Validity Study, Sam Hambur, Ken Rowe, Luc Le

Dr Luc Tu Le

The Graduate Skills Assessment (GSA) is a new test with complex aims and is in the first stages of development and application. Principally, the test aims to assess a set of valued and widely applicable generic skills that may be developed by the university experience and which are relevant to university achievement and graduate work. This publication reports on the validity of the first stage of the Graduate Skills Assessment test (GSA Stage One Validity Study), which covers the first two tests, Exit 2000 and Entry 2001. These tests involved the participation of 3663 students drawn from nine broad fields …


Differential Performance Of Poor Readers In International Mathematics Tests By Item Formats, Luc Le Aug 2011

Differential Performance Of Poor Readers In International Mathematics Tests By Item Formats, Luc Le

Dr Luc Tu Le

The important role of language, including reading, on student performance on assessments in school academic areas such as mathematics has been addressed in number of studies. Although positive relations between different aspects of reading and mathematics performance have been investigated, there have been few studies focusing on the interaction between the context of the mathematics item and student reading proficiency, and most of those there were related only to the verbal loading. Recently, a low correlation between verbal loading and item difficulty was found for PISA mathematics items. This study used PISA 2003 mathematics data with 41 countries with about …


Student Perceptions Of Target Language Use In The Secondary School Classroom!, Bernadette Brouwers, Luc Le Jun 2011

Student Perceptions Of Target Language Use In The Secondary School Classroom!, Bernadette Brouwers, Luc Le

Dr Luc Tu Le

No abstract provided.


Investigating Item Difficulty Change By Item Positions Under The Rasch Model, Luc T. Le, Van Nguyen Apr 2011

Investigating Item Difficulty Change By Item Positions Under The Rasch Model, Luc T. Le, Van Nguyen

Dr Luc Tu Le

In operational testing programs using item response theory (IRT), item parameter invariance is one of essential requirements in common item equating designs. However, in practice, the stability of item parameters can be affected by many factors. Particularly, this study utilised data from the large-scale Graduate Skills Assessment (GSA) in 2010 to investigate the change of Rasch item difficulty by item positions. The test included 78 multiple-choice items and was presented in eight test forms by arranging the items in different orders. Items addressed three components of generic skills: Critical Thinking, Problem Solving and Interpersonal Understandings. Each test form was randomly …


We Need More Time!, Bernadette Brouwers, Luc Le Jun 2010

We Need More Time!, Bernadette Brouwers, Luc Le

Dr Luc Tu Le

No abstract provided.


Effects Of Student Reading Proficiency On Pisa Mathematics Items – A Dif Study Across Countries, Ray Adams, Luc Le Aug 2009

Effects Of Student Reading Proficiency On Pisa Mathematics Items – A Dif Study Across Countries, Ray Adams, Luc Le

Dr Luc Tu Le

No abstract provided.


Effect Of Gender And Reading Ability On Questions In The Target Language In L2 Listening Tests, Luc Le, Anna Filipi, Bernadette Brouwers Jun 2009

Effect Of Gender And Reading Ability On Questions In The Target Language In L2 Listening Tests, Luc Le, Anna Filipi, Bernadette Brouwers

Dr Luc Tu Le

No abstract provided.


Investigating Gender Differential Item Functioning Across Countries And Test Languages For Pisa Science Items, Luc Le Dec 2008

Investigating Gender Differential Item Functioning Across Countries And Test Languages For Pisa Science Items, Luc Le

Dr Luc Tu Le

This study uses PISA cycle 3 field trial data to investigate the relationships between gender differential item functioning (DIF) across countries and test languages for science items and their formats and the four other dimensions defined in PISA framework: focus, context, competency, and scientific knowledge. The data used were collected from 60 test language groups by 50 participating countries with a total of about 83,000 15-year-old students. An IRT method is used to detect the gender uniform DIF for each of the language groups and the whole international sample. Gender directions have been drawn for each of the five item …


Effects Of Item Positions On Their Difficulty And Discrimination : A Study In Pisa Science Data Across Test Language And Countries, Luc Le Dec 2008

Effects Of Item Positions On Their Difficulty And Discrimination : A Study In Pisa Science Data Across Test Language And Countries, Luc Le

Dr Luc Tu Le

No abstract provided.


Investigating Effects Of The Use Of The Target Language Characters In The Tests Of Second Languages On Student Performance?, Luc Le, Anna Filipi Jun 2008

Investigating Effects Of The Use Of The Target Language Characters In The Tests Of Second Languages On Student Performance?, Luc Le, Anna Filipi

Dr Luc Tu Le

No abstract provided.


Gender Gaps In Gamsat Scores And Effects Of Its Candidate Language Background, Age And Their Academic Background, K Macleod, Luc Le Feb 2008

Gender Gaps In Gamsat Scores And Effects Of Its Candidate Language Background, Age And Their Academic Background, K Macleod, Luc Le

Dr Luc Tu Le

No abstract provided.


Examine Test-Retest Performance And Effects Of Gender And Esb In A Large-Scale Postgraduate Selection Test, Luc Le, Van Nguyen Dec 2007

Examine Test-Retest Performance And Effects Of Gender And Esb In A Large-Scale Postgraduate Selection Test, Luc Le, Van Nguyen

Dr Luc Tu Le

No abstract provided.


Effects Of Examinee Ability Levels On The Stability Of Item Difficulty Estimates - An Empirical Study On Different Estimation Methods For The Rasch Model, D Lay, Luc Le Jun 2007

Effects Of Examinee Ability Levels On The Stability Of Item Difficulty Estimates - An Empirical Study On Different Estimation Methods For The Rasch Model, D Lay, Luc Le

Dr Luc Tu Le

No abstract provided.


Effect Of Language Speaking Background On Gender Difference In Verbal And Non-Verbal Reasoning Tests : A Study From Umat, Luc Le, Van Nguyen Jun 2007

Effect Of Language Speaking Background On Gender Difference In Verbal And Non-Verbal Reasoning Tests : A Study From Umat, Luc Le, Van Nguyen

Dr Luc Tu Le

No abstract provided.


Effects Of Item Positions On Their Difficulty And Discrimination : A Study In Pisa Science Data Across Test Language And Countries, Luc T. Le Jun 2007

Effects Of Item Positions On Their Difficulty And Discrimination : A Study In Pisa Science Data Across Test Language And Countries, Luc T. Le

Dr Luc Tu Le

This study was based on a four-cluster rotation design of 13 linked test booklets from PISA 2006 science data. It investigated effects of item positions on their difficulty and discrimination parameter estimates obtained from one and two parameter IRT Partial Credit models. The analyses were done separately for 57 test language groups from 53 countries with a total of about 340,000 students. The results revealed that for all of the test language groups the items tended to become more difficult when they were located later in the test. However, a high linear relationship between the item difficulty estimates by the …


Investigating Gender Differential Item Functioning Across Countries And Test Languages For Pisa Science Items, Luc Le Jun 2006

Investigating Gender Differential Item Functioning Across Countries And Test Languages For Pisa Science Items, Luc Le

Dr Luc Tu Le

No abstract provided.


Analysis Of Differential Item Functioning, Luc Le Mar 2006

Analysis Of Differential Item Functioning, Luc Le

Dr Luc Tu Le

No abstract provided.


Generic Skills: Can They Be Measured?, A Butler, Luc Le, Sam Hambur Mar 2004

Generic Skills: Can They Be Measured?, A Butler, Luc Le, Sam Hambur

Dr Luc Tu Le

No abstract provided.


Reverse Polyblock Approximation For Optimization Over The Weakly Efficient Set And Efficient Set, Luc Le Dec 2000

Reverse Polyblock Approximation For Optimization Over The Weakly Efficient Set And Efficient Set, Luc Le

Dr Luc Tu Le

A new method is developed for maximizing a concave function over the weakly efficient set, or the efficient set. The method consists of converting the problem into a monotonic optimization problem and solving the latter by a reverse polyblock approximation algorithm.