Open Access. Powered by Scholars. Published by Universities.®

Education Commons™

Open Access. Powered by Scholars. Published by Universities.®

Selected Works

Educational Assessment, Evaluation, and Research

PDF

Dr Luc Tu Le

Articles 1 - 6 of 6

Full-Text Articles in Education

Reduce Randomly Guessing Effects In A University Generic Skills Test, Luc T. Le Jun 2018

Reduce Randomly Guessing Effects In A University Generic Skills Test, Luc T. Le

Dr Luc Tu Le

There frequent concern of guessing with multiple-choice questions (MCQ) in item response theory (IRT), particularly with the Rach model where a guessing parameter is not included.  A practical solution is done post-hoc by removing responses to items too hard for a low ability examinee (see Andrich, et al., 2011; RUMM 2030, Andrich et al., 2012; Winsteps, Linacre, 2012). This study is used data from The Special Tertiary Admissions Test (STAT) to explore whether such responses from lower ability candidates to a hard item in a real test could be considered as randomly guessing and how Rasch item difficulty estimates improve …

Go to article

Effect Of Trial Items On Candidate Performances In A Large-Scale Postgraduate Medical Selection Test, Luc T. Le Jun 2018

Effect Of Trial Items On Candidate Performances In A Large-Scale Postgraduate Medical Selection Test, Luc T. Le

Dr Luc Tu Le

The Graduate Australian Medical School Admissions Test (GAMSAT) is a cognitive test developed by the Australian Council for Educational Research (ACER) for the Consortium of Graduate-entry Medical Schools. GAMSAT consists of two writing tasks and two multiple-choice (MC) sections: Reasoning in Humanities and Social Sciences (75 items), and Reasoning in Biological and Physical Sciences (110 items). In each administration, each of the two MC sections includes different test booklets with the same cored items but different sets of trialled items. The trial item sets have been aimed to be equivalent in contents and difficulty levels across the test booklets. This …

Go to article

Evaluate Item Dependency In An Aptitude Reasoning Test, Luc T. Le Jun 2016

Evaluate Item Dependency In An Aptitude Reasoning Test, Luc T. Le

Dr Luc Tu Le

The Special Tertiary Admissions Test (STAT), developed by the Australian Council for Educational Research (ACER), is as an alternate method of gaining entry into Australian university courses, for people who do not hold a recent Year 12 certificate in Australia. The test compromises 64 scored multiple-choice items, half of which are Verbal Reasoning questions and the other half, Quantitative Reasoning questions. Items were designed in testlets, where they could share the same stimulus (example, text paragraph). A natural question here was if the local independency assumption was violated in any sets of the items of the testlets. To investigate the …

Go to article

Investigating Stability Of Item Parameters In One And Two-Parameter Partial Credit Models On Pisa Science Cognitive Data, Luc T. Le Aug 2015

Investigating Stability Of Item Parameters In One And Two-Parameter Partial Credit Models On Pisa Science Cognitive Data, Luc T. Le

Dr Luc Tu Le

This study focuses on investigating the stability of item parameter estimates from partial credit model (PCM) and generalised partial credit model (GPCM) respectively, by the test form booklets across the country and language groups used in the PISA study (Programme for International Student Achievement). From that, it could suggest whether the item discrimination parameter should be needed in the item calibration model for large and heterogeneous samples of an international test like PISA, particularly for PISA Science 2015.

Go to article

Evaluation Of Item Parameter Recovery Estimation By Acer Conquest Software, Luc T. Le, Ray Adams Aug 2014

Evaluation Of Item Parameter Recovery Estimation By Acer Conquest Software, Luc T. Le, Ray Adams

Dr Luc Tu Le

ACER ConQuest (Adams, Wu, and Wilson, 2012) has been popularly used for analysing testing and assessment data. Two of the most common estimation methods for Rasch measurement models (Rasch, 1960/1980) are available in this software, marginal maximum likelihood estimation (MML) and joint maximum likelihood estimation (JML). This study is concerned with item parameter recovery for the dichotomous Rasch model. Our primary focus is on comparing JML and MML when the assumptions of MML are violated, that is the abilities are not sampled from the distribution that is assumed in the estimation.

Go to article

Effects Of Item Positions On Their Difficulty And Discrimination : A Study In Pisa Science Data Across Test Language And Countries, Luc T. Le Jun 2007

Effects Of Item Positions On Their Difficulty And Discrimination : A Study In Pisa Science Data Across Test Language And Countries, Luc T. Le

Dr Luc Tu Le

This study was based on a four-cluster rotation design of 13 linked test booklets from PISA 2006 science data. It investigated effects of item positions on their difficulty and discrimination parameter estimates obtained from one and two parameter IRT Partial Credit models. The analyses were done separately for 57 test language groups from 53 countries with a total of about 340,000 students. The results revealed that for all of the test language groups the items tended to become more difficult when they were located later in the test. However, a high linear relationship between the item difficulty estimates by the …

Go to article