Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

None

Evaluation

Educational Assessment, Evaluation, and Research

2005

Articles 1 - 2 of 2

Full-Text Articles in Education

Assessing Second Language Writing: The Rater’S Perspective, Tom Lumley Dec 2004

Assessing Second Language Writing: The Rater’S Perspective, Tom Lumley

Dr Tom Lumley

This study investigates the process of rating texts written by adult ESL learners. Four experienced raters provided think-aloud protocols describing the rating process for a set of 24 texts. The think-aloud data allowed analysis of the sequence of rating, raters' interpretations of the scoring categories, and difficulties raters faced. The study reveals the complexity of the rating process, whereby raters struggle to resolve a tension between the wordings (or rules) of the rating scale and their complex, initial, intuitive impression of the text. Rating requires training to provide reliable measurement. The study also demonstrates that caution is needed in interpreting …


Values And Goal-Free Evaluation: A Case Study, Brandon Youker Dec 2004

Values And Goal-Free Evaluation: A Case Study, Brandon Youker

Brandon W. Youker Ph.D

How does a goal-free evaluator deal with values? Which values? Whose values? This presentation argues that the goal-free evaluator takes a consumerist perspective. Thus the evaluator's values are in serving the program's consumers and satisfying the consumers' needs.