Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 3 of 3
Full-Text Articles in Business
Reliability And The Actfl Oral Proficiency Interview: Reporting Indices Of Interrater Consistency And Agreement For 19 Languages, Eric Surface, Erich Dierdorff
Reliability And The Actfl Oral Proficiency Interview: Reporting Indices Of Interrater Consistency And Agreement For 19 Languages, Eric Surface, Erich Dierdorff
Erich C. Dierdorff
The reliability of the ACTFL Oral Proficiency Interview (OPI) has not been reported since ACTFL revised its speaking proficiency guidelines in 1999. Reliability data for assessments should be reported periodically to provide users with enough information to evaluate the psychometric characteristics of the assessment. This study provided the most comprehensive analysis of ACTFL OPI reliability to date, reporting interrater consistency and agreement data for 19 different languages. Overall, the interrater reliability of the ACTFL OPI was found to be very high. These results demonstrate the importance of using an OPI assessment program that has a well-designed interview process, a well-articulated …
Psychological Testing: Rogues, Romance And Roadside Assistance, Carol Gill
Psychological Testing: Rogues, Romance And Roadside Assistance, Carol Gill
Carol Gill
Psychological testing has the mystique of white magic…potential and existing employees complete several relatively brief paper and pencil tests and the organization receives a concise report (accurate to the percentile!) that is able to describe personality, intelligence and various other significant characteristics in detail…to predict the future! This magic though, in most cases, can only be performed by a witch doctor (Psychologist), which contributes to the “black box” aura of testing. Despite the reported validity of testing there are a range of methodological and ethical issues in using psychological tests, however, the most important question is how significant is the …
A Meta-Analysis Of Job Analysis Reliability, Erich Dierdorff, Mark Wilson
A Meta-Analysis Of Job Analysis Reliability, Erich Dierdorff, Mark Wilson
Erich C. Dierdorff
Average levels of interrater and intrarater reliability for job analysis data were investigated using meta-analysis. Forty-six studies and 299 estimates of reliability were cumulated. Data were categorized by specificity (generalized work activity or task data), source (incumbents, analysts, or technical experts), and descriptive scale (frequency, importance, difficulty, time-spent, and the Position Analysis Questionnaire). Task data initially produced higher estimates of interrater reliability than generalized work activity data and lower estimates of intrarater reliability. When estimates were corrected for scale length and number of raters by using the Spearman-Brown formula, task data had higher interrater and intrarater reliabilities. Incumbents displayed the …