Educational Psychology Commons^™

Threats To The Operational Use Of Situational Judgment Tests In The College Admission Process, Michael J. Cullen, Paul R. Sackett, Filip Lievens

Research Collection Lee Kong Chian School Of Business

This study examined the coachability of two situational judgment tests, the College Student Questionnaire (CSQ) and the Situational Judgment Inventory (SJI), developed for consideration as selection instruments in the college admission process. Strategies for raising scores on each test were generated, and undergraduates were trained in the use of the strategies using a video-based training program. Results indicated that the CSQ was susceptible to coaching. In addition, the scoring format of the CSQ was found to be easily exploited, such that trainees could increase their scores by greater than 1 SD simply by avoiding extreme responses on that test. The …