Educational Assessment, Evaluation, and Research Commons^™

7. Basic Psychometric Issues In Licensure Testing, Howard W. Stoker, James C. Impara

Licensure Testing: Purposes, Procedures, and Practices

INTRODUCTION

The number of people in the United States who carry some responsibility for the writing of examination questions and the construction of tests is unknown. In the Preface to The Construction and Use of Achievement Examinations, published by the American Council on Education in 1936, the authors indicated that the number probably exceeded a million. That number has certainly grown in the past 60 years. Questions are posed to students by teachers at all levels of education; the Armed Forces have people whose job it is to construct tests which are used in the promotion of personnel; over …

4. Practice Analysis: Building The Foundation For Validity, Joan E. Knapp, Lenora G. Knapp

Licensure Testing: Purposes, Procedures, and Practices

INTRODUCTION

A review of the literature associated with job analysis reveals two extremes of opinion as represented by the following provocative quotes:

Historically job analysis has been a relatively soporific area of industrial and organizational psychology, characterized by neither heated controversy nor prominent visibility in the research literature. (Harvey, 1991, p. 71)

Validation was once a priestly mystery, a ritual behind the scenes with the professional elite as witness and judge. Today it is a public spectacle combining the attraction of chess and mud wrestling. (Cronbach, 1988, p. 3)

Both our evaluation of practice analysis research and our professional experience …

5. Systematic Item Writing And Test Construction, Anthony Laduca, Steven M. Downing, Thomas R. Henzel

Licensure Testing: Purposes, Procedures, and Practices

Standardized objective testing remains the most popular mode of licensure testing. Even where other types of tests are incorporated, it is often the case that they are provided as complimentary to standardized, multiple-choice (MC) tests. Moreover, scoring theories and standard-setting procedures have been developed over the years in the context of standardized MC testing. At the same time, critics have pointed to limitations of contemporary MC testing practices, including lack of fidelity to real-life challenges and emphasis on recall of factual minutiae. In our view, testing professionals should make conscientious attempts to modify test development procedures so as to address …

3. Policy Issues With Psychometric Implications, Michael Rosenfeld, Richard F. J. Tannenbaum, Scott Wesley

Licensure Testing: Purposes, Procedures, and Practices

Testing candidates with disabilities, testing repeaters, and coaching involve issues of fairness, the validity of the inferences made from test scores, and protection of the public. Licensing boards must develop policies to deal with each of these issues. It is interesting to note that although all three are of concern to licensing agencies, little of the research on these topics has been conducted in licensure settings. This chapter discusses the results of research conducted on each topic, considers the psychometric implications for policy of each, and suggests steps licensing boards can take when formulating policy.

TESTING CANDIDATES WITH DISABILITIES IN …

8. Item Banking, Betty A. Bergstrom, Richard C. Gershon

Licensure Testing: Purposes, Procedures, and Practices

Item banks developed by licensure agencies range from a collection of items stored on index cards to highly sophisticated electronic databases. Regardless of the storage mechanism, most banks contain items that have been organized and referenced according to procedures established by the licensure agency. This chapter outlines useful practices for building and maintaining a computerized item bank. We address storage of item text, graphics, and statistical history. We deal with the creation of paper-and-pencil and computerized tests from an item bank and the use of Item Response Theory (lRT) to calibrate and equate item banks. New directions in item banking …

12. Computerized Testing In Licensure, C. David Vale

Licensure Testing: Purposes, Procedures, and Practices

Computerized testing has come out of the laboratory and into the field. By rough estimates, over a million licensure and certification examinations are currently given by computer each year, and the number is rising. Computerized testing is not appropriate for every application, however. Computerized tests always result in significantly greater direct costs than paper-and-pencil tests. To justify their use, a computerized test must result in a net dollar saving. This means that something in the process of computerization must offer a cost reduction that more than offsets the direct cost of computerization. The purpose of this chapter is to identify …

13. Future Psychometric Practices In Licensure Testing, Steven S. Nettles

Licensure Testing: Purposes, Procedures, and Practices

New technologies continue to emerge each year, and influence testing practices. In particular, in the last 10 years the personal computer has evolved from a curious and minimally useful tool to an indispensable partner in many certification and licensure testing programs. It is involved in every aspect- including candidate scheduling, test assembly, test administration, test scoring and analysis, and score reporting. Initially, it is used to determine the content to be included in the job analysis instrument, and later, to analyze the returned surveys. After the job analysis is completed and test specifications prepared, it can be used to bank …

A Case Study To Investigate The Use Of Computers Across A School Population, Janine Bersan

Theses : Honours

The National Advisory Committee on Computers in Schools (Commonwealth Schools Commission, 1983) recommended to support computing in both government and non-government schools in Australia over 1984 - 1986. This led to the injection of computer resources to schools. The Western Australian Government then provided significant funds for the provision of computer equipment to primary and secondary schools (1987 -1989). Primacy schools in Western Australia now have on average three computers per primary school. The Ministry of Education has produced a policy document on computer use in primary education which clearly outlines goals to be achieved by all primary school teachers …

The Organization Of A Learning Resource Center At The Christian And Missionary Alliance Church In Ellensburg, Washington, Robert Neil Gordon

All Graduate Projects

This paper presents an investigation into providing a model and designing and organizing a learning resource center (LRC) for the Christian and Missionary Alliance Church. Including existing and potential resources and/or media used in teaching and general church ministries, the plan makes provision for systematically using these resources by evaluation. Recommendations for the learning resource center were based on the review of related literature, the philosophy, goals and objectives of the Christian and Missionary Alliance Church and input from church members.

Illinois Science Academy: A Proposal To The State Of Illinois, Corridor Partnership For Excellence In Education, Friends Of Fermilab

IMSA History

There is a widely recognized perception that the nation facing a crisis in fulfilling its needs for citizens trained in the fields of science, mathematics and technology. In particular, the State of Illinois has an obligation toward this national issue and to .its own need to develop these human resources that are so intimately coupled to economic leadership in a post-industrial society. This is a very broad challenge; here we propose to address only one important aspect: the nurturing of creative excellence in students of science and mathematics. We are concerned with the extraordinarily gifted person--the upper few tenths of …

An Instructional Package In Personal And Leadership Development For Trade And Industrial Education Students, Richard Dale Spice

All Master's Theses

This paper presents an outline of performance goals on personal and leadership development for Trade and Industrial Education students. These goals are based on characteristics and needs identified by industry. Classroom learning activities and other reference materials are listed. A sample validation of the goals by industrial representatives supports the use of these goals in vocational instructional programs.

Recommendations included the need to field test the goals in Trade and Industrial Education classes and validate them with industry advisory committees.

A Study Of The Expectations Of High School Seniors Concerning Marriage And College, Allen W. Gustafson

All Master's Theses

The problem was: (1) to study the expectations of high school seniors concerning marriage and education, and (2) to ascertain the amount of conflict between two of the important roles confronting many of the young adults, marriage and a college education.