Educational Assessment, Evaluation, and Research Commons^™

13. Future Psychometric Practices In Licensure Testing, Steven S. Nettles

Licensure Testing: Purposes, Procedures, and Practices

New technologies continue to emerge each year, and influence testing practices. In particular, in the last 10 years the personal computer has evolved from a curious and minimally useful tool to an indispensable partner in many certification and licensure testing programs. It is involved in every aspect- including candidate scheduling, test assembly, test administration, test scoring and analysis, and score reporting. Initially, it is used to determine the content to be included in the job analysis instrument, and later, to analyze the returned surveys. After the job analysis is completed and test specifications prepared, it can be used to bank …

11. Equating, Judy A. Shea, John J. Norcini

Licensure Testing: Purposes, Procedures, and Practices

INTRODUCTION

Testing programs nearly always need examinations that measure the same thing, but are composed of different questions (i .e., alternate forms of the same test). When different questions are used, however, there is no assurance that scores on the forms are equivalent; different sets of items might be easier or harder and, therefore, produce higher or lower scores. Equating is used to overcome this problem. Simply stated, it is the design and statistical procedure that permits scores on one form of a test to be comparable to scores on an alternate form.

A hypothetical example will help explain why …

Licensure Testing: Purposes, Procedures, And Practices [Complete Work], James C. Impara, Linda L. Murphy

Licensure Testing: Purposes, Procedures, and Practices

Licensure Testing: Purposes, Procedures, and Practices (374 pages)

Copyright © 1995 by Buros Institute of Mental Measurements All rights reserved. No part of this book may be reproduced in any form, by photostat, microfilm, retrieval system, or any other means, without the prior written permission of the publisher.

Buros Institute of Mental Measurements 135 Bancroft Hall University of Nebraska-Lincoln Lincoln, NE 68588-0348

The paper used in this publication meets the minimum requirements of American National Standard for Information Sciences-Permanence of Paper for Printed Library Materials, ANSI Z39.48-1984.

Title And Contents- Licensure Testing: Purposes, Procedures, And Practices, James C. Impara, Linda L. Murphy

Licensure Testing: Purposes, Procedures, and Practices

Licensure Testing: Purposes, Procedures, And Practices

Contents

Dedication

Preface

SECTION ONE: Purposes and Policy Issues

1. What is Licensure?
Kara Schmitt

2. Legal and Professional Bases for Licensure Testing
William A. Mehrens

3. Policy Issues with Psychometric Implications
Michael Rosenfeld, Richard J. Tannenbaum, and Scott Wesley

SECTION TWO: Procedures

Overview of the Licensure Testing Process
James C. Impara

4. Practice Analysis: Building the Foundation for Validity
Joan Knapp and Lenora Knapp

5. Test Development: Systematic Item Writing and Test Construction
Anthony LaDuca, Steven Downing, and Thomas Henzel

6. Developing and Using Clinical Examinations
Jimmie Fortune and Ted Cromack

7. Basic …

1. What Is Licensure, Kara Schmitt

Licensure Testing: Purposes, Procedures, and Practices

When most individuals hear the terms license and licensure, their first reaction is that these are easily understood and relatively simple words. Everyone knows what these terms mean. Or do they?

What is licensure? It is a multifaceted, complex governmental system of regulation with the stated purpose being public protection. According to Webster's dictionary (Guralnik, 1976), a license is defined as "a formal permission to do something: esp., authorization by law to do some specified thing (license to marry, practice medicine, hunt, etc.)." The term Licensure is then defined to mean "the act or practice of granting licenses, …

2. Legal And Professional Bases For Licensure Testing, William A. Mehrens

Licensure Testing: Purposes, Procedures, and Practices

In this chapter the author presents the legal setting for licensure testing, I discusses the role of various professional standards and codes (i.e., the EEOC Uniform Guidelines, 1978, and the AERA/APA/NCME Standards, 1985), presents some of the pertinent rulings from several court decisions, and makes inferences about future changes in professional standards and their potential impact on licensure test development.

There necessarily is some minor overlap with the material in this chapter and some other chapters in this book. There is a brief discussion of the differences between licensure, certification. and employment testing and how those differences relate …

Author Index

Licensure Testing: Purposes, Procedures, and Practices

Authors listed A-Z (8 pages)

A

Ader, H. 1. : 2 10,2 18
Ahluwalia, N. T.: 240, 25 1, 330, 344
Aitkin, M.: 262, 267, 282
AI-Dosary, I. M.: 28 1, 282
AI-Karni , A.: 27 1, 28 1, 282
Albanese, M. A.: 125, 138,324,341
Alexander, R. A.: 225, 250
Algin a, 1.: 256, 283
Allen, D. L.: 158, 164
American Counci l on Education: 167, 185
American Educational Research Association: 33,37,38,39,40, 41 , 42,43,53,55,66, 68,72,84,94, 11 4, 11 8, 122,137, 138, 168, 170, 17 1, 179, 185, 236, 248, 254, 255,26 1,28 1
American Psychological Association: 33, 37, 38,39,40, …

Subject Index

Licensure Testing: Purposes, Procedures, and Practices

Subject Index listed A-Z (8 pages)

A

a parameter: 299-300, 303, 305-306, 314
absolute standard procedure: 329
absolute standards: 222-223
accuracy of the inference: 150
Adaptive Mastery Testing (AMT): 298,305
advisory committee: 100-101 , 103-105,111- 112
AERA/APA/NCME Standards: 33,37-43, 53, 55 , 66, 68, 72, 84, 94, 11 4, 118, 122, 137-138,168, 170- 171,179,185, 236, 248, 254-255, 26 1, 281
all -in-one requirement: 155
alternate-choice: 120
alternate-choice multiple choice: 324
Americans with Disabilities Act of 1990 (ADA): 22-23, 43, 54-55, 60-6 1, 63, 65, 68-70, 297
amplified objective: 129,147
amplified objective method: 129
analysis of variance (ANaYA): 153
anchor items: …

10. Establishing Passing Standards, Craig N. Mills

Licensure Testing: Purposes, Procedures, and Practices

INTRODUCTION

When tests are used to determine eligibility for a license, a passing standard or cut score must be established that divides the test scores into two categories: eligible for license or not. Standard setting has been widely researched and there are many reviews available (see, for example, Jaeger, 1989; Mills & Melican, 1988; Berk, 1986; Hambleton, 1980; Hambleton & Eignor, 1980; and Shepard, 1980a, 1980b), yet there is limited practical advice available for conducting standard setting studies and establishing standards. The one available resource (Livingston & Zieky, 1982) is somewhat dated. The purpose of this chapter is to provide …

Yakima Alternative Education Program: Serving At-Risk Students In Grades 9-12, Earl Steven Lee

All Graduate Projects

The project describes and analyzes the Alternative School program of the Yakima (WA) School District. The project reviews the nine components that make up the alternative programs for the Yakima School District: (1) Stanton, (2) Outreach, (3) Project 107, (4) MAS, (5) The Place, (6) Detention Home, (7) Crossroads, (8) Key-OIC and (9) Stride. The project will identify the critical attributes of each program in an effort to clearly understand how they each promote the educational growth of high risk students in grades 9-12. Techniques, instructional materials and educational resources used by teachers and students will be discussed.

A Case Study To Investigate The Use Of Computers Across A School Population, Janine Bersan

Theses : Honours

The National Advisory Committee on Computers in Schools (Commonwealth Schools Commission, 1983) recommended to support computing in both government and non-government schools in Australia over 1984 - 1986. This led to the injection of computer resources to schools. The Western Australian Government then provided significant funds for the provision of computer equipment to primary and secondary schools (1987 -1989). Primacy schools in Western Australia now have on average three computers per primary school. The Ministry of Education has produced a policy document on computer use in primary education which clearly outlines goals to be achieved by all primary school teachers …

Educational Access For Homeless School-Age Children : A Model For Building Collaboration Between Educators And Social Services Providers, Karen Tilbor, Al Leighton

Maine Collection

Educational Access for Homeless School-Age Children : A Model for Building Collaboration Between Educators and Social Services Providers

Karen Tilbor and Al Leighton

Human Services Development Institute, Edmund S. Muskie Institute of Public Affairs, Graduate Program in Public Policy and Management, University of Southern Maine

October 1990

"This report was prepared under contract with the Maine Department of Education" Printed under Appropriation # 013-05A-1002-01

Contents: Introduction / Forum for Portland-Area Educators / Brochure / Educators and Social Service Providers Collaborate / Summary and Recommendations / Appendices

The Pine Mountain Valley Rural Community Project 1934-1946, Nick Marino

Theses and Dissertations

During the Great Depression New Deal planners attributed much of the nation's unemployment problem to automation in the workplace. It was believed that structural economic changes had dislocated millions of city workers permanently. To get these people off relief, the Federal Emergency Relief Administration established about 100 rural industrial communities across America. By providing the opportunity to develop rural communities based upon modern farming and agriculturally-related industries, dislocated workers would be brought back to the land as productive citizens. One of the most unique of these rural industrial communities was established in Pine Mountain Valley, Georgia. Being near President Roosevelt's …

An Overview Of Registered Family Day Care In Muscogee County, Georgia, Rhoda Boggs

Theses and Dissertations

This research surveyed the characteristics and components of family day care in a southeastern urban area. The subjects consisted of all family day care providers who resided within the county being studied and who were registered with the state's Department of Human Resources. The questionnaire developed by the researcher consists of 20 questions which address the caregivers' personal traits, educational qualifications, and business organization. The responses were compiled, and descriptive statistics were computed in order to provide the composite characteristics and overall range of available family day care in the county. Results show that there are significant differences in the …

Columbus' Combative Editor: Julian Larose Harris Versus The Klan In Georgia, 1921-1929, Michael L. Regnier

Theses and Dissertations

Despite the apparent ease and gaiety of life in America in the 1920's. there were seamier sides to society. One aspect of the seamy side was race relations. However, Columbus, Georgia, can lay claim to a bright spot in the darkness, the presence of Julian LaRose Harris as owner/editor of The Columbus Enquirer-Sun. Harris became the first, and for a while the only, newspaper man to openly criticize the Ku Klux Klan for Its program of terror and secrecy. Not only did other Georgia dallies follow his lead, but the local chapter of the Klan disbanded for a time in …

Dissent From Bourbon On-Party Rule: The 1878 Georgia Fourth District Congressional Election, Ellen H. Reames

Theses and Dissertations

The 1878 Georgia Fourth District Congressional Election demonstrated the persistence of the Bourbon Democrat movement. The campaign and election exemplified the techniques used by Bourbons to gain and maintain their influence. In this paper, three methods were focal points: the one-party system, the Democratic Party nominating conventions and the influence of an active press. Significant local issues included in this election were the importance of the rural voters, and the influence of the Democratic Party on Fourth District matters.

Important characters included the incumbent, Henry Harris, and the challenger, Henry Persons. Two leading Columbusites, William H. Young and John King, …

The Organization Of A Learning Resource Center At The Christian And Missionary Alliance Church In Ellensburg, Washington, Robert Neil Gordon

All Graduate Projects

This paper presents an investigation into providing a model and designing and organizing a learning resource center (LRC) for the Christian and Missionary Alliance Church. Including existing and potential resources and/or media used in teaching and general church ministries, the plan makes provision for systematically using these resources by evaluation. Recommendations for the learning resource center were based on the review of related literature, the philosophy, goals and objectives of the Christian and Missionary Alliance Church and input from church members.

Guidelines For Equivalent Instruction Through Home-Schooling, Robert E. Boose

Maine Collection

Guidelines for Equivalent Instruction Through Home-Schooling

Dr. Robert E. Boose, Commissioner, Department of Educational and Cultural Services, Augusta, Maine, September 13, 1984

Contents: Part I - Rules for Equivalent Instruction Programs / Part II - Guidelines for Implementation of Equivalent Instruction Programs by School Boards

A Study Of Four Bible Colleges Which Are Candidates For Accreditation With The Southern Association Of Colleges And Schools, Francis M. Nash

Morehead State Theses and Dissertations

A thesis presented to the faculty of the School of Education at Morehead State University in partial fulfillment of the requirements for the Degree of Educational Specialist by Francis M. Nash on August 31,1984.

Illinois Science Academy: A Proposal To The State Of Illinois, Corridor Partnership For Excellence In Education, Friends Of Fermilab

IMSA History

There is a widely recognized perception that the nation facing a crisis in fulfilling its needs for citizens trained in the fields of science, mathematics and technology. In particular, the State of Illinois has an obligation toward this national issue and to .its own need to develop these human resources that are so intimately coupled to economic leadership in a post-industrial society. This is a very broad challenge; here we propose to address only one important aspect: the nurturing of creative excellence in students of science and mathematics. We are concerned with the extraordinarily gifted person--the upper few tenths of …

Advanced Ocularmetrics: Graphing Multiple Time Series Residual Data, David E. Drew

CGU Faculty Publications and Research

The desirability of randomized experiments (see Gilbert, Light, & Mosteller, 1975) and the usual need for quasi-experimental designs (because real programs rarely can be administered randomly) are staples of the evaluation literature. Campbell (1969) and others long have advocated the need for acquisition and analysis of longitudinal data in such evaluations.

Today's graduate students dutifully study trend data from the famous Connecticut crackdown on speeding and the British Breathalyser experiment to learn how graphs can be interpreted to shed light on possible program effects. Inevitably, the data portrayed represent zero-order effects. An outcome is plotted over time, or several graphs …

A Study Of Secondary School Students' Right To Free Expression As Granted By The First Amendment To The United States Constitution, Sharon Elain Wenzl Wright

Theses and Dissertations - UTB/UTPA

The investigator studied the application of the First Amendment of the United States Constitution to secondary school students' right to free expression. The investigator examined landmark cases such as Tinker v Des Moines Independent Community School District in order to depict the historical development of extending constitutional rights to secondary school students.

The study encompasses both landmark cases (those cases involving highly significant decisions that established a precedent) and relevant cases which led to the present judicial posture regarding secondary students' right to free expression. Findings of the case study reveal the present judiciary standard to rest on the application …

An Instructional Package In Personal And Leadership Development For Trade And Industrial Education Students, Richard Dale Spice

All Master's Theses

This paper presents an outline of performance goals on personal and leadership development for Trade and Industrial Education students. These goals are based on characteristics and needs identified by industry. Classroom learning activities and other reference materials are listed. A sample validation of the goals by industrial representatives supports the use of these goals in vocational instructional programs.

Recommendations included the need to field test the goals in Trade and Industrial Education classes and validate them with industry advisory committees.

A Survey Of The Fifty States To Determine Design Standards For The Multiple Car Method, Donaldson Martin Carnahan

All Master's Theses

A survey of the supervisors of traffic safety education programs of the fifty states was conducted to determine what, if any, design standards or guidelines were imposed upon school districts when designing multiple-car facilities for use in traffic safety education programs.

From the information gathered it is apparent that many states are improving the pupil-teacher ratio through the inclusion of the multiple-car methods of instruction and thereby reducing the cost of the traffic safety education programs.

However, only two states, Texas and Minnesota, had well-defined minimum standards for the design and approval of such facilities in approved programs. Georgia and …

A Study To Determine The Contribution Of Laboratory Training To Student Activities In Auburn High School, Howard Conway Webb Iii

All Master's Theses

The purposes of the study are (1) to develop a practical rating scale to evaluate the activity program, and (2) to determine the contribution of laboratory training to student activities in Auburn High School. This study was conducted at Auburn High School during the 1968-1969 school year.

Attitudes Of Principals Concerning Their Role As A Result Of Professional Negotiations In The State Of Washington, Karl Michael Fankhuaser

All Master's Theses

It was the purpose of this study (1) to examine the attitudes of principals as to whether they saw their roles changing as a result of professional negotiations, (2) to show how the principals felt their roles would be changed, (3) to examine which type or group of principals felt most threatened by professional negotiations, and (4) what stratagem principals may follow in the future as a reaction to teacher militancy.

Birth Order And Its Relationship To Dogmatism, John Richard Downs

All Master's Theses

The purpose of this study was to take one definable personality pattern, open and closed mindedness, and to see if this dimension is reflected in ordinal birth position, specifically first- and later-born. The literature reviewed in this study appears to describe the first-born very much like Rokeach (1960) describes his closed-minded person. Further, the description of the later-born is very much in line with Rokeach's description of the open-minded person.

Periodical Use In Secondary School Libraries In The State Of Washington: A Survey With Recommendations, Lillian C. Canzler

All Master's Theses

It was the purpose of this study (1) to assess through a questionnaire-study the use of 213 selected periodicals by faculty and students in high schools in first and second class districts in the State of Washington, and (2) to determine some general values held regarding periodicals.

The Development Of The Wenatchee Youth Circus As An Extra-Curricular Educational Experience, Paul K. Pugh

All Master's Theses

The purpose of this study is to trace the development of the Wenatchee Youth Circus and its contribution to the educational growth and development of its participants.

Comparative Study Of The Effect Of Creative Dramatics On Listening Achievement, Alice L. Setzer

All Master's Theses

The researcher, in an attempt to find if there were any differences in listening skills, compared the rate of progress in listening skills of fifth grade students, one group (experimental) participating in a planned program in creative dramatics in addition to the regular school program, with the second group (control) participating in the regular school program.