Teacher Education and Professional Development Commons^™

8. Item Banking, Betty A. Bergstrom, Richard C. Gershon

Licensure Testing: Purposes, Procedures, and Practices

Item banks developed by licensure agencies range from a collection of items stored on index cards to highly sophisticated electronic databases. Regardless of the storage mechanism, most banks contain items that have been organized and referenced according to procedures established by the licensure agency. This chapter outlines useful practices for building and maintaining a computerized item bank. We address storage of item text, graphics, and statistical history. We deal with the creation of paper-and-pencil and computerized tests from an item bank and the use of Item Response Theory (lRT) to calibrate and equate item banks. New directions in item banking …

12. Computerized Testing In Licensure, C. David Vale

Licensure Testing: Purposes, Procedures, and Practices

Computerized testing has come out of the laboratory and into the field. By rough estimates, over a million licensure and certification examinations are currently given by computer each year, and the number is rising. Computerized testing is not appropriate for every application, however. Computerized tests always result in significantly greater direct costs than paper-and-pencil tests. To justify their use, a computerized test must result in a net dollar saving. This means that something in the process of computerization must offer a cost reduction that more than offsets the direct cost of computerization. The purpose of this chapter is to identify …

9. Differential Item Functioning In Licensure Tests, Barbara S. Plake

Licensure Testing: Purposes, Procedures, and Practices

When test scores are used to make important decisions, as is typically the case with licensure tests, the validity of test score interpretations is extremely critical. The validity of the decision (e.g., pass or fail the licensure examination) relies heavily on the validity of the test score that is used in making the licensure decision. So, although validity is always a critical component in test score interpretation, it has increased importance when the score is used in high-stakes decision situations such as licensure testing.

Issues in validity for licensure tests have been addressed in Chapter 4 of this volume. The …

13. Future Psychometric Practices In Licensure Testing, Steven S. Nettles

Licensure Testing: Purposes, Procedures, and Practices

New technologies continue to emerge each year, and influence testing practices. In particular, in the last 10 years the personal computer has evolved from a curious and minimally useful tool to an indispensable partner in many certification and licensure testing programs. It is involved in every aspect- including candidate scheduling, test assembly, test administration, test scoring and analysis, and score reporting. Initially, it is used to determine the content to be included in the job analysis instrument, and later, to analyze the returned surveys. After the job analysis is completed and test specifications prepared, it can be used to bank …

11. Equating, Judy A. Shea, John J. Norcini

Licensure Testing: Purposes, Procedures, and Practices

INTRODUCTION

Testing programs nearly always need examinations that measure the same thing, but are composed of different questions (i .e., alternate forms of the same test). When different questions are used, however, there is no assurance that scores on the forms are equivalent; different sets of items might be easier or harder and, therefore, produce higher or lower scores. Equating is used to overcome this problem. Simply stated, it is the design and statistical procedure that permits scores on one form of a test to be comparable to scores on an alternate form.

A hypothetical example will help explain why …

Licensure Testing: Purposes, Procedures, And Practices [Complete Work], James C. Impara, Linda L. Murphy

Licensure Testing: Purposes, Procedures, and Practices

Licensure Testing: Purposes, Procedures, and Practices (374 pages)

Copyright © 1995 by Buros Institute of Mental Measurements All rights reserved. No part of this book may be reproduced in any form, by photostat, microfilm, retrieval system, or any other means, without the prior written permission of the publisher.

Buros Institute of Mental Measurements 135 Bancroft Hall University of Nebraska-Lincoln Lincoln, NE 68588-0348

The paper used in this publication meets the minimum requirements of American National Standard for Information Sciences-Permanence of Paper for Printed Library Materials, ANSI Z39.48-1984.

I'D Like To Use Essay Tests, But..., Marilla Svinicki

Professional and Organizational Development Network in Higher Education: Archives

The "Writing Across the Curriculum" movement of several years ago urged instructors in all departments to help their students learn to write more coherent prose, whether it be in papers or essay tests, not just to improve student writing but to encourage more complex thinking. Having to explain an answer in prose format requires more from the student in the way of deep processing of the material than is usually the case on objectively scorable exam questions.

Many instructors across campus subscribed to these ideas enthusiastically, but were stymied when it came to putting them into practice in their classes. …

Mentorship In The Classroom: Making The Implicit Explicit, Deanna Martin, Robert Blanc, David Arendale

Professional and Organizational Development Network in Higher Education: Archives

The "under-prepared student" once something of an oddity on American campuses, now seems omnipresent. And not only in undergraduate institutions, not only in America. The government of Great Britain ordered a 25% increase in university enrollment. Black South Africans will occupy a majority of the places in previously white and apartheid universities. The Association of American Medical College will triple minority representation in medical schools in their 3000 x 2000 campaign, drawing heavily on the urban areas that have been on the receiving end of the wrenching body blows of poverty, unemployment, and despair, the areas that have provided many …

In The Name Of The Student... What Is Fairness In College Teaching?, Rita Rodabaugh

Professional and Organizational Development Network in Higher Education: Archives

If we remember our own college days, most of us can think of at least one professor who was less than ideal. All of us have had professors who fit one or more of the following descriptions: dull, boring lecturer; confusing and hard to follow; too easy and presents no challenge; and so on. Yet if you describe your worst experience as a student, more than likely it was one in which you were treated unfairly.

For the past two years, much of my research has focused on college students' perceptions of fair practices in the classroom. From this research, …

Mistakes And Other Classroom Techniques, Harriet C. Edwards

Professional and Organizational Development Network in Higher Education: Archives

As teachers, we wish to do more than present to our students the established ideas and facts of our fields. We want to give them a sense of how one thinks and creates within the discipline, to impart the tools of scholarship. In my field, mathematics, this concern has led to an increased focus on the teaching and learning of problem solving. Researchers have directed much attention to the executive functions and metacognition involved in problem solving, that is, the solver's awareness of thinking processes and of progress toward a solution (Schoenfeld, 1985). In addition to these procedural matters, attitudes …

Helping First-Year Students Study: Part I, Bette Lasere Erickson

Professional and Organizational Development Network in Higher Education: Archives

In preparing to write Teaching College Freshmen, we heard negative sentiments echoed many times. Faculty complained about students' lack of motivation, their neglect of their studies, and their refusal to assume any responsibility for their learning. At the same time, freshmen told us the pace in most courses was far beyond them, it was not humanly possible to do all the work, they frequently felt overwhelmed, and their professors seemed neither to notice nor to care whether or not they learned.

What sense are we to make of these conflicting stories? For starters, freshman descriptions of "humanly impossible" work loads …

What Did I Do Right In One Freshman Seminar? What Did I Do Wrong In Another? What Will I Do Next Time?, Richard L. Schoenwald

Professional and Organizational Development Network in Higher Education: Archives

An essay from a university instructor answering the questions: What did I do right in one freshman seminar? What did I do wrong in another? What will I do next time?

Emerging Trends In College Teaching For The 21st Century, Milton D. Cox

Professional and Organizational Development Network in Higher Education: Archives

After national calls for the reform of undergraduate education were made a decade ago, students, parents, and legislators began to apply pressure to reestablish the importance of student learning. More recently, central administrators have begun to change reward structures. University-wide community is beginning to be built around teaching. New disciplinary journals that publish the scholarship of teaching are being started, and established ones are gaining respect. National teaching conferences and journals that provide a forum for the scholarship of teaching are expanding. With these emerging opportunities, faculty are going public about their interest in teaching and learning. Over the last …

Helping First-Year Students Study: Part Ii, Better Lasere Erickson

Professional and Organizational Development Network in Higher Education: Archives

Few freshmen can keep pace with their courses if they study only an hour between classes and if their only study activities are reading, highlighting, and copying over notes. Faculty expect more, and those who teach freshmen play an important role both in making expectations about college work explicit and in helping freshmen develop their study skills. What, then, might we do to get students to spend more time studying and to study in more productive ways?

Title And Contents- Licensure Testing: Purposes, Procedures, And Practices, James C. Impara, Linda L. Murphy

Licensure Testing: Purposes, Procedures, and Practices

Licensure Testing: Purposes, Procedures, And Practices

Contents

Dedication

Preface

SECTION ONE: Purposes and Policy Issues

1. What is Licensure?
Kara Schmitt

2. Legal and Professional Bases for Licensure Testing
William A. Mehrens

3. Policy Issues with Psychometric Implications
Michael Rosenfeld, Richard J. Tannenbaum, and Scott Wesley

SECTION TWO: Procedures

Overview of the Licensure Testing Process
James C. Impara

4. Practice Analysis: Building the Foundation for Validity
Joan Knapp and Lenora Knapp

5. Test Development: Systematic Item Writing and Test Construction
Anthony LaDuca, Steven Downing, and Thomas Henzel

6. Developing and Using Clinical Examinations
Jimmie Fortune and Ted Cromack

7. Basic …

1. What Is Licensure, Kara Schmitt

Licensure Testing: Purposes, Procedures, and Practices

When most individuals hear the terms license and licensure, their first reaction is that these are easily understood and relatively simple words. Everyone knows what these terms mean. Or do they?

What is licensure? It is a multifaceted, complex governmental system of regulation with the stated purpose being public protection. According to Webster's dictionary (Guralnik, 1976), a license is defined as "a formal permission to do something: esp., authorization by law to do some specified thing (license to marry, practice medicine, hunt, etc.)." The term Licensure is then defined to mean "the act or practice of granting licenses, …

2. Legal And Professional Bases For Licensure Testing, William A. Mehrens

Licensure Testing: Purposes, Procedures, and Practices

In this chapter the author presents the legal setting for licensure testing, I discusses the role of various professional standards and codes (i.e., the EEOC Uniform Guidelines, 1978, and the AERA/APA/NCME Standards, 1985), presents some of the pertinent rulings from several court decisions, and makes inferences about future changes in professional standards and their potential impact on licensure test development.

There necessarily is some minor overlap with the material in this chapter and some other chapters in this book. There is a brief discussion of the differences between licensure, certification. and employment testing and how those differences relate …

Author Index

Licensure Testing: Purposes, Procedures, and Practices

Authors listed A-Z (8 pages)

A

Ader, H. 1. : 2 10,2 18
Ahluwalia, N. T.: 240, 25 1, 330, 344
Aitkin, M.: 262, 267, 282
AI-Dosary, I. M.: 28 1, 282
AI-Karni , A.: 27 1, 28 1, 282
Albanese, M. A.: 125, 138,324,341
Alexander, R. A.: 225, 250
Algin a, 1.: 256, 283
Allen, D. L.: 158, 164
American Counci l on Education: 167, 185
American Educational Research Association: 33,37,38,39,40, 41 , 42,43,53,55,66, 68,72,84,94, 11 4, 11 8, 122,137, 138, 168, 170, 17 1, 179, 185, 236, 248, 254, 255,26 1,28 1
American Psychological Association: 33, 37, 38,39,40, …

Subject Index

Licensure Testing: Purposes, Procedures, and Practices

Subject Index listed A-Z (8 pages)

A

a parameter: 299-300, 303, 305-306, 314
absolute standard procedure: 329
absolute standards: 222-223
accuracy of the inference: 150
Adaptive Mastery Testing (AMT): 298,305
advisory committee: 100-101 , 103-105,111- 112
AERA/APA/NCME Standards: 33,37-43, 53, 55 , 66, 68, 72, 84, 94, 11 4, 118, 122, 137-138,168, 170- 171,179,185, 236, 248, 254-255, 26 1, 281
all -in-one requirement: 155
alternate-choice: 120
alternate-choice multiple choice: 324
Americans with Disabilities Act of 1990 (ADA): 22-23, 43, 54-55, 60-6 1, 63, 65, 68-70, 297
amplified objective: 129,147
amplified objective method: 129
analysis of variance (ANaYA): 153
anchor items: …

10. Establishing Passing Standards, Craig N. Mills

Licensure Testing: Purposes, Procedures, and Practices

INTRODUCTION

When tests are used to determine eligibility for a license, a passing standard or cut score must be established that divides the test scores into two categories: eligible for license or not. Standard setting has been widely researched and there are many reviews available (see, for example, Jaeger, 1989; Mills & Melican, 1988; Berk, 1986; Hambleton, 1980; Hambleton & Eignor, 1980; and Shepard, 1980a, 1980b), yet there is limited practical advice available for conducting standard setting studies and establishing standards. The one available resource (Livingston & Zieky, 1982) is somewhat dated. The purpose of this chapter is to provide …

Teaching Goals, Assessment, Academic Freedom And Higher Learning, Thomas Angelo

Professional and Organizational Development Network in Higher Education: Archives

In this brief essay, I'm going to try to convince you that examining our teaching goals carefully--and balancing them against our students' learning goals and colleagues' teaching goals--can help us become more effective, and perhaps even excellent college teachers.

The Why Of Teacher/Student Relationships, Richard G. Tiberius

Professional and Organizational Development Network in Higher Education: Archives

I heard it again last week, "Yeah, she has a good relationship with her students, but can she teach?", as if the two were completely separate entities, like the icing and the cake. But a teacher's relationship with learners is not icing. It is an essential component of the teaching and learning process. Plumbers and computer technicians may be able to perform useful services on sinks and computers without entering into relation with them or with their owners but teaching simply cannot happen without teachers entering into relation with their students. Moreover, the teacher's success in facilitating learning is directly …

Teaching For Cognitive Growth, Barbara J. Duch, Mary K. Norton

Professional and Organizational Development Network in Higher Education: Archives

The Perry Model

The theme of Perry's work is that no matter how unclouded our message or lucid our meaning, students make their own meanings from their own cognitive structures. Our students come to us naive epistemologists, replete with mistaken views of the nature of knowledge and its acquisition. Perry charts their odyssey from naiveté to maturity through stages where these restrictive cognitive chrysalises are outgrown for increasingly more subtle structures. Briefly, the journey involves the following.

Learning A Lot Vs. Looking Good: A Source Of Anxiety For Students, Anastasia S. Hagen

Professional and Organizational Development Network in Higher Education: Archives

Many teachers have observed that some of their best students also appear to be the students with the greatest amount of anxiety towards school. Teachers have often asked themselves, "Why is this bright, capable student feeling so anxious about what they will be asked to do in my course?" This article is an attempt to provide some insight into this situation with respect to the way students set academic goals.

Changing Priorities In Higher Education: Promotion And Tenure, Robert Diamond

Professional and Organizational Development Network in Higher Education: Archives

A recent study involving over 23,000 faculty chairs, deans and administrators at research universities indicated that even those most directly involved with the present reward system feel that the balance between research and teaching needs to be modified. Most significantly, the results indicate that an effort to modify the system to recognize and reward teaching would be supported by a majority of those surveyed. It may be the time to propose a change in the system.

What They Don't Know Can Hurt Them: The Role Of Prior Knowledge In Learning, Marilla Svinicki

Professional and Organizational Development Network in Higher Education: Archives

Discusses prior knowledge and current learning, and using prior knowledge in instruction.

The lesson we take from the research on prior knowledge is simply this: students are not blank slates on which our words on inscribed. The students bring more to the interpretation of the situation than we realize. What they learn is conditioned by what they already know. What they know can be as damaging as what they don't know.

"If You Can Fake That...": A Reflection On The Morality Of Teaching, David A. Hoekema

Professional and Organizational Development Network in Higher Education: Archives

How can we identify a professor who is genuinely open and honest in the classroom? What are the traits of an instructor who both earns and deserves students' trust? Included are suggested, potential answers to these questions.

Of Gurus, Gatekeepers, And Guides: Metaphors Of College Teaching, Mary K. Norton

Professional and Organizational Development Network in Higher Education: Archives

From what the students tell me, in their experience there are three common metaphors of the college teacher. (Of course there are many more.) While we may disagree that these are the images that guide us, the students' viewpoint is nevertheless instructive, if only to remind us of the difference between what they perceive and we intend. My purpose here is to look through the students' eyes to explore what these metaphors reveal, especially in terms of their "collateral lessons," as Dewey called them: the implied concomitant messages students may draw from them: Guru, Gatekeeper, and Guide.

The Muse: Resources For Faculty And Ta Newsletters, No. 6, Spring 1993

Professional and Organizational Development Network in Higher Education: Archives

An essay on style: Somewhere between baseball caps and mortarboards, by LeAne H. Rutherford

Editors' musings: Newsletters à la française, by Laura Border

Filings: More Muse news to use

Excerpt: A Dozen Hints for Drowsy Proofreaders

Design Review: Boldness and restraint make BYU's new publication an instant winner, by Linc. Fisch

Supplement: TIPS: A Publication of Seneca College, SPRING 1993, VOLUME 10:

REFLECTIONS: GRADUATING STUDENT SURVEY, SENECA COLLEGE, by Eleanor Kirby Badger

People in Profile: Erika Gottlieb, by Malea Litovitz and Renee Scheremata

Dear Dr. Kath: THE RESEARCH PERSPECTIVES COLUMN

THREE COMMANDMENTS OF EFFECTIVE LISTENING, by Abava Newman

Charlene's …

Risky Business: Making Active Learning A Reality, Charles C. Bonwell

Professional and Organizational Development Network in Higher Education: Archives

Much has been said about the power of active learning as an instructional model. But moving from theory to practice may need some careful thought and timely advice.