Psychology Commons^™

The Content Validation Of An Employment Selection Process For Vehicle Mechanics, Michael Heighway

Masters Theses & Specialist Projects

The current study is a significant portion of a content validation study conducted to evaluate new selection tools developed by an organization. In it I assessed the content validity of a structured interview through the following steps: conducting a literature review to establish best practices, reviewing the data gathering process, conducting data analyses, recommending item weights, evaluating the validity of the interview, suggesting standardized materials, creating a plan for training for interview use, and ensuring documentation is kept as required by law.

The data were collected internally by the organization and were provided for analyses. Analyses included one-way ANOVAs, and …

The Validation Of A Structured Situational Interview For Registered And Licensed Practical Nurses, Nicholas L. Simmons

Masters Theses & Specialist Projects

The profession of nursing is experiencing a shortage of qualified nursing professionals. Hospitals understaffed with nurses are likely to experience several negative consequences including low quality care, which places the health and safety of patients at risk. In order to ensure an effective selection process for hospital nurses, a structured situational interview, developed using a content validation approach, was validated using a criterion-related approach.

Interviews that have a high degree of structure consistently demonstrate higher predictive validities with job performance than do interviews with less structure. The structured situational interview in this study had a high degree of structure and …

Population Cross-Validity Estimation And Adjustment For Direct Range Restriction: A Monte Carlo Investigation Of Procedural Sequences To Achieve Optimal Cross-Validity, David Matthew Goins

Masters Theses & Specialist Projects

The current study employs Monte Carlo analyses to evaluate the effectiveness of various statistical procedures for determining specific values of interest within a population of 1,000,000 cases. Specifically, the proper procedures for addressing the opposing effects of direct range restriction and validity overestimation were assessed through a comparison of multiple correlation coefficients derived using various sequences of procedures in randomly drawn samples. A comparison of the average bias associated with these methods indicated that correction for range restriction prior to the application of a validity overestimation adjustment formula yielded the best estimate of population parameters over a number of conditions. …

The Effects Of Rater Training On The Relationship Between Item Observability And Rater Agreement, Keaton Edwin Montgomery

Masters Theses & Specialist Projects

This study was an extension of a study conducted by Roch, Paquin, and Littlejohn (2009). They investigated the relationship between rater agreement and the observability of items on a rating form. The current study found similar results in that, as items became less observable, interrater agreement increased. The purpose of this study was to introduce frame of reference training as an extension to the Roch et al. study in order to reverse their findings. In other words, trained raters would be less likely to default to a general impression on less observable items and thus would demonstrate higher rater agreement …

A Content Validity Study Of The Water Training Institute Curriculum, Alicia Turner

Masters Theses & Specialist Projects

Content validity methods, such as matching matrices, have been used to assist in the design and evaluation of training programs. In the present study, the Water Training Institute (WTI) curriculum was evaluated using a content validation approach. The purpose of the study was to identify topics that were being under-emphasized, over-emphasized, or receiving the correct amount of emphasis in the curriculum. A Job Knowledge Survey was developed and administered to subject matter experts to determine the importance of topics to the jobs that WTI graduates would most likely enter after graduation; the importance ratings were used as the criterion for …

A Situational Assessment Of Student Leadership: An Evaluation Of Alternate Forms Reliability And Convergent Validity, Patricia Slack

Masters Theses & Specialist Projects

The Situational Assessment of Leadership: Student Assessment (SALSA©) was developed in the spring of 2009 to be used as a measure of student leadership. Study 1 assessed alternate forms reliability of the SALSA using scores from 178 students. The overall scores on SALSA Form A and SALSA Form B showed a significant correlation (rAB = .906, p < .01). Dimension scores on the two forms ranged from rAB = .475 to rAB = .804. Study 2 evaluated the convergent validity between the SALSA and the Western Kentucky University Center for Leadership Excellence assessment center. SALSA scores as well as assessment scores from 53 students were analyzed. The overall scores on the SALSA and CLE assessment center had a significant yet moderate correlation (r = .513). Dimension correlations were significant but low, ranging from r = .310 to r = .392. The strong correlations in Study 1 indicate the two forms of the SALSA may be used as alternate measures such as in a pre and post-test of leadership. The convergent validities in Study 2 demonstrate that both the SALSA and assessment center may be used to assess leadership. However, the low convergent validities across dimensions indicate overall scores likely should be used rather than dimension scores.

An Evaluation Of The Impact Of A Thesis Colloquium On Self-Regulated Motivation Toward Thesis Completion, Frank Nicholas Reding

Masters Theses & Specialist Projects

What motivates one to write a thesis? This study assessed whether presenting one’s master’s thesis proposal at a thesis colloquium increased the probability of Industrial/Organizational I/O) Psychology graduate students completing their thesis on time (i.e., finishing their thesis as they finished their graduate coursework). This study also examined the relationship between presenting one’s thesis proposal at a thesis colloquium and different forms of motivated regulation and three basic psychological needs (autonomy, competence, and relatedness).

Participants included 94 master’s level I/O Psychology alumni from four universities. As expected, students who presented at a thesis colloquium had a higher rate of on-time …

Potential Factors That Influence Team Identification: A Desire To Be Similar Or Different?, Courtney A. Clippert

Masters Theses & Specialist Projects

The purpose of the current study is to determine whether eliciting the need for assimilation or the need for differentiation influences individuals’ identification with a given team. Team identification is defined as a fan’s psychological connection to a team; that is, the extent to which the fan views the team as an extension of him or herself (Wann, Melnick, Russell, & Pease, 2001). It is important to understand potential factors that may motivate and potentially increase one’s identification with a particular team.

The sample consisted of 106 participants attending Western Kentucky University. The participants completed the Sport Fandom Questionnaire (SFQ) …

An Evaluation Of The Convergent Validity Of Multi-Source Feedback With Situational Assessment Of Leadership - Student Assessment (Salsa©), Heather Stroupe

Masters Theses & Specialist Projects

The current study assessed the convergent validity of the Situational Assessment of Leadership – Student Assessment (SALSA©), a situational judgment test (SJT), with multi-source ratings. The SALSA© was administered to ROTC cadets via Blackboard; multi-source ratings, which paralleled the leadership dimensions of the SALSA©, were administered via paper. Each cadet completed the SALSA© and was rated by 10 peers, his/herself, and at least one cadre (superior). SALSA© scores were not correlated with any of the corresponding dimensions on multi-source ratings, with one exception. Cadre ratings of Consideration/Team Skills were positively correlated with SALSA© scores on the same dimension. This finding …

Benevolent Vs. Hostile Sexism Impact On Work Performance For Women In Turkey, Crystal M. Bonneau-Kaya

Masters Theses & Specialist Projects

All studies to date that have assessed the direct impact of benevolent vs. hostile sexism on performance outcomes have done so in the context of a Western society. Because of this void in the literature, it remained unknown how living in a low egalitarian and/or non-Western society may impact women's experiences of sexism. The purpose of this study is to address this gap in the literature. This study investigates the impact of benevolent vs. hostile sexism on women in four Turkish textile factories. 210 Turkish female textile factory workers were randomly assigned to the benevolent sexism, hostile sexism, or control …