Psychology Commons^™

A Monte Carlo Analysis Of Thorndike's Indirect Range Restriction Correction Equations, Michael Thomas Pelayo

Masters Theses & Specialist Projects

Employee selection is an important process for organizations. Organizations seek to select the best employees for their available positions. Testing is key to many selection efforts. The results of studies assessing the criterion-related validity of a selection test are affected by a number of statistical artifacts, one of which is range restriction. Range restriction has the effect of attenuating the correlation coefficient. Statistical equations exist to correct for the effects of range restriction, and they enable researchers to obtain a more accurate estimate of the validity coefficient. Thorndike (1949) developed the best known and most frequently used of these correction …

A Monte Carlo Analysis Of Standard Error-Based Methods For Computing Confidence Intervals, Elayna Wichert

Masters Theses & Specialist Projects

The objective of this study is to empirically test existing techniques to calculate the likely range of values for a Classical Test Theory true score given an observed score. The traditional method for forming these confidence intervals has used the standard error of measurement (SEM) as the basis for this confidence interval. An alternate equation, the standard error of estimate (SEE), has been recommended in place of the SEM for this purpose, yet it remains overlooked in the field of psychometrics. It is important that the correct equation be used in various applications in personnel psychology. Monte Carlo analyses were …

Unpacking The Burnout Phenomenon: Understanding Daily Influences On Burnout, Emily Houk

Masters Theses & Specialist Projects

Burnout is a work-related phenomenon that is not bound to the work domain. As such, experiencing burnout can be particularly detrimental for employees because effects of burnout can spill over into other life domains. The present study serves to examine the burnout phenomenon; specifically, I examined the direct effect of daily job stress on perceptions of burnout, as well as explored daily work-related affective rumination as a mediating effect in the relationship between daily job stress and burnout. Work-related affective rumination is a mechanism that potentially helps to explain how buildup of daily job stress influences the development of burnout. …

The Effects Of Optimism, Transformational Leadership, And Work Engagement On Work Outcomes: A Moderated Mediation Model, Chad Kenneally

Psychology Theses & Dissertations

Optimism serves as a powerful resource that can help employees accomplish tasks at work and overcome challenges. However, there are still psychological connections that need to be drawn to explain why optimism has these effects. The Job Demands-Resources Model and the general resource perspective have previously investigated resources in the workplace and the relationships they hold with different work outcomes. In this study, work engagement was investigated as a mediator between optimism and task performance, work withdrawal, and turnover intention. Transformational leadership was investigated as a moderator for the relationship between optimism and work engagement. Optimism was expected to have …

Helping Employees Help The Environment: An Intervention To Increase Environmental Organizational Citizenship Behaviors (Ocb-E) Via A Subtle Stimulus, Rebecca C. Garden

Psychology Theses & Dissertations

Researchers’ understanding of the relationships between environmentally-oriented organizational citizenship behaviors (i.e., OCB-Es) and other workplace variables have improved since the turn of the century, but both our comprehension of the behaviors and the effectiveness of interventions targeting them require much more investigation. Further, there is very little research that examines the role of positive affect in promoting these behaviors, even though scholars have suggested that it may be the “silver bullet” (Kals & Müller, 2012) to facilitating employees’ voluntary environmental actions. To that end, the aim of the current research is to take an initial step towards understanding how organizations …

Cognitive Ability Tests, Megan Paul

Umbrella Summaries

What are cognitive ability tests?

In an employment context, cognitive ability (also known as general intelligence or general mental ability) tests are hiring tools that assess candidates’ ability to learn and solve problems (Hunter & Schmidt, 1996). There are many commercially available cognitive ability tests, and they typically involve multiple-choice questions that measure abilities such as vocabulary, verbal comprehension, and verbal, numerical, and spatial reasoning. Some tests measure a combination of these abilities, whereas some focus only on specific abilities. Because the questions have right and wrong answers, the tests must often be proctored. Tests vary in terms of length, …

Ebci Progress Update- Developing An Onboarding Program, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Eastern Band of Cherokee Indians (EBCI) established their Family Safety Program (FSP) in 2015. FSP is a multi-disciplinary unit and includes behavioral health and child welfare. They are a small agency with about 35-40 child welfare employees at any given time, including front-line caseworkers, case aides, supervisors, and a manager. Minimum qualifications for the caseworker role are rigorous, requiring a bachelor’s or master’s degree in social work and/or years of relevant experience. They also seek to hire enrolled members of the EBCI, enrolled members of other federally recognized tribes, or those married to, or who are children of, enrolled …

Special Issue - Call For Papers: Understanding Effects Of Impression Management On Assessment Outcomes, Neil Christiansen, Chet Robie

Personnel Assessment and Decisions

No abstract provided.

Biodata Measures, Stephanie Weddington, Megan Paul

Umbrella Summaries

What are biodata measures?

Biodata measures are hiring tools that assess a variety of biographical or background data about job candidates. When they were first developed, biodata measures included objective and verifiable questions about a person’s background and history (e.g., education level, number of siblings, job history), but over time they have come to include more subjective questions similar to those found on personality tests (e.g., attitudes, interests, recreational activities, education, and work experiences and preferences) (Schmitt & Golubovich, 2013). They are typically administered using a paper-and-pencil or online-survey format (Breaugh, 2009), and the response options can be yes-no, multiple …

Work Sample Tests, Maggie Thompson, Megan Paul

Umbrella Summaries

What are work sample tests?

Work sample tests are methods used to assess an individual’s ability to successfully perform a job. These tests require individuals to perform tasks that are physically and/or psychologically similar to those they would experience on the job (Schneider & Schmitt, 1986). Though much of the early use of work samples was to assess psychomotor skills for manual tasks like carpentry, electrical work, or welding (Robertson & Downs, 1989), more relevant examples include role plays, in-basket exercises, filing, and writing or typing exercises (Roth, Bobko, McFarland, & Buster, 2008). There are two primary categories of work …

A New Perspective To Measuring Employee Growth: Developing A Successful Aging At Work Scale, Stanimira K. Taneva, Georgi P. Yankov

Personnel Assessment and Decisions

The aging of the world’s population has become a grand societal challenge, which requires an urgent response from researchers, professionals, and the wider society. One way to respond to this challenge is by supporting individuals in sustaining longer and healthier working lives, that is, age successfully. Although the advantages of promoting and enabling successful aging at work have been widely acknowledged, no single instrument for measuring this construct has been published so far. We develop and test in three consecutive samples a two-dimensional successful aging at work scale. This novel instrument is rooted conceptually in the most recent theoretical developments …

Behavioral Assessment Of Expert Talent Competencies: Analysis, Decision Making, And Written And Verbal Communication Skills, Homayoon Kord, George C. Thornton Iii

Personnel Assessment and Decisions

Organizations face challenges of screening applicants for critical skills to serve in expert staff positions requiring interactions with line managers. Such positions require a special set of cognitive and interpersonal competencies. This study investigates the psychometric qualities of a new behavioral assessment method in use in an applied setting. Using data from a group of 219 finalists for positions in a large Iranian steel company, it examined the validity and fairness of the method in relation to other test and demographic information. Results showed evidence of convergent and discriminant validity and no discrimination against women or older candidates. The study …

Initial Reliability And Validity For The Critical Hire® - Screen, Tony Tatman, Matthew T. Huss

Personnel Assessment and Decisions

Although the use of integrity testing during the application process has become a frequent practice in general business settings, their use has been rather nonexistent in the field of corrections. This limited use may stem from a lack of awareness about integrity tests in corrections, as well as a lack of integrity measures that have been normed and validated for use with correctional applicants. This study outlines the development, reliability, and validity for the Critical Hire®-Screen (CH-S), an overt integrity assessment measure developed for probation, parole, and other correctional officer job applicants. Four separate studies were conducted and provide evidence …

Some Advice For Psychologists Who Want To Work With Computer Scientists On Big Data, Cornelius J. König, Andrew M. Demetriou, Philipp Glock, Annemarie M. F. Hiemstra, Dragos Iliescu, Camelia Ionescu, Markus Langer, Cynthia C. S. Liem, Anja Linnenbürger, Rudolf Siegel, Ilias Vartholomaios

Personnel Assessment and Decisions

This article is based on conversations from the project “Big Data in Psychological Assessment” (BDPA) funded by the European Union, which was initiated because of the advances in data science and artificial intelligence that offer tremendous opportunities for personnel assessment practice in handling and interpreting this kind of data. We argue that psychologists and computer scientists can benefit from interdisciplinary collaboration. This article aims to inform psychologists who are interested in working with computer scientists about the potentials of interdisciplinary collaboration, as well as the challenges such as differing terminologies, foci of interest, data quality standards, approaches to data analyses, …

Situational Judgment Tests: An Overview Of Development Practices And Psychometric Characteristics, Deborah L. Whetzel, Taylor S. Sullivan, Rodney A. Mccloy

Personnel Assessment and Decisions

Situational judgment tests (SJTs) are popular assessment methods often used for personnel selection and promotion. SJTs present problem scenarios to examinees, who then evaluate each response option for addressing the issue described in the scenario. As guidance for practitioners and researchers alike, this paper provides experience- and evidence-based best practices for developing SJTs: writing scenarios and response options, creating response instructions, and selecting a response format. This review describes scoring options, including key stretching and within-person standardization. The authors also describe research on psychometric issues that affect SJTs, including reliability, validity, group differences, presentation modes, faking, and coaching.

Training And Experience Evaluations, Kate Stephenson, Megan Paul

Umbrella Summaries

What are training and experience evaluations?

Training and experience (T&E) include previous work and volunteer experience, education or other training, and credentials (Schneider, 1994). Evaluations of T&E are often included in employee selection procedures to screen and rate applicants based on information provided on resumes, applications, or other documents. These evaluations attempt to identify future successful employees by examining and applying systematic, judgment-based ratings to this information (McDaniel, Schmidt, & Hunter, 1988). The idea behind T&E evaluations is that past behavior is a good predictor of future behavior, and people with experience are more committed and motivated to perform well …

Integrating Aviation Technology, Emergency Services, And Human Resilience: Considerations From Social Scientists, Chelsea A. Lenoble Ph.D., Joel M. Billings Ph.D., Allison A. Kwesell Ph.D., Ray H. Chang Ph.D.

National Training Aircraft Symposium (NTAS)

Unmanned aerial systems (UAS) have a range of applications within the field of disaster response. This presentation offers a novel framework of psychosocial considerations designed to advance UAS and disaster management integration. Social scientists highlight important challenges to the effective integration of three primary entities: UAS, the team of teams that responds to disasters, and populations affected by disasters.

The presentation adopts an emerging theoretical perspective on the intersection between UAS capabilities and disaster phases and extends it by bringing necessary attention to social science issues. Specifically, the framework outlines psychosocial considerations and areas of improvement for preparation (training), response …

Adversity: Its Affect On The Resilience Of Female Pilots, Linda M. Pittenger D.Mgt., Stephanie Douglas Ph.D.

National Training Aircraft Symposium (NTAS)

Women are one of the solutions to alleviating the pending pilot shortage. Becoming a pilot needs to appeal to women. Resilience plays an important role in determining whether women in male-dominated career fields will pursue or abandon their careers. The pilot profession is dominated by masculine beliefs, values and perceptions creating an organizational culture adverse and challenging to women.

The study objective was to explore the influence of adversity on female pilots and its effect on resiliency. In our sample of 1,499 female pilots, we found lower resiliency levels as compared to a general U.S. sample. Additionally, statistically significant differences …

Behavioral Antecedents Of Fuel Efficiency, James A. Cotton

Theses and Dissertations

The US Department of Defense is the largest institutional petroleum consumer in the world. In addition to the financial cost of petroleum-based fuels, the US DoD generates more CO₂-equivalent greenhouse gases than the entirety of modern, industrialized nations like Sweden and Norway. Other dangers and externalities arise from the fuels supply chain, like toxin risks to fuel handlers, and human costs to transport fuel in-theater. Within the DoD, the USAF alone often rivals or exceeds the consumption of all other services combined. While the USAF prefers technical, hardware-based solutions to problems, and has given increasing attention to logistical …

Multiple Speed Assessments: Theory, Practice, And Research Evidence, Christoph N. Herde, Filip Lievens

Research Collection Lee Kong Chian School Of Business

This paper presents Multiple Speed Assessments as an umbrella term to encompass a variety of approaches that include multiple (e.g., 20), short (e.g., 3 min), and often integrated interpersonal simulations to elicit overt behavior in a standardized way across participants. Multiple Speed Assessments can be used to get insight into the behavioral repertoire of a target person in situations sampled from a predefined target domain and their intraindividual variability across these situations. This paper outlines the characteristics and theoretical basis of Multiple Speed Assessments. We also discuss various already existing examples of Multiple Speed Assessments (Objective Structured Clinical Examinations, Multiple …

Situational Judgment Tests, Megan Paul

Umbrella Summaries

What is a situational judgment test?

A situational judgment test (SJT) is a hiring tool that measures knowledge, skills, abilities, and other characteristics by assessing test takers’ responses to various job-related situations. They are typically administered in paper-and-pencil or video format, and each item presents a scenario and various potential responses or actions to take. Instructions tend to fall into one of two categories: knowledge or behavioral tendency. Knowledge instructions require judgments about the efficacy of different options, and they ask test takers to choose, for example, the best option, the best and worst option, or the most effective option. …

Don't Google It! Appeal To Students' Passions To Inspire Information Literacy, Ellen B. Derwin Ph.D.

Georgia International Conference on Information Literacy

Who doesn’t love Google? Yet in courses all across disciplines at colleges and universities, faculty struggle with assigning work that requires research. Why? Students immediately Google (or use another search engine) to seek information and often ignore requirements to seek information that is relevant, credible, accurate and evidence-based. Despite partnering with librarians, grading with information literacy as a high priority, and guiding students to seek appropriate sources, googling without critical thinking happens on a regular basis. At Brandman University, this frustration for faculty occurs throughout the curriculum, even in courses such as Critical Thinking, Student Success, and Information Literacy, which …

Realistic Job Previews, Michelle Graef

Umbrella Summaries

What is a realistic job preview?

A realistic job preview (RJP) is a strategic organizational communication designed to provide job candidates with positive and negative information about the job and the organization, for the purpose of influencing employee perceptions, attitudes, job performance, and ultimately, retention. Although the first published examples of organizations providing realistic information to job candidates or new employees appeared in the 1960s, Wanous (1973) is credited with popularizing the term. An RJP should be based on a thorough diagnosis of the job and the organization, so that the content of the preview targets the relevant information that …

Motivational Antecedents To Fandom And The Resultant Effects In The Foreign Contemporary Music Market, Hyun Sang An, Wooyang Kim, C. Anthony Di Benedetto

Atlantic Marketing Association Proceedings

No abstract provided.

Coach Ohio- The View From The Site Implementation Manager, Vincent Ciola

Other QIC-WD Products

Vincent Ciola: I am the Site Implementation Manager in Ohio for our QICWD initiative, Coach Ohio, and work for the Ohio Department of Job and Family Services. Ohio is a county administered system, so I work with nine diverse counties on this project. It has been inspiring to see the dedication to the child protection workforce in each of these different places. I also work on Ohio’s improvement plan for round three of the Child and Family Services Review (CFSR). In that work, I focus on strategies to achieve comprehensive assessment and planning with all our families. I’ve been intrigued …

Recruitment, Megan Paul

Umbrella Summaries

What is recruitment?

Recruitment refers to efforts by organizations to make potential job candidates aware of job openings and influence whether they apply, maintain interest in the job until an offer is made, and accept an offer (Breaugh, 2008). Note that although applicants may be affected by strategies used to assess their qualifications and potential (e.g., interviews), those activities are not considered part of recruitment and will not be covered in this summary. Further details will be provided in the umbrella summary on employee selection.

Why is recruitment important?

The most obvious reason that recruitment is important is because vacancies …

Evaluation Of Unm's Parental Leave Policy, Julia Fulghum, Karlyn A. Edwards, Charlie Christian, Steven Verney, Lisa A. Marchiondo, Teagan Mullins

ADVANCE Reports

Experiences with UNM’s parental leave policy C215 have been evaluated using the ADVANCE 2018 Main Campus Faculty Climate Survey, a series of junior faculty interviews, and concerns brought to the ADVANCE leadership. Key findings are:

• Women and STEM faculty are more hesitant to use family-leave policies, and perceive greater disadvantage in using them than men and non-STEM faculty
• Sharing of information about, and implementation of, parental leave varies significantly between units
• The attitude of the department chair and senior faculty strongly influence the experience of faculty who use parental leave
• Appropriately implemented, the parental leave policy contributes to faculty recruitment …

Adding Insult To Rivalry: Exploring The Discord Communicated Between Rivals, Jennifer L. Harker, Jonathan A. Jensen

Faculty & Staff Scholarship

Purpose – The purpose of this research is to extend current knowledge regarding rivalry communication among sport consumers to better understand how rivals behave with one another when they communicate.

Design/methodology/approach – This national survey of US sport consumers used a novel approach to explore whether and with whom rivals discuss National Football League (NFL) game outcomes. The survey captured both uniplex and multiplex data by asking respondents to name rival discussants with whom they had recently interacted, and the fan behaviors they exchanged with those named rival discussants.

Findings – Through use of this novel data collection approach, new …

Happy Analysts, Ole-Kristian Hope, Congcong Li, An-Ping Lin, Maryjane Rabier

Research Collection School Of Accountancy

This paper is the first to investigate the role of work-life balance in financial analysts’ performance and career advancement. Using a large sample of Glassdoor reviews by financial analysts, we find a significant non-linear relation between work-life balance satisfaction and analyst performance and analyst career advancement. Specifically, when work-life balance satisfaction is relatively low, an increase in work-life balance is associated with better analyst performance and career advancement; however, when perceived work-life balance is already high, a further increase in work-life balance is associated with worse analyst performance and career advancement.

Is It All In The Eye Of The Beholder? The Importance Of Situation Construal For Situational Judgment Test Performance, Jan-Philipp Freudenstein, Philipp Schaepers, Lena Roemer, Patrick Mussel, Stefan Krumm

Research Collection Lee Kong Chian School Of Business

Recent research challenges the importance of situation descriptions for situational judgment test (SJT) performance. This study contributes to resolving the ongoing debate on whether SJTs are situational measures, by incorporating findings on person x situation interactions into SJT research. Specifically, across three studies (N-Total = 1,239), we first tested whether situation construal (i.e., the individual perception of situations in SJTs) predicts responses to SJT items. Second, we assessed whether the relevance of situation construal for SJT performance depends on test elements (i.e., situation descriptions and response options) and item features (i.e., description-dependent vs. description-independent SJT items). Lastly, we determined whether …