Industrial and Organizational Psychology Commons^™

Public Opinions Of Unmanned Aerial Technologies In 2014 To 2019: A Technical And Descriptive Report, Lisa M. Pytlikzillig, Janell C. Walther, Carrick Detweiler, Sebastian Elbaum, Adam Houston

Lisa PytlikZillig Publications

The primary purpose of this report is to provide a descriptive and technical summary of the results from similar surveys administered in fall 2014 (n = 576), 2015 (n = 301), 2016 (ns = 1946 and 2089), and 2018 (n = 1050) and summer 2019 (n = 1300). In order to explore a variety of factors that may impact public perceptions of unmanned aerial technologies (UATs), we conducted survey experiments over time. These experiments randomly varied the terminology (drone, aerial robot, unmanned aerial vehicle (UAV), unmanned aerial system (UAS)) used to describe the technology, the purposes of the technology (for …

Integrity Tests, Michael Cunningham, Megan Paul

Umbrella Summaries

What are integrity tests?

Employee integrity tests are attitude self-report hiring tools that measure candidates’ disposition to productively perform their work, while refraining from counterproductive actions. Counterproductive actions include behaviors such as theft; safety and procedure violations; revealing confidential information or falsifying records; arguing with customers, clients and staff; and tardiness, absenteeism and job abandonment (Gruys, as cited in Sackett, 2002). There are many commercially available integrity tests, and they are often classified as either overt or personality based (Sackett, Burris, & Callahan, 1989). Overt integrity tests (also known as clear-purpose tests) are designed to directly assess attitudes regarding dishonest …

Supporting The Child Welfare Workforce When People Have To Work From Home, Quality Improvement Center For Workforce Development (Qic-Wd)

Other QIC-WD Products

Transitioning a face-to-face, people-focused workforce into one that leverages virtual meetings and visits is no small feat, especially in a crisis. Many child welfare agencies are considering how best to incorporate technology solutions into everyday workforce activities. The QIC-WD is focused on strengthening the child welfare workforce by reviewing and translating the evidence about what works for agency leaders. Although there is not a lot of research on the most effective strategies to manage a remote child welfare workforce, Harvard Business Review recently released an article that summarizes the available evidence and provides concrete tips for managers with employees who …

Cognitive Ability Tests, Megan Paul

Umbrella Summaries

What are cognitive ability tests?

In an employment context, cognitive ability (also known as general intelligence or general mental ability) tests are hiring tools that assess candidates’ ability to learn and solve problems (Hunter & Schmidt, 1996). There are many commercially available cognitive ability tests, and they typically involve multiple-choice questions that measure abilities such as vocabulary, verbal comprehension, and verbal, numerical, and spatial reasoning. Some tests measure a combination of these abilities, whereas some focus only on specific abilities. Because the questions have right and wrong answers, the tests must often be proctored. Tests vary in terms of length, …

Ebci Progress Update- Developing An Onboarding Program, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Eastern Band of Cherokee Indians (EBCI) established their Family Safety Program (FSP) in 2015. FSP is a multi-disciplinary unit and includes behavioral health and child welfare. They are a small agency with about 35-40 child welfare employees at any given time, including front-line caseworkers, case aides, supervisors, and a manager. Minimum qualifications for the caseworker role are rigorous, requiring a bachelor’s or master’s degree in social work and/or years of relevant experience. They also seek to hire enrolled members of the EBCI, enrolled members of other federally recognized tribes, or those married to, or who are children of, enrolled …

Biodata Measures, Stephanie Weddington, Megan Paul

Umbrella Summaries

What are biodata measures?

Biodata measures are hiring tools that assess a variety of biographical or background data about job candidates. When they were first developed, biodata measures included objective and verifiable questions about a person’s background and history (e.g., education level, number of siblings, job history), but over time they have come to include more subjective questions similar to those found on personality tests (e.g., attitudes, interests, recreational activities, education, and work experiences and preferences) (Schmitt & Golubovich, 2013). They are typically administered using a paper-and-pencil or online-survey format (Breaugh, 2009), and the response options can be yes-no, multiple …

Work Sample Tests, Maggie Thompson, Megan Paul

Umbrella Summaries

What are work sample tests?

Work sample tests are methods used to assess an individual’s ability to successfully perform a job. These tests require individuals to perform tasks that are physically and/or psychologically similar to those they would experience on the job (Schneider & Schmitt, 1986). Though much of the early use of work samples was to assess psychomotor skills for manual tasks like carpentry, electrical work, or welding (Robertson & Downs, 1989), more relevant examples include role plays, in-basket exercises, filing, and writing or typing exercises (Roth, Bobko, McFarland, & Buster, 2008). There are two primary categories of work …

Training And Experience Evaluations, Kate Stephenson, Megan Paul

Umbrella Summaries

What are training and experience evaluations?

Training and experience (T&E) include previous work and volunteer experience, education or other training, and credentials (Schneider, 1994). Evaluations of T&E are often included in employee selection procedures to screen and rate applicants based on information provided on resumes, applications, or other documents. These evaluations attempt to identify future successful employees by examining and applying systematic, judgment-based ratings to this information (McDaniel, Schmidt, & Hunter, 1988). The idea behind T&E evaluations is that past behavior is a good predictor of future behavior, and people with experience are more committed and motivated to perform well …

Situational Judgment Tests, Megan Paul

Umbrella Summaries

What is a situational judgment test?

A situational judgment test (SJT) is a hiring tool that measures knowledge, skills, abilities, and other characteristics by assessing test takers’ responses to various job-related situations. They are typically administered in paper-and-pencil or video format, and each item presents a scenario and various potential responses or actions to take. Instructions tend to fall into one of two categories: knowledge or behavioral tendency. Knowledge instructions require judgments about the efficacy of different options, and they ask test takers to choose, for example, the best option, the best and worst option, or the most effective option. …

Realistic Job Previews, Michelle Graef

Umbrella Summaries

What is a realistic job preview?

A realistic job preview (RJP) is a strategic organizational communication designed to provide job candidates with positive and negative information about the job and the organization, for the purpose of influencing employee perceptions, attitudes, job performance, and ultimately, retention. Although the first published examples of organizations providing realistic information to job candidates or new employees appeared in the 1960s, Wanous (1973) is credited with popularizing the term. An RJP should be based on a thorough diagnosis of the job and the organization, so that the content of the preview targets the relevant information that …

Coach Ohio- The View From The Site Implementation Manager, Vincent Ciola

Other QIC-WD Products

Vincent Ciola: I am the Site Implementation Manager in Ohio for our QICWD initiative, Coach Ohio, and work for the Ohio Department of Job and Family Services. Ohio is a county administered system, so I work with nine diverse counties on this project. It has been inspiring to see the dedication to the child protection workforce in each of these different places. I also work on Ohio’s improvement plan for round three of the Child and Family Services Review (CFSR). In that work, I focus on strategies to achieve comprehensive assessment and planning with all our families. I’ve been intrigued …

Recruitment, Megan Paul

Umbrella Summaries

What is recruitment?

Recruitment refers to efforts by organizations to make potential job candidates aware of job openings and influence whether they apply, maintain interest in the job until an offer is made, and accept an offer (Breaugh, 2008). Note that although applicants may be affected by strategies used to assess their qualifications and potential (e.g., interviews), those activities are not considered part of recruitment and will not be covered in this summary. Further details will be provided in the umbrella summary on employee selection.

Why is recruitment important?

The most obvious reason that recruitment is important is because vacancies …

Texas Decreased Caseworker Turnover. The Qic-Wd Is Implementing And Testing Some Of Their Strategies And Building Evidence, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The QIC-WD is dedicated to building evidence. Foundational work in the early years of the Center included combing the literature from multiple fields (e.g., business, education, industrial-organizational psychology) to inform strategies to strengthen the child welfare workforce. In 2018, Casey Family Programs reported on how the Texas Department of Family and Protective Services (DFPS) reduced caseworker turnover by implementing multiple changes to system operations (How did Texas decrease caseworker turnover and stabilize its workforce?). This post discusses how the QICWD is working with eight other jurisdictions and building on what was learned in Texas. According to the report, Texas initiated …

Addressing Students’ Mental Health Needs In Faculty-Led Study Abroad Courses, Elizabeth Niehaus, Angela Bryan, Matthew J. Nelson, Kaleb Briscoe

Department of Educational Administration: Faculty Publications

The increased enrollment of students with mental health needs in U.S. higher education, paired with increasing emphasis on study abroad participation has led campus mental health professionals to consider how their services might extend to serve students with mental health needs who are studying abroad. When it comes to faculty led courses, instructors can play a key role in providing on-the-ground support for students experiencing mental health challenges. The findings from this study provide key insights that college mental health professionals can use to better understand and support these instructors as they serve on the front lines of addressing students’ …

Recent Research To Build Knowledge Of The Child Welfare Workforce, Quality Improvement Center For Workforce Development

Other QIC-WD Products

Child welfare worker turnover is costly and can negatively affect the relationship between families and the child welfare agency. The Quality Improvement Center for Workforce Development (QIC-WD) aims to build the body of evidence in the child welfare field to better understand worker turnover and strategies to address it. Although turnover is a widely acknowledged problem, there has not been reliable data to calculate staff turnover, caseloads, and workforce capacity. A recent study and article, Characteristics of the Front-line Child Welfare Workforce (Edwards & Wildeman, 2018), makes available a new data source and provides an analysis of workforce data from …

Using Technology To Reduce The Burden Of Paperwork: Preliminary Lessons Learned From The Qic -Wd Virginia Site, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Quality Improvement Center for Workforce Development (QIC-WD) partnered with the Virginia Department of Social Services (VDSS) in 2017 to conduct research examining the efficacy of technology interventions aimed at reducing child welfare staff turnover and improving child welfare outcomes. Virginia is a state-supervised, countyadministered child welfare system. The state elected to study the implementation of and outcomes from job modernization technology interventions in 18 localities. These 18 localities represent a workforce of approximately 450 of the state’s 2,200 frontline staff. The intervention is occurring in multiple phases: (1) transcription services; (2) a mobility technology application; and (3) a Comprehensive …

Introducing Virginia’S Mobile Solution, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Virginia Department of Social Services (VDSS) and the 18 local departments of social services (LDSS) identified the lack of technological supports to help child welfare workers complete the administrative tasks of their job as a cause of turnover. The Virginia site rolled out the first part of their intervention (transcription services) in 2018 and is now preparing to roll out a mobile application in late fall 2019. This one-page summary describes COMPASS, Virginia’s mobile app designed to make it easier for workers to manage the administrative aspects of their job.

Designing Rigorous Tests Of Workforce Interventions In Complex Environments, Quality Improvement Center For Workforce Development

Other QIC-WD Products

Public child welfare agencies continually struggle with how to address issues of staff recruitment and retention. Furthermore, very little evidence exists regarding what works to attract, select, and retain talented staff. Much of what agencies do to address workforce issues is never formally evaluated and successes are not published widely. Thus, agencies confronted with urgent retention needs have little to go on to identify an intervention that is likely to succeed. The Quality Improvement Center for Workforce Development (QIC-WD) was funded by the Children’s Bureau to begin to address this issue, in part through carefully selected, and rigorously evaluated interventions …

Secondary Traumatic Stress Among Child Welfare Workers, Quality Improvement Center For Workforce Development

Other QIC-WD Products

There is growing evidence to suggest that child welfare workers are experiencing high levels of secondary traumatic stress (STS) as a result of exposure to traumatized clients in crisis (e.g., Barbee, et al, 2018). The Quality Improvement Center on Workforce Development (QIC-WD) surveyed 1,113 front line child welfare workers in 13 jurisdictions between November, 2017 and March, 2018 using the Bride (2007) Secondary Traumatic Stress Scale as part of a comprehensive workforce needs assessment. An average of 54% of participants reported clinical levels of STS. When these elevated numbers are compared to the original Bride research of social workers, they …

Context And Regulation Of Homeschooling: Issues, Evidence, And Assessment Practices, Janet F. Carlson

Buros Center: Professional Staff Publications

The article discusses salient factors that influence the current context within which homeschooling occurs. Individual states have applied various approaches to establish regulations that both preserve the rights of homeschooling parents and fulfill the state’s obligation to ensure that its residents receive the education to which they are constitutionally entitled. Case and ethnographic studies or research involving small and selected samples often appear in outlets associated with homeschool advocacy groups or in outlets that are not mainstream. The paucity of empirical evidence derived from methodologically strong research paradigms has led to little certainty about many aspects of homeschooling including its …

Effectively Using & Sharing Data, Quality Improvement Center For Workforce Development (Qic-Wd)

Other QIC-WD Products

The QIC-WD recently had the opportunity to talk with a group of human services training evaluators in Baltimore about how to effectively use and share data. The QIC-WD has a dissemination plan and data visualization experts (learn more here) to help our team and our sites use and share data for a variety of purposes. We shared the following tips to help evaluators determine what to share, when, and why.

• Plan for dissemination – that is, identify who needs the information and how best to get it to them.
• Consider who is in your target audience and how they …

Using A Logic Model To Guide Workforce Interventions, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The QIC-WD uses logic models—visual representations that depict the resources that go into and expected results that will come out of the implementation of a program—to guide the implementation and evaluation of the selected interventions. A logic model is developed after the intervention is selected and must fit within the overall theory of change, as part of the exploration phase of the project. Read this summary (originally developed on behalf of the Center for States) by Dr. Megan Paul, the QIC-WD Workforce Team Lead, to learn more about why a jurisdiction should create a logic model and see what a …

Describing A Workforce Intervention, Anita Barbee

Other QIC-WD Products

For the purpose of the Quality Improvement Center for Workforce Development (QIC-WD), a workforce intervention is a structured set of activities aimed at solving an identified cause of frontline worker turnover. Some interventions, or parts of interventions, have been created in other settings and are being adopted or adapted for the QIC-WD program. Other interventions are being developed collaboratively by the QIC-WD and site implementation teams. All include the four key components that are the hallmark of strong interventions. The four key components of strong interventions include:

1) A description of the theoretical base upon which the actions in the …

Conducting Comprehensive Workforce Needs Assessments In Child Welfare, Megan Paul, Courtney Harrison

Other QIC-WD Products

Staff recruitment, selection, and retention are persistent challenges for many child welfare agencies. Agency directors recognize these challenges but often lack the capacity or strong relationships with human resources (HR) to hire and keep the right child welfare staff. The lack of evidence-based practices to address child welfare workforce issues compounds the situation. The Quality Improvement Center for Workforce Development (QIC-WD) was created through a 5-year cooperative agreement with the Children's Bureau to advance knowledge about evidence-informed workforce interventions, test a variety of interventions in real-world settings, and examine how workforce stability is related to outcomes for children.

The QIC-WD …

Supportive Supervision And Resiliency Ohio - Guidance For Coaches Supporting Resilience, Quality Improvement Center For Workforce Development

Other QIC-WD Products

I. Preparation for Coaching Session A. Preparation of Supervisor ➢ Review Coaching Skills and Coaching Process (see Pgs. 4-5 Coaching in Child Welfare Participant Guide from the Supervisor’s Coaching Training) ➢ Reflect on how coaching builds a trusting relationship ▪ Commitment to confidentiality ▪ Clear mutual understanding of coaching, the process and expectations ▪ Modeling the coaching mindset/skill set ➢ Review the basics of Resilience Alliance (Handout of Slide Deck provided at the Supervisor’s Coaching Training) B. Preparation of Caseworker (can be done by supervisor in unit/team meeting) ➢ Discuss how Resilience coaching is a part of supportive supervision ➢ …

Oklahoma Selects And Designs A Selection Intervention, Quality Improvement Center For Workforce Development

Other QIC-WD Products

Oklahoma’s Quality Improvement Center for Workforce Development Steering Committee has decided to refine the selection process for new child welfare workers as part of their ongoing commitment to hiring a dedicated, talented workforce and supporting that workforce in practice with children, youth, and families. The committee spent much of 2018 doing a thorough needs assessment and exploration of their child welfare recruitment and retention challenges. Through this process they recognized that interviewing strategies and hiring decisions are made inconsistently across the state. The team acknowledged that this could result in the selection of individuals who are not the best fit …

Louisiana Selects A Workforce Intervention: Job Redesign & Teaming, Quality Improvement Center For Workforce Development

Other QIC-WD Products

For several years prior to the current Administration, Louisiana suffered through an unstated policy of “Do More with Less”: Fewer employees, higher caseloads, less resources, and high employee turnover. In 2016, the Louisiana Department of Children and Family Services (DCFS) leadership determined that supporting and stabilizing the child welfare workforce was a high priority. To strengthen its workforce, Louisiana will implement “Job Redesign and Teaming” as its QIC-WD intervention. The job redesign aspect of the intervention includes a comprehensive job analysis and process mapping to determine which tasks needed to be retained by the child welfare worker and which tasks …

Eastern Band Of Cherokee Indians Selects A Workforce Intervention: Onboarding, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Family Safety Program (FSP) serves the Eastern Band of Cherokee Indians (EBCI) to provide high quality and innovative care, utilizing an integrated model to ensure client access to behavioral health services and targeted case management. To retain a competent and committed workforce and best serve children and families, FSP partnered with the Quality Improvement Center for Workforce Development (QIC-WD) to be one of eight national project sites to test child welfare workforce interventions. In 2018, FSP conducted a workforce needs assessment, which revealed that staff had inconsistent job expectations for their own role and lacked understanding of the roles …

Milwaukee Selects A Workforce Intervention: Organizational Culture & Climate, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Division of Milwaukee Child Protective Services (DMCPS) of the Wisconsin Department of Children and Families (DCF) will be implementing and testing an organizational culture and climate intervention called ARC, which stands for Availability, Responsiveness, & Continuity. ARC is an organizational change process that has improved outcomes in mental health settings by: 1) introducing core principles to guide service improvement efforts, 2) embedding research-based organizational components for service improvement, and 3) fostering attitudes necessary for ongoing service improvement. DMCPS employs approximately 185 State employees. These employees conduct initial child protective service assessments, oversee ongoing case management services delivered by private …

Washington Selects A Workforce Intervention: Telework, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Washington State Department of Children, Youth, and Families (DCYF) will be implementing and testing the effectiveness of telework for child welfare field operations staff and their supervisors. DYCF is a stateadministered system with a total of 3,075 employees. There are approximately 1,600 field operation staff and 260 field operation supervisors that make up the majority of the child welfare workforce in the agency. A comprehensive workforce needs assessment showed a strong desire among employees to be able to work from home or an alternate work site. A telework policy existed but was inconsistently implemented, and the majority of employees …