Performance Management Commons^™

Emotional Intelligence Tests, Megan Paul

Umbrella Summaries

What are emotional intelligence tests?

In an employment context, emotional intelligence tests are tools that assess job candidates’ or employees’ abilities or tendencies related to recognizing, understanding, and managing emotions. Depending on the tool, they can be used to inform hiring decisions and/or for professional development. Beyond the general description above, there is variation in the definition and measurement of emotional intelligence, with the differences falling into three categories (Ashkanasy & Daus, 2005). When it was first conceived, emotional intelligence was considered to be a set of abilities or competencies, to be assessed through actual behavior (Salovey & Mayer, 1990; …

Washington Progress Update – Telework In Action, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The vast majority of the U.S. workforce (80%) says they would like to telework at least part-time, according to research by Global Workplace Analytics. Although not all jobs are conducive to telework, the Washington State Department of Children, Youth & Families (DCYF) is working with the QIC-WD to design, implement, and research the impacts of telework as a strategy to support and retain the child welfare workforce. Implementing telework is more complicated than giving staff a laptop and a cell phone and telling them to check in with their supervisor. This post summarizes what actions DCYF is taking to implement …

Integrity Tests, Michael Cunningham, Megan Paul

Umbrella Summaries

What are integrity tests?

Employee integrity tests are attitude self-report hiring tools that measure candidates’ disposition to productively perform their work, while refraining from counterproductive actions. Counterproductive actions include behaviors such as theft; safety and procedure violations; revealing confidential information or falsifying records; arguing with customers, clients and staff; and tardiness, absenteeism and job abandonment (Gruys, as cited in Sackett, 2002). There are many commercially available integrity tests, and they are often classified as either overt or personality based (Sackett, Burris, & Callahan, 1989). Overt integrity tests (also known as clear-purpose tests) are designed to directly assess attitudes regarding dishonest …

Middle Managers & Leadership Trainings For Effective Senior Leadership Positions In Public Organizations; Applications In Emergency Management, Norah Alshayhan, Juita-Elena Wie Yusuf

College of Business (Strome) Posters

Leaders and training are vital dimensions of organizational development and effectiveness. Availing leadership programs provide continuous learning to the leaders in public sector organizations. However, leaders in senior positions in the public sector organizations have faced struggles and obstacles that inhibit their capacity to drive organizational agenda. Therefore, understanding the relationship between the training programs and the performance of the leaders in the senior positions is vital. The study will discover the struggles and obstacles experienced by the public-service leader and the impact training middle managers the leadership skills. The study hopes to propose a training program for middle managers …

Cognitive Ability Tests, Megan Paul

Umbrella Summaries

What are cognitive ability tests?

In an employment context, cognitive ability (also known as general intelligence or general mental ability) tests are hiring tools that assess candidates’ ability to learn and solve problems (Hunter & Schmidt, 1996). There are many commercially available cognitive ability tests, and they typically involve multiple-choice questions that measure abilities such as vocabulary, verbal comprehension, and verbal, numerical, and spatial reasoning. Some tests measure a combination of these abilities, whereas some focus only on specific abilities. Because the questions have right and wrong answers, the tests must often be proctored. Tests vary in terms of length, …

Ebci Progress Update- Developing An Onboarding Program, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Eastern Band of Cherokee Indians (EBCI) established their Family Safety Program (FSP) in 2015. FSP is a multi-disciplinary unit and includes behavioral health and child welfare. They are a small agency with about 35-40 child welfare employees at any given time, including front-line caseworkers, case aides, supervisors, and a manager. Minimum qualifications for the caseworker role are rigorous, requiring a bachelor’s or master’s degree in social work and/or years of relevant experience. They also seek to hire enrolled members of the EBCI, enrolled members of other federally recognized tribes, or those married to, or who are children of, enrolled …

Biodata Measures, Stephanie Weddington, Megan Paul

Umbrella Summaries

What are biodata measures?

Biodata measures are hiring tools that assess a variety of biographical or background data about job candidates. When they were first developed, biodata measures included objective and verifiable questions about a person’s background and history (e.g., education level, number of siblings, job history), but over time they have come to include more subjective questions similar to those found on personality tests (e.g., attitudes, interests, recreational activities, education, and work experiences and preferences) (Schmitt & Golubovich, 2013). They are typically administered using a paper-and-pencil or online-survey format (Breaugh, 2009), and the response options can be yes-no, multiple …

Work Sample Tests, Maggie Thompson, Megan Paul

Umbrella Summaries

What are work sample tests?

Work sample tests are methods used to assess an individual’s ability to successfully perform a job. These tests require individuals to perform tasks that are physically and/or psychologically similar to those they would experience on the job (Schneider & Schmitt, 1986). Though much of the early use of work samples was to assess psychomotor skills for manual tasks like carpentry, electrical work, or welding (Robertson & Downs, 1989), more relevant examples include role plays, in-basket exercises, filing, and writing or typing exercises (Roth, Bobko, McFarland, & Buster, 2008). There are two primary categories of work …

Training And Experience Evaluations, Kate Stephenson, Megan Paul

Umbrella Summaries

What are training and experience evaluations?

Training and experience (T&E) include previous work and volunteer experience, education or other training, and credentials (Schneider, 1994). Evaluations of T&E are often included in employee selection procedures to screen and rate applicants based on information provided on resumes, applications, or other documents. These evaluations attempt to identify future successful employees by examining and applying systematic, judgment-based ratings to this information (McDaniel, Schmidt, & Hunter, 1988). The idea behind T&E evaluations is that past behavior is a good predictor of future behavior, and people with experience are more committed and motivated to perform well …

Merit, Diversity, And Performance: Does Diversity Management Moderate The Effect Of Merit Principles On Governmental Performance?, Sanghee Park, Jiaqi Liang

Public Policy and Administration Faculty Publications and Presentations

The compatibility of merit principles and diversity management is particularly intriguing in theory and practice. Although theoretical arguments for merit-based practices and diversity management are well established, the effect of their dynamics on governmental performance remains an empirical issue. This article examines the effect of merit principles, workforce diversity, and diversity management on government performance, and inquiries about whether diversity management efforts moderate the effect of merit-based practices. Analyzing a combined data set on federal agencies, this study finds that merit-based practices and diversity management have independent positive impact on organizational performance, but there is no significant relationship between workforce …

Situational Judgment Tests, Megan Paul

Umbrella Summaries

What is a situational judgment test?

A situational judgment test (SJT) is a hiring tool that measures knowledge, skills, abilities, and other characteristics by assessing test takers’ responses to various job-related situations. They are typically administered in paper-and-pencil or video format, and each item presents a scenario and various potential responses or actions to take. Instructions tend to fall into one of two categories: knowledge or behavioral tendency. Knowledge instructions require judgments about the efficacy of different options, and they ask test takers to choose, for example, the best option, the best and worst option, or the most effective option. …

Realistic Job Previews, Michelle Graef

Umbrella Summaries

What is a realistic job preview?

A realistic job preview (RJP) is a strategic organizational communication designed to provide job candidates with positive and negative information about the job and the organization, for the purpose of influencing employee perceptions, attitudes, job performance, and ultimately, retention. Although the first published examples of organizations providing realistic information to job candidates or new employees appeared in the 1960s, Wanous (1973) is credited with popularizing the term. An RJP should be based on a thorough diagnosis of the job and the organization, so that the content of the preview targets the relevant information that …

Coach Ohio- The View From The Site Implementation Manager, Vincent Ciola

Other QIC-WD Products

Vincent Ciola: I am the Site Implementation Manager in Ohio for our QICWD initiative, Coach Ohio, and work for the Ohio Department of Job and Family Services. Ohio is a county administered system, so I work with nine diverse counties on this project. It has been inspiring to see the dedication to the child protection workforce in each of these different places. I also work on Ohio’s improvement plan for round three of the Child and Family Services Review (CFSR). In that work, I focus on strategies to achieve comprehensive assessment and planning with all our families. I’ve been intrigued …

Recruitment, Megan Paul

Umbrella Summaries

What is recruitment?

Recruitment refers to efforts by organizations to make potential job candidates aware of job openings and influence whether they apply, maintain interest in the job until an offer is made, and accept an offer (Breaugh, 2008). Note that although applicants may be affected by strategies used to assess their qualifications and potential (e.g., interviews), those activities are not considered part of recruitment and will not be covered in this summary. Further details will be provided in the umbrella summary on employee selection.

Why is recruitment important?

The most obvious reason that recruitment is important is because vacancies …

Evaluation Of Unm's Parental Leave Policy, Julia Fulghum, Karlyn A. Edwards, Charlie Christian, Steven Verney, Lisa A. Marchiondo, Teagan Mullins

ADVANCE Reports

Experiences with UNM’s parental leave policy C215 have been evaluated using the ADVANCE 2018 Main Campus Faculty Climate Survey, a series of junior faculty interviews, and concerns brought to the ADVANCE leadership. Key findings are:

• Women and STEM faculty are more hesitant to use family-leave policies, and perceive greater disadvantage in using them than men and non-STEM faculty
• Sharing of information about, and implementation of, parental leave varies significantly between units
• The attitude of the department chair and senior faculty strongly influence the experience of faculty who use parental leave
• Appropriately implemented, the parental leave policy contributes to faculty recruitment …

Texas Decreased Caseworker Turnover. The Qic-Wd Is Implementing And Testing Some Of Their Strategies And Building Evidence, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The QIC-WD is dedicated to building evidence. Foundational work in the early years of the Center included combing the literature from multiple fields (e.g., business, education, industrial-organizational psychology) to inform strategies to strengthen the child welfare workforce. In 2018, Casey Family Programs reported on how the Texas Department of Family and Protective Services (DFPS) reduced caseworker turnover by implementing multiple changes to system operations (How did Texas decrease caseworker turnover and stabilize its workforce?). This post discusses how the QICWD is working with eight other jurisdictions and building on what was learned in Texas. According to the report, Texas initiated …

Recent Research To Build Knowledge Of The Child Welfare Workforce, Quality Improvement Center For Workforce Development

Other QIC-WD Products

Child welfare worker turnover is costly and can negatively affect the relationship between families and the child welfare agency. The Quality Improvement Center for Workforce Development (QIC-WD) aims to build the body of evidence in the child welfare field to better understand worker turnover and strategies to address it. Although turnover is a widely acknowledged problem, there has not been reliable data to calculate staff turnover, caseloads, and workforce capacity. A recent study and article, Characteristics of the Front-line Child Welfare Workforce (Edwards & Wildeman, 2018), makes available a new data source and provides an analysis of workforce data from …

The Effect Of Organizational Tenure, Bargaining Unit Status, And Union Membership On Local Government Employee Public Service Motivation, Ty Ryburn

Graduate Theses and Dissertations

Two of the largest challenges public organizations face in motivating their workforces are the aging workforce and the strong union influence (Lavigna, 2014). On June 27, 2018, the United States Supreme Court ruled in Janus vs. AFSCME to abolish agency fees, and gave public service employees in bargaining units the right to choose whether they want to pay union dues or pay no fees at all.

In examining the unique motivational factors of employees in the public sector, Perry and Wise (1990) developed a theory called Public Service Motivation (PSM). Later, Perry (1996) developed a survey instrument which despite criticism, …

Using Technology To Reduce The Burden Of Paperwork: Preliminary Lessons Learned From The Qic -Wd Virginia Site, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Quality Improvement Center for Workforce Development (QIC-WD) partnered with the Virginia Department of Social Services (VDSS) in 2017 to conduct research examining the efficacy of technology interventions aimed at reducing child welfare staff turnover and improving child welfare outcomes. Virginia is a state-supervised, countyadministered child welfare system. The state elected to study the implementation of and outcomes from job modernization technology interventions in 18 localities. These 18 localities represent a workforce of approximately 450 of the state’s 2,200 frontline staff. The intervention is occurring in multiple phases: (1) transcription services; (2) a mobility technology application; and (3) a Comprehensive …

Introducing Virginia’S Mobile Solution, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Virginia Department of Social Services (VDSS) and the 18 local departments of social services (LDSS) identified the lack of technological supports to help child welfare workers complete the administrative tasks of their job as a cause of turnover. The Virginia site rolled out the first part of their intervention (transcription services) in 2018 and is now preparing to roll out a mobile application in late fall 2019. This one-page summary describes COMPASS, Virginia’s mobile app designed to make it easier for workers to manage the administrative aspects of their job.

Designing Rigorous Tests Of Workforce Interventions In Complex Environments, Quality Improvement Center For Workforce Development

Other QIC-WD Products

Public child welfare agencies continually struggle with how to address issues of staff recruitment and retention. Furthermore, very little evidence exists regarding what works to attract, select, and retain talented staff. Much of what agencies do to address workforce issues is never formally evaluated and successes are not published widely. Thus, agencies confronted with urgent retention needs have little to go on to identify an intervention that is likely to succeed. The Quality Improvement Center for Workforce Development (QIC-WD) was funded by the Children’s Bureau to begin to address this issue, in part through carefully selected, and rigorously evaluated interventions …

Secondary Traumatic Stress Among Child Welfare Workers, Quality Improvement Center For Workforce Development

Other QIC-WD Products

There is growing evidence to suggest that child welfare workers are experiencing high levels of secondary traumatic stress (STS) as a result of exposure to traumatized clients in crisis (e.g., Barbee, et al, 2018). The Quality Improvement Center on Workforce Development (QIC-WD) surveyed 1,113 front line child welfare workers in 13 jurisdictions between November, 2017 and March, 2018 using the Bride (2007) Secondary Traumatic Stress Scale as part of a comprehensive workforce needs assessment. An average of 54% of participants reported clinical levels of STS. When these elevated numbers are compared to the original Bride research of social workers, they …

Effectively Using & Sharing Data, Quality Improvement Center For Workforce Development

Workforce Analytics Resources

The QIC-WD recently had the opportunity to talk with a group of human services training evaluators in Baltimore about how to effectively use and share data. The QIC-WD has a dissemination plan and data visualization experts to help our team and our sites use and share data for a variety of purposes. We shared the following tips to help evaluators determine what to share, when, and why.

• Plan for dissemination – that is, identify who needs the information and how best to get it to them.
• Consider who is in your target audience and how they like to receive information. …

Using A Logic Model To Guide Workforce Interventions, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The QIC-WD uses logic models—visual representations that depict the resources that go into and expected results that will come out of the implementation of a program—to guide the implementation and evaluation of the selected interventions. A logic model is developed after the intervention is selected and must fit within the overall theory of change, as part of the exploration phase of the project. Read this summary (originally developed on behalf of the Center for States) by Dr. Megan Paul, the QIC-WD Workforce Team Lead, to learn more about why a jurisdiction should create a logic model and see what a …

Supportive Supervision And Resiliency Ohio - Guidance For Coaches Supporting Resilience, Quality Improvement Center For Workforce Development

Other QIC-WD Products

I. Preparation for Coaching Session A. Preparation of Supervisor ➢ Review Coaching Skills and Coaching Process (see Pgs. 4-5 Coaching in Child Welfare Participant Guide from the Supervisor’s Coaching Training) ➢ Reflect on how coaching builds a trusting relationship ▪ Commitment to confidentiality ▪ Clear mutual understanding of coaching, the process and expectations ▪ Modeling the coaching mindset/skill set ➢ Review the basics of Resilience Alliance (Handout of Slide Deck provided at the Supervisor’s Coaching Training) B. Preparation of Caseworker (can be done by supervisor in unit/team meeting) ➢ Discuss how Resilience coaching is a part of supportive supervision ➢ …

Oklahoma Selects And Designs A Selection Intervention, Quality Improvement Center For Workforce Development

Other QIC-WD Products

Oklahoma’s Quality Improvement Center for Workforce Development Steering Committee has decided to refine the selection process for new child welfare workers as part of their ongoing commitment to hiring a dedicated, talented workforce and supporting that workforce in practice with children, youth, and families. The committee spent much of 2018 doing a thorough needs assessment and exploration of their child welfare recruitment and retention challenges. Through this process they recognized that interviewing strategies and hiring decisions are made inconsistently across the state. The team acknowledged that this could result in the selection of individuals who are not the best fit …

Louisiana Selects A Workforce Intervention: Job Redesign & Teaming, Quality Improvement Center For Workforce Development

Other QIC-WD Products

For several years prior to the current Administration, Louisiana suffered through an unstated policy of “Do More with Less”: Fewer employees, higher caseloads, less resources, and high employee turnover. In 2016, the Louisiana Department of Children and Family Services (DCFS) leadership determined that supporting and stabilizing the child welfare workforce was a high priority. To strengthen its workforce, Louisiana will implement “Job Redesign and Teaming” as its QIC-WD intervention. The job redesign aspect of the intervention includes a comprehensive job analysis and process mapping to determine which tasks needed to be retained by the child welfare worker and which tasks …

Eastern Band Of Cherokee Indians Selects A Workforce Intervention: Onboarding, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Family Safety Program (FSP) serves the Eastern Band of Cherokee Indians (EBCI) to provide high quality and innovative care, utilizing an integrated model to ensure client access to behavioral health services and targeted case management. To retain a competent and committed workforce and best serve children and families, FSP partnered with the Quality Improvement Center for Workforce Development (QIC-WD) to be one of eight national project sites to test child welfare workforce interventions. In 2018, FSP conducted a workforce needs assessment, which revealed that staff had inconsistent job expectations for their own role and lacked understanding of the roles …

Milwaukee Selects A Workforce Intervention: Organizational Culture & Climate, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Division of Milwaukee Child Protective Services (DMCPS) of the Wisconsin Department of Children and Families (DCF) will be implementing and testing an organizational culture and climate intervention called ARC, which stands for Availability, Responsiveness, & Continuity. ARC is an organizational change process that has improved outcomes in mental health settings by: 1) introducing core principles to guide service improvement efforts, 2) embedding research-based organizational components for service improvement, and 3) fostering attitudes necessary for ongoing service improvement. DMCPS employs approximately 185 State employees. These employees conduct initial child protective service assessments, oversee ongoing case management services delivered by private …

Washington Selects A Workforce Intervention: Telework, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Washington State Department of Children, Youth, and Families (DCYF) will be implementing and testing the effectiveness of telework for child welfare field operations staff and their supervisors. DYCF is a stateadministered system with a total of 3,075 employees. There are approximately 1,600 field operation staff and 260 field operation supervisors that make up the majority of the child welfare workforce in the agency. A comprehensive workforce needs assessment showed a strong desire among employees to be able to work from home or an alternate work site. A telework policy existed but was inconsistently implemented, and the majority of employees …