Training and Development Commons^™

Are Participants Good Evaluators?, Jeffrey A. Smith, Alexander Whalley, Nathaniel T. Wilcox

Upjohn Press

Managers of workforce training programs are often unable to afford costly, full-fledged experimental or nonexperimental evaluations to determine their programs’ impacts. Therefore, many rely on the survey responses of program participants to gauge program impacts.

Smith, Whalley, and Wilcox present the first attempt to assess such measures despite their already widespread use in program evaluations. They develop a multidisciplinary framework for addressing the issue and apply it to three case studies: the National Job Training Partnership Act Study, the U.S. National Supported Work Demonstration, and the Connecticut Jobs First Program.

Each of these studies were subjected to experimental evaluations that …

Leadership Training, Megan Paul

Umbrella Summaries

What is leadership training?

Leadership training is a broad term with no universal definition. For the purposes of this review, it refers to “programs that have been systematically designed to enhance leader knowledge, skills, abilities, and other components” and it includes “all forms of leader, managerial, and supervisory training/development programs and/or workshops” (Lacerenza et al., 2017, p. 1687). As with all training, leadership training can vary in many ways. Below are some of the more common aspects that have been empirically evaluated:

Needs analysis: whether a systematic process was used to identify training needs and design the training accordingly

Content: …

Conversational Style In Training, Megan Paul

Umbrella Summaries

What is conversational style?

Conversational style refers to a combination of stylistic strategies to personalize instructional text (oral or written) for learners. These include “the use of first and second rather than third person, directly addressing the reader, revealing [the author’s] personal beliefs, and/or using polite forms of address” (Ginns et al., 2013, p. 452). The following excerpts illustrate such styles:

“During inhaling, the [your] diaphragm moves down creating more space for the [your] lungs” (Mayer et al., 2004)

“Let me tell you what happens when lightning forms” (vs. just the scientific description; Moreno & Mayer, 2000)

“You are about …

Addressing Work-Related Traumatic Stress Nebraska - Implementation Overview, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Implementation Team

The QIC-WD worked with Nebraska Division of Children and Family Services (DCFS) to establish an implementation team to lead the development and implementation of their intervention to address secondary traumatic stress. The implementation team was called the Nebraska Workforce Project Team. It included a representative from each of the five geographic regions of the state (known as a Service Areas), a representative from each staff level (worker, supervisor, administrator), the Site Implementation Manager (SIM), the Data Coordinator, sponsors (the DCFS director and Human Resources [HR] director), and three members of the QIC-WD (representing expertise in workforce, implementation, …

Organizational Change Process Milwaukee - Evaluation Overview, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The QIC-WD evaluation was conducted with the support of the Division of Milwaukee Child Protective Services (DMCPS) to determine if an Organizational Change Process intervention (Availability Responsiveness Continuity or ARC) was effective in improving workforce and child welfare outcomes.

Research Questions

Process Evaluation

1. Did the ARC purveyor follow the training curriculum with fidelity and quality delivery?
2. Did the ARC Team Leaders follow the ARC implementation model with fidelity and quality?
3. Were participants satisfied with the quality of leadership, training, and group dynamics?
4. Did participants learn the required concepts and skills?
5. What were the mediators of fidelity and training outcomes?
6. Did …

Data Segmentation (Video), Quality Improvement Center For Workforce Development

Workforce Analytics Resources

Data segmentation is the process of breaking down “big” data into smaller, more meaningful groups, called segments. In the case of workforce data, each segment represents a group of people with similar characteristics, either that pertain to them as an individual (e.g., gender, race, educational background) or to their connection to the organization (e.g., their job title, supervisor, or work schedule).

There are a variety of ways to “slice and dice” your data into meaningful groups. Some possibilities are listed below. The squares represent the unit of categorization (e.g., agency structure), and dashed green squares represent the data segments (e.g., …

Supportive Supervision And Resiliency Ohio - Implementation Overview, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Implementation Team The QIC-WD worked with the Ohio Department of Job and Family Services (ODJFS), through the Office of Families and Children (OFC), to establish an implementation team to lead the development and implementation of their supportive supervision and resiliency intervention. After recruiting nine counties to participate in the QIC-WD project, the Workforce Implementation Team (WIT) initially was composed of representatives from the nine public children services agencies including administrators, managers, and human resources staff, the Site Implementation Manager (SIM), the Data Coordinator, OFC leadership, and three members of the QIC-WD (representing expertise in workforce, implementation, and evaluation). The …

Supportive Supervision And Resiliency Ohio - Evaluation Overview, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The QIC-WD evaluation was conducted with the support of the Ohio Department of Job and Family Services to determine if a Supportive Supervision and Resiliency intervention, known as Coach Ohio, was effective in improving workforce and child welfare outcomes. Research Questions The site-level evaluation for Ohio was designed to understand implementation of and outcomes related to the Coach Ohio intervention and its component parts: (1) the ACCWIC Coaching Model for managers and supervisors to introduce the key principles of supportive supervision and (2) Resilience Alliance (RA) groups for supervisor and frontline workers to enhance coping in the face of exposure …

Linking Human Resources And Child Welfare Data (Video), Quality Improvement Center For Workforce Development

Workforce Analytics Resources

When examining workforce data, it can be valuable to capitalize on data from a variety of systems, such as various human resources (HR) databases, learning management systems, and child welfare information systems. Each can be useful on their own, but additional information can be learned when different types of data are connected. For example, applicant information may be stored in a database that is separate from other HR data on those hired, and there is value in looking at the connections between applicant data and later aspects of employment.

Data linkage involves pairing observations from two or more data files …

Effect Of Training Opportunity And Job Satisfaction On Turnover Intentions Among Gen X And Gen Y, Regin Justin

Human Resource Development Theses and Dissertations

Employee turnover costs billions of dollars for companies every year, and it has been increasing over the years. Multiple studies have explored the different antecedents that affect turnover intentions. However, there has been little focus on the effects of training opportunities on turnover intentions. This study examines the impacts of training opportunity on job satisfaction and turnover intention among the generation X and generation Y cohorts in the United States. A total of 252 respondents completed questionnaires that assessed the internal elements of the model among Amazon mturk workers. Data from the measurements of training opportunity, job satisfaction, and turnover …

Workforce Metrics Using Child Welfare Data, Quality Improvement Center For Workforce Development

Workforce Analytics Resources

Workforce metrics that can be constructed from child welfare data fall into three categories: caseload/workload, case continuity, and worker- and unit-level variability.

Caseload/Workload Metrics

Caseload metrics can help to

• Assess compliance with caseload standards (e.g., policy, statute)
• Describe and inform case assignment decisions
• Describe and address the work burden experienced by staff
• Describe and address inequities in caseloads among workers
• Inform workforce planning or staffing decisions
• Monitor caseloads to assess policy or practices intended to affect caseloads

Caseload metrics are among the most commonly used workforce metrics that can typically be obtained from child welfare data. These metrics are usually …

Growth Begins From Within: How Internal Transparency Influences Organizational Learning, Wesley J. Cheung

Master's Projects and Capstones

Ample research exists that focuses on organizational learning in the context of program efficiency and outcomes, and organizational transparency in the context of governance and compliance. The purpose of this research is to further explore the relationship between organizational learning culture and the commitment to internal transparency, specifically pertaining to the internal members across multiple levels of an organization. This paper includes a literary review of previous research, an outline for the methodology used for this research, qualitative data analysis of 10 expert interviews, a discussion of the results and findings, and the exploration of present and future implications and …

Mentoring Early Career Teachers Under Covid-19 Pandemic In The State Of Texas: A Phenomenological Case Study, Sonya H. Niazy

Human Resource Development Theses and Dissertations

The purpose of this phenomenological case study was to understand the impact of COVID-19 on the mentoring relationship, processes, and outcomes from the mentee’s perspective in the K-12 sector and how this understanding changes the organization’s role in facilitating these relationships. The framework for the study was based on the theoretical foundations of social exchange theory. Semi-structured interviews were conducted with fourteen first- and second- year teachers who were participating in a formal mentoring program at a Texas school district during the 2020-2021 school year. The interviews were transcribed, coded, and 26 themes were identified in the resulting data. These …

Workplace Ostracism, Megan Paul

Umbrella Summaries

What is workplace ostracism?

Workplace ostracism is “the extent to which an individual perceives that he or she is ignored or excluded by others at work” (Ferris et al., 2008, p. 1348). The most popular measure is the 10item Workplace Ostracism Scale (Ferris et al., 2008). Example items include “others avoided you at work,” “others refused to talk to you at work,” and “others at work shut you out of the conversation.”

Why is workplace ostracism important?

Ostracism in the workplace is important because it is associated with an array of job attitudes, stress indicators, and behaviors. Specifically, ostracism is …

Secondary Traumatic Stress, Burnout And Resilience In The Child Welfare Workforce: Early Results From Nebraska’S Randomized Controlled Trial Of Resilience Alliance, Quality Improvement Center For Workforce Development

Other QIC-WD Products

A 2018 needs assessment indicated that more than 50% of the child welfare workforce in Nebraska was experiencing elevated secondary traumatic stress (STS). STS refers to the experience of people – generally professionals– who are exposed to others’ traumatic events as part of their work. As a result of this exposure, these professionals can develop their own traumatic symptoms and reactions such as sleeplessness and anxiety. The Nebraska Department of Health and Human Services (DHHS) Division of Children and Family Services (DCFS) in partnership with the Quality Improvement Center for Workforce Development (QIC-WD) implemented CFS Strong, a multi-phased workforce intervention …

Workload, Megan Paul

Umbrella Summaries

What is workload?

There is no one, universally accepted definition of workload. A broad definition is that it is “an all-encompassing term that includes any variable reflecting the amount or difficulty of one’s work” (Bowling & Kirkendall, 2012, p. 222). Quantitative workload is the label for the amount of work done, and qualitative workload is the label for the difficulty of work (Bowling & Kirkendall, 2012). Further, there is a distinction between mental and physical workload and between objective and perceived workload (Bowling & Kirkendall, 2012). A variety of approaches have been used to measure objective workload. A common one …

Frontline Job Redesign Louisiana - Intervention Overview, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The Louisiana Department of Children and Family Services (DCFS), Child Welfare Division (CWD), in collaboration with the QIC-WD, implemented a frontline job redesign as its intervention. (For more information see Intervention Background.) An implementation team, including QIC-WD representatives, CWD leadership, child welfare staff from all levels of practice, and human resources and civil service representatives undertook development of the job redesign. Development of the intervention was guided by the following principles:

• children and families are the center and focus of the practice,
• a dual focus on prevention and permanency, requiring increased knowledge and skills in providing both parents and …

Addressing Work-Related Traumatic Stress Nebraska - Evaluation Overview, Quality Improvement Center For Workforce Development

Other QIC-WD Products

Research Questions

The site-level evaluation for Nebraska was designed to understand implementation of and outcomes related to CFS Strong and its component parts, including Resilience Alliance (RA), Peer Support Groups (PSG) and Restoring Resiliency Response© (RRR). Relationships among intervention components, outputs, and outcomes were mapped out in Nebraska’s logic model. Initial research questions of interest included how much participants were satisfied with the RA, PSG, and RRR sessions they attended. Furthermore, for RA, the evaluation measured how much facilitators adhered to the manualized RA program, whether group dynamics (e.g., engagement and conflict) were positive or negative, and how …

Onboarding Autism Employees In Technology Industry, Heung-For Cheng

Doctor of Business Administration (DBA)

The autism spectrum disorder (ASD) population experiences high unemployment, underemployment, and job turnover. Many people with autism have exceptional skills in areas, such as science, mathematics, and art. Companies in the technology industry are interested in tapping into the ASD talent pool because the industry cannot find enough qualified job applicants to meet the hiring demand. Few studies have focused on understanding how to help onboard ASD employees. Understanding the onboarding process can help technology firms retain ASD employees. In return, retaining this talent pool in the technology industry can continue to bring innovation. This research examined how a workplace …

Frontline Job Redesign Louisiana - Evaluation Overview, Quality Improvement Center For Workforce Development

Other QIC-WD Products

The QIC-WD evaluation was conducted with the support of the Louisiana Department of Children and Families to determine if a Job Redesign was effective in improving workforce and child welfare outcomes.

Research Questions

A key research question concerned the extent to which the job redesign reduced the amount of time caseworkers spent on administrative tasks and increased time spent on clinical work with children and families. The QIC-WD also tested questions related to the expected effects of the redesign on workers’ perceptions of their job complexity, role overload, and work-life balance, and how these perceptions relate to job satisfaction, case …