Open Access. Powered by Scholars. Published by Universities.®
- Institution
-
- University of Nebraska - Lincoln (296)
- The University of Southern Mississippi (19)
- UMass Global (10)
- University of Texas at Tyler (10)
- Embry-Riddle Aeronautical University (7)
-
- Kennesaw State University (6)
- Nova Southeastern University (6)
- Walden University (6)
- Old Dominion University (5)
- Abilene Christian University (4)
- University for Business and Technology in Kosovo (4)
- University of Arkansas, Fayetteville (4)
- University of New Mexico (4)
- Western Kentucky University (4)
- American Dental Association (3)
- Brigham Young University (3)
- California State University, San Bernardino (3)
- East Tennessee State University (3)
- Liberty University (3)
- SUNY Buffalo State University (3)
- Seton Hall University (3)
- Technological University Dublin (3)
- University of Nevada, Las Vegas (3)
- University of New Hampshire (3)
- American University in Cairo (2)
- Association of Arab Universities (2)
- Bridgewater College (2)
- Butler University (2)
- City University of New York (CUNY) (2)
- Cleveland State University (2)
- Keyword
-
- Workforce (124)
- Child welfare (76)
- Child Welfare (67)
- Training (29)
- Work (29)
-
- Leadership (24)
- Workplace (18)
- Management (13)
- Turnover (13)
- Job performance (12)
- Retention (12)
- Data (11)
- Job (11)
- Stress (11)
- Human Resources (10)
- Job satisfaction (10)
- Learning (10)
- RA (10)
- Resilience Alliance (10)
- Burnout (9)
- Technology (9)
- Employee engagement (8)
- Higher education (8)
- Human resources (8)
- Job attitude (8)
- Pandemic (8)
- HR (7)
- Performance (7)
- Development (6)
- Engagement (6)
- Publication Year
- Publication
-
- Other QIC-WD Products (136)
- Umbrella Summaries (85)
- Intervention Summaries (46)
- Dissertations (31)
- Workforce Analytics Resources (13)
-
- Human Resource Development Theses and Dissertations (9)
- QIC-Tips (9)
- QIC-Takes (6)
- Electronic Theses and Dissertations (5)
- Office of Human Resources News (5)
- Atlantic Marketing Association Proceedings (4)
- International Journal of Business and Technology (4)
- Publications (4)
- Creativity and Change Leadership Graduate Student Master's Projects (3)
- ETSU Faculty Works (3)
- Electronic Theses, Projects, and Dissertations (3)
- Graduate Theses and Dissertations (3)
- International Journal of Applied Management and Technology (3)
- National Training Aircraft Symposium (NTAS) (3)
- Seton Hall University Dissertations and Theses (ETDs) (3)
- The Journal of the Michigan Dental Association (3)
- ADVANCE Reports (2)
- Al Jinan الجنان (2)
- Doctoral Dissertations and Projects (2)
- Journal of Global Awareness (2)
- Journal of Nonprofit Innovation (2)
- LSU Doctoral Dissertations (2)
- M.S. in Leadership (2)
- Masters Theses & Specialist Projects (2)
- Research Awards (2)
- Publication Type
- File Type
Articles 211 - 240 of 507
Full-Text Articles in Training and Development
Addressing Work-Related Traumatic Stress Nebraska - Theory Of Change, Quality Improvement Center For Workforce Development
Addressing Work-Related Traumatic Stress Nebraska - Theory Of Change, Quality Improvement Center For Workforce Development
Other QIC-WD Products
Several workforce challenges were discussed as opportunities for intervention during the needs assessment process conducted partnership with the Nebraska Department of Children and Family Services’ (DCFS) to address child welfare workforce turnover. Through a series of steps and causal links, a theory of change provides a roadmap to address the root causes of an identified workforce problem and describes how and why changes are expected to lead to the desired outcomes. Ultimately, two theories of change were developed to step through the “if, then” logic:
- building resiliency skills within child welfare workers and supervisors; and
- implementing a debriefing protocol focused …
Organizational Change Process Milwaukee - Theory Of Change, Quality Improvement Center For Workforce Development
Organizational Change Process Milwaukee - Theory Of Change, Quality Improvement Center For Workforce Development
Other QIC-WD Products
Through a series of steps and causal links, a theory of change provides a roadmap to address the root causes of an identified workforce problem and describes how and why changes are expected to lead to the desired outcomes. In Milwaukee, the theory of change was driven by the results of the Organizational Social Context (OSC) Measure administered during the needs assessment process. More specifically, the OSC showed that there were several aspects of both culture and climate that were in need of improvement, including 1) a hierarchical and rigid decision-making structure, 2) high role conflict and change resistance within …
Emotional Intelligence: Using Relationship Management In Leadership, Lauren Odette
Emotional Intelligence: Using Relationship Management In Leadership, Lauren Odette
Undergraduate Honors Theses
The professional world is evolving, and business leaders are required to operate in sometimes difficult situations for which they might feel unprepared. While in recent years, research on emotional intelligence has shown to be an important leadership component, it is not always translated successfully to business leadership nor contextualized to young leaders. This project aims to present a workshop to help people in leadership communicate effectively with their employees using skills stemming from increased emotional intelligence. The workshop draws on a range of literature and experiences in leadership training and emotional intelligence. Key concepts that serve as the focal points …
Evaluating Job Redesign: Strategies And Preliminary Findings From Louisiana, Quality Improvement Center For Workforce Development
Evaluating Job Redesign: Strategies And Preliminary Findings From Louisiana, Quality Improvement Center For Workforce Development
Other QIC-WD Products
The Louisiana Department of Children and Family Services, Child Welfare Division (CWD), in partnership with the Quality Improvement Center for Workforce Development (QIC-WD) conducted a needs assessment of their child welfare system. The needs assessment indicated high caseloads and administrative tasks were barriers to caseworkers’ ability to support families, engage clients, determine root causes of maltreatment, and implement timely services. Furthermore, surveys conducted with caseworkers revealed that they perceived their jobs as highly complex - requiring a wide range of tasks, a variety of specialized skills, and a high degree of information processing. These findings resulted in CWD and the …
Workplace Incivility, Megan Paul
Workplace Incivility, Megan Paul
Umbrella Summaries
What is workplace incivility?
Workplace incivility refers to “low-intensity deviant behavior with ambiguous intent to harm the target, in violation of workplace norms for mutual respect. Uncivil behaviors are characteristically rude and discourteous, displaying a lack of regard for others” (Anderson & Pearson, 1999, p. 457). Though there is some conceptual and empirical overlap between incivility and ostracism, bullying, and abusive supervision, incivility is considered distinct (Yao et al., 2021). Incivility has been examined from the perspective of both the victim and the instigator, exploring factors related to being the target of incivility and factors related to engaging in uncivil …
The Relationship Between The Protean Career Attitude And Feedback After The Employee Promotion Process, Marcie Overstreet
The Relationship Between The Protean Career Attitude And Feedback After The Employee Promotion Process, Marcie Overstreet
Dissertations
The deterioration of the traditional organizational career model progressively challenges employees to manage their careers (Briscoe et al., 2006). Increasingly, individuals self-manage their careers, focusing on both professional and personal circumstances throughout a career (Li et al., 2019). Employees continue to pursue career advancement by developing their knowledge, skills, and competencies. While individuals seek career development pursuing more challenging and higher paying jobs, organizations also show interest in career development.
Organizations take an interest in the career growth of employees because career advancement leads to increased morale and productivity and reduced costs associated with employee turnover (Bowness, 2019). Increased morale …
Frontline Job Redesign Louisiana - Implementation Overview, Quality Improvement Center For Workforce Development
Frontline Job Redesign Louisiana - Implementation Overview, Quality Improvement Center For Workforce Development
Other QIC-WD Products
The Implementation Team
The QIC-WD worked with the Louisiana Department of Children and Family Services (DCFS), Child Welfare Division (CWD) to establish an Implementation Team to lead the development and implementation of their intervention. The Implementation Team included the Site Implementation Manager (SIM); the project Training and Coaching Specialist; the Data Coordinator; representatives from Human Resources (HR), Civil Service and the Department’s training unit; representatives from the intervention parishes (from administrators to frontline workers); and three members of the QIC-WD (representing expertise in workforce, implementation, and evaluation). Members were selected for their leadership abilities, knowledge, experience, and their willingness …
Behavior Modeling Training, Megan Paul
Behavior Modeling Training, Megan Paul
Umbrella Summaries
What is behavior modeling training?
Behavior modeling training (BMT) involves the following five steps: “(a) describing to trainees a set of well-defined behaviors (skills) to be learned, (b) providing a model or models displaying the effective use of those behaviors, (c) providing opportunities for trainees to practice using those behaviors, (d) providing feedback and social reinforcement to trainees following practice, and (e) taking steps to maximize the transfer of those behaviors to the job” (Taylor et al., 2005, p. 692). BMT can be used to train a variety of skills, from interpersonal skills like conflict management, interviewing, assertive communication, and …
Signaling In Training, Megan Paul
Signaling In Training, Megan Paul
Umbrella Summaries
What is signaling?
In a learning environment, signaling refers to cues that direct learners’ attention to specific instructional content or that emphasize how the content is organized (van Gog, 2014). Signals can be verbal (oral or written) or visual (static or dynamic images or graphics). More commonly studied examples include:
signals in written materials: underlining, italics, bold, highlighting, outlines, headings, overviews, and summaries
signals in visual materials: arrows, circles, flashing, color coding, spotlighting (graying out some content), zooming in on key content, and gestures of pedagogical agents
When signals are used only in written text (i.e., without accompanying visuals), they …
Secondary Traumatic Stress (Sts) – Its Impact On The Child Welfare Workforce And Strategies For Agencies To Address It, Quality Improvement Center For Workforce Development
Secondary Traumatic Stress (Sts) – Its Impact On The Child Welfare Workforce And Strategies For Agencies To Address It, Quality Improvement Center For Workforce Development
Other QIC-WD Products
Secondary traumatic stress (STS) can mimic symptoms of post-traumatic stress disorder (PTSD) (Bride, 2007). These symptoms include having dreams and flashbacks of the traumatic event, avoiding activities or places that might remind someone of the traumatic event, having sleep issues, being irritable, difficulty concentrating, or being hypervigilant. In this video, child welfare staff share how the trauma they experience as part of their job affects them, including physical and emotional reactions and the desire to leave the field. Unfortunately, experiencing STS is very common among the child welfare workforce. Although child welfare is not the only profession that is exposed …
Organizational Change Process Milwaukee - Implementation Overview, Quality Improvement Center For Workforce Development
Organizational Change Process Milwaukee - Implementation Overview, Quality Improvement Center For Workforce Development
Other QIC-WD Products
Implementation Team
The QIC-WD worked with the Division of Milwaukee Child Protective Services (DMPCS) to establish an implementation team to lead the development and implementation of the workforce project. The implementation team was composed of representatives from Human Resources; Quality Assurance; DMCPS frontline staff, supervisors, and administrators; Department of Children and Families state office leaders, the Site Implementation Manager (SIM), and three members of the QIC-WD (representing expertise in workforce, implementation, and evaluation).
The implementation team met monthly, face-to-face for the first year of the project. During these meetings, the SIM led the team in discussions about intervention development, implementation …
Improving The Child Welfare Workforce Through Training: Common Questions And Evidence-Informed Answers From The Qic-Wd, Quality Improvement Center For Workforce Development
Improving The Child Welfare Workforce Through Training: Common Questions And Evidence-Informed Answers From The Qic-Wd, Quality Improvement Center For Workforce Development
QIC-Tips
Training is often the first intervention child welfare agencies use to address critical workforce development issues. This QIC-Tip aims to answer child welfare agency leaders’ questions about effective training strategies to increase knowledge, enhance skills, and improve job performance. Answers are drawn from the QIC-WD Umbrella Summaries which present a synopsis of the published meta-analyses of specific workforce topics.
What broad-based training approaches can improve employee learning outcomes and job performance?
Coaching uses a structured learning process, over time, to help the learner reach specific goals. Meta-analytic research on the use of professional coaches (not managers or experienced coworkers) …
Organizational Change Process Milwaukee - Site Overview, Quality Improvement Center For Workforce Development
Organizational Change Process Milwaukee - Site Overview, Quality Improvement Center For Workforce Development
Other QIC-WD Products
The Division of Milwaukee Child Protective Services (DMCPS) of the Wisconsin Department of Children and Families (DCF) has approximately 185 State employees, responsible for the delivery of child protective services and ongoing case management services through contract agencies in Milwaukee County. DMCPS performs intake and investigative functions, while ongoing casework is managed by partner agencies in the community.
The majority of DMCPS staff work in the Access Section (hotline) and the Initial Assessment Bureau (IAB). Within the IAB was a constellation of Initial Assessment Specialists (IAS), mentors, supervisors, and program directors, who are led by the Bureau Director. While the …
Self-Explanation In Training, Megan Paul
Self-Explanation In Training, Megan Paul
Umbrella Summaries
What is self-explanation?
Self-explanation is “a process by which learners generate inferences about causal connections or conceptual relationships” (Bisra et al., 2018). It involves pausing to think more deeply about instructional content, to better connect it with prior knowledge or to check for understanding. Self-explanations can be prompted (through specific instructions or questions) or unprompted (done spontaneously by a learner). Prompts can include instructions to explain, open-ended questions, or closed-ended questions such as multiple choice (Bisra et al., 2018). There is no one type of self-explanation. Examples include providing rationale for a decision or belief and explaining a concept, process, …
Attributes And Characteristics Of The Physician-Physician Assistant Organizational Leader Relationship, Victoria S. Louwagie
Attributes And Characteristics Of The Physician-Physician Assistant Organizational Leader Relationship, Victoria S. Louwagie
Graduate Dissertations and Theses
Purpose: The aim of this study was to evaluate and better understand the attributes and characteristics of the influential physician, the dual-roled physician assistant (PA)leader and how this relationship impacts the PA leader and the PA leader-physician relationship. These dual-role PA leaders may possess additional formal job titles and duties while also having direct reports.
Method: We surveyed PA leaders at a large academic medical center and its associated health system. The survey instrument evaluates perceptions, attitudes and characteristics of the PA leader, influential physician, and their relationship.
Results: There were 34/56 PA organizational leaders that responded to the survey …
Time Management, Megan Paul
Time Management, Megan Paul
Umbrella Summaries
What is time management?
The definition of time management varies across disciplines, researchers, and practitioners. In the context of workplace research, one suggested definition is “behaviours that aim at achieving an effective use of time while performing certain goal-directed activities” (Claessens et al., 2007, p. 262). Another is “a form of decision making used by individuals to structure, protect, and adapt their time to changing conditions” (Aeon & Aguinis, 2017, p. 311). Most research on time management has used self-report measures; diaries and ratings by others (e.g., supervisors) are used much less frequently. Of the self-report measures, no one measure …
Leadership Training, Megan Paul
Leadership Training, Megan Paul
Umbrella Summaries
What is leadership training?
Leadership training is a broad term with no universal definition. For the purposes of this review, it refers to “programs that have been systematically designed to enhance leader knowledge, skills, abilities, and other components” and it includes “all forms of leader, managerial, and supervisory training/development programs and/or workshops” (Lacerenza et al., 2017, p. 1687). As with all training, leadership training can vary in many ways. Below are some of the more common aspects that have been empirically evaluated:
Needs analysis: whether a systematic process was used to identify training needs and design the training accordingly
Content: …
Conversational Style In Training, Megan Paul
Conversational Style In Training, Megan Paul
Umbrella Summaries
What is conversational style?
Conversational style refers to a combination of stylistic strategies to personalize instructional text (oral or written) for learners. These include “the use of first and second rather than third person, directly addressing the reader, revealing [the author’s] personal beliefs, and/or using polite forms of address” (Ginns et al., 2013, p. 452). The following excerpts illustrate such styles:
“During inhaling, the [your] diaphragm moves down creating more space for the [your] lungs” (Mayer et al., 2004)
“Let me tell you what happens when lightning forms” (vs. just the scientific description; Moreno & Mayer, 2000)
“You are about …
Addressing Work-Related Traumatic Stress Nebraska - Implementation Overview, Quality Improvement Center For Workforce Development
Addressing Work-Related Traumatic Stress Nebraska - Implementation Overview, Quality Improvement Center For Workforce Development
Other QIC-WD Products
The Implementation Team
The QIC-WD worked with Nebraska Division of Children and Family Services (DCFS) to establish an implementation team to lead the development and implementation of their intervention to address secondary traumatic stress. The implementation team was called the Nebraska Workforce Project Team. It included a representative from each of the five geographic regions of the state (known as a Service Areas), a representative from each staff level (worker, supervisor, administrator), the Site Implementation Manager (SIM), the Data Coordinator, sponsors (the DCFS director and Human Resources [HR] director), and three members of the QIC-WD (representing expertise in workforce, implementation, …
Organizational Change Process Milwaukee - Evaluation Overview, Quality Improvement Center For Workforce Development
Organizational Change Process Milwaukee - Evaluation Overview, Quality Improvement Center For Workforce Development
Other QIC-WD Products
The QIC-WD evaluation was conducted with the support of the Division of Milwaukee Child Protective Services (DMCPS) to determine if an Organizational Change Process intervention (Availability Responsiveness Continuity or ARC) was effective in improving workforce and child welfare outcomes.
Research Questions
Process Evaluation
- Did the ARC purveyor follow the training curriculum with fidelity and quality delivery?
- Did the ARC Team Leaders follow the ARC implementation model with fidelity and quality?
- Were participants satisfied with the quality of leadership, training, and group dynamics?
- Did participants learn the required concepts and skills?
- What were the mediators of fidelity and training outcomes?
- Did …
Data Segmentation (Video), Quality Improvement Center For Workforce Development
Data Segmentation (Video), Quality Improvement Center For Workforce Development
Workforce Analytics Resources
Data segmentation is the process of breaking down “big” data into smaller, more meaningful groups, called segments. In the case of workforce data, each segment represents a group of people with similar characteristics, either that pertain to them as an individual (e.g., gender, race, educational background) or to their connection to the organization (e.g., their job title, supervisor, or work schedule).
There are a variety of ways to “slice and dice” your data into meaningful groups. Some possibilities are listed below. The squares represent the unit of categorization (e.g., agency structure), and dashed green squares represent the data segments (e.g., …
Supportive Supervision And Resiliency Ohio - Implementation Overview, Quality Improvement Center For Workforce Development
Supportive Supervision And Resiliency Ohio - Implementation Overview, Quality Improvement Center For Workforce Development
Other QIC-WD Products
The Implementation Team The QIC-WD worked with the Ohio Department of Job and Family Services (ODJFS), through the Office of Families and Children (OFC), to establish an implementation team to lead the development and implementation of their supportive supervision and resiliency intervention. After recruiting nine counties to participate in the QIC-WD project, the Workforce Implementation Team (WIT) initially was composed of representatives from the nine public children services agencies including administrators, managers, and human resources staff, the Site Implementation Manager (SIM), the Data Coordinator, OFC leadership, and three members of the QIC-WD (representing expertise in workforce, implementation, and evaluation). The …
Supportive Supervision And Resiliency Ohio - Evaluation Overview, Quality Improvement Center For Workforce Development
Supportive Supervision And Resiliency Ohio - Evaluation Overview, Quality Improvement Center For Workforce Development
Other QIC-WD Products
The QIC-WD evaluation was conducted with the support of the Ohio Department of Job and Family Services to determine if a Supportive Supervision and Resiliency intervention, known as Coach Ohio, was effective in improving workforce and child welfare outcomes. Research Questions The site-level evaluation for Ohio was designed to understand implementation of and outcomes related to the Coach Ohio intervention and its component parts: (1) the ACCWIC Coaching Model for managers and supervisors to introduce the key principles of supportive supervision and (2) Resilience Alliance (RA) groups for supervisor and frontline workers to enhance coping in the face of exposure …
Linking Human Resources And Child Welfare Data (Video), Quality Improvement Center For Workforce Development
Linking Human Resources And Child Welfare Data (Video), Quality Improvement Center For Workforce Development
Workforce Analytics Resources
When examining workforce data, it can be valuable to capitalize on data from a variety of systems, such as various human resources (HR) databases, learning management systems, and child welfare information systems. Each can be useful on their own, but additional information can be learned when different types of data are connected. For example, applicant information may be stored in a database that is separate from other HR data on those hired, and there is value in looking at the connections between applicant data and later aspects of employment.
Data linkage involves pairing observations from two or more data files …
Workforce Metrics Using Child Welfare Data, Quality Improvement Center For Workforce Development
Workforce Metrics Using Child Welfare Data, Quality Improvement Center For Workforce Development
Workforce Analytics Resources
Workforce metrics that can be constructed from child welfare data fall into three categories: caseload/workload, case continuity, and worker- and unit-level variability.
Caseload/Workload Metrics
Caseload metrics can help to
- Assess compliance with caseload standards (e.g., policy, statute)
- Describe and inform case assignment decisions
- Describe and address the work burden experienced by staff
- Describe and address inequities in caseloads among workers
- Inform workforce planning or staffing decisions
- Monitor caseloads to assess policy or practices intended to affect caseloads
Caseload metrics are among the most commonly used workforce metrics that can typically be obtained from child welfare data. These metrics are usually …
Workplace Ostracism, Megan Paul
Workplace Ostracism, Megan Paul
Umbrella Summaries
What is workplace ostracism?
Workplace ostracism is “the extent to which an individual perceives that he or she is ignored or excluded by others at work” (Ferris et al., 2008, p. 1348). The most popular measure is the 10item Workplace Ostracism Scale (Ferris et al., 2008). Example items include “others avoided you at work,” “others refused to talk to you at work,” and “others at work shut you out of the conversation.”
Why is workplace ostracism important?
Ostracism in the workplace is important because it is associated with an array of job attitudes, stress indicators, and behaviors. Specifically, ostracism is …
Secondary Traumatic Stress, Burnout And Resilience In The Child Welfare Workforce: Early Results From Nebraska’S Randomized Controlled Trial Of Resilience Alliance, Quality Improvement Center For Workforce Development
Secondary Traumatic Stress, Burnout And Resilience In The Child Welfare Workforce: Early Results From Nebraska’S Randomized Controlled Trial Of Resilience Alliance, Quality Improvement Center For Workforce Development
Other QIC-WD Products
A 2018 needs assessment indicated that more than 50% of the child welfare workforce in Nebraska was experiencing elevated secondary traumatic stress (STS). STS refers to the experience of people – generally professionals– who are exposed to others’ traumatic events as part of their work. As a result of this exposure, these professionals can develop their own traumatic symptoms and reactions such as sleeplessness and anxiety. The Nebraska Department of Health and Human Services (DHHS) Division of Children and Family Services (DCFS) in partnership with the Quality Improvement Center for Workforce Development (QIC-WD) implemented CFS Strong, a multi-phased workforce intervention …
Workload, Megan Paul
Workload, Megan Paul
Umbrella Summaries
What is workload?
There is no one, universally accepted definition of workload. A broad definition is that it is “an all-encompassing term that includes any variable reflecting the amount or difficulty of one’s work” (Bowling & Kirkendall, 2012, p. 222). Quantitative workload is the label for the amount of work done, and qualitative workload is the label for the difficulty of work (Bowling & Kirkendall, 2012). Further, there is a distinction between mental and physical workload and between objective and perceived workload (Bowling & Kirkendall, 2012). A variety of approaches have been used to measure objective workload. A common one …
Frontline Job Redesign Louisiana - Intervention Overview, Quality Improvement Center For Workforce Development
Frontline Job Redesign Louisiana - Intervention Overview, Quality Improvement Center For Workforce Development
Other QIC-WD Products
The Louisiana Department of Children and Family Services (DCFS), Child Welfare Division (CWD), in collaboration with the QIC-WD, implemented a frontline job redesign as its intervention. (For more information see Intervention Background.) An implementation team, including QIC-WD representatives, CWD leadership, child welfare staff from all levels of practice, and human resources and civil service representatives undertook development of the job redesign. Development of the intervention was guided by the following principles:
- children and families are the center and focus of the practice,
- a dual focus on prevention and permanency, requiring increased knowledge and skills in providing both parents and …
Addressing Work-Related Traumatic Stress Nebraska - Evaluation Overview, Quality Improvement Center For Workforce Development
Addressing Work-Related Traumatic Stress Nebraska - Evaluation Overview, Quality Improvement Center For Workforce Development
Other QIC-WD Products
Research Questions
The site-level evaluation for Nebraska was designed to understand implementation of and outcomes related to CFS Strong and its component parts, including Resilience Alliance (RA), Peer Support Groups (PSG) and Restoring Resiliency Response© (RRR). Relationships among intervention components, outputs, and outcomes were mapped out in Nebraska’s logic model. Initial research questions of interest included how much participants were satisfied with the RA, PSG, and RRR sessions they attended. Furthermore, for RA, the evaluation measured how much facilitators adhered to the manualized RA program, whether group dynamics (e.g., engagement and conflict) were positive or negative, and how …