Health and Medical Administration Commons^™

Administrative Coding In Electronic Health Care Record-Based Research Of Nafld: An Expert Panel Consensus Statement, Hannes Hagström, Leon A Adams, Alina M Allen, Christopher D Byrne, Yoosoo Chang, Henning Grønbaek, Mona Ismail, Peter Jepsen, Fasiha Kanwal, Jennifer Kramer, Jeffrey V Lazarus, Michelle T Long, Rohit Loomba, Philip N Newsome, Ian A Rowe, Seungho Ryu, Jörn M Schattenberg, Marina Serper, Nick Sheron, Tracey G Simon, Elliot B Tapper, Sarah Wild, Vincent Wai-Sun Wong, Yusuf Yilmaz, Shira Zelber-Sagi, Fredrik Åberg

Faculty, Staff and Students Publications

BACKGROUND AND AIMS: Electronic health record (EHR)-based research allows the capture of large amounts of data, which is necessary in NAFLD, where the risk of clinical liver outcomes is generally low. The lack of consensus on which International Classification of Diseases (ICD) codes should be used as exposures and outcomes limits comparability and generalizability of results across studies. We aimed to establish consensus among a panel of experts on ICD codes that could become the reference standard and provide guidance around common methodological issues.

APPROACH AND RESULTS: Researchers with an interest in EHR-based NAFLD research were invited to collectively define …

Development And Validation Of Machine Learning-Based Race-Specific Models To Predict 10-Year Risk Of Heart Failure: A Multicohort Analysis, Matthew W Segar, Byron C Jaeger, Kershaw V Patel, Vijay Nambi, Chiadi E Ndumele, Adolfo Correa, Javed Butler, Alvin Chandra, Colby Ayers, Shreya Rao, Alana A Lewis, Laura M Raffield, Carlos J Rodriguez, Erin D Michos, Christie M Ballantyne, Michael E Hall, Robert J Mentz, James A De Lemos, Ambarish Pandey

Faculty, Staff and Students Publications

BACKGROUND: Heart failure (HF) risk and the underlying risk factors vary by race. Traditional models for HF risk prediction treat race as a covariate in risk prediction and do not account for significant parameters such as cardiac biomarkers. Machine learning (ML) may offer advantages over traditional modeling techniques to develop race-specific HF risk prediction models and to elucidate important contributors of HF development across races.

METHODS: We performed a retrospective analysis of 4 large, community cohort studies (ARIC [Atherosclerosis Risk in Communities], DHS [Dallas Heart Study], JHS [Jackson Heart Study], and MESA [Multi-Ethnic Study of Atherosclerosis]) with adjudicated HF events. …

Regional Variations In Heart Failure Quality And Outcomes: Get With The Guidelines-Heart Failure Registry, Luke C Cunningham, Gregg C Fonarow, Clyde W Yancy, Shubin Sheng, Roland A Matsouaka, Adam D Devore, Hani Jneid, Anita Deswal

Faculty, Staff and Students Publications

Background

Regional patient characteristics, care quality, and outcomes may differ based on a variety of factors among patients hospitalized for heart failure (HF). Regional disparities in outcomes of cardiovascular disease have been suggested across various regions in the United States. This study examined whether there are significant differences by region in quality of care and short‐term outcomes of hospitalized patients with HF across the United States.

Methods and Results

We examined regional demographics, quality measures, and short‐term outcomes across 4 US Census Bureau regions in patients hospitalized with HF and enrolled in the GWTG‐HF (Get With The Guidelines–Heart Failure) registry …

A Principal Components Analysis Of Factors Associated With Successful Implementation Of An Lvad Decision Support Tool, Kristin M Kostick, Meredith Trejo, Arvind Bhimaraj, Andrew Civitello, Jonathan Grinstein, Douglas Horstmanshof, Ulrich P Jorde, Matthias Loebe, Mandeep R Mehra, Nasir Z Sulemanjee, Vinay Thohan, Barry H Trachtenberg, Nir Uriel, Robert J Volk, Jerry D Estep, J S Blumenthal-Barby

Faculty, Staff and Students Publications

BACKGROUND: A central goal among researchers and policy makers seeking to implement clinical interventions is to identify key facilitators and barriers that contribute to implementation success. Despite calls from a number of scholars, empirical insights into the complex structural and cultural predictors of why decision aids (DAs) become routinely embedded in health care settings remains limited and highly variable across implementation contexts.

METHODS: We examined associations between "reach", a widely used indicator (from the RE-AIM model) of implementation success, and multi-level site characteristics of nine LVAD clinics engaged over 18 months in implementation and dissemination of a decision aid for …

Pediatric Wound Care: Establishing A Consensus Group To Develop Clinical Practice Guidelines, Ryan Krasnosky, Geran Barton, Linda Highfield, Sheila Martinez, Stephen Linder, Edward Buchanan, Angelo P. Giardino

Journal of Nursing & Interprofessional Leadership in Quality & Safety

Introduction. Wound care practices for neonatal and pediatric patients have created a lack of standardized evidence-based guidelines for treatments in clinical practices. Unfortunately, published clinical guidelines for the evaluation and management of wounds in pediatric populations is limited. Consensus groups are used to develop clinical guidelines which define key aspects of the quality of health care, particularly appropriate indications for interventions. The aim of this initiative was to conduct the first two steps of the guideline development process, and to report on the findings from the expert consensus group for pediatric wound care.

Methods. The goal was to recruit a …

Inferior St-Elevation Myocardial Infarction Presenting When Urgent Primary Percutaneous Coronary Intervention Is Unavailable: Should We Adhere To Current Guidelines?, Yochai Birnbaum, Glenn N Levine, John French, Juan Carlos Kaski, Dan Atar, Mahboob Alam, David Hasdai, Hani Jneid, Barry F Uretsky

Faculty, Staff and Students Publications

The pivotal studies that led to the recommendations for emergent reperfusion therapy for ST-elevation myocardial infarction (STEMI) were conducted for the most part over 25 years ago. At that time, contemporary standard treatments including aspirin, statin, and even anticoagulation were not commonly used. The 2013 American College of Cardiology Foundation (ACCF)/American Heart Association (AHA) guidelines and the 2017 European Society of Cardiology guidelines give a class I recommendation (with the level of evidence A) for primary percutaneous coronary intervention (pPCI) in patients with STEMI and ischemic symptoms of less than 12 h. However, if the patient presents to a hospital …

Implementation Of A Hospital Medicine Rotation And Curriculum For Internal Medicine Residents, Doris Lin, Chirayu Shah, Erica Lescinskas, Cory Ritter, Lindsey Gay

Faculty, Staff and Students Publications

INTRODUCTION: Hospital medicine is a growing field that focuses not only on expertise in inpatient medicine but also on knowledge of nonclinical health system topics. The traditional model for resident education does not lend itself to learning these topics. We developed a unique ward rotation with a dedicated curriculum called the Resident Inpatient Training Experience (RITE) to address this deficiency.

METHODS: The RITE rotation was initially implemented in the 2013-2014 academic year. The curriculum accompanying the rotation contained four case-based modules that included content on patient safety, quality improvement, cost-conscious care, hospital metrics/reimbursement, physician billing and coding, and transitions of …

Reflections Of The Angiotensin Receptor Blocker Recall By The Fda And Repercussions On Healthcare, Michael Gillette, Addison Taylor, Djenita Butulija, Himabindu Kadiyala, Hani Jneid

Faculty, Staff and Students Publications

PURPOSE: Beginning in July of 2018, the FDA issued a voluntary recall regarding the presence of a contaminant found in the manufacturing of valsartan. What would ensue has become a largely unprecedented sequence of alarming events since the FDA began reporting public recalls, withdrawals and safety alerts on their website in 2016. Since then, the United States has been significantly impacted by drug recalls affecting angiotensin receptor blockers. This report arms clinicians with additional guidance and provides a framework for responding appropriately to future similar incidents and includes an overview of the angiotensin receptor blockers, and their effects and safety …

Dermatology Resident Training On Depression Screening: A Cross-Sectional Survey, Kaitlyn L Streight, Harry Dao, Soo Jung Kim

Faculty, Staff and Students Publications

Background

Many dermatologic diseases are implicated in the development of depression. Currently, there is no literature addressing the extent of dermatology residency training on depression screening.

Objective

Our study aimed to determine the extent of dermatology residency training on depression screening to potentially improve education in this area.

Methods

We designed a 12-question survey to assess the level of resident training and comfort in depression screening for patients with acne vulgaris, atopic dermatitis, psoriasis, hidradenitis suppurativa, and skin cancer. Fifty-six residents completed the survey, and data for each question was analysed in aggregate.

Results

Participants found depression screening most important …

Efficacy Of Quality Improvement And Patient Safety Workshops For Students: A Pilot Study, Kevin P Shah, Shreya Goyal, Vignesh Ramachandran, Jaden R Kohn, Jonathan A Go, Zachary Wiley, Anoosha Moturu, Meera K Namireddy, Anjali Kumar, Ryan C Jacobs, Matthew Stampfl, Jesal R Shah, Justin Fu, Weijie V Lin, Brandon Ho, Grace Wey, Sophie Y Lin, Andrew C Caruso, Lindsey Jordan Gay, Diana E Stewart, Sara Andrabi

Faculty, Staff and Students Publications

BACKGROUND: While the Association of American Medical Colleges encourages medical schools to incorporate quality improvement and patient safety (QI/PS) into their curriculum, medical students continue to have limited QI/PS exposure. To prepare medical students for careers that involve QI/PS, the Institute for Healthcare Improvement chapter at an allopathic medical school and school of allied health professions initiated self-directed learning by offering student-led workshops to equip learners with skills to improve the quality and safety of healthcare processes.

METHODS: In this prospective cohort study, workshops were hosted for medical students between 2015 and 2018 on five QI/PS topics: Process Mapping, Root-Cause …

Evaluation Of An Advanced Quality Improvement Program, Arjun M. Dangre Bds Mph, Angelo P. Giardino Md, Phd

Journal of Nursing & Interprofessional Leadership in Quality & Safety

Texas Children’s Hospital implemented the Advanced Quality Improvement and Patient Safety Program (AQI) in 2009, designed to train clinicians and staff to develop leaders in quality improvement to improve patient care, lower costs, change culture, and lead improvement initiatives at the organization. Evaluations of the AQI programs measured the program’s effectiveness in achieving its goals and objectives. This paper describes the Texas Children’s Hospital’s Advanced Quality Improvement and Patient Safety program (AQI,) the program’s evaluation processes, and show the results of the evaluation of the AQI programs using evaluation surveys completed by QI participants over the span of 13 successful …

Development Of A Hybrid, Interprofessional, Interactive Quality Improvement Curriculum As A Model For Continuing Professional Development, Isabelle S Kusters, Megan E Gregory, Jennifer L Bryan, Sylvia J Hysong, Lechauncy D Woodard, Aanand D Naik, Kyler M Godwin

Faculty, Staff and Students Publications

Over the past 20 years, there has been an increased focus on quality improvement (QI) in health care, which is critical in achieving care that is patient-centered, safer, timelier, and more effective, efficient, and equitable. At the center of this movement is QI education, which is known to lead to learning, behavior change, and improved outcomes. However, there is a need for the development and provision of long-duration, interactive, interprofessional training in QI, to allow for in-depth learning and application of learned skills. To this end, we designed a curriculum for an established interprofessional, interactive, web-based QI fellowship for doctorally …

An Examination Of Student Performance In Pre-Requisite Coursework And Upper Division Nursing Coursework, Jennifer L. Brown, Cheryl M. Smith

Journal of Nursing & Interprofessional Leadership in Quality & Safety

Admission and retention of qualified nursing students are essential in meeting the demands of a rapidly changing health care environment and nursing shortage. The purpose of this exploratory correlational study was to determine the relationship between student performance in quantitative pre-requisite coursework and student performance in upper division nursing coursework in order to identify students at-risk for attrition. A series of descriptive and correlational analyses were conducted using pre-existing institutional data. A moderate relationship existed among the chemistry II and first-year upper division nursing courses (r = .21 to r = .40). These results suggest that prerequisite chemistry course …

Use Of Best Practice Alerts To Improve Adherence To Evidence-Based Screening In Pediatric Diabetes Care, Daniel Desalvo, Sara K. Bartz, Blair Mockler, Rona Y. Sonabend

Journal of Nursing & Interprofessional Leadership in Quality & Safety

Background: Youth with type 1 diabetes (T1D) are at increased risk for comorbid autoimmune conditions and long-term complications. To help with early identification of these complications, the American Diabetes Association (ADA) has published evidence-based screening guidelines. The aim of our quality improvement intervention was to improve and sustain adherence to the ADA recommended screening guidelines to >90% for youth with T1D in the Texas Children’s Hospital (TCH) Diabetes Center by utilizing best practice alerts (BPA) within the electronic medical record (EMR).

Methods: In accordance with the ADA Standards of Care screening guidelines for youth with T1D, we analyzed the database …

Implementation Of A Critical Incident Stress Management Program For Nurse Anesthetists., Peter C. Slivinski, Joanne V. Hickey

Journal of Nursing & Interprofessional Leadership in Quality & Safety

BACKGROUND: Healthcare is a stressful profession where in addition to routine stressors, there are critical incident (CI) events which are occurrences capable of overwhelming an individual’s normal coping mechanisms. The purpose of this quality improvement project was to improve the process by which certified registered nurse anesthetists (CRNAs) exposed to critical incident events are provided post-critical incident support thus mitigating the potential for CI stress

METHODS: We created a CI stress management pilot program for nurse anesthetists employed by an academic hospital located in the Southeastern United States. The program was based upon concepts introduced by Medically Induced Trauma Support …

What You Need To Know About Bar-Code Medication Administration, Marie E. Mcbee Dnp, Msn, Martha Kuhlmann Dnp, Msn, Rn, Fnp, Pmhcns-Bc, Aprn, Pam Patterson Dnp, Msn, Ne-Bc

Journal of Nursing & Interprofessional Leadership in Quality & Safety

Medication errors are the most common type of preventable error. Bar-code medication administration (BCMA) technology was designed to reduce medication administration errors. Poor system design, implementation and workarounds remain a cause of errors. This paper reviews the literature on BCMA, identifies a gap in the findings and identifies three evidence based practices that could be used to improve system implementation and reduce error. The literature review identified that Bar-code medication administration and system workarounds are well documented and affect patient safety. Based on the critical analysis of 10 studies, we identified gaps in the standardization of BCMA planning, implementation, and …

Peripheral Intravenous Infiltrates: Engaging Staff To Increase Reporting, Emily Weber, Kimberly Castrillon, Joyce Ramsey-Coleman

Journal of Nursing & Interprofessional Leadership in Quality & Safety

A large free standing children’s academic hospital aimed to improve patient safety and outcomes by decreasing the overall severity of peripheral intravenous infiltration and extravasations (PIVIEs). A care bundle was developed by creating a PIVIE measurement tool within the electronic medical record (EMR) and integrating the tool into standardized daily practice for nurses. The care bundle included creating a team of clinical leaders consisting of empowered bedside nurses acting as mobilized resources embedded into each unit. The initiative resulted in a large scale increase in reported PIVIEs system-wide within 1 month of education dissemination to bedside RN staff. The QI …

Improving Nurse Anesthetist Intraoperative Handoff Process By Developing And Implementing An Evidence-Based, Facility-Specific Cognitive Aid, Jason Silva, Myron Arnaud

Journal of Nursing & Interprofessional Leadership in Quality & Safety

Miscommunication or non-transfer of pertinent patient information during intraoperative handoffs between anesthesia providers creates patient safety risks. An evidence-based facility-specific cognitive aid was developed and introduced to nurse anesthetists in an anesthesiology department of a large academic hospital with the aim of improving the intraoperative patient handoff process. The program used a handoff cognitive aid that addressed five pertinent patient information points. A secondary measure was evaluation of provider satisfaction. Twenty-four nurse anesthetists utilized the handoff cognitive aid during handoffs in the course of a 4-week pilot program. Eighty-eight nurse anesthetist handoffs were observed (23 with and 65 without the …

Sustainability In Quality Improvement And Patient Safety Initiatives, Angelo P. Giardino, Eileen R. Giardino

Journal of Nursing & Interprofessional Leadership in Quality & Safety

The question often asked of a quality improvement initiative is whether the improvement process has been sustained within the organization. Rarely is the question answered satisfactorily. The sustainability of an improvement process is important as it justifies the investment of human and financial capital. The term 'evaporation of improvements' addresses the dilemma that between 33% to 70% of all innovations are reportedly not sustained (Fleiszer, Semenic, Ritchie, Richer, & Denis, 2015) . This evaporation of improvement captures the frustrating inability of many institutions to maintain the achieved improvement after the newness of the initial effort wears off (Buchanan, Fitzgerald, & …

Scientific Proceedings Of The Texas Children’S Hospital’S 17th Session Of The Advanced Quality Improvement And Patient Safety Program, Arjun M. Dangre Bds Mph, Kelly Wallin Ms Rn Chse, Gertrude A. Leidich Mba, Rn, Angelo P. Giardino Md, Phd

Journal of Nursing & Interprofessional Leadership in Quality & Safety

The Texas Children’s Hospital’s Advanced Quality Improvement and Patient Safety (AQI) Program is a six month mixed didactic and experiential learning experience designed to improve patient care, lower costs, change the culture, and develop quality leaders. As a part of AQI program participants are grouped into teams and each team completes a healthcare related Quality Improvement (QI) project. Each project demonstrates use of various QI tools including process maps, fishbone diagrams, and key driver diagrams. The projects use ‘Model for Improvement’ as the primary QI methodology to achieve their aim. Three or more Plan-do-study-act (PDSA) cycles are required for each …

Scientific Proceedings Of The Texas Children’S Hospital’S 16th Session Of The Advanced Quality Improvement And Patient Safety Program, Arjun M. Dangre Bds, Mph, Kelly Wallin Ms, Rn, Chse, Gertrude A. Leidich Mba, Rn, Angelo P. Giardino Md, Phd

Journal of Nursing & Interprofessional Leadership in Quality & Safety

The Texas Children’s Hospital’s Advanced Quality Improvement and Patient Safety (AQI) Program is a six month mixed didactic and experiential learning experience designed to improve patient care, lower costs, change the culture, and develop quality leaders. As a part of AQI program participants are grouped into teams and each team completes a healthcare related Quality Improvement (QI) project. Each project demonstrates use of various QI tools including process maps, fishbone diagrams, and key driver diagrams. The projects use the IHI ‘Model for Improvement’ as the primary QI methodology to achieve their aim. Three or more Plan-do-study-act (PDSA) cycles are required …

Public Hospitals Matter, Herbert L Fred

The Texas Heart Institute Journal

Recent events in this country pose major concerns. Police shoot unarmed blacks, gun-wielding malcontents ambush policemen, white supremacists march, gays are murdered, gender inequality pervades our workforce, and sexual harassment and abuse are surfacing in many segments of our society. In reaction, various social movements have sprung up, including Black Lives Matter, White Lives Matter, Blue Lives (policemen) Matter, Gay Lives Matter, Girls for Gender Equity (GGE), #MeToo, and Time's Up. To that list, I add another battle cry: Public Hospitals Matter.

Optimizing Emergency Department Throughput Using Best Practices To Improve Patient Flow, Puneet Freibott Dnp, Rn, Nea-Bc, Ccrn-K'S

Journal of Nursing & Interprofessional Leadership in Quality & Safety

Emergency Department (ED) crowding and bottle necks are the reality of hospitals across the country. Patients seeking care and needing inpatient beds via the emergency rooms are facing delays with attaining the right level of care. Orchestrating a patient through an ED admission requires a multidisciplinary effort to provide safe, effective and efficient care. This quality improvement project conducted in a tertiary acute care hospital focused on Centers for Medicare and Medicaid metrics to measure Emergency Department (ED) throughput. This multidisciplinary initiative focused on reducing time stamps for patient arrival to the ED through departure to hospital or home. Outcomes …

Reducing Antibiotic Use In Pediatric Upper Respiratory Infection: A Multifaceted Parent-Clinician Approach, Sydnee H. Lucas Dnp, Aprn, Sydney Thompson Dnp, Arnp, Fnp-Bc

Journal of Nursing & Interprofessional Leadership in Quality & Safety

The goal of this QI initiative was to decrease inappropriate antibiotic for the treatment of pediatric upper respiratory infection (URI) in the retail clinic setting. The approach included the use of a protocol to treat viral upper respiratory illness, a visual aid decision-making tool for guideline adherence, prescription pad for nonprescription remedies, and shared decision-making techniques for providers to involve patients and parents in management plans regarding nonprescription remedies, supportive treatment, and signs and symptoms that would warrant a return visit. An improvement trend during the first 3 months of the initiative showed a shift in antibiotic avoidance from a …

Using Business Modeling To Streamline Cost Of Anesthesia In A Cardiopulmonary Laboratory, Johnny Dang Dnp, Crna, Kristen Starnes-Ott Phd, Crna

Journal of Nursing & Interprofessional Leadership in Quality & Safety

The Time Driven Activity Based Costing (TDABC) measurement system, a model used in the business arena, can capture clinical processes and costs that other costing models often overlook. Use of this system permitted tying costs to time and resources and identified areas of inefficiency such as depleted supplies and health care and emergency supplies placed inconveniently. A multidisciplinary team developed an anesthesia checklist for use in a remote cardiopulmonary laboratory. The compliance rate for checklist completion was approximately 85%. Checklist implementation translated to a decrease in case delays and time expenditure in patient care by 58% with a cost savings …

Protocol To Increase Administration Of Herpes Zoster Vaccine In A Long-Term Care Facility, Stephen Mbola Dnp, Rn, Anp-Bc

Journal of Nursing & Interprofessional Leadership in Quality & Safety

Although the herpes zoster (HZ) vaccine to decrease the incidence of Shingles was licensed for use in 2008, little coverage for HZ vaccination has occurred and stands nationally at 16%. At a targeted nursing home and assisted living facility, a protocol for including HZ along with state-mandated vaccinations was devised and used in screening incoming residents. Baseline data from chart reviews (n=122) showed that despite treatments given for the infection in the preceding 12 months, no vaccinations had occurred. During a 6-month implementation period, all new residents meeting eligibility criteria were offered the HZ vaccination. In this period, four residents …

Quality Improvement And Safety In Healthcare: Reflections On Essential Frameworks To Guide Applied Scholarship That Promotes Transformation And Innovation, Angelo P. Giardino Md, Phd, Mph

Journal of Nursing & Interprofessional Leadership in Quality & Safety

The publication of the inaugural issue of the Journal of Nursing and Interprofessional Leadership in Quality and Safety (JONILQS) is a unique milestone that is the culmination of visionary leadership, scholarly effort, and keen attention to the many tasks necessary to launch a journal. The University of Texas Health Science Center at Houston’s School of Nursing launches this journal to address the focus on quality and safety initiatives and research that helps to make the health care we provide safer and better. This journal seeks to highlight practical work from the field that will change things for the better for …

Developing The Improving Post-Event Analysis And Communication Together (Impact) Tool To Involve Patients And Families In Post-Event Analysis, Madelene J. Ottosen Phd, Rn, Emily W. Sedlock Mph, Aitebureme O. Aigbe Drph, Jason M. Etchegaray Phd, Sigall K. Bell Md, Thomas H. Gallagher Md, Eric J. Thomas Md, Mph

Journal of Nursing & Interprofessional Leadership in Quality & Safety

The analysis of harmful errors is typically led by a team within the hospital and includes clinicians and staff who were involved at the time of the event. However, the patient and family are often left out of this process and are not asked to participate in the investigation. Because little guidance is available for facilitating patient input, an interprofessional team convened to develop a semi-structured tool to be used in eliciting patient feedback. Some 72 persons who had experienced adverse events were interviewed. Using a thematic analysis approach, the team learned that 51% of the interviewees preferred to participate …

From The Editors-In-Chief, Joanne V. Hickey Phd, Rn, Acnp, Faan, Fccm, Eileen R. Giardino Phd, Rn, Aprn, Fnp

Journal of Nursing & Interprofessional Leadership in Quality & Safety

The Co-editors in chief welcome The Journal of Nursing & Interprofessional Leadership in Quality and Safety to state what the purpose of the journal is and why it is important for this journal to start.

Implementation Of A Comprehensive Clinical Toolkit For Postpartum Depression Screening: Breaking Barriers In Women's Health Care, Liza C. Rivera Dnp, Msn, Aprn, Whnp-Bc

Journal of Nursing & Interprofessional Leadership in Quality & Safety

A quality improvement initiative to increase screening of postpartum women to detect depression and appropriately refer women screening positive for follow-up care was implemented in an obstetrics and gynecology practice. Physicians in the practice (n = 13) completed an educational module on use and benefits of a toolkit and showed a significant post test increase. Review of patient medical charts found a significant increase in screening rate in an 8-week intervention cycle. Through means of establishing a protocol for appropriate referral for follow-up, the goal of referring 50% of women who screened positive was exceeded.