- Research article
- Open Access
- Open Peer Review
Sequential organ failure assessment score predicts mortality after coronary artery bypass grafting
BMC Surgery volume 17, Article number: 22 (2017)
Mortality after coronary artery bypass grafting (CABG) is generally associated with underlying disease and surgical factors overlooked in preoperative prognostic models. Sequential Organ Failure Assessment (SOFA) and Acute Physiology and Chronic Health Evaluation (APACHE II) scores are widely used in intensive care units for outcome prediction. This study investigated the accuracy of these models in predicting mortality.
Between January 2010 and April 2013, 483 patients who underwent isolated CABG were enrolled. The clinical characteristics, outcomes, and prognostic model scores of the patients were collected. Discrimination was assessed using the area under the curve approach.
Both SOFA and APACHE II scores were effective for predicting in-hospital mortality. Among the organ systems examined in the SOFA, the cardiac and renal systems were the strongest predictors of CABG mortality. Multivariate analysis identified only the SOFA score as being an independent risk factor for mortality.
In summary, the SOFA score can be used to accurately identify mortality after isolated CABG.
Studies have reported that the mortality of cardiac surgery ranges from 2.94 to 32.5 according to different surgeries and population [1–3]. Prognostic models developed by the Society of Thoracic Surgeons European System for Cardiac Operative Risk Evaluation for mortality and morbidity are widely used before operations. However, unexpected intraoperative factors might influence the outcomes of these patients. General severity scoring systems, such as the Acute Physiology and Chronic Health Evaluation (APACHE II)  and Sequential Organ Failure Assessment (SOFA) , are generally used in intensive care units (ICUs) to predict mortality, but their validity in isolated coronary artery bypass grafting (CABG) patients is not well established , Therefore, we undertook a post hoc analysis of a prospectively accumulated database to evaluate the accuracy of the SOFA and APACHE II for predicting postoperative mortality on the date of surgical ICU admission.
Study participants and data collection
This clinical study was conducted in full compliance with the ethical principles of the Declaration of Helsinki and was consistent with Good Clinical Practice guidelines and the applicable local regulatory requirements. The local institutional review board of Chang Gung Memorial Hospital approved our study protocol. The requirement for obtaining patient consent was waived because the study utilized prospectively collected data for post hoc analysis. This database was constructed for medical quality assurance. Patients of ages older than 20 years were enrolled in this study. Between January 2010 and April 2013, 483 consecutive patients who received isolated CABG in a single tertiary referral hospital were investigated. Pertinent data on patients’ medical history including clinical characteristics, demographic data, and a scoring system were extracted from this database. Congestive heart failure (CHF, based on Framingham criteria and defined using New York Heart Association classifications), shock (defined as hypotension with systolic arterial blood pressure of 90 mmHg despite adequate fluid resuscitation), and myocardial infarction (MI; defined according to the 2007 Expert Consensus Document of Circulation from the European Heart Journal) were evaluated. Illness severity was assessed using APACHE II and SOFA [4, 5] scores determined on the day of ICU admission. The primary outcome was in-hospital mortality. Patients who underwent CABG received standard medical care according to the 2011 American College of Cardiology Foundation/American Heart Association guidelines for CABG .
The Kolmogorov–Smirnov test was used to determine the normal distribution for each variable. Student’s t test was used to compare the means of continuous variables and normally distributed data; otherwise, the Mann–Whitney U test was used. Categorical data were tested using the chi-square test or Fisher exact test. Furthermore, the Hosmer–Lemeshow goodness-of-fit test was used for calibration when evaluating the number of observed and predicted deaths for the entire range of death probabilities. Discrimination was assessed using the area under the curve (AUC), which was compared using a nonparametric approach . Cumulative survival curves as a function of time were generated using the Kaplan–Meier approach and compared using a log-rank test. All statistical tests were 2-tailed; a value of P < .05 was considered statistically significant.
Study population characteristics
The 483 patients were all adults and had a mean age of 62.9 years; of them, 17.6% (n = 85) were female. Overall in-hospital mortality was 9.9%. All patient characteristics are listed in Table 1. Compared with the survival group, the mortality group was older, was more likely to have end-stage renal disease (ESRD), and was more likely to be on ventilator support before surgery. Those who died also had higher creatinine (Cr), lower albumin (ALB), and lower hemoglobin (Hb) levels and poorer preoperative heart conditions such as greater more preoperative intra-aortic balloon pumping (IABP) usage, extracorporeal membrane oxygenation (ECMO) usage, more shock, more recent MI, and a lower ejection fraction. Table 2 lists the surgical details and postoperative data of the patients. The nonsurvivors required the surgery more urgently and had more intraoperative IABP and ECMO usage compared with the survivors. They also had a greater proportion of shock as well as higher Cr, and lower Hb levels after the operation. ICU stay was markedly prolonged in the mortality group.
Scoring systems and in-hospital mortality
The mean Society of Thoracic Surgeons (STS) mortality risk, European System for Cardiac Operative Risk Evaluation (EuroSCORE) II, SOFA, and APACHE II scores were 7.7, 6.8, 6.6, and 12.9, respectively. All scores differed significantly between the survivors and nonsurvivors. The AUC results listed in Table 3 indicate that the SOFA, STS mortality risk, APACHE II, and EuroSCORE II all had satisfactory discriminatory ability (0.912 ± 0.019, P < .001, 0.898 ± 0.017, P < .001, 0.866 ± 0.027, P < .001, and 0.863 ± 0.022, P < .001). Both the SOFA and STS mortality risk were significantly superior to EuroSCORE II (P = .016 and P < .001, respectively). Low P values for the Hosmer–Lemeshow test indicated that there were no statistical hints against an assumed fit of the scoring system. Both the postoperative SOFA and APACHE II scores exhibited close agreement between the observed and expected mortality. Figure 1 presents the observed and predicted mortality results for the scoring systems stratified into quintiles.
To investigate the individual organ systems that affect post-CABG mortality, we dissected the SOFA score components to calculate the discriminatory power of each (Table 4). The cardiovascular system followed by the renal system had the higher discriminatory power, after which were coagulation and neurology, both with similar discriminatory power. Liver and respiration had the lowest discriminatory power among the individual factors. Combining the cardiovascular and renal system components resulted in increased discriminatory power, but this power was still less than that of the entire SOFA score (P < .001).
Figure 2 illustrates the cumulative survival rate, stratified according to SOFA score tertiles. Patients in the high and middle tertiles had significantly lower survival rates than did those in the low tertile (log-rank P < .001)
Logistic regression analysis for mortality according to postoperative variables
According to univariable and multivariable logistic regression models based on patient characteristics and postoperative factors, only the age, postoperative ECMO and SOFA score were independently associated with mortality (Table 5).
This present investigation examined 483 isolated CABG patients admitted to an ICU after operation. The overall in-hospital mortality rate was 9.9%, which was higher than that reported in previous studies. Tamayo et al. studied post-cardiac surgery patients and found a 90-day in-hospital mortality rate of 8.8% . Curiel-Balsera et al. performed a study using the ARIAM Andalus adult cardiac surgery registry, which included data from 11 hospitals in the autonomous region of Andalusia between 2008 and 2011, and reported intra-ICU mortality of 7.7% and 30-day mortality of 9.3% . Rodríguez-Rieiro et al. reported an observed mortality rate of 7.69% . Our preoperative STS and EuroSCORE II scores were much higher than those reported in the literature [12–14]. Potential explanations for this are as follows. First, the current data were collected in the largest tertiary referral hospital in Northern Taiwan, in which a large proportion of patients have advanced comorbidities such as ESRD (11.8%), which is well known to be a high-risk population for surgical mortality . Second, in traditional Chinese culture, families typically seek treatment for patients even when doing so involves high surgical risk and a high likelihood of complications . Third, of the patients who underwent emergent and salvage CABG, some had severe preoperative cardiogenic shock (12.4%) and received mechanical circulatory support (MCS), namely patients with IABP (13.2%) and ECMO (2.5%), both of which are positively associated with CABG mortality. Early mortality in patients undergoing emergent and salvage CABG is substantial, with the in-hospital mortality rates of 13 and 41%, respectively . Patients requiring preoperative MCS have operative mortality of 37.2%, and those undergoing CABG as a salvage procedure have an operative mortality of 53.3% . Finally, the low total hospital costs (approximately 10% of the costs in the United States) and large reimbursement amounts under the health insurance system of Taiwan may have affected the quality of patient care and negatively affected the CABG outcomes .
Numerous prognostic risk models for cardiac surgery have been introduced into current practice. Among them, the EuroSCORE, published in 1999 ; revised EuroSCORE II, published in 2012 ; and STS score, published in 2008  are widely used. These assessments, which are based on collected data, can be used to predict the risk of cardiac surgery mortality according to patient demographics and clinical variables, and can be determined using an easy-to-use online calculator. No previous study has compared preoperative and postoperative risk modes for predicting the occurrence of mortality in isolated CABG. Our data showed that preoperative scores underestimated mortality in high-risk patients (Fig. 1). Thus, a postoperative score is necessary for ICU doctors to reevaluate condition severity. In this study, we demonstrated that SOFA and APACHE II scores at ICU day 1 have similar predictive effectiveness for mortality. SOFA score based upon respiratory, renal, hepatic, cardiovascular, neurological and coagulation systems, were used as an assessment tool to evaluate outcome. The Cardiac Surgery Score (CASUS) was designed for predicting cardiac surgery mortality by using 10 variables measured upon ICU admission . Several studies have concluded that the scale can effectively predict cardiac surgery mortality, and have recommended its use . The CASUS also evaluates several organ functions and has similar parameters to those of SOFA. However, lactic acid was not routinely recorded postoperatively in our ICU; thus, we could not validate CASUS results in this study. The Post Cardiac Surgery (POCAS) prognostic score was developed on the basis of 4 parameters (mean arterial pressure [MAP], lactate, bicarbonate, and international normalized ratio [INR]), and has favorable discrimination in predicting postcardiac mortality . Although we did not compare POCAS and SOFA scores, MAP and lactate represent the cardiac system, bicarbonate represents the renal system, and the INR represents coagulation and the liver system, which might explain why the SOFA and POCAS results were similar.
Patients receiving CABG mainly exhibit 2 complex cardiorenal syndromes. First, patients with coronary arterial disease are usually older and have DM, HTN, and CHF, which cause chronic kidney disease (CKD) through microvascular and macrovascular pathophysiology. Moreover, sympathetic tone, renin–angiotensin–aldosterone system activation, and endothelin release cause excess vasoconstriction and impair glomerular filtration. CKD also induces erythropoietin deficiency, decreased vitamin D receptor activation, and fluid acumination, which might affect cardiac function through cardiomyopathy. Second, during CABG, patients experience low cardiac output, nonpulsatile blood flow, hemolysis, and free iron release, which induce oxidative stress and reactive oxygen species and impair kidney function. Otherwise, excess diuretic and analgesic use might result in acute kidney injury (AKI). In fact, AKI affects 12–30% of patients undergoing CABG, contributes to increased in-hospital mortality and reduced long-term survival, and results in high medical expenditure, CKD, and dialysis dependence [25–28]. Postoperative AKI not only contributes to increased in-hospital mortality and reduced long-term survival but also results in high medical expenditure, CKD, and dialysis dependence. In the present study, the mortality group patients exhibited anemia, hypoalbuminemia, and poor renal function, which reflect the severity of heart failure, water retention, inflammation, and malnutrition and which are known risk factors for mortality after cardiac surgery [14, 29, 30]. The occurrence of cardiac and renal dysfunction varies among patients admitted to the ICU with CABG, with different degrees of association existing between individual organ system failure and ICU mortality . This explains why combining the cardiac and renal factors of the SOFA score is an accurate technique for assessing mortality in patients who receive CABG.
Despite the favorable results obtained in this study, some crucial limitations must be noted. First, our study was limited by its post hoc analysis nature and relatively small number of cases from a single referral center in Asia; care should be used when generalizing the results to different populations. Second, scoring was performed only on the first day of ICU admission. The sequential application of these scoring systems (for example, daily or weekly) may reflect dynamic aspects of clinical diseases and thus provide more complete data on mortality risk. Finally, the etiology of mortality is often multifactorial, and postoperative care factors that were not included in the scoring systems may have affected the prediction results.
The analysis results highlight the strong discriminative power of the SOFA and APACHE II scores in predicting mortality in patients after CABG. Among the different components of the SOFA, renal dysfunction is the only one that is also incriminated in cardiac failure, indicating that mortality is often part of a cardiorenal syndrome. The multivariate analysis identified the SOFA score alone as an independent risk factor for mortality. Higher SOFA scores are correlated with higher mortality. In conclusion, SOFA might be the most effective tool for guiding the use of preventive and early therapeutic strategies to prevent mortality and improve clinical outcomes for patients who undergo CABG. Future studies could conduct multicenter and repeated measurements to enhance accuracy for future clinical management.
Mehta RH, Suzuki T, Hagan PG, Bossone E, Gilon D, Llovet A, Maroto LC, Cooper JV, Smith DE, Armstrong WF, et al. Predicting death in patients with acute type a aortic dissection. Circulation. 2002;105(2):200–6.
Siregar S, Groenwold RH, de Mol BA, Speekenbrink RG, Versteegh MI, Brandon Bravo Bruinsma GJ, Bots ML, van der Graaf Y, van Herwerden LA. Evaluation of cardiac surgery mortality rates: 30-day mortality or longer follow-up? Eur J Cardiothorac Surg. 2013;44(5):875–83.
Chang CH, Lee CC, Chen SW, Fan PC, Chen YC, Chang SW, Chen TH, Wu VC, Lin PJ, Tsai FC. Predicting acute kidney injury following mitral valve repair. Int J Med Sci. 2016;13(1):19–24.
Knaus WA, Zimmerman JE, Wagner DP, Draper EA, Lawrence DE. APACHE-acute physiology and chronic health evaluation: a physiologically based classification system. Crit Care Med. 1981;9(8):591–7.
Vincent JL, Moreno R, Takala J, Willatts S, De Mendonca A, Bruining H, Reinhart CK, Suter PM, Thijs LG. The SOFA (sepsis-related organ failure assessment) score to describe organ dysfunction/failure. On behalf of the working group on sepsis-related problems of the European society of intensive care medicine. Intensive Care Med. 1996;22(7):707–10.
Chang CH, Fan PC, Chang MY, Tian YC, Hung CC, Fang JT, Yang CW, Chen YC. Acute kidney injury enhances outcome prediction ability of sequential organ failure assessment score in critically ill patients. PLoS One. 2014;9(10):e109649.
Hillis LD, Smith PK, Anderson JL, Bittl JA, Bridges CR, Byrne JG, Cigarroa JE, Disesa VJ, Hiratzka LF, Hutter Jr AM, et al. 2011 ACCF/AHA guideline for coronary artery bypass graft surgery: a report of the American college of cardiology foundation/American heart association task force on practice guidelines. Circulation. 2011;124(23):e652–735.
DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837–45.
Tamayo E, Fierro I, Bustamante-Munguira J, Heredia-Rodriguez M, Jorge-Monjas P, Maroto L, Gomez-Sanchez E, Bermejo-Martin F, Alvarez F, Gomez-Herreras J. Development of the post cardiac surgery (POCAS) prognostic score. Crit Care. 2013;17(5):R209.
Curiel-Balsera E, Mora-Ordonez JM, Castillo-Lorente E, Benitez-Parejo J, Herruzo-Aviles A, Ravina-Sanz JJ, Alvarez-Bueno M, Rivera-Fernandez R. Mortality and complications in elderly patients undergoing cardiac surgery. J Crit Care. 2013;28(4):397–404.
Rodriguez-Rieiro C, Rodriguez Perez P, Granado de la Orden S, Moreno M, Garcia AC, Sanchez-Gomez A. In-hospital mortality rates after CABG by autonomous regions in Spain. Int J Health Care Qual Assur. 2011;24(4):300–7.
Kennedy JL, LaPar DJ, Kern JA, Kron IL, Bergin JD, Kamath S, Ailawadi G. Does the society of thoracic surgeons risk score accurately predict operative mortality for patients with pulmonary hypertension? J Thorac Cardiovasc Surg. 2013;146(3):631–7.
Edgerton J, Filardo G, Ryan WH, Brinkman WT, Smith RL, Hebeler Jr RF, Hamman B, Sass DM, Harbor JP, Mack MJ. Risk of not being discharged home after isolated coronary artery bypass graft operations. Ann Thorac Surg. 2013;96(4):1287–92.
Poullis M, Pullan M, Chalmers J, Mediratta N. The validity of the original EuroSCORE and EuroSCORE II in patients over the age of seventy. Interact Cardiovasc Thorac Surg. 2015;20(2):172–7.
Rahmanian PB, Adams DH, Castillo JG, Vassalotti J, Filsoufi F. Early and late outcome of cardiac surgery in dialysis-dependent patients: single-center experience with 245 consecutive patients. J Thorac Cardiovasc Surg. 2008;135(4):915–22.
Wen KY, Lin YC, Cheng JF, Chou PC, Wei CH, Chen YF, Sun JL. Insights into Chinese perspectives on do-not-resuscitate (DNR) orders from an examination of DNR order form completeness for cancer patients. Support Care Cancer. 2013;21(9):2593–8.
Axelsson TA, Mennander A, Malmberg M, Gunn J, Jeppsson A, Gudbjartsson T. Is emergency and salvage coronary artery bypass grafting justified? The Nordic Emergency/Salvage coronary artery bypass grafting study. Eur J Cardiovasc Thorac Surg. 2016;49(5):1451–6. doi:10.1093/ejcts/ezv388.
Acharya D, Gulack BC, Loyaga-Rendon RY, Davies JE, He X, Brennan JM, Thourani VH, Williams ML. Clinical characteristics and outcomes of patients with myocardial infarction and cardiogenic shock undergoing coronary artery bypass surgery: data from the society of thoracic surgeons national database. Ann Thorac Surg. 2016;101(2):558–66.
Chang GM, Cheng SH, Tung YC. Impact of cuts in reimbursement on outcome of acute myocardial infarction and use of percutaneous coronary intervention: a nationwide population-based study over the period 1997 to 2008. Med Care. 2011;49(12):1054–61.
Nashef SA, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R. European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardiothorac Surg. 1999;16(1):9–13.
Nashef SA, Roques F, Sharples LD, Nilsson J, Smith C, Goldstone AR, Lockowandt U. EuroSCORE II. Eur J Cardiothorac Surg. 2012;41(4):734–44. discussion 744–735.
O'Brien SM, Shahian DM, Filardo G, Ferraris VA, Haan CK, Rich JB, Normand SL, DeLong ER, Shewan CM, Dokholyan RS, et al. The society of thoracic surgeons 2008 cardiac surgery risk models: part 2--isolated valve surgery. Ann Thorac Surg. 2009;88(1 Suppl):S23–42.
Hekmat K, Kroener A, Stuetzer H, Schwinger RH, Kampe S, Bennink GB, Mehlhorn U. Daily assessment of organ dysfunction and survival in intensive care unit cardiac surgical patients. Ann Thorac Surg. 2005;79(5):1555–62.
Badreldin A, Elsobky S, Lehmann T, Brehm BB, Doenst T, Hekmat K. Daily-Mean-SOFA, a new derivative to increase accuracy of mortality prediction in cardiac surgical intensive care units. Thorac Cardiovasc Surg. 2012;60(1):43–50.
Gallagher S, Jones DA, Lovell MJ, Hassan S, Wragg A, Kapur A, Uppal R, Yaqoob MM. The impact of acute kidney injury on midterm outcomes after coronary artery bypass graft surgery: a matched propensity score analysis. J Thorac Cardiovasc Surg. 2014;147(3):989–95.
Ryden L, Ahnve S, Bell M, Hammar N, Ivert T, Sartipy U, Holzmann MJ. Acute kidney injury after coronary artery bypass grafting and long-term risk of myocardial infarction and death. Int J Cardiol. 2014;172(1):190–5.
Rosner MH, Okusa MD. Acute kidney injury associated with cardiac surgery. Clin J Am Soc Nephrol. 2006;1(1):19–32.
Chen YC, Tsai FC, Chang CH, Lin CY, Jenq CC, Juan KC, Hsu HH, Chang MY, Tian YC, Hung CC, et al. Prognosis of patients on extracorporeal membrane oxygenation: the impact of acute kidney injury on mortality. Ann Thorac Surg. 2011;91(1):137–42.
Tang YD, Katz SD. Anemia in chronic heart failure: prevalence, etiology, clinical correlates, and treatment options. Circulation. 2006;113(20):2454–61.
Silverberg DS. The role of erythropoiesis stimulating agents and intravenous (IV) iron in the cardio renal anemia syndrome. Heart Fail Rev. 2011;16(6):609–14.
Lin YF, Ko WJ, Wu VC, Chen YS, Chen YM, Hu FC, Shiao CC, Wu MS, Chen YW, Li WY, et al. A modified sequential organ failure assessment score to predict hospital mortality of postoperative acute renal failure patients requiring renal replacement therapy. Blood Purif. 2008;26(6):547–54.
The authors also thank all entire surgical team and staff of the Kidney Research Center of Chang Gung Memorial Hospital, Linkou, Taiwan.
This study was supported by grants from Chang Gung Memorial Hospital, Taiwan (BMRPD97). Dr. C-H Chang was supported by the Ministry of Science and Technology (MOST 103-2314-B-182A-018-MY3).
Availability of data and materials
The data that support the findings of this study are available from the department of cardiovascular surgery of the Chang Gung Memorial Hospital but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of Liver Transplantation Center of the Chang Gung Memorial Hospital.
Contributorship statement: C-H Chang and S-W Chen participated in all works aspects of present study. F-C Tsai is a surgeon and consultant. C-H Chang and Y-C Chen devised with the hypothesis, and were responsible for the design. S-W Chang is a biostatistician who analyzed the data with P-C Fan, C-C Lee, H-C Pan and C-H Chang. H-Y Yang and C-W Yang assisted manuscript preparation and editing. All authors read and approved the final manuscript.
The authors declare no competing financial interests.
Consent for publication
Ethics approval and consent to participate
This clinical investigation was approved by the Institutional Review Board of Chang Gung Memorial Hospital (approval No. 103-6381B). The protocol of the study was designed in full compliance with Good Clinical Practice guidelines and the principles of the Declaration of Helsinki. In this study, no organs from executed persons were used. Because only pre-existing data were examined, we did not obtain written informed consent from each patient. Instead, patients were informed of their right for accepting or refusing enrollment by telephone interview. Before data analysis, the records of patients were anonymized and de-identified. The approaches followed the ordinances concerning informed consent and enrollment expounded in guidelines.
About this article
Cite this article
Chang, C., Chen, S., Fan, P. et al. Sequential organ failure assessment score predicts mortality after coronary artery bypass grafting. BMC Surg 17, 22 (2017) doi:10.1186/s12893-017-0219-9
- Coronary artery by pass grafting
- Sequential organ failure assessment
- Society of thoracic surgeons mortality risk
- Cardiorenal syndrome