Article Text

Download PDFPDF

Original research
Novel scoring system based on clinical examination for prediction of in-hospital mortality in acute coronary syndrome patients: a retrospective cohort study
  1. Miftah Pramudyo,
  2. Transiska Liesmadona Bijaksana,
  3. Achmad Fauzi Yahya and
  4. Iwan Cahyo Santosa Putra
  1. Department of Cardiology and Vascular Medicine, Padjadjaran University, Bandung, Jawa Barat, Indonesia
  1. Correspondence to Dr Miftah Pramudyo; miftah.pramudyo{at}gmail.com

Abstract

Background This study aims to develop PADjadjaran Mortality in Acute coronary syndrome (PADMA) Score to predict in-hospital mortality in acute coronary syndrome (ACS) patients based on clinical examination only. Additionally, we also compared the predictive value of the PADMA Score with the Global Registry of Acute Coronary Events (GRACE), Canada Acute Coronary Syndrome (C-ACS), and The Portuguese Registry of Acute Coronary Syndromes (ProACS) risk scores.

Methods This retrospective cohort study included all ACS patients aged≥18 years who were admitted to Dr. Hasan Sadikin Central General Hospital from January 2018 to January 2022. Patients’ demographic, comorbidities and clinical presentation data were collected and analysed using multivariate logistic regression to create two models of scoring system (probability and cut-off model) to predict in-hospital all-cause mortality. The area under the curve (AUC) among PADMA, GRACE, C-ACS and ProACS risk scores was compared using the fisher Z test.

Results Multivariate regression analysis of 1359 patients showed that older age, history of cerebrovascular disease, tachycardia, high Shock Index and Killip class III and IV were independent mortality predictors and included in the PADMA Score. PADMA Score ranged from 0 to 20, with a score≥5 that can predict all-cause mortality with 82.78% sensitivity and 72.35% specificity. The difference in AUC between PADMA and GRACE scores was insignificant (p=0.126). Moreover, the AUC of the PADMA Score was significantly higher compared with the C-ACS (p=0.002) and ProACS risk scores (p<0.001).

Conclusion PADMA Score is a simple scoring system to predict in-hospital mortality in ACS patients. PADMA Score≥5 showed an accurate discriminative capability to predict in-hospital mortality, comparable with the GRACE Score and superior to C-ACS and ProACS scores.

  • carotid artery diseases
  • acute coronary syndrome
  • myocardial infarction

Data availability statement

Data are available upon reasonable request.

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

WHAT IS ALREADY KNOWN ON THIS TOPIC

  • Although the Global Registry of Acute Coronary Events (GRACE) risk Score is the most widely used scoring system for predicting the risk of mortality in acute coronary syndrome (ACS) patients, this scoring system is time-consuming and cannot be performed in healthcare centres with limited facilities.

WHAT THIS STUDY ADDS

  • This study develops a novel scoring system to predict the risk of in-hospital mortality in ACS patients based only on clinical examination, namely PADjadjaran Mortality in Acute coronary syndrome (PADMA) risk Score.

  • The predictive value of the PADMA Score is proven to be comparable to the GRACE risk Score and superior to Canada Acute Coronary Syndrome and Portuguese Registry of Acute Coronary Syndromes scores.

HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY

  • Since the PADMA Score is simple and easy to calculate, clinicians can rapidly predict the risk of in-hospital mortality of ACS patients in the first medical contact.

Introduction

Cardiovascular diseases (CVD) are a global health burden and are responsible for one-third of mortality worldwide. In 2019, approximately 17.9 million people died from CVD. Its prevalence is expected to increase.1 Compared with other CVD, acute coronary syndrome (ACS) is a worldwide health issue with the highest mortality rate, with over three-quarters of CVD deaths in low-middle-income countries.1 2 Therefore, the risk stratification tool to predict mortality risk in this population is mandatory to assess the early prognosis and help clinicians decide the best therapeutical options for the patients.

Until now, several prognostic tools (eg, Global Registry of Acute Coronary Events [GRACE], Thrombolysis in Myocardial Infarction [TIMI], Zwolle De Luca, Primary Angioplasty in Myocardial Infarction [PAMI] Addala and Cadillac Halkin) have been discovered to predict the risk of mortality in ACS patients.3 Nonetheless, GRACE Score is still the most widely used scoring system and also the validated instruments that had the highest sensitivity and specificity in predicting mortality compared with other prognostic tools.4 5 However, this scoring system relies heavily on electrocardiography (ECG) and laboratory findings to complete the calculation; hence, it is time-consuming and cannot be performed in rural healthcare centres with limited facilities.

Several cohort studies evaluate the usefulness of the CHA2DS2VASc (Congestive heart failure, Hypertension, Aged ≥ 75 years, Diabetes mellitus, Stroke, Vascular disease, Aged 65-74 years, Sex category [female]) score as a clinical scoring system in which the calculation is based only on the history of a patient’s comorbidities.6–8 These cohort studies showed that a high CHA2DS2VASc Score significantly increased the risk of major adverse cardiac events in ACS patients regardless of atrial fibrillation status.6–8 Nevertheless, although this scoring system is convenient compared with the GRACE Score, it also has limitations as it does not include the patient’s clinical presentation into the calculation; therefore, it can underestimate the mortality risk in ACS patients with poor haemodynamic status. Thus, this study aims to develop a novel risk scoring system named PADjadjaran Mortality in Acute coronary syndrome (PADMA) Score to predict the risk of in-hospital mortality in ACS patients, which in the calculation is based on the patient’s history and clinical presentation at admission. This scoring is simple and can be completed in the first medical contact in all healthcare facilities. Additionally, we also compared the prognostic value of the PADMA Score with other scoring systems, including GRACE, Canada Acute Coronary Syndrome (C-ACS) and The Portuguese Registry of Acute Coronary Syndromes (ProACS) risk scores.

Methods

Study design and patient selection

This retrospective and single-centre cohort study included all ACS patients aged≥18 years hospitalised in Dr. Hasan Sadikin Central General Hospital from January 2018 to January 2022. Incomplete or missing data from medical records were excluded from the study.

Definition of variables and outcome

Variables that were considered in the model were as follows; demography (female sex, age, body mass index (BMI)), clinical presentation (initial systolic blood pressure (SBP), initial heart rate (HR), Shock Index (SI), which is defined as HR divided by SBP, Killip class and ST-segment deviation in ECG), history and cardiovascular risk factors (smoking, diabetes, hypertension, family history of coronary artery disease, history of cerebrovascular disease, history of angina and history of revascularisation, including primary percutaneous intervention and coronary artery bypass surgery). All these variables were collected from the patient’s medical records. The primary endpoint was in-hospital mortality, defined as all-cause death that occurred during the index hospitalisation of the ACS event.

Statistical analyses

All statistical analyses were performed using SPSS V.25.0. All categorical data were presented in numbers and percentages. In contrast, numerical data were presented in mean and SD if the distribution was normal or median and IQR if the distribution was not normal. Chi-square and Fisher’s tests were performed to analyse the association between predicting factors and in-hospital mortality. The logistic regression analysis was performed to find the significant p value (p<0.05) from the adjusted OR. All the significant parameters were included in logistic regression with a stepwise backward method. The scoring system was developed by numbering each independent variable based on the regression coefficient (B) from multivariate logistic regression analysis. Receiver operating characteristics (ROC) analysis was used to produce the area under the curve (AUC) for predicting the outcome of interest. Moreover, the DeLong method was used to generate the PADMA Score’s sensitivity and specificity and determine the ideal cut-off. The Granger model was performed to obtain the estimated probability of mortality for in-hospital death. The scoring system validated the previous sample to find diagnostic value. Finally, to compare the prognostic value of PADMA, GRACE, C-ACS and ProACS risk scores, we compared the AUC of these scoring systems using Fisher Z test.

Results

The baseline characteristics of the studies are summarised in table 1. Of 1359 subjects who enrolled in this study, most of the patients were male (76.6%) and less than 65 years (72.9%). Most patients were non-obese (6.8%), more than half of the subjects were smokers (59.7%) and had hypertension (62.8%). The initial presentation showed that most of the patients had no congestion (71%) with stable haemodynamics with HR less than 100 bpm (86%), blood pressure more than 100 mm Hg (76.5%) and SI less than 0.7 (59.6%). More than half of the ECG presented ST elevation (58.9%).

Table 1

Baseline characteristic of the study participants

In-hospital mortality occurred in 151 patients (11.1%). Female gender, older age, smoking and patients who had a history of cerebrovascular disease, low SBP, increased HR, high SI, ST-segment elevation myocardial infarction (STEMI) and high Killip class (III and IV) were significantly associated with higher mortality risk (p<0.05). Furthermore, the survivors had a higher number of revascularisation procedures and medical treatments in opposition to the non-survivors (p<0.05).

Table 2 showed the bivariate and multivariate regression analyses. Independence predictor in mortality were age 65–75 years (AOR=2.437 (95% CI=1.530 to 3.884); p<0.001), age>75 years (AOR=4.042 (95% CI=2.225 to 7.344); p<0.001), history of cerebrovascular disease (AOR=1.954 (95% CI=1.032 to 3.698); p=0.04), HR>100 bpm (AOR=1.859 (95% CI=1.080 to 3.202); p=0.025), SI 0.71–1.00 (AOR=2.189 (95% CI=1.341 to 3.572); p=0.002), SI>1.00 (OR=4.033 (95% CI=1.844 to 8.820); p<0.001), Killip III (OR=4.768 (95% CI=2.07 to 10.98); p<0.001) and Killip IV (OR=6.859 (95% CI=3.933 to 11.963); p<0.001).

Table 2

Logistic regression analysis of in-hospital mortality risk

Several independent predictors that were calculated as a new scoring system were elaborated in table 3. The scoring result is based on regression coefficient (B) from multivariate logistic regression with a minimum score of 0 and the maximum score of +20. It showed that the lowest score is Killip II with 1 point, history of cerebrovascular disease and HR got 2 points, SI 0.7–1.0 got 3 points, age 65–75, SI>1.00 and Killip III got 4 points, age>75 years got 5 points and the highest score is Killip IV with 7 points.

Table 3

Assessment of the score value from each independent predictor factor

Table 4 shows the scoring model based on the probability of mortality events—the greater the score, the higher chance of mortality, which indicates a dose–response related. ROC analysis revealed that with a cut-off of 5, the AUC, sensitivity and specificity of this scoring system in predicting in-hospital mortality were 0.842, 82.78% and 72.35%, respectively, (table 5 and figure 1).

Figure 1

Receiver operating characteristics curve score to predict mortality. AUC, area under the curve; PADMA, PADjadjaran Mortality in Acute coronary syndrome.

Table 4

Scoring system based on patient’s probability on mortality event

Table 5

Receiver operating characteristics (ROC) analysis as mortality scoring system model

Furthermore, we performed the Granger model to predict the incidence of mortality events based on three risk categories of PADMA Score (low risk: 0, moderate risk: 1–4 and high risk: 5–20). This model showed that low, intermediate and high risk yielded a probability of death of<3.0%, 3.0–6.8% and>6.8%, respectively, and an accumulated patient of 457 (33.6%), 463 (34%) and 440 (32.4%), respectively, (table 6).

Table 6

PADMA scoring system based on patient’s probability on mortality event

We compared the predictive value of the PADMA Score with the GRACE, C-ACS and ProACS scores using the Fisher Z test. The AUC value between PADMA and GRACE risk scores was not statistically significant for predicting in-hospital mortality (p=0.126). Furthermore, it showed that the AUC value of the PADMA Score was significantly higher in comparison to C-ACS (p=0.002) and ProACS risk scores (p<0.001) (table 7 and figure 2).

Figure 2

Comparison of AUC of PADMA Score with GRACE, C-ACS and ProACS risk scores to predict in-hospital mortality. AUC, area under curve; C-ACS, Canada Acute Coronary Syndrome; GRACE, Global Registry of Acute Coronary Events; PADMA, PADjadjaran Mortality in Acute coronary syndrome; ProACS, The Portuguese Registry of Acute Coronary Syndromes.

Table 7

ROC analysis result between GRACE and PADMA scoring system based on mortality

Discussion

The major findings of this cohort study are as follows. First, the components of the PADMA Score were age, history of cerebrovascular disease, HR, SI and Killip class. Second, the association between PADMA scores and in-hospital mortality in ACS patients showed that every increment of one score presented a higher mortality risk. PADMA Score was classified into three risk stratification: low, intermediate and high, with the probability of in-hospital mortality being <3%, 3%–6.8% and>6.8%, respectively. Third, using the cut-off of 5, a high PADMA Score substantially increased the risk of in-hospital mortality with AUC, sensitivity and specificity were 0.842, 82.78%, and 72.35%, respectively. Fourth, the PADMA Score’s predictive value was comparable to the GRACE Score and superior to the C-ACS and ProACS scores in predicting the risk of in-hospital mortality in ACS patients. Thus, we recommended using the PADMA Score as a simple prognosticator of in-hospital mortality in ACS patients.

There are two similar scoring systems to ours that only require a clinical examination to complete the calculation: C-ACS and ProACS risk scores. The C-ACS and ProACS were initiated in Canada and Portuguese, respectively.9 10 In this study, the PADMA Score was superior in predicting in-hospital mortality compared with C-ACS and ProACS scores based on the AUC values. According to the C-ACS and ProACS development cohorts, these two scoring systems had significantly lower AUC values than the GRACE risk Score.9 10 Otherwise, the predictive value of the PADMA Score was shown to be comparable with the GRACE Score, indicating that the PADMA Score can be useful as an alternative scoring system to the GRACE risk Score. However, there are several differences in baseline characteristics between this study and other cohorts. In contrast to GRACE, C-ACS and ProACS cohorts, patients in our study were younger, had fewer females and incidences of diabetes mellitus and history of angina, but had higher smokers, STEMI, and Killip class IV presentation.11–13 In addition, our patients had lower SBP and BMI levels than other cohorts. Moreover, as opposed to the ProACS development cohort, the revascularisation procedures in this study were higher.10 The in-hospital mortality rate in GRACE, C-ACS and ProACS cohorts were 4%, 5.2% and 5.4%, respectively, in which these numbers are approximately half of the mortality rate in our study.9 10 13 The possible explanation for this phenomenon is that compared with other cohorts, our study had a higher number of STEMI patients and Killip class IV presentation, thereby significantly increasing the risk of in-hospital mortality.

Generally, the PADMA Score encompasses two main elements, including demographic and haemodynamic status at admission. Demographic status is represented by age and history of cerebrovascular disease. Whereas HR, SI and Killip class reflect haemodynamic status. Every component of this scoring system was statistically significant and independent in increasing mortality in ACS patients and relatively reasonable to be included, given that every component had its mechanism related to mortality.

According to the current study, older age was one of the independent predictors of mortality, with age 65–75 and >75 years had 2.5 times and 4 times, respectively, higher mortality risk compared with those with age<65 years. Consistently, previous two cohort studies stated that old patients (>65 years and >75 years) significantly increased the risk of mortality in ACS patients.14 15 Furthermore, there are several explanations for why old ACS patients tend to present with high mortality risk. First, older patients are more likely to have comorbidities such as kidney disorders and hypertension.16 Second, mostly old patients who were finally diagnosed with ACS were presented with atypical symptoms at admission, often getting delayed diagnosis and treatment. Third, since old patients have a higher risk of bleeding, several old patients are not tolerable to undergo revascularisation procedures according to guidelines.17

This study showed that a history of cerebrovascular disease had a significant effect on mortality in ACS patients, which this variable was not used in GRACE or TIMI scores.18 19 Consistent with our findings, the association between cerebrovascular disease in the ACS population and mortality has been revealed by Mukherjee et al.20 Furthermore, patients with the cerebrovascular disease were less likely to be treated invasively or had limited medical drugs.21 Additionally, when coronary angiography was performed, patients with prior cerebrovascular disease often had multivessel disease, which increased the risk of death.22

Another novel and interesting finding in our study, we include the SI as a parameter in this study. The SI comprises two main components: HR and SBP. Originally, this index was used in patients who experienced hypovolemic and haemorrhagic shock.23 Nonetheless, several studies proved that high SI was significantly correlated with higher mortality risk in ACS populations.24–29 In this study, we divided SI into three categories, including <0.70, 0.71–1.00 and>1.00. This study showed that those with moderate (0.71–1.00) and high SI (>1.00) significantly and independently increased the risk of mortality by two times and four times higher as opposed to patients with low SI (<0.7). This finding is aligned with several cohort studies results, which revealed that SI higher than 0.7 and 1 significantly elevated the risk of mortality in ACS patients.24–29

In this study, high HR (>100) at admission was associated with increased mortality by approximately two times higher in contrast to those with low HR (<100). Consistently, previous studies supporting this result revealed that high admission HR was independently linked to mortality in ACS patients.9 15 30–32 It is widely known that sympathetic hyperactivity caused by a catecholamine surge in ACS patients can increase the HR. A study by Petterson et al found that high catecholamine levels in ACS patients were correlated with low left ventricular ejection fraction (LVEF).33 Moreover, sympathetic stimulation in ACS patients can cause ischemia-induced ventricular fibrillation and lead to sudden cardiac death.34 In addition, Yuksek et al stated that ACS patients who presented with elevated HR had higher serum troponin, glucose levels, lower LVEF and were more likely to have acute heart failure.35

An observational study conducted by Shlomai et al stated that admission SBP in ACS patients had a predictive value on mortality, as those with low SBP had a significant mortality risk compared with those with normal SBP.36 On the contrary, our study demonstrated that blood pressure less than 100 mm Hg was not significantly increased the risk of mortality in multivariate analysis. However, when SBP is included in the calculation of SI, the significance was numerically obtained. Theoretically, low SBP reflects low mean arterial pressure, as patients with low SBP, can lead to end-organ hypoperfusion and death.37 38 Thus, it concludes that ACS patients with high HR and low SBP indicated by high SI were associated with reduced LV function, increased arrhythmia risk and induced end-organ damage, leading to elevated mortality risk.

Our last PADMA Score component is the Killip class which is the standard classification to predict mortality in myocardial infarction. The higher Killip class was linked with a higher risk of in-hospital mortality.39 Persistently, the current study revealed that Killip class III and IV were independently associated with higher mortality risk. Basically, the Killip class is determined by pre-existing heart failure conditions (acute or chronic) and cardiogenic shock status. Heart failure markedly increased mortality risk in ACS patients, as it reduced the cardiac output, diminished the oxygen perfusion into the lung circulatory and induced renin–angiotensin–aldosterone system activation.40 On the other hand, cardiogenic shock, as an indicator of end-organ hypoperfusion due to cardiac dysfunction, significantly increased the risk of mortality in ACS patients.41 42

This study has several limitations. First, this study had a relatively small sample size and was only conducted in a single centre. Second, according to its retrospective design, it can lead to recall and selection bias. Third, due to the high amount of loss to follow-up, this scoring is limited to predicting only in-hospital mortality. Last, to better evaluate the association between PADMA Score and mortality in ACS patients, this scoring system still needs further validation by a multicentre cohort study with numerous participants and a longer duration of follow-up.

Conclusion

In conclusion, this study proudly presented the new scoring system to predict in-hospital mortality in ACS patients, PADMA Score, with several components including age, history of cerebrovascular disease, HR, SI and Killip class. This study revealed that the association between PADMA Score and in-hospital mortality was dose–response related. Moreover, this scoring system showed a good predictive value for predicting in-hospital mortality, which was comparable to the GRACE Score and superior to C-ACS and ProACS risk scores. Therefore, we highly suggest using the PADMA Score as a convenient scoring system for all ACS patients in an emergency setting to predict the risk of in-hospital mortality.

Data availability statement

Data are available upon reasonable request.

Ethics statements

Patient consent for publication

Ethics approval

This study involves human participants. This study was approved by the medical research ethics committee of Dr. Hasan Sadikin Central General Hospital, West Java, Indonesia. (ID: 25/UN6.C.5.14/PT/2022). Participants gave informed consent to participate in the study before taking part.

References

Footnotes

  • MP: conceptualisation, methodology, investigation, writing—original draft, writing—review & editing. TLB: conceptualisation, methodology, data curation, formal analysis, writing—original draft. AFY: methodology, data curation, formal analysis, writing—original draft. ICSP: methodology, formal analysis, investigation, writing—original draft. MP accepts full responsibility for the work, conduct of the study, had access to the data, and controlled the decision to publish. All co-authors contributed to the production of the manuscript.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.