Article Text

Download PDFPDF

Original research article
Prognostic value of routinely available data in patients with stable coronary heart disease. A 10-year follow-up of patients sampled at random times during their disease course
  1. Per Winkel1,
  2. Janus Christian Jakobsen1,2,
  3. Jørgen Hilden3,
  4. Gorm Jensen4,
  5. Erik Kjøller5,
  6. Ahmad Sajadieh6,
  7. Jens Kastrup7,
  8. Hans Jørn Kolmos8,
  9. Anders Larsson9,
  10. Johan Ärnlöv10,11 and
  11. Christian Gluud1
  1. 1 Copenhagen Trial Unit, Centre for Clinical Intervention Research, Rigshospitalet, Copenhagen University Hospital Blegdamsvej, Copenhagen, Denmark
  2. 2 Department of Cardiology, Holbæk Hospital, Holbæk, Denmark
  3. 3 Section of Biostatistics, Department of Public Health Research, University of Copenhagen, Copenhagen, Denmark
  4. 4 Department of Cardiology, Hvidovre Hospital, Copenhagen University Hospital, Copenhagen, Denmark
  5. 5 Department of Cardiology S, Herlev Hospital, Copenhagen University Hospital, Copenhagen, Denmark
  6. 6 Department of Cardiology, Bispebjerg Hospital, Copenhagen University Hospital, Copenhagen, Denmark
  7. 7 Department of Cardiology B, The Heart Centre, Rigshospitalet, Copenhagen University Hospital, Copenhagen, Denmark
  8. 8 Department of Clinical Microbiology, Odense University Hospital, Odense, Denmark
  9. 9 Department of Medical Sciences, Uppsala University, Uppsala, Sweden
  10. 10 School of Health and Social Studies, Dalarna University, Falun, Sweden
  11. 11 Division of Family Medicine and Primary Care, Department of Neurobiology, Care Science and Society, Karolinska Institutet, Huddinge, Sweden
  1. Correspondence to Dr Per Winkel; pwinkel{at}


Objective To characterise the long-term prognosis of patients with stable coronary artery heart disease by means of ‘standard predictors’ defined as demographic, clinical and biochemical quantities routinely available in general practices and ascertained at an interview not prompted by renewed cardiac complaints.

Methods This is an observational study based on data from 2199 Copenhagen placebo patients from the ‘clarithromycin for patients with stable coronary heart disease’ trial of patients with stable coronary heart disease. In the trial, we compared the effects of 14 days of clarithromycin treatment versus placebo. The predictors were based on the interview forms and blood samples collected at entry, along with demographic information from hospital files.

We studied ‘standard predictors’ of a composite outcome (myocardial infarction, unstable angina, cerebrovascular disease or all-cause death) and of all-cause death. Using Cox regression, we compared predictions of status at 3, 6 and 9 years without and with the use of ‘standard predictors’ and used receiver operating characteristic statistic.

Results Few ‘standard predictors’ were associated (p<0.01) with the composite outcome or with all-cause death. When no ‘standard predictors’ were included, 63.2% of the model-based predictions of the composite outcome and 79.9% of death predictions were correct. Including all ‘standard predictors’ in the model increased the figures to 68.4% and 83.4%, respectively. C indices were low, except when all-cause death was assessed as a single outcome where C was 0.79.

Conclusion ‘Standard predictors’ routinely available in general practices contribute only modestly to risk assessment in consecutively sampled patients with stable coronary heart disease as ascertained at a contact not prompted by renewed cardiac complaints. Novel biomarkers may improve the assessment.

Trial registration number NCT00121550.

  • cardiovascular disease
  • ischaemic heart disease
  • predictors
  • mortality.

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See:

Statistics from

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Key questions

What is already known about this subject?

  • Patients with stable coronary artery disease are at an increased risk of death or non-fatal cardiovascular incidents.

What does this study add?

  • New knowledge regarding the long-term impact of routinely measured, demographic, clinical and biochemical factors for the prediction of non-fatal cardiovascular incidents and all-cause death in patients with stable coronary heart disease ascertained at baseline review not prompted by renewed cardiac complaints.

  • Routinely measured, demographic, clinical and biochemical factors do show an expected association with long-term course, but the prognostic impact is weak. For useable prognostic differentiation, stronger clinical markers are needed.

How might this impact on clinical practice?

  • High-risk patients with stable coronary heart disease presenting in a general practice with non-cardiac complaints may be identified using ‘standard predictors’ and advanced biomarkers and referred to further examinations by specialist cardiologists.


It would be of great practical value if the long-term prognosis of patients with stable coronary heart disease could be assessed by the general practitioner at a random time during the patient’s disease course, that is, when the visit at the general practitioner is not prompted by acute symptoms or made during recovery from a major cardiovascular event. To be practically useful, the assessment should be based on information routinely available to the general practitioner. The term ‘stable coronary heart disease’ calls for a definition that is readily applied in general practice. In the ‘clarithromycin for patients with stable coronary heart disease’ (CLARICOR) trial,1 2 we have developed the operational definition described below, covering a common and important class of patients.

Our present objective, therefore, is to use the data from the CLARICOR trial to identify relevant prognostic quantities, readily available during clinical routine work, when a patient with stable coronary heart disease is seen by the practising physician for reasons other than renewed cardiac complaints. Such quantities may prove useful as a background for closer investigation of selected patients. The present analysis also serves as a background for a search for additional prognostic covariates which may be available in the biobank of the CLARICOR trial. A detailed account of methodology and statistical analysis was published before the analysis commenced.3



In the CLARICOR trial, 13 702 patients aged 18–85 years who had a discharge diagnosis of myocardial infarction or angina pectoris during 1993–1999 and were alive in August 1999 were invited by letter for a 14-day trial of clarithromycin versus placebo.1 2 Of the 13 702 patients, 6116 accepted the invitation. Of these, 177 refused to participate and 1567 were excluded while 4372 were randomised.

Baseline data were obtained from the hospital files and patient interviews at six cardiology clinics covering the Copenhagen area. Initial follow-up lasted for 2.6 years, during which outcomes were collected through hospital and death registries and assessed by an adjudication committee.2 Corresponding register data later showed to produce similar results.4 5 The adjudicated outcomes were therefore replaced and augmented by register outcomes to cover 10 years of follow-up. Biochemical data were obtained from analysis of serum from the CLARICOR biobank collected at randomisation and stored at −80°C.

The patients excluded from the trial were those who fulfilled the following conditions: (1) suffered from acute myocardial infarction or unstable angina pectoris within the previous 3 months; (2) had percutaneous transluminal coronary angioplasty and coronary bypass surgery within the previous 6 months; (3) with impaired renal, or (4) hepatic dysfunction, (5) congestive heart failure (New York Heart Association (NYHA) IV classification of heart failure), or (6) active malignancy; (7) without capacity to manage own affairs; and (8) without breast feeding or possible pregnancy.

The main results of the CLARICOR trial were that clarithromycin increased the risk of cardiovascular as well as all-cause death.1 6–8 Therefore, we here focus on the placebo group.


Data material collected from the 2199 placebo patients was covering the period until 31 December 2009, that is, 10 years (±3 months), and was obtained by use of public registers with almost 100% coverage,4 5 as explained in the Outcomes section and in refs 4–6.

Demographic and anamnestic data

Enrolment interviews provided smoking status, current medication and known hypertension or diabetes, while information concerning sex, age and history of myocardial infarction or unstable angina pectoris was obtained from the local hospital files.

Biochemical measurements on plasma collected at entry

Biochemical measurements on plasma collected at entry included lipoproteins,9 high-sensitivity C-reactive protein (hs-CRP/mg/L)10 and glomerular filtration rate (GFR/mL/min) using creatinine.11 Along with variables already mentioned, these quantities are those collectively referred to as ‘standard predictors’ and specified in table 1.

Table 1

The distributions of standard predictors in the placebo group and in the group of patients who received clarithromycin


We assessed the time from randomisation until the first occurrence of one of the following events: acute myocardial infarction, unstable angina pectoris, cerebrovascular disease and all-cause death (the composite outcome) and the time from randomisation to all-cause death. The algorithm used to get from the International Statistical Classification of Diseases used in the national registries12 13 to the events of the composite outcome is described in refs 4 5.


Statistical analysis

We used the Cox proportional hazards model supplemented by Breslow estimation of the baseline hazard and using SAS V.9.4 in agreement with our peer-reviewed, published statistical analysis plan.3 The model assumptions were tested using Bonferroni adjusted p values.3 14

There are virtually no missing data from entry information in the CLARICOR trial3 but 9.4% of the patients had one or more laboratory test values missing. We used Little’s test to decide whether to use multiple imputation or a complete case analysis.15

All analyses that included covariates were stratified by centre. For each covariate, we examined if it interacted significantly with sex (using a Bonferroni adjustment).

Inference analyses

If an HR showed a deviation from 1.00 such that p<0.01, we classified the variable as a prognostic predictor, given the outcome analysed and the other covariates included in the analysis. We identified the prognostic predictors among the ‘standard predictors’ for each of the two outcomes, the predictor being tested when used alone in a Cox regression analysis (except for age, see below) and when used in combination with the remaining ‘standard predictors’.3

Assessing the prognostic utility of the ‘standard predictors’

We used the Cox-Breslow method to estimate the survival curve of the outcome of each patient using all available information. From the curve, we read off the probabilities that the patient will be event free at time T=3, 6 and 9 years. If the probability is larger than or equal to 0.5, we make the favourable (F) prediction that the patient is still event free at time T; otherwise, we make the unfavourable (un-F) prediction that the patient experiences an event before T. The truth values of the predictions were determined by comparison with the observed records. To assess the role of the covariates in these predictions we repeated the procedure without introducing any covariates (the Cox output then reduces to a Kaplan-Meier curve). Here we used methods that do not allow time-dependent covariates, so in this case stratification on age was used (cutting at 60 and 75 years) and age was excluded as a covariate.16

We also analysed data using a parametric, accelerated failure time model. For the underlying time-to-event distribution type of the accelerated failure time model, we considered several choices using q-q graphs to assess the fit14 (p 100). The generalised gamma model gave a perfect fit for the composite outcome and a reasonable fit for all-cause mortality.

Using the events observed during the first 9 years of follow-up, the prognostic differentiation was characterised by receiver operating characteristics (ROC) and ‘predictive impact’ diagrams.17–19 The hazard estimation is based on the full 10-year follow-up of 1998 patients with complete covariate data but the ROC analysis is limited to what happened to them within the 9-year window.

The calculations involve a prognostic rule being applied to the same data sample from which it was derived. But model fit is assessable (see the ROC diagram).


As Little’s test15 had p=0.93, we used complete case analyses in the following.

Table 1 presents an overview of the covariates expected to be available from patients with stable cardiovascular disease during clinical routine work (‘standard predictors’). We have shown the corresponding data of the clarithromycin group to illustrate that the randomisation was successful. It appears that the results are consistent across the placebo group and the clarithromycin group. Figure 1 presents the Kaplan-Meier curves for the composite outcome (figure 1A) and all-cause death (figure 1B). At 2 years, 1826 (83.0%) had not yet suffered a composite outcome and 2073 (94.3%) were still alive. At 6 years, 1261 (57.3%) had not yet suffered a composite outcome and 1758 (79.9%) were still alive. At 9 years, the numbers are 969 (44.9%) and 1487 (67.6%), respectively. In the following we shall describe the differentiation of these risks offered by the covariates presented in table 1.

Figure 1

(A) Kaplan-Meier estimate (with 95% CI) of composite outcome including acute myocardial infarction, unstable angina pectoris, cerebrovascular disease, and all-cause death. Figures below the curve are biannual number at risk in the placebo group of the CLARICOR trial. (B) Kaplan-Meier estimate (with 95% CI) of the outcome all-cause death. Figures below the curve are biannual number at risk in the placebo group of the CLARICOR trial.

Testing the ‘standard predictors’

As the proportional hazards assumption was violated for age we included an interaction between age at entry and time (since randomisation) in the inference analyses.

Table 2 shows the HR of each of the ‘standard predictors’ when used alone in a Cox analysis (table 2, columns 2–4) and when used in combination with the rest of the ‘standard predictors’ for the composite outcome (table 2, columns 5–7). The main effect of age is only significant when no adjustment by the ‘standard predictors’ is used. By contrast, the interaction between age and time is significant with and without adjustment. Smoking habits, diabetes, most of the medication indicators, log (hs-CRP) and reduced GFR predict the risk of the composite outcome when used alone (the threshold of p<0.01). In the analysis that included all the ‘standard predictors’, smoking habits, diabetes, long-lasting nitrate medication, digoxin medication and GFR provided prognostic information.

Table 2

Composite outcome including acute myocardial infarction, unstable angina pectoris, cerebrovascular disease and all-cause death. HRs of standard predictors when used alone and when used in combination with the rest of the standard predictors

Table 3, whose structure is the same as that of table 2, shows the results for all-cause death. When each predictor is assessed alone, the results are much like those for the composite outcome. Smoking habits, diabetes, most of the medication indicators, log (hs-CRP) and reduced GFR predict the risk of all-cause death when used alone (p<0.01). When all ‘standard predictors’ are included, male sex now becomes also significantly unfavourable in association with smoking habits, diuretic medication, digoxin medication, log (hs-CRP) and reduced glomerular filtration rate. The biochemical lipid quantities were not prognostic.

Table 3

All-cause death. HRs of standard predictors when used alone and when used in combination with the rest of the standard predictors

For neither outcome did any standard predictor interact significantly with sex.

Prognostic impact of the ‘standard predictors’

Table 4 (columns 2–3) shows the types, numbers and percentages of correct predictions obtained when we used the Cox model and the composite outcome without covariates included (column 2) and when the ‘standard predictors’ (and age strata, see the Methods section) were included. The percentages are correct predictions over total number of predictions made (three per patient unless dropout, see footnote §, table 4). Without covariates included in the model, 63.2% of the predictions were correct. With ‘standard predictors’ included, 68.4% became correct, increasing the number of correct predictions by only 5.2%, and leaving 31.6% in error.

Table 4

The types and numbers of correct predictions obtained when the Cox proportional hazards model was used and when the accelerated failure model (using generalised gamma distribution) was used. For comparison, the results without covariates included are shown

For the all-cause death outcome (see table 4, lower half, left side), the corresponding percentages were 79.9%, 83.4%, 3.5% and 16.6%, respectively. So, it appears that the contributions of the individual’s own routine data (the ‘standard predictors’) to the predictions are rather modest.

Table 4 (columns 4 and 5) shows the corresponding results obtained when we used the accelerated failure time model. These results are very similar to those obtained using the Cox model.

Table 5 shows the C indices for the composite outcome and its components, describing concordance as to whether patients were to experience the event in question (within the 9-year window). The underlying ROC curve is given in figure 2Afor all-cause death. The empirical curve (dashed) shows that the 644 deaths and 1354 survivals closely fit the predicted pattern (smooth curve).

Table 5

Receiver operating characteristic (ROC) areas (C indices) of placebo patients with complete records (n=1998). Nine-year risks assigned by the Cox analysis using all standard predictors

Figure 2

(A) ROC diagram (death vs survival at 9 year data). (B) Predicted imapct curves. ROC, receiver operating characteristic.

Figure 2Bholds a ‘predictive impact’ graph, designed to compare the predictive power of rival prognostic rules. The diagram estimates the benefit that might accrue by treating high-risk patients if a completely effective preventive intervention existed. The patients are ordered according to assigned risk (just as in the ROC). As a function of the percentage imagined to be selected for treatment (abscissa), the ordinate shows how many deaths (dashed) and life-years (fat curve) would be saved. Within the 9-year window, the 644 deaths will cause 2703 years to be lost without treatment. From the graph it may be read that if 10% of the patients were to be treated with a 100% effective intervention, 29% of the total loss of years may be saved.


In this study, we assessed the predictive value of ‘standard predictors’ routinely available for a general practitioner when he/she meets a patient with stable coronary heart disease whose visit is not prompted by renewed cardiac complaints. When no ‘standard predictors’ were included in the prediction, 63.2% of the model-based predictions of the composite outcome and 79.9% of all-cause death predictions were correct. Including all ‘standard predictors’ in the model increased the figures to 68.4% and 83.4%, respectively.

We have not been able to identify a study where death of all causes and cardiovascular insults have been assessed in patients with (1) stable coronary heart disease of a type like the above described, (2) with a 10-year follow-up, and (3) where the clinical examination was not prompted by renewed cardiovascular complaints. Taken together, most of the studies we identified were either analysing small study samples, for example,20 were developed in patients with acute coronary syndromes,21 or had short follow-up.22

In many respects, our patients are like those of the Prospective Observational Longitudinal Registry of Patients with Stable Coronary Heart Disease (CLARIFY) study23 which enrolled 20 291 patients of whom 20% had anginal symptoms corresponding to the 20% of our patients who took long-lasting nitrates. Patients with hospital admission for cardiovascular reasons (including revasculariation) in the past 3 months before enrolment or conditions interfering with life expectancy such as cancer and NYHA class 4 were excluded. So, in these respects, the CLARIFY patients are like our patients. However, the CLARIFY patients had been observed with a median of 24.1 months and enrolment took place 10 years later than in the CLARICOR trial. A total of 469 cardiovascular deaths or myocardial infarctions occurred in these patients (2.3%).23 By contrast, in our cohort the corresponding numbers found during the first 2 years of observation were 170 cardiovascular deaths and 7.7%, respectively, probably reflecting improved quality of treatment and more frequent statin treatment in the CLARIFY patients (84% vs only 41% in the CLARICOR patients).

Many of our ‘standard predictors’ showed that they contained statistically significant prognostic information. However, few of the ‘standard predictors’ contributed statistically significant prognostic information when all predictors were tested simultaneously. Moreover, the ‘standard predictors’ offered little prognostic discrimination.


Regarding our methodology, the performance statistics reported here are minimal, but they suffice to show that the results are meagre, leaving room for improvement with advanced biomarkers.3 Prediction at 3, 6 and 9 years covers the follow-up as well as would a sophisticated integral over continuous time. Using 0.50 as a probability threshold is again a least arbitrary choice (the relative impact of false and true predictions being unknown), as is the ROC principle. Adding realism to the naked construct of a ‘completely effective preventive intervention’ (figure 2B) would again be subject to criticism in the absence of alternatives, with solid empirical backing.


The strengths of the CLARICOR trial are the considerable size of the patient population, the long duration of follow-up, few losses to follow-up (0.5%), the ethnic homogeneity of the patient population, rarity of missing values, with focus on an operationally defined, homogeneous and relevant patient category. The design implies that the patients are sampled at random, presumably uneventful, time points during their stable state (as defined by the CLARICOR trial). Furthermore, the large biobank formed during the trial allows an extensive search for new advanced biomarkers to be made.


Among those 7586 patients who declined our invitation to visit a cardiology centre, many must have been eligible for the CLARICOR trial, and we do not know how they looked and fared. With a response rate of about 50%, the cohort could represent a prognostic elite if responders were mostly mobile and health-conscious patients. So, selection bias cannot be excluded.

Furthermore, the patients recruited for the CLARICOR trial were diagnosed with coronary heart disease about 20 years ago. Because of the tremendous developments in treatment and rehabilitation, there has been a very significant and graded increase in prognosis of such patients,24 as shown in national data.25 Given these uncertainties, prognostic findings in the CLARICOR cohort should not directly be applied to present-day patient materials. However, the overall picture regarding the relative predictive effect of ‘standard predictors’ and advanced biomarkers should provide relevant and valuable information.

Potential weaknesses of the present cohort within the context of prognostication of patients with stable coronary heart disease as here defined include the lack of information about left ventricle function, body mass index and blood pressure, as well as the effects of changes in medications during follow-up. Information about postinfarction heart failure and postinfarction angina pectoris was not available to us. But information about the medication at entry into CLARICOR served as proxy information. The lack of left ventricular ejection fraction may be partially or completely compensated, as Solomon et al 26 found that age, sex, hypertension, prior acute myocardial infarction, creatinine, diuretics and digoxin were related to left ventricular ejection fraction, all quantities that we have included within the group referred to as ‘standard predictors’. The shortcomings of our data files are mitigated by the fact that by design the present study focuses on the situation where patients with stable coronary heart disease visit a physician for reasons unrelated to the coronary heart disease. Here it might be of value if simple clinical information readily available could be used to screen these patients with stable coronary heart disease to identify high-risk patients who might be referred to a more thorough cardiologic examination and follow-up.

It was our hope that the simple ‘standard predictors’ of table 1 might serve this purpose, but they proved too little informative. Behind this disappointing feature lie undoubtedly a meshwork of behavioural and statistical interconnections that are impossible to unravel. A reviewer has pointed out that ‘index event’ phenomena27–29 may also be involved. Briefly, to develop an index event (say, infarction), those with a given low-risk trait tend to have unrecorded high-risk traits, and vice versa, so, to the extent that risk traits are permanent, high-low follow-up comparisons will be biased when based on such patients. While this is true, there is no prognostic bias here as the index event is part of the definition of the population of interest.

Furthermore, patients, if any, who became eligible for the CLARICOR trial during the period 1993–1999 and then died before August 1999, are absent. Thus, our data do not represent patients as they enter a stable disease state (as delimited by CLARICOR exclusion criteria); instead, they may be regarded as community patients (subject to some self-selection) seen by their physician on a random date during their stable state.

Our model was tested using the same data that were used to derive it. Therefore, we do not feel it is advisable to use the results for predictive purposes without using some independent data to calibrate the model, and for this and the above-mentioned reasons we have elected not to present an explicit prediction model.


We thank the CLARICOR trial participants. We thank the investigators and other staff involved in the first phases of the CLARICOR trial (for full list of names, please see references 6, 11, and 13. We also thank our original funders of the CLARICOR trial (see references 6, 11, and 13). The Copenhagen Trial Unit, Centre for Clinical Intervention Research, is thanked for providing monetary support for part of the biochemical analyses for the PREMAC study as well as wages for Per Winkel, Janus C. Jacobsen, and Christian Gluud.


  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.


  • Contributors PW, JH, JCJ and CG contributed substantially to the concept and design and drafted the manuscript. PW and JH conducted the statistical analyses. AL and JÄ conducted the analysis of lipids and creatinine. All authors revised the manuscript critically for important intellectual content, gave final approval of the version to be published, and agreed to be accountable for all aspects of the work in assuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

  • Funding This study was funded by the Copenhagen Trial Unit, Centre for Clinical Intervention Research; original funders of the CLARICOR trial; and the Swedish Research Council, Swedish Heart-Lung Foundation; Thuréus Foundation; Marianne and Marcus Wallenberg Foundation, Dalarna University; and Uppsala University.

  • Competing interests None declared.

  • Patient consent Not required.

  • Ethics approval Danish Ethics Committee.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data statement All pertinent anonymised data will be uploaded at ZENODO ( when the individual manuscripts have been published.