Discussion
This systematic review identified seven observational studies that have provided estimates of IE diagnostic rates before-and-after changes to national guideline recommendations.16–22 The quality of the studies was variable but generally insufficient to resolve uncertainty about how these changes have affected rates of incident IE; one of the studies reporting a small rate increase, whereas the others reporting no significant change compared to the period antedating guideline changes. It is unlikely that further observational studies of incident IE before-and-after guideline changes will be helpful in resolving this uncertainty.
Population studies of sufficient quality to provide confident estimates of how antibiotic prophylaxis affects rates of incident IE have proved hard to prosecute. The relative rarity of IE demands huge populations to generate sufficient cases. Only an estimated 35–45% of such cases, however, are due to oral streptococcal infection and of these only a proportion, perhaps half, are likely to result from invasive dental procedures making them potentially preventable by antibiotic prophylaxis. Add to this the increasing prevalence of staphylococcal endocarditis in recent years and it is clear that studies of almost unprecedented scale would be required to confidently identify changes in rates of incident IE in response to the antibiotic guideline changes. Whether any of the studies included in this review were sufficiently large enough to answer this question, therefore, is questionable. Numbers were large in four studies from the UK and USA, but the registry sources in these studies are potentially subject to under-reporting and coding inconsistencies either of which may have distorted incidence estimates and trends over time.23 The remaining studies were considerably smaller and although diagnostic ascertainment was a strength in two of them, the limited number of cases inevitably undermines confidence in the incidence analyses. In many of the studies, patient selection by age, hospital type or geographic area questions their generalisability, and in all of them, incidence estimates are undermined by the unavailability of risk factor data and other confounders. Thus, while incidence estimates were adjusted for age and sex in three studies plus ethnicity in one and the size of the denominator population in another, none was able to adjust for population risk factors such as structural cardiac disorders, implanted intravascular devices, diabetes and immunosuppression. This has major potential to distort the calculated IE incidence trends given the relative rarity of IE and the increasing numbers of people at risk in western populations through aortic valve disease, adult congenital heart disease and immunodepressive disorders.24 ,25
In assessing the impact of guideline changes on incidence of IE, it should be recognised that the US and European guidelines10 ,11 continued to advise antibiotic prophylaxis for very high-risk patients (prosthetic heart valves or prior endocarditis), unlike the UK's NICE guideline which was more radical in ruling out the need for antibiotic prophylaxis across all patient groups.12 It is instructive, therefore, to focus on the two studies from the UK because the impact of the 2008 guideline change was potentially greatest here.16 ,20 Despite similarities between the studies in terms of their national perspective, patient identification and data analysis, only the more recent study by Dayer et al,20 with three additional years of follow-up, found a small but significant increase in the incidence of IE above the projected historical trend following the NICE guideline change. This was associated with a sharp 90% reduction in antibiotic prescriptions. There is no clear explanation for the disparate findings of the two UK studies but the Dayer paper has been criticised for including 2007 data in the postguideline analysis even though the guideline was not introduced until October that year.26 Moreover, a recent critique of the Dayer study in the NICE clinical guideline update concluded that the study, in particular the change in slope of the IE incidence curve, was at high risk of bias.27 Certainly, as the editorialist emphasised,28 the temporal association between reduced antibiotic prescriptions and increased rates of IE reported by Dayer et al20 do not prove causality, not least because there was no adjustment for temporal changes in major risk factors for IE, including age, in the annual incidence calculations.
Although the studies included in this review sought to determine how guideline-recommended changes in antibiotic prophylaxis have affected incident IE, only the two UK studies reported prescription data. Without prescription data, it is simply not possible to determine whether temporal changes in incident IE have been influenced by changes in antibiotic prophylaxis called for in guidelines. For the two UK studies, it must be recognised that prescription data were not linked to the health records which, coupled with the unadjusted incidence calculations, makes it impossible to determine whether the sharp reduction in prescriptions following the 2009 NICE guideline was causally related to changes in incident IE. The monitored prescriptions for a single 3 g dose of oral amoxicillin (or a 600 mg dose of oral clindamycin for patients allergic to penicillin) account for the large bulk of prophylactic treatment in patients undergoing dental work and are targeted against streptococcal infection. Logically, therefore, any change consequent to the guideline recommendations should be confined largely to streptococcal IE. It was a limitation of the Dayer study20 that the infective organism was not available to the investigators and we do not know, therefore, if the small increase in the recorded incidence of IE after 2008 was driven by increases in streptococcal IE. The earlier UK study, however, found no apparent change in the upward trend of streptococcal IE after 2008, although the recording of infective organisms was incomplete and captured streptococcal infection generically without specification of the viridans species.16 Nevertheless, the French study, the smaller Olmstead County study and the US Children's study17 ,19 ,21 also reported no increases in cases of streptococcal infection after the guideline changes. Only the large US study by Pant et al22 reported an increase in streptococcal IE hospitalisation rates although overall trends in IE hospitalisations from 2000 to 2007 and from 2008 to 2011 were not significantly different.
The sharp fall in UK prophylactic antibiotic prescriptions in 2008 reflects a level of adherence to the guideline changes. This is consistent with the results of a survey in which 87% of UK dentists reported adherence to the NICE guidance, although 35% admitted administering antibiotic prophylaxis after the guideline change. Among cardiologists and cardiothoracic surgeons, only 61% reported adherence.29 A more contemporary US survey of paediatric cardiologists found that more than half of the participants (56%) do not follow current antibiotic prophylaxis guidelines.30 This variable, often low level of adherence, further limits the ability of the studies included in this review to provide reliable estimates of the impact of guideline changes on the incidence of IE.
Since this systematic review was completed, at least two further studies have been published aimed at determining the impact of antibiotic prophylaxis guideline changes on the incidence of IE.31 ,32 Similar limitations to those discussed in this review applied to both studies, one of which reported no impact of the guideline31 and the other a negative impact reflected in a significant increase in streptococci-related IE cases.32
Concerns that international guideline changes to recommendations for antibiotic prophylaxis in at-risk patients might lead to an increase in rates of IE have not been resolved by the observational studies included in this systematic review. The heterogeneity of the studies makes robust conclusions impossible particularly given their variable methodological limitations, including study size, duration of follow-up, diagnostic ascertainment, uncertainty about guideline adherence, and absence of relevant prescription and bacteriological data. Many of the studies suggested an upward trend in incident IE not obviously associated with the guideline changes and there is a clear need for onward monitoring. However, further before-and-after observational studies of the type included in this review will not be helpful in determining the impact of the antibiotic prophylaxis guideline changes without detailed clinical phenotyping of unselected registry populations at scale, with linked prescribing and bacteriological data.