Hostname: page-component-745bb68f8f-b95js Total loading time: 0 Render date: 2025-02-11T13:27:05.785Z Has data issue: false hasContentIssue false

The long-term risk of recognized and unrecognized myocardial infarction for depression in older men

Published online by Cambridge University Press:  21 March 2016

O. Jovanova
Affiliation:
Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
A. I. Luik
Affiliation:
Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
M. J. G. Leening
Affiliation:
Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands Department of Cardiology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
R. Noordam
Affiliation:
Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands Department of Internal Medicine, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
N. Aarts
Affiliation:
Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands Department of Internal Medicine, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
A. Hofman
Affiliation:
Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
O. H. Franco
Affiliation:
Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
A. Dehghan
Affiliation:
Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
H. Tiemeier*
Affiliation:
Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands Department of Child and Adolescent Psychiatry, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands Department of Psychiatry, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
*
*Address for correspondence: H. Tiemeier, MD, PhD, Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, P.O. Box 2040, 3000 CA Rotterdam, The Netherlands. (Email: h.tiemeier@erasmusmc.nl)
Rights & Permissions [Opens in a new window]

Abstract

Background

The association between myocardial infarction (MI) and depression is well described. Yet, the underlying mechanisms are unclear and the contribution of psychological factors is uncertain. We aimed to determine the risk of recognized (RMI) and unrecognized (UMI) myocardial infections on depression, as both have a similar impact on cardiovascular health but differ in psychological epiphenomena.

Method

Participants of the Rotterdam Study, 1823 men aged ⩾55 years, were followed for the occurrence of depression. RMI and UMI were ascertained using electrocardiography and medical history at baseline. We determined the strength of the association of RMI and UMI with mortality, and we studied the relationship of RMI and UMI with depressive symptoms and the occurrence of major depression.

Results

The risk of mortality was similar in men with RMI [adjusted hazard ratio (aHR) 1.71, 95% confidence interval (CI) 1.45–2.03] and UMI (aHR 1.58, 95% CI 1.27–1.97). Men with RMI had on average [unstandardized regression coefficient (B) 1.14, 95% CI 0.07–2.21] higher scores for depressive symptoms. By contrast, we found no clear association between UMI and depressive symptoms (B 0.55, 95% CI −0.51 to 1.62) in men. Analysis including occurrence of major depression as the outcome were consistent with the pattern of association.

Conclusion

The discrepant association of RMI and UMI with mortality compared to depression suggests that the psychological burden of having experienced an MI contributes to the long-term risk of depression.

Type
Original Articles
Copyright
Copyright © Cambridge University Press 2016 

Introduction

The increased occurrence of depression after myocardial infarction (MI) is well-recognized in clinical practice (Frasure-Smith et al. Reference Frasure-Smith, Lesperance and Talajic1993; Denollet et al. Reference Denollet, Strik, Lousberg and Honig2006; Park et al. Reference Park, Park, Kwak and Sung2012). In those that experienced MI, the prevalence of depression exceeds 30% (Frasure-Smith et al. Reference Frasure-Smith, Lesperance and Talajic1993; Lesperance & Frasure-Smith, Reference Lesperance and Frasure-Smith2000). Several biological and pathophysiological pathways including inflammation and endothelial dysfunction might link MI and depression (Tiemeier et al. Reference Tiemeier, Hofman, van Tuijl, Kiliaan, Meijer and Breteler2003; Harrison et al. Reference Harrison, Cooper, Voon, Miles and Critchley2013), but post-MI depression could also occur as a result of illness perception. Alterations in mood can be part of the coping process after surviving a cardiac event, treatment and recovery (Lesperance & Frasure-Smith, Reference Lesperance and Frasure-Smith2000).

MI is traditionally described as a clinical syndrome characterized with precordial discomfort and pain. Nevertheless, a substantial proportion of MIs are not clinically recognized by patients or treating physicians (Stokes & Dawber, Reference Stokes and Dawber1959; de Torbal et al. Reference de Torbal, Boersma, Kors, van Herpen, Deckers, van der Kuip, Stricker, Hofman and Witteman2006; Leening et al. Reference Leening, Kavousi, Heeringa, van Rooij, Verkroost-van Heemst, Deckers, Mattace-Raso, Ziere, Hofman, Stricker and Witteman2012). The available epidemiological, clinical and basic science evidence provides support for a similar ischaemic pathology underlying both recognized (RMI) and unrecognized (UMI) myocardial infarctions (Cabin & Roberts, Reference Cabin and Roberts1982; Kannel & Abbott, Reference Kannel and Abbott1984; Barsky et al. Reference Barsky, Hochstrasser, Coles, Zisfein, O'Donnell and Eagle1990; Kumar et al. Reference Kumar, Abbas and Aster2012; Schelbert et al. Reference Schelbert, Cao, Sigurdsson, Aspelund, Kellman, Aletras, Dyke, Thorgeirsson, Eiriksdottir, Launer, Gudnason, Harris and Arai2012). Many studies demonstrated that UMI has a similar long-term impact on physical health as RMI. In men, and to a lesser extent in women, both RMI and UMI are associated with increased risk of all-cause mortality, heart failure and sudden death (Schelbert et al. Reference Schelbert, Cao, Sigurdsson, Aspelund, Kellman, Aletras, Dyke, Thorgeirsson, Eiriksdottir, Launer, Gudnason, Harris and Arai2012; Dehghan et al. Reference Dehghan, Leening, Solouki, Boersma, Deckers, van Herpen, Heeringa, Hofman, Kors, Franco, Ikram and Witteman2014). In the Rotterdam Study, men with UMI were also at increased risk for dementia, stroke and cerebral small vessel diseases (Ikram et al. Reference Ikram, Hollander, Bos, Kors, Koudstaal, Hofman, Witteman and Breteler2006, Reference Ikram, van Oijen, de Jong, Kors, Koudstaal, Hofman, Witteman and Breteler2008; Leening et al. Reference Leening, Elias-Smale, Felix, Kors, Deckers, Hofman, Stricker and Witteman2010; Krijthe et al. Reference Krijthe, Leening, Heeringa, Kors, Hofman, Franco, Witteman and Stricker2013).

Whether there is a common mechanism that engenders RMI and clinically UMI  remains controversial (Barsky et al. Reference Barsky, Hochstrasser, Coles, Zisfein, O'Donnell and Eagle1990). One theory suggests that the cardiac-pain mechanism is the main reason for the difference in the perception of the discomfort (Sheifer et al. Reference Sheifer, Manolio and Gersh2001). A second theory suggests that various humoral and neurological factors together determine whether the symptoms arise from myocardial ischaemia (Cohn et al. Reference Cohn, Fox and Daly2003). Third, despite similar pathophysiology the size, location or duration of the myocardial ischaemia could explain the absence of pain in UMI (Cabin & Roberts, Reference Cabin and Roberts1982; Cohn et al. Reference Cohn, Fox and Daly2003; Schelbert et al. Reference Schelbert, Cao, Sigurdsson, Aspelund, Kellman, Aletras, Dyke, Thorgeirsson, Eiriksdottir, Launer, Gudnason, Harris and Arai2012). There is a lack of empirical evidence to supporting any of the above theories and the reported long-term impacts of UMI on physical health suggests that differences in size and duration of ischaemia are unlikely explanations. Finally, psychological factors regarding the recognition and willingness of the patient to seek medical attention have been discussed (Barsky et al. Reference Barsky, Hochstrasser, Coles, Zisfein, O'Donnell and Eagle1990).

To test the impact of RMI and UMI in the present study population, we first compared the association of RMI and UMI with mortality in men and women (note, mortality has been studied in a slightly different sample of the Rotterdam Study previously; Dehghan et al. Reference Dehghan, Leening, Solouki, Boersma, Deckers, van Herpen, Heeringa, Hofman, Kors, Franco, Ikram and Witteman2014). By definition, the awareness of having survived a life-threatening health event is absent in persons with UMI. This characteristic of UMI provides us with the opportunity to explore the potential role of psychological mechanisms underlying the relationship between MI and depression, but only if the long-term impact can be established and if depression can be assessed independently of help-seeking behaviour. In this case our approach provides us with the unique opportunity to disentangle the pathophysiological from the psychological mechanisms in the association between MI and depression.

The main aim of our study was to determine the relationship of RMI and UMI with depression in older persons. If MI would cause depression mainly due to psychological mechanisms, we would expect that individuals, who are unaware of having had an MI, are not at risk of developing depression. Indeed we hypothesized that RMI but not UMI is associated with an increased risk of depression.

Method

The study was part of the Rotterdam Study, a population-based cohort designed to study the occurrence and determinants of diseases (Hofman et al. Reference Hofman, Darwish Murad, van Duijn, Franco, Goedegebure, Ikram, Klaver, Nijsten, Peeters, Stricker, Tiemeier, Uitterlinden and Vernooij2013). In 1990, all residents aged ⩾55 years of Ommoord, a district in Rotterdam, The Netherlands, were invited to participate. Informed consent to retrieve information from treating physicians was obtained from all participants. The medical ethics committee approved the study according to the Wet Bevolkingsonderzoek-Population Study Act executed by the Ministry of Health, The Netherlands.

In the Rotterdam Study, four examination rounds took place. In each round, participants underwent home interviews and subsequent physical examinations at the research centre. During the second examination (1993–1995), 4940 persons were interviewed for depressive symptoms. This round constituted the baseline for the current study (Luijendijk et al. Reference Luijendijk, van den Berg, Dekker, van Tuijl, Otte, Smit, Hofman, Stricker and Tiemeier2008). We excluded 461 persons without electrocardiography, due to technical problems, or lack of personnel to operate the electrocardiography device. Another 23 persons were excluded because they withdrew informed consent. We excluded persons with a Mini Mental State Examination (MMSE) score of ⩽26 at baseline (n = 287) (Folstein et al. Reference Folstein, Folstein and McHugh1975), no valid information on the MMSE (n = 129), and bipolar disorder (n = 3). In total, 4037 participants were eligible with a valid electrocardiography and evaluation of depressive symptoms. These participants were followed from baseline to occurrence of major depression (MDD), death, loss to follow-up, or the end of the study (1 January 2010).

History of MI

MI status was assessed as described in detail previously (Leening et al. Reference Leening, Kavousi, Heeringa, van Rooij, Verkroost-van Heemst, Deckers, Mattace-Raso, Ziere, Hofman, Stricker and Witteman2012). In short, at the research centre visit, a 10-s 12-lead electrocardiogram was recorded using an ACTA Gnosis IV electrocardiography recorder (Esaote Biomedica, Italy) at a sampling frequency of 500 Hz and scored digitally.

Electrocardiograms were processed by the Modular Electrocardiogram Analysis System (MEANS; http://www.telelab.nl/doc/kors_ane09.pdf) to obtain electrocardiogram measurement and interpretation (van Bemmel et al. Reference van Bemmel, Kors and van Herpen1990). Two research doctors blinded for other clinical information validated the electrocardiograms selected by MEANS. The diagnosis of MI using MEANS is mainly driven by pathological Q waves and auxiliary criteria, such as QR ratio and R-wave progression. ST-T changes were not considered as criteria for MI by MEANS, but were taken into account by the clinicians validating and ascertaining the diagnosis of MI. A senior cardiologist, ascertained the final diagnosis of MI. Assessment of clinically RMI was done as reported previously (Leening et al. Reference Leening, Kavousi, Heeringa, van Rooij, Verkroost-van Heemst, Deckers, Mattace-Raso, Ziere, Hofman, Stricker and Witteman2012). A history of RMI was defined by self-reported MI confirmed by clinical data (GP records, and Nationwide Medical Registry), and confirmed or not confirmed with electrocardiogram characteristics matching MI (Leening et al. Reference Leening, Kavousi, Heeringa, van Rooij, Verkroost-van Heemst, Deckers, Mattace-Raso, Ziere, Hofman, Stricker and Witteman2012). A history of UMI included all participants without documentation or self-reported MI, but with electrocardiogram characteristics matching MI (Leening et al. Reference Leening, Kavousi, Heeringa, van Rooij, Verkroost-van Heemst, Deckers, Mattace-Raso, Ziere, Hofman, Stricker and Witteman2012). All UMIs were therefore Q-wave MIs. Persons without indication of MI on electrocardiography and no medical documentation of an earlier MI constituted the reference group (Leening et al. Reference Leening, Kavousi, Heeringa, van Rooij, Verkroost-van Heemst, Deckers, Mattace-Raso, Ziere, Hofman, Stricker and Witteman2012).

Vital status

The information on vital status is collected continuously, on a weekly basis from the Central Register of Population of Rotterdam. The follow-up for mortality started from the assessment of depression until loss to follow-up or 5 September 2013 (mean follow-up 13.9 years) (Leening et al. Reference Leening, Kavousi, Heeringa, van Rooij, Verkroost-van Heemst, Deckers, Mattace-Raso, Ziere, Hofman, Stricker and Witteman2012; Dehghan et al. Reference Dehghan, Leening, Solouki, Boersma, Deckers, van Herpen, Heeringa, Hofman, Kors, Franco, Ikram and Witteman2014).

Depression

At baseline, all participants were screened for depression with the validated Dutch versions of the Centre for Epidemiologic Studies Depression (CES-D) scale (Beekman et al. Reference Beekman, Deeg, Van Limbeek, Braam, De Vries and Van Tilburg1997), or the Hospital Anxiety and Depression Scale (HADS-D; Bjelland et al. Reference Bjelland, Dahl, Haug and Neckelmann2002). The reliability of these questionnaires was tested formally: Cronbach alphas were 0.82 and 0.83, respectively. The CES-D consists of 20 items related to assess depressive symptoms. All symptoms were self-rated on a 0–3 scale, dependent upon the frequency of the experienced symptom (Breslau, Reference Breslau1985). Participants could score from 0 up to 60. The HADS-D consists of seven items measuring depressive symptoms. Again, participants rated the symptoms on a 0–3 scale. Standardized z score of the CES-D and HADS-D scores at baseline was used to control for the severity of depressive symptoms and adjust for pre-existing depressive symptoms.

During first and second follow-up assessments (at the examination rounds in 1997–1999 and 2002–2004) the CES-D Scale was used to determine depressive symptoms.

From 1993 to 2010, participants were followed for the occurrence of MDD, which was determined from two sources of information as described previously (Luijendijk et al. Reference Luijendijk, van den Berg, Dekker, van Tuijl, Otte, Smit, Hofman, Stricker and Tiemeier2008). At follow-up examinations all participants who scored ⩾16 on the CES-D scale (Beekman et al. Reference Beekman, Deeg, Van Limbeek, Braam, De Vries and Van Tilburg1997), were invited to the research centre for a semi-structured clinical interview to diagnose depressive disorders. A trained clinician diagnosed depression according to the Diagnostic and Statistical Manual of Mental Disorders, 4th revised edition (DSM-IV) by using the Dutch version of the Schedules for Clinical Assessment in Neuropsychiatry (SCAN; Piyavhatkul et al. Reference Piyavhatkul, Krisanaprakornkit, Paholpak and Khiewyou2008). Second, medical records of general practitioners were continuously monitored for occurrence of an episode of MDD from baseline onward (mean follow-up 12.5 years). Considering the information about possible MDD provided by the psychiatric interviews and medical records, we defined the occurrence of MDD episodes as the first event that chronologically occurred in one of the two data sources (note, all record retrievals were blinded for prior episodes). The occurrences inferred from the different data sources were consistent (Luijendijk et al. Reference Luijendijk, van den Berg, Dekker, van Tuijl, Otte, Smit, Hofman, Stricker and Tiemeier2008). However, one assessment (SCAN) was repeatedly cross-sectional and the other assessment reflects continuous monitoring, thus such comparison must be interpreted carefully to account for the different assessment methods.

Covariates

Potential confounders were selected on the basis of prior knowledge (Frasure-Smith et al. Reference Frasure-Smith, Lesperance and Talajic1993; Denollet et al. Reference Denollet, Strik, Lousberg and Honig2006). Marital status, education, smoking, and alcohol use were assessed at baseline during the home interview. Education was classified as low, intermediate, or high. Participants were classified as never married or divorced, married, and widowed. Smoking habits were classified as never, past, or current smoker and, similarly, alcohol consumption was classified as never, past, or current consumer. The MMSE was used to measure cognitive performance (Folstein et al. Reference Folstein, Folstein and McHugh1975).

Blood pressure was measured twice in the sitting position at the right upper arm with a random-zero sphygmomanometer. The average of these consecutive measurements was calculated. Diabetes was considered present if fasting plasma glucose was ⩾7.0 mmol/l, non-fasting glucose or an oral glucose tolerance test result of ⩾11.1 mmol/l, or if the participant used blood glucose-lowering medication (Dehghan et al. Reference Dehghan, Kardys, de Maat, Uitterlinden, Sijbrands, Bootsma, Stijnen, Hofman, Schram and Witteman2007). A history of stroke was defined as a self-reported stroke verified by medical records (Wieberdink et al. Reference Wieberdink, Ikram, Hofman, Koudstaal and Breteler2012). Height and weight were measured without heavy clothing to calculate body mass index (BMI).

Data analysis

First, we determined the relative mortality risk of participants with RMI and UMI using Cox proportional hazard regression analyses. These analyses were adjusted for age, level of education, smoking status, alcohol consumption, history of stroke, diabetes, systolic blood pressure, and baseline depressive symptoms. Results of previous studies suggested sex difference in the prognosis of RMI and UMI (Dehghan et al. Reference Dehghan, Leening, Solouki, Boersma, Deckers, van Herpen, Heeringa, Hofman, Kors, Franco, Ikram and Witteman2014). Moreover, the interaction term of history of MI with sex and mortality was statistically significant (p < 0.05). Therefore we stratified all analyses by sex.

Second, we studied whether RMI and UMI are associated with depressive symptoms with linear regression. The models were adjusted for baseline depressive symptoms in order to correct for pre-existing depression. The Generalized Estimating Equation (GEE) approach was used to estimate the pooled effect of RMI and UMI on repeatedly assessed depressive symptoms. The interaction term of history of MI with sex and depressive symptoms was statistically significant (p < 0.05).

All analyses related to the association between RMI/UMI and depressive symptoms were tested using two models. The first model was adjusted for age and baseline depressive symptoms. The second model was additionally adjusted for level of education, marital status, smoking status, alcohol consumption, BMI, history of stroke, diabetes mellitus, and systolic blood pressure.

Third, we assessed the association between RMI/UMI and MDD using Cox proportional hazard regression analyses. These analyses included two models with the same covariates in those testing depressive symptoms described above. The Breslow Generalized Wilcoxon test was used to compare the hazard curves of RMI and UMI.

Multiple imputations were used in order to account for missing data on potential confounding variables. Smoking status was missing in 2.9%, marital status in 16.9%, BMI in 3.5%, alcohol consumption in 1.4%, systolic blood pressure in 1.5%, and education in 0.3% of the participants. All analyses were rerun in the complete case and five imputed datasets. In this paper we present the data on the imputed data. All analyses were performed using IBM SPSS Statistics v. 21 (IBM Corp., USA).

Results

Baseline characteristics of 4037 participants are presented in Table 1. The mean age of men was 68.1 years (s.d. = 6.9) and women were on average 68.5 years (s.d. = 7.7). Of the men, 12.3% (n = 220) had a RMI, 6.3% (n = 115) an UMI and 81.4% (n = 1488) had no evidence of a MI. Of the women, 2.4% (n = 53) had had a RMI, 4.7% (n = 104) had had an UMI and 92.9% (n = 2057) were free of MI. In total, 273 persons had a RMI, of these 138 had electrocardiographic evidence of MI. The remaining 135 RMI cases were identified by clinical records and therefore represent non-Q-wave MIs.

Table 1. Baseline characteristics of the study population (N = 4037)

RMI, Recognized myocardial infarction; UMI, unrecognized myocardial infarction; MMSE, Mini Mental State Examination; BMI, body mass index; CABG, coronary artery bypass graft; PCI, percutaneous coronary intervention.

Table presents complete data, missing values are not imputed here.

a Centre for Epidemiologic Studies Depression Scale/Hospital Anxiety and Depression Scale z score.

First, we assessed the mortality risk of RMI and UMI (Table 2). In men, the average follow-up was 13.1 years (23 846 person-years) during which 943 men died. RMI and UMI were associated with an increased risk of mortality: RMI [hazard ratio (HR) 1.71, 95% confidence interval (CI) 1.45–2.03]; UMI (HR 1.58, 95% CI 1.27–1.97). In women, the average follow-up was 13.9 years (32 438 person-years) during which time 825 women died. Women with RMI (N = 53) had a higher mortality risk (HR 1.81, 95% CI 1.33–2.46). However, there was no association between UMI (N = 104) and mortality risk in women (HR 0.99, 95% CI 0.77–1.30).

Table 2. Recognized (RMI) and unrecognized (UMI) myocardial infarction and all-cause mortality risk with Cox regression (N = 4037)

HR, Hazard ratio; CI, confidence interval.

1768 (943 men) of 4037 person died during 56 284 person-years of follow-up.

a Multivariate adjusted: additionally adjusted for age, level of education, smoking status, alcohol consumption, history of stroke, diabetes mellitus and systolic blood pressure.

Next, we studied the association between RMI and UMI and repeated assessments of depressive symptoms after a mean of 3.8 and 8.5 years The mean CES-D score at the first and second follow-up assessment was 4.2 (s.d. = 6.7) and 6.7 (s.d. = 7.7), respectively. In men (Table 3), RMI predicted higher scores of depressive symptoms at the first (B 1.05, 95% CI 0.16–1.95) and second (B 1.29, 95% CI 0.07–2.52) assessment. UMI was not associated with depressive symptoms at the first (B 0.79, 95% CI −0.34 to 1.97), or second (B 0.54, 95% CI −1.14 to 2.21) assessment. In the combined analysis of the two assessments, we observed that RMI (B 1.14, 95% CI 0.07–2.21) but not UMI (B 0.55, 95% CI −0.51 to 1.62) was associated with more depressive symptoms. In women (Table 4), RMI was not significantly associated with depressive symptoms in the first (B−1.37, 95% CI −3.64 to 0.90) or in the second (B 1.48, 95% CI −1.94 to 4.89) assessment. Moreover, there were no significant associations in the combined analysis of the two depressive symptoms assessments (B−0.86, 95% CI −3.13 to 1.42). UMI was not associated with depressive symptoms in any analysis. For this reason we restricted the additional analysis on occurrence of MDD in men only.

Table 3. The longitudinal association of recognized (RMI) or unrecognized (UMI) myocardial infarction with depressive symptoms in men (N = 1823)

CI, Confidence interval.

Analysis were performed with linear regression and Generalized Estimating Equations.

a Centre for Epidemiologic Studies Depression Scale mean score (s.d.). First assessment: RMI 4.2 (7.9), UMI 3.8 (6.5), no MI 2.9 (5.3). Second assessment: RMI 6.7 (8.1), UMI 5.4 (5.9), no MI 5.1 (6.3).

b Model adjusted for age and baseline depression (corrected for baseline depressive symptoms).

c Multivariate adjusted: additionally adjusted for level of education, marital status, body mass index, smoking status, alcohol consumption, and history of stroke, diabetes mellitus and systolic blood pressure.

Table 4. The longitudinal association of recognized (RMI) or unrecognized (UMI) myocardial infarction with depressive symptoms in women (N = 2214)

CI, Confidence interval.

Analysis were performed with linear regression and generalized estimating equations.

a Centre for Epidemiologic Studies Depression Scale mean score (s.d.). First assessment: RMI 5.2 (8.2), UMI 5.9 (8.2), no MI 4.9 (7.2). Second assessment: RMI 10.2 (9.2), UMI 9.1 (8.4), no MI 7.6 (8.3).

b Model adjusted for age and baseline depression (corrected for baseline depressive symptoms).

c Multivariate adjusted: additionally adjusted for level of education, marital status, body mass index, smoking status, alcohol consumption, and history of stroke, diabetes mellitus and systolic blood pressure.

In an additional sensitivity analysis we explored the relationship of RMI and UMI with the occurrence of MDD. Men were followed up for 11.8 years ± 4.71 s.d. (21 664 person years). In total, 52 men (10 of those with RMI but only three of those with UMI) developed MDD during follow-up. We calculated occurrence of MDD during follow-up and cannot present point prevalence data. Men with a history of RMI were at increased risk of developing MDD (HR 2.18, 95% CI 1.04–4.57), but not those with an UMI (HR 0.99, 95% CI 0.77–1.30). The difference between the risk of RMI and UMI was statistically significant (p = 0.024).

We repeated the analyses (see Supplementary material) excluding RMI cases that did not meet electrocardiography criteria for prior Q-wave MI, to reduce possible misclassification and bias by persons (over)reporting symptoms. In these analyses, the effect estimates were very similar. However, due to loss of statistical power the effect was no longer statistically significant.

Discussion

Men with RMI or UMI had an increased mortality risk in this population-based study, as demonstrated previously (Dehghan et al. Reference Dehghan, Leening, Solouki, Boersma, Deckers, van Herpen, Heeringa, Hofman, Kors, Franco, Ikram and Witteman2014). However, the risks of RMI and UMI for depression did not correspond to the mortality risks. Whereas men with RMI had an increased risk to develop depression, men with UMI were at similar risk of developing depression compared to persons without MI. In line with other studies, we confirmed a much weaker association between UMI and survival in women (de Torbal et al. Reference de Torbal, Boersma, Kors, van Herpen, Deckers, van der Kuip, Stricker, Hofman and Witteman2006). This has been attributed to the increased likelihood of lead-placement artifacts due to breast tissue (Murabito et al. Reference Murabito, Evans, Larson and Levy1993). Therefore, the results of the association between UMI and depression in women are hard to interpret.

A history of RMI conveyed a long-term increased risk of both depressive symptoms and MDD in men. Many studies of cardiovascular disease and depression focused on the prognostic value of short-term incidence of depression in patients shortly after the diagnosis of MI (Frasure-Smith et al. Reference Frasure-Smith, Lesperance and Talajic1993; Thombs et al. Reference Thombs, Bass, Ford, Stewart, Tsilidis, Patel, Fauerbach, Bush and Ziegelstein2006; Larsen, Reference Larsen2013). One such study reported that patients with heart disease have 45% more depressive symptoms compared to those without heart disease (Polsky et al. Reference Polsky, Doshi, Marcus, Oslin, Rothbard, Thomas and Thompson2005). The long-term risk of psychological distress in post-MI patients as well as depression in patients with cardiovascular disease have previously been studied for follow-up periods of 5–8 years (Drory et al. Reference Drory, Kravetz and Hirschberger2002; Polsky et al. Reference Polsky, Doshi, Marcus, Oslin, Rothbard, Thomas and Thompson2005). The present study addresses a period of 11 years after experiencing MI. In men, RMI was associated with an increased risk of MDD that remained elevated even over a long period. However, in men UMI was not associated with depressive symptoms or occurrence of MDD, although it was a risk factor for mortality. This discrepancy in the risks of UMI for mortality and depression, compared to RMI, can be explained in multiple ways.

First, previous studies have suggested that patients with UMI may have less severe symptoms and mostly do not consult physicians (Barsky et al. Reference Barsky, Hochstrasser, Coles, Zisfein, O'Donnell and Eagle1990; Stern, Reference Stern2005). Others have argued that, the size of myocardial tissue damage underlying UMI may also be less severe (Lumley et al. Reference Lumley, Torosian, Rowland, Ketterer and Pickard1997). Yet, our study showed that in men, UMI was almost as predictive of mortality as RMI. This suggests that the underlying pathology is of equal severity.

Second, it is conceivable that the mortality risk of RMI and UMI are similar only due to the medical interventions and behavioural changes occurring after RMI. Successful treatment of RMI certainly decreases mortality risk (Steg et al. Reference Steg, James, Atar, Badano, Blomstrom-Lundqvist, Borger, Di Mario, Dickstein, Ducrocq, Fernandez-Aviles, Gershlick, Giannuzzi, Halvorsen, Huber, Juni, Kastrati, Knuuti, Lenzen, Mahaffey, Valgimigli, van ‘t Hof, Widimsky and Zahger2012). However, it is questionable whether treating MI successfully has a strong impact on the risk of depression (Ravven et al. Reference Ravven, Bader, Azar and Rudolph2013).

Third, depression may also be an adverse effect of the treatment of RMI. Patients with RMI are more often treated with interventions such as percutaneous coronary intervention to restore the coronary blood flow and the tissue perfusion (Steg et al. Reference Steg, James, Atar, Badano, Blomstrom-Lundqvist, Borger, Di Mario, Dickstein, Ducrocq, Fernandez-Aviles, Gershlick, Giannuzzi, Halvorsen, Huber, Juni, Kastrati, Knuuti, Lenzen, Mahaffey, Valgimigli, van ‘t Hof, Widimsky and Zahger2012). These procedures have been associated with increased risk of depressive symptoms because of the intensity of the treatment procedure (Park et al. Reference Park, Park, Kwak and Sung2012). Further, drugs used for blood-pressure and heart-rate control, such as beta-blockers, may worsen depressive symptoms (Steg et al. Reference Steg, James, Atar, Badano, Blomstrom-Lundqvist, Borger, Di Mario, Dickstein, Ducrocq, Fernandez-Aviles, Gershlick, Giannuzzi, Halvorsen, Huber, Juni, Kastrati, Knuuti, Lenzen, Mahaffey, Valgimigli, van ‘t Hof, Widimsky and Zahger2012). However, we accounted for antihypertensive use and previous cardiac interventions at baseline to control for this effect.

Fourth, our results suggest that in men psychological factors contribute to the development of depression after MI. Although it remains difficult to disentangle psychological mechanisms from the pathophysiological mechanism underlying both MI and depression, we argue that psychological mechanisms are key to the different risk patterns of RMI and UMI in men. Due to improved clinical management of clinical MI, the survival has improved substantially, yet patients with MI often experience the event as life threatening (Ladwig et al. Reference Ladwig, Roll, Breithardt, Budde and Borggrefe1994). Further, frightening events impact not only the survivors’ health, but also their families and working life (Wiles, Reference Wiles1998). These resulting lifestyle changes contribute to the psychological reaction following the MI experience and often resulting in depression (Lloyd & Cawley, Reference Lloyd and Cawley1982). Clinical studies of MI patients demonstrated that the psychological distress related to health problems makes men particularly vulnerable to depression (Drory et al. Reference Drory, Kravetz and Hirschberger2002).

We did not observe any relationship between RMI or UMI with depressive symptoms in women. Only 53 women but 220 men had RMI at baseline, thus our analysis were underpowered in women. Moreover, we found no relationship between UMI and mortality in women, suggesting that this event does not signal pathophysiological change or that there is possible misclassification of UMI in women. Some studies reported a low accuracy of electrocardiography diagnostics in older women (Murabito et al. Reference Murabito, Evans, Larson and Levy1993). In this light the association of UMI with both mortality and depression was consistent.

Depression is an established risk factor for coronary heart disease (Lesperance et al. Reference Lesperance, FrasureSmith and Talajic1996) and may thus contribute to the occurrence of MI. Although we corrected for baseline depressive symptoms, reverse causality could in theory influence the observed association between RMI and depression (Trivedi, Reference Trivedi2004). The Rotterdam Study started with screening for depression during 1993, this assessment constitutes the baseline of our study and no prior assessments were conducted.

A limitation of our study is the possible misclassification of UMI. The definition of UMI heavily relies on the presence of pathological Q waves, therefore most non-Q-wave MIs remained undetected. Second, electrocardiogram evidence of a previous MI can disappear over time (Sheifer et al. Reference Sheifer, Manolio and Gersh2001). This again could lead to misclassification of UMI and thereby lower the effect estimates. Third, the known history of RMI might introduce assessment bias towards MDD diagnosis. In contrast, individuals with UMI have less specific symptomatology and mostly seek no medical care thus may avoid MDD medical diagnosis. However, the systematic approaches we used to ascertain events of MDD minimize the possibility of these biases (Luijendijk et al. Reference Luijendijk, van den Berg, Dekker, van Tuijl, Otte, Smit, Hofman, Stricker and Tiemeier2008). Fourth, due to the observational nature of the study design presence of residual confounding cannot be ruled out.

Our study has several strengths. It is based on a large well-described population-based cohort with a long follow-up. Data were gathered prospectively and without prior knowledge of MI status. Participants were monitored continuously during follow-up for the occurrence of depression and diagnoses were made by clinical interviews according to DSM-IV criteria. We used different data sources and approaches to collect and validate MDD (Luijendijk et al. Reference Luijendijk, van den Berg, Dekker, van Tuijl, Otte, Smit, Hofman, Stricker and Tiemeier2008).

Furthermore, detailed information on RMI was collected and validated from the medical records of the participants (Leening et al. Reference Leening, Kavousi, Heeringa, van Rooij, Verkroost-van Heemst, Deckers, Mattace-Raso, Ziere, Hofman, Stricker and Witteman2012). Importantly, when we restricted the cases with RMI to those with electrocardiography-verified changes (excluding those with clinical symptoms only) the results did not change. This suggest that possible misclassification cannot explain our findings. Possibly, persons (over)reporting more symptoms (without pathology) do not account for the observed association and did not bias the effect estimates (see Macleod et al. Reference Macleod, Davey Smith, Heslop, Metcalfe, Carroll and Hart2002, for example).

In conclusion, RMI and UMI are both associated with a higher mortality risk in men. However, only men with RMI had a higher likelihood of depression during follow-up. Although pathophysiological differences between UMI and RMI may also explain this discrepancy, our results are consistent with the hypothesis that the psychological burden of experiencing MI contributes to the long-term risk of depression after MI. We can only carefully speculate about clinical implication as future studies must confirm this results and the underlying mechanisms but our findings suggest that effective long-term prevention of post-MI depression should address the psychological impact of experiencing an MI.

Supplementary material

For supplementary material accompanying this paper visit http://dx.doi.org/10.1017/S0033291716000544.

Acknowledgements

We acknowledge the contribution of librarian W. M. Bramer who helped in performing the literature search prior to the study analysis. We also gratefully acknowledge the contribution of participants, staff, general practitioners, and pharmacists in the Rotterdam Study. M. J. G. Leening is supported by a Prins Bernhard Cultuurfonds Fellowship (30140588); and the De Drie Lichten Foundation (04/14). O. H. Franco works at ErasmusAGE, a centre for ageing research across the life course funded by Nestlé Nutrition (Nestec Ltd); Metagenics Inc.; and AXA. Nestlé Nutrition (Nestec Ltd.); Metagenics Inc.; and AXA had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; and preparation, review or approval of the manuscript. A. Dehghan is supported by a Netherlands Organization for Scientific Research grant (NWO-VENI, 916.12.154) and EUR Fellowship. H. Tiemeier is supported by a Netherlands Organization for Scientific Research grant (NWO-VIDI: 017.106.370).

Declaration of Interest

None.

References

Barsky, AJ, Hochstrasser, B, Coles, NA, Zisfein, J, O'Donnell, C, Eagle, KA (1990). Silent myocardial ischemia. Is the person or the event silent? Journal of the American Medical Association 264, 11321135.CrossRefGoogle ScholarPubMed
Beekman, AT, Deeg, DJ, Van Limbeek, J, Braam, AW, De Vries, MZ, Van Tilburg, W (1997). Criterion validity of the Center for Epidemiologic Studies Depression scale (CES-D): results from a community-based sample of older subjects in The Netherlands. Psychological Medicine 27, 231235.CrossRefGoogle Scholar
Bjelland, I, Dahl, AA, Haug, TT, Neckelmann, D (2002). The validity of the hospital anxiety and depression scale. An updated literature review. Journal of Psychosomatic Research 52, 6977.CrossRefGoogle ScholarPubMed
Breslau, N (1985). Depressive symptoms, major depression, and generalized anxiety: a comparison of self-reports on CES-D and results from diagnostic interviews. Psychiatry Research 15, 219229.CrossRefGoogle ScholarPubMed
Cabin, HS, Roberts, WC (1982). Quantitative comparison of extent of coronary narrowing and size of healed myocardial infarct in 33 necropsy patients with clinically recognized and in 28 with clinically unrecognized (‘silent’) previous acute myocardial infarction. American Journal of Cardiology 50, 677681.CrossRefGoogle ScholarPubMed
Cohn, PF, Fox, KM, Daly, C (2003). Silent myocardial ischemia. Circulation 108, 12631277.CrossRefGoogle ScholarPubMed
Dehghan, A, Kardys, I, de Maat, MP, Uitterlinden, AG, Sijbrands, EJ, Bootsma, AH, Stijnen, T, Hofman, A, Schram, MT, Witteman, JC (2007). Genetic variation, C-reactive protein levels, and incidence of diabetes. Diabetes 56, 872878.CrossRefGoogle ScholarPubMed
Dehghan, A, Leening, MJ, Solouki, AM, Boersma, E, Deckers, JW, van Herpen, G, Heeringa, J, Hofman, A, Kors, JA, Franco, OH, Ikram, MA, Witteman, JC (2014). Comparison of prognosis in unrecognized versus recognized myocardial infarction in men versus women >55 years of age (from the Rotterdam Study). American Journal of Cardiology 113, 16.CrossRefGoogle ScholarPubMed
Denollet, J, Strik, JJ, Lousberg, R, Honig, A (2006). Recognizing increased risk of depressive comorbidity after myocardial infarction: looking for 4 symptoms of anxiety-depression. Psychotherapy and Psychosomatics 75, 346352.CrossRefGoogle ScholarPubMed
de Torbal, A, Boersma, E, Kors, JA, van Herpen, G, Deckers, JW, van der Kuip, DA, Stricker, BH, Hofman, A, Witteman, JC (2006). Incidence of recognized and unrecognized myocardial infarction in men and women aged 55 and older: the Rotterdam Study. European Heart Journal 27, 729736.CrossRefGoogle ScholarPubMed
Drory, Y, Kravetz, S, Hirschberger, G, Israeli Study Group on First Acute Myocardial I (2002). Long-term mental health of men after a first acute myocardial infarction. Archives of Physical Medicine and Rehabilitation 83, 352359.CrossRefGoogle ScholarPubMed
Folstein, MF, Folstein, SE, McHugh, PR (1975). ‘Mini-mental state’. A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research 12, 189198.CrossRefGoogle Scholar
Frasure-Smith, N, Lesperance, F, Talajic, M (1993). Depression following myocardial infarction. Impact on 6-month survival. Journal of the American Medical Association 270, 18191825.CrossRefGoogle ScholarPubMed
Harrison, NA, Cooper, E, Voon, V, Miles, K, Critchley, HD (2013). Central autonomic network mediates cardiovascular responses to acute inflammation: relevance to increased cardiovascular risk in depression? Brain, Behavior, and Immunity 31, 189196.CrossRefGoogle ScholarPubMed
Hofman, A, Darwish Murad, S, van Duijn, CM, Franco, OH, Goedegebure, A, Ikram, MA, Klaver, CC, Nijsten, TE, Peeters, RP, Stricker, BH, Tiemeier, HW, Uitterlinden, AG, Vernooij, MW (2013). The Rotterdam Study: 2014 objectives and design update. European Journal of Epidemiology 28, 889926.CrossRefGoogle ScholarPubMed
Ikram, MA, Hollander, M, Bos, MJ, Kors, JA, Koudstaal, PJ, Hofman, A, Witteman, JC, Breteler, MM (2006). Unrecognized myocardial infarction and the risk of stroke: the Rotterdam Study. Neurology 67, 16351639.CrossRefGoogle ScholarPubMed
Ikram, MA, van Oijen, M, de Jong, FJ, Kors, JA, Koudstaal, PJ, Hofman, A, Witteman, JC, Breteler, MM (2008). Unrecognized myocardial infarction in relation to risk of dementia and cerebral small vessel disease. Stroke 39, 14211426.CrossRefGoogle ScholarPubMed
Kannel, WB, Abbott, RD (1984). Incidence and prognosis of unrecognized myocardial infarction. An update on the Framingham study. New England Journal of Medicine 311, 11441147.CrossRefGoogle ScholarPubMed
Krijthe, BP, Leening, MJ, Heeringa, J, Kors, JA, Hofman, A, Franco, OH, Witteman, JC, Stricker, BH (2013). Unrecognized myocardial infarction and risk of atrial fibrillation: the Rotterdam Study. International Journal of Cardiology 168, 14531457.CrossRefGoogle ScholarPubMed
Kumar, V, Abbas, AK, Aster, JC (2012). Robbins Basic Pathology. Elsevier Canada: Toronto.Google Scholar
Ladwig, KH, Roll, G, Breithardt, G, Budde, T, Borggrefe, M (1994). Post-infarction depression and incomplete recovery 6 months after acute myocardial infarction. Lancet 343, 2023.CrossRefGoogle ScholarPubMed
Larsen, KK (2013). Depression following myocardial infarction – an overseen complication with prognostic importance. Danish Medical Journal 60, B4689.Google ScholarPubMed
Leening, MJ, Elias-Smale, SE, Felix, JF, Kors, JA, Deckers, JW, Hofman, A, Stricker, BH, Witteman, JC (2010). Unrecognised myocardial infarction and long-term risk of heart failure in the elderly: the Rotterdam Study. Heart 96, 14581462.CrossRefGoogle ScholarPubMed
Leening, MJ, Kavousi, M, Heeringa, J, van Rooij, FJ, Verkroost-van Heemst, J, Deckers, JW, Mattace-Raso, FU, Ziere, G, Hofman, A, Stricker, BH, Witteman, JC (2012). Methods of data collection and definitions of cardiac outcomes in the Rotterdam Study. European Journal of Epidemiology 27, 173185.CrossRefGoogle ScholarPubMed
Lesperance, F, Frasure-Smith, N (2000). Depression in patients with cardiac disease: a practical review. Journal of Psychosomatic Research 48, 379391.CrossRefGoogle ScholarPubMed
Lesperance, F, FrasureSmith, N, Talajic, M (1996). Major depression before and after myocardial infarction: its nature and consequences. Psychosomatic Medicine 58, 99110.CrossRefGoogle ScholarPubMed
Lloyd, GG, Cawley, RH (1982). Psychiatric morbidity after myocardial infarction. Quarterly Journal of Medicine 51, 3342.Google ScholarPubMed
Luijendijk, HJ, van den Berg, JF, Dekker, MJ, van Tuijl, HR, Otte, W, Smit, F, Hofman, A, Stricker, BH, Tiemeier, H (2008). Incidence and recurrence of late-life depression. Archives of General Psychiatry 65, 13941401.CrossRefGoogle ScholarPubMed
Lumley, MA, Torosian, T, Rowland, LL, Ketterer, MW, Pickard, SD (1997). Correlates of unrecognized acute myocardial infarction detected via perfusion imaging. American Journal of Cardiology 79, 11701173.CrossRefGoogle ScholarPubMed
Macleod, J, Davey Smith, G, Heslop, P, Metcalfe, C, Carroll, D, Hart, C (2002). Psychological stress and cardiovascular disease: empirical demonstration of bias in a prospective observational study of Scottish men. British Medical Journal 324, 12471251.CrossRefGoogle Scholar
Murabito, JM, Evans, JC, Larson, MG, Levy, D (1993). Prognosis after the onset of coronary heart disease. An investigation of differences in outcome between the sexes according to initial coronary disease presentation. Circulation 88, 25482555.CrossRefGoogle ScholarPubMed
Park, MW, Park, SH, Kwak, DJ, Sung, YM (2012). Effects of substrate heating on the photovoltaic characteristics of dye-sensitized solar cells during two-step Ti film deposition by RF magnetron sputtering. Journal of Nanoscience and Nanotechnology 12, 33093312.CrossRefGoogle ScholarPubMed
Piyavhatkul, N, Krisanaprakornkit, T, Paholpak, S, Khiewyou, J (2008). Validity and reliability of WHO Schedules for Clinical Assessment in Neuropsychiatry (SCAN)-Thai version: cognitive Impairment or Decline Section. Journal of the Medical Association of Thailand 91, 11291136.Google ScholarPubMed
Polsky, D, Doshi, JA, Marcus, S, Oslin, D, Rothbard, A, Thomas, N, Thompson, CL (2005). Long-term risk for depressive symptoms after a medical diagnosis. Archives of Internal Medicine 165, 12601266.CrossRefGoogle ScholarPubMed
Ravven, S, Bader, C, Azar, A, Rudolph, JL (2013). Depressive symptoms after CABG surgery: a meta-analysis. Harvard Review of Psychiatry 21, 5969.CrossRefGoogle ScholarPubMed
Schelbert, EB, Cao, JJ, Sigurdsson, S, Aspelund, T, Kellman, P, Aletras, AH, Dyke, CK, Thorgeirsson, G, Eiriksdottir, G, Launer, LJ, Gudnason, V, Harris, TB, Arai, AE (2012). Prevalence and prognosis of unrecognized myocardial infarction determined by cardiac magnetic resonance in older adults. Journal of the American Medical Association 308, 890896.CrossRefGoogle ScholarPubMed
Sheifer, SE, Manolio, TA, Gersh, BJ (2001). Unrecognized myocardial infarction. Annals of Internal Medicine 135, 801811.CrossRefGoogle ScholarPubMed
Steg, PG, James, SK, Atar, D, Badano, LP, Blomstrom-Lundqvist, C, Borger, MA, Di Mario, C, Dickstein, K, Ducrocq, G, Fernandez-Aviles, F, Gershlick, AH, Giannuzzi, P, Halvorsen, S, Huber, K, Juni, P, Kastrati, A, Knuuti, J, Lenzen, MJ, Mahaffey, KW, Valgimigli, M, van ‘t Hof, A, Widimsky, P, Zahger, D (2012). ESC Guidelines for the management of acute myocardial infarction in patients presenting with ST-segment elevation. European Heart Journal 33, 25692619.Google ScholarPubMed
Stern, S (2005). Symptoms other than chest pain may be important in the diagnosis of ‘silent ischemia’, or ‘the sounds of silence’. Circulation 111, e435e437.CrossRefGoogle ScholarPubMed
Stokes, J III, Dawber, TR (1959). The silent coronary: the frequency and clinical characteristics of unrecognized myocardial infarction in the Framingham study. Annals of Internal Medicine 50, 13591369.Google ScholarPubMed
Thombs, BD, Bass, EB, Ford, DE, Stewart, KJ, Tsilidis, KK, Patel, U, Fauerbach, JA, Bush, DE, Ziegelstein, RC (2006). Prevalence of depression in survivors of acute myocardial infarction. Journal of General Internal Medicine 21, 3038.CrossRefGoogle ScholarPubMed
Tiemeier, H, Hofman, A, van Tuijl, HR, Kiliaan, AJ, Meijer, J, Breteler, MM (2003). Inflammatory proteins and depression in the elderly. Epidemiology 14, 103107.CrossRefGoogle ScholarPubMed
Trivedi, MH (2004). The link between depression and physical symptoms. Prim Care Companion. Journal of Clinical Psychiatry 6, 1216.Google ScholarPubMed
van Bemmel, JH, Kors, JA, van Herpen, G (1990). Methodology of the modular ECG analysis system MEANS. Methods of Information in Medicine 29, 346353.Google ScholarPubMed
Wieberdink, RG, Ikram, MA, Hofman, A, Koudstaal, PJ, Breteler, MM (2012). Trends in stroke incidence rates and stroke risk factors in Rotterdam, the Netherlands from 1990 to 2008. European Journal of Epidemiology 27, 287295.CrossRefGoogle ScholarPubMed
Wiles, R (1998). Patients’ perceptions of their heart attack and recovery: the influence of epidemiological ‘evidence’ and personal experience. Social Science & Medicine 46, 14771486.CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Baseline characteristics of the study population (N = 4037)

Figure 1

Table 2. Recognized (RMI) and unrecognized (UMI) myocardial infarction and all-cause mortality risk with Cox regression (N = 4037)

Figure 2

Table 3. The longitudinal association of recognized (RMI) or unrecognized (UMI) myocardial infarction with depressive symptoms in men (N = 1823)

Figure 3

Table 4. The longitudinal association of recognized (RMI) or unrecognized (UMI) myocardial infarction with depressive symptoms in women (N = 2214)

Supplementary material: File

Jovanova supplementary material

Tables S1-S4

Download Jovanova supplementary material(File)
File 30.8 KB