Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Prediction of cardiovascular events in rheumatoid arthritis using risk age calculations: evaluation of concordance across risk age models

Arthritis Research & Therapy volume 22, Article number: 90 (2020) Cite this article

Abstract

Background

In younger individuals, low absolute risk of cardiovascular disease (CVD) may conceal an increased risk age and relative risk of CVD. Calculation of risk age is proposed as an adjuvant to absolute CVD risk estimation in European guidelines. We aimed to compare the discriminative ability of available risk age models in prediction of CVD in rheumatoid arthritis (RA). Secondly, we also evaluated the performance of risk age models in subgroups based on RA disease characteristics.

Methods

RA patients aged 30–70 years were included from an international consortium named A Trans-Atlantic Cardiovascular Consortium for Rheumatoid Arthritis (ATACC-RA). Prior CVD and diabetes mellitus were exclusion criteria. The discriminatory ability of specific risk age models was evaluated using c-statistics and their standard errors after calculating time until fatal or non-fatal CVD or last follow-up.

Results

A total of 1974 patients were included in the main analyses, and 144 events were observed during follow-up, the median follow-up being 5.0 years. The risk age models gave highly correlated results, demonstrating R2 values ranging from 0.87 to 0.97. However, risk age estimations differed > 5 years in 15–32% of patients. C-statistics ranged 0.68–0.72 with standard errors of approximately 0.03. Despite certain RA characteristics being associated with low c-indices, standard errors were high. Restricting analysis to European RA patients yielded similar results.

Conclusions

The cardiovascular risk age and vascular age models have comparable performance in predicting CVD in RA patients. The influence of RA disease characteristics on the predictive ability of these prediction models remains inconclusive.

Background

Patients with rheumatoid arthritis (RA) have higher risk of cardiovascular disease (CVD) [1]. Risk algorithms for the general population lack precision when applied to RA patients, while validated RA-specific CVD prediction models are currently lacking [2,3,4,5].

Numerous CVD risk prediction models have been developed and differ in terms of CVD events (fatal or non-fatal), patient population of interest, and also CVD risk factors (CVD-RFs) included [6]. In clinical practice, the decision whether to initiate lipid-lowering therapy or not is supported by calculating the absolute risk of CVD [7]. Using the Systematic Coronary Risk Evaluation (SCORE) algorithm, the absolute 10-year risk of a fatal CVD event can be estimated separately for patients in countries with low and high risk of CVD [8]. The SCORE algorithm estimates CVD risk according to age, sex, and modifiable CVD-RFs including smoking status, systolic blood pressure (sBP), and total cholesterol (TC). Since high-density lipoprotein cholesterol (HDL-c) may improve prediction of CVD, an updated algorithm includes TC to HDL-c ratio [9, 10]. The European League Against Rheumatism (EULAR) advises to adapt CVD risk prediction models with a 1.5 multiplication factor to the estimated risk of CVD for patients with RA [11].

Absolute risk of CVD the next 10 years is largely driven by age, and younger individuals will thus have a low calculated risk by SCORE, even in the presence of high levels of CVD-RFs [12]. Accordingly, a low absolute 10-year risk may conceal a high relative and lifetime risk of CVD [7]. Risk age may be a favorable supplement for assessment and communication of CVD risk, and its use is recommended in the guidelines on CVD prevention by the European Society of Cardiology (ESC) in addition to assessment of absolute 10-year risk [7].

The risk age concept estimates the detrimental effects of CVD-RFs, by comparing the absolute risk of the patient of interest to the absolute risk in a hypothetical individual of the same sex with the absence of CVD-RFs (a non-smoker with sBP of 120 mmHg and TC at 4 mmol/L). Estimated risk age for any given individual may be similar to his/her true age or far beyond the chronologic age in presence of high levels of CVD-RFs. If a 40-year-old has a risk age of 60 years, then he/she has an absolute risk corresponding to a 60-year-old person of the same sex without CVD-RFs (non-smoker with sBP of 120 mmHg and TC of 4 mmol/L). Currently, two risk age models based on the SCORE algorithm have been developed: the cardiovascular risk age and the vascular age [13, 14].

Recently, we reported that different CVD risk age models yield highly correlated results, yet differ by 5 years or more in a substantial fraction of RA patients, suggesting a need for validation of these prediction models [15]. Our objective was to compare the discriminative ability of cardiovascular risk age and vascular age calculations in predicting CVD among RA patients. We also aimed to evaluate the performance of these risk age models in subgroups of RA patients stratified according to rheumatic disease related characteristics.

Methods

Study populations

Patients were included from the international consortium, A Trans-Atlantic Cardiovascular Consortium for Rheumatoid Arthritis (ATACC-RA), which encompasses 11 RA patient cohorts (the UK, Norway, Netherlands, Sweden, Greece, Spain, the USA, South Africa, Canada, Mexico (2 cohorts)) [3]. Approval was granted by the ethical boards/committees at each center. Data were anonymized and aggregated before analyses.

In the current analyses, we included patients aged 30–70 years at baseline. Exclusion criteria were prior CVD and/or diabetes mellitus at baseline in line with European guidelines (as CVD risk prediction is limited to patients without known prior CVD and/or diabetes mellitus). For main analyses, we also excluded patients using lipid-lowering therapy (LLT) and/or antihypertensive treatment (AntiHT) at baseline. In secondary analyses, we performed analyses on data from European RA cohorts (subanalyses 1), included RA patients on LLT and/or AntiHT (subanalyses 2), and performed analyses on European RA cohorts also including patients on LLT and/or AntiHT (subanalyses 3).

Demographic and rheumatic disease characteristics

Age, sex, and RA disease-related variables (disease duration, disease activity score using 28 joint count (DAS28), rheumatoid factor (RF) and anti-citrullinated protein antibodies (ACPA), and treatment with glucocorticoids (GC), synthetic and biologic disease-modifying anti-rheumatic drugs (bDMARDs and sDMARDs)) were collected at baseline. Recorded CVD-RFs included current smoking, sBP, TC, and HDL-c; body mass index (BMI), low-density lipoprotein cholesterol (LDL-c), and triglycerides were also recorded.

Outcomes

The outcome of interest was time to physician-verified fatal or non-fatal CVD events, including CVD death, myocardial infarction, stroke, peripheral arterial disease (with or without revascularization procedures), and coronary revascularization (percutaneous coronary intervention or coronary artery bypass grafting). Patients were followed from baseline to the time of event or censored at the time of last follow-up.

Relative risk calculation

Relative risk of CVD was calculated according to the relative risk chart, which is included in the 2016 European guidelines on CVD prevention in clinical practice, in accordance with smoking status as well as total cholesterol and systolic blood pressure levels [7].

Risk age estimations using the cardiovascular risk age model

Cardiovascular risk age was estimated according to the cardiovascular risk age chart, based on the nearest intervals of sBP (120/140/160/180 mmHg) and TC (4/5/6/7/8 mmol/L) for males and females, depending on different chronologic age strata (40/45/50/55/60/65 years) [13].

Risk age estimations using the vascular age model

In contrast, the vascular age calculation was performed in two steps. First, we estimated 10-year risk of fatal CVD according to the SCORE algorithms [8, 10]. Then, we matched calculated 10-year risk to corresponding risk ages [14]. The vascular age was calculated in four different ways, corresponding to the four different SCORE formulas for assessing the 10-year risk of fatal CVD: using the formula for low-risk countries and the formula high-risk countries, as well as those with and without HDL-c.

Statistical analysis

Descriptive data was presented as counts (percentages) for categorical data and as mean or median for normally distributed and non-normally distributed data, respectively. The significance level was set at p < 0.05.

Since the cardiovascular risk age model was developed for patients aged 40–65, ages 30–40 and 65–70 years were truncated to 40 and 65 years, respectively. Agreement between risk age models was evaluated using R2 from a linear regression model and the frequency of risk age estimations differing 5 years or more across models.

To validate the CVD risk prediction models, discrimination (e.g., correctly ranking patients who experience CVD as individuals at higher risk than those who do not experience CVD) was calculated using concordance statistics (c-statistics) [16, 17]. Moreover, c-statistics with standard errors were compared across risk age models to evaluate which risk age models perform better at ranking individuals correctly as low- or high-risk individuals (in which the latter should have shorter observed time to event). Concordance was also estimated for individual centers.

Furthermore, concordance according to sex and baseline RA disease characteristics was calculated to assess whether these features influence the risk age model’s predictive ability. In detail, these RA disease characteristics included (1) disease duration ≤ 1 vs. > 1 year, (2) disease activity (remission/low disease activity vs. moderate/high disease activity according to DAS28) [18, 19], (3) seropositivity (RF and/or ACPA positivity), and presence or absence of anti-rheumatic treatment with (4) glucocorticoids, (5) methotrexate, (6) sDMARDs in general, or (7) bDMARDs. The sampling variability of these sub-group c-statistics was assessed using standard errors.

Statistical analyses were conducted using R 3.2.0 (R Foundation for Statistical Computing, Vienna, Austria) and STATA version 14.1.

Results

Table 1 presents baseline characteristics of the 1973 RA patients included in the main analyses.

Table 1 Patient characteristics
Full size table

Seventy-four percent were female, and median (inter-quartile range) age was 52.0 (44, 59) years. Disease duration was 0.6 (0.1, 5.8) years, and more than half (61%) had an RA disease duration of 1 year or less. Overall, 73% were RF positive. There were a substantial number of patients with moderate (43%) or high (30%) disease activity according to DAS28. Twenty-four percent were treated with glucocorticoids, while 10% and 38% were using bDMARDs and sDMARDs, respectively. About a third (30%) were current smokers, and 19% were obese (BMI ≥ 30kg/m2).

The median follow-up time was 5.0 (2.5, 9.1) years. A total of 144 RA patients experienced CVD events during the observation period: confirmed myocardial infarction (n = 64), stroke (n = 33), CVD death (n = 19), peripheral arterial events (n = 14), and revascularization procedures (n = 14). Among the patients included in the main analyses, estimation of risk age was not possible in 338 (17%) and 357 (18%) individuals when using prediction models without or with HDL-c, respectively, due to missing data on sBP (n = 114), TC (n = 205), HDL-c (n = 219), and current smoking (n = 119).

The estimated risk of CVD according to different prediction models are presented in Table 2. Calculated risk age was highest when the cardiovascular risk age model was applied and, depending on the specific risk age model used, the median risk age ranged from 56 to 59 years. According to the relative risk table, two thirds of patients with RA had at least twice the risk of CVD (due to either smoking and/or elevated sBP/TC levels), compared to individuals with no CVD-RFs, whereas 7–28% of RA patients would be classified as high-risk individuals (absolute 10-year risk of fatal CVD ≥ 5%) at baseline, depending on which SCORE algorithm was used and if the EULAR 1.5 multiplication factor was applied or not.

Table 2 Estimated risk age, relative risk, and absolute risk
Full size table

The scatter plot (Fig. 1) gives a graphical presentation of the agreement between estimated risk age according to the cardiovascular risk age model and the various vascular age models. Linear regression analyses, calculating the correlation between the risk age models, yielded R2 values ranging from 0.87 to 0.97. Moreover, comparison of cardiovascular risk age and various vascular age models revealed that risk age estimations differed ≥ 5 years in 15–32% of observations. The most extreme risk age difference was 21 years in which a female non-smoker, aged 69 years, sBP of 151 mmHg and HDL-c and TC of 2.8 and 7.5 mmol/L, respectively, had a cardiovascular risk age of 80 years, and a vascular age of 59 according to the vascular age model (using the SCORE HDL-c algorithm for low-risk countries).

Fig. 1
figure 1

Agreement in estimated risk age by the cardiovascular risk age and vascular age models. Cardiovascular risk age estimations versus cardiovascular risk age calculations using the SCORE algorithms with (left panels) or without HDL-C (right panels) for high-risk countries (top panels) and low-risk countries (bottom panels)

Full size image

Overall, the risk age algorithms had c-indices ranging from 0.68 to 0.72, with standard errors (SE) around 0.03 (Table 3). The cardiovascular risk age model had the lowest c-index. Applying the EULAR 1.5 multiplication factor to the estimated risk do not change the risk ranking of subjects and thereby have no impact on concordance. Table 3 also presents the c-indexes when stratifying on sex and RA disease related characteristics. Certain characteristics were associated with low concordance, but standard errors were high. Additional analyses restricted to only European cohorts and/or including patients on LLT and/or AntiHT gave comparable results (data not shown). Finally, we evaluated the concordance of risk models for each center, which revealed wide ranging c-indexes (data not shown). For centers in which CVD events did not occur during the observation period, concordance could not be calculated (data not shown).

Table 3 Discriminatory ability according to stratification by RA disease characteristics
Full size table

Discussion

Using longitudinal data with CVD outcomes from rheumatic outpatient clinics from the total ATACC-RA cohort, we have revealed comparable ability of various risk age models to rank RA patients in terms of time to CVD events. Interestingly, the cardiovascular risk age chart, which is based on quite wide CVD-RF intervals (e.g., sBP 120/140/160/180 mmHg), had only a slightly lower c-index (0.68) than the other risk age models, indicating comparable performance in correct ranking of individuals in terms of future CVD risk. Thus, although risk age estimations frequently differ 5 years or more [15], their discriminative ability is very similar.

Among the included RA patients, the concordance was about 0.7 for all risk age models and similar to the SCORE algorithms they are based on, which had a c-index of 0.71–0.72. Thus, c-indices were somewhat lower than what was reported for the general European population in the original SCORE paper. Conroy et al. found c-indices of 0.81 and 0.74 for high- and low-risk countries, respectively [8].

Evaluating risk age models by investigating time to event and using a composite of CVD events, the cardiovascular risk age model and the vascular age models all had comparable c-statistics around 0.7. In comparison, a concordance of 0.5 implies a discriminative ability no better than pure chance, whereas c-statistics approaching 0.60 to 0.75 are sometimes expressed as demonstration of “possibly helpful discrimination” and > 0.75 as “clearly useful discrimination” (although this is a criticized practice) [20].

External validation of the SCORE algorithm, from which the cardiovascular risk age and vascular age models are based on and calculated from, respectively, have revealed wide ranging c-statistics. In a review by Damen et al., reported c-indices ranged from 0.62 to 0.91 in different European and non-European study populations [6]. Comparisons of c-indices across populations are hampered due to factors such as differences in age distributions. However, for analyses in these cohorts, several additional explanations of the observed suboptimal concordance are plausible. The SCORE algorithm was developed for the European population. In our analyses, European and non-European cohorts were included. Additional analyses restricted to data from European cohorts were performed, but comparable c-indices were found. We also performed CVD risk estimations using both algorithms for high- and low-risk countries. In the main analyses, we pooled data across centers to increase the numbers and observation time (total person years at risk), but a limitation is the heterogeneity between the various cohorts. There was wide range of the c-indexes and standard errors across each unique center included in the analyses.

In RA, inflammatory disease activity, disease duration, and usage of GCs, sDMARDs, and bDMARDs are all factors that may influence overall risk of CVD [21,22,23,24,25,26,27,28]. In a recent study, Crowson et al. demonstrated that albeit conventional CVD-RFs accounted for half (49%) of CVD events in RA, high-grade inflammation and RA characteristics explained about 30% of the CVD risk [29]. However, the prediction models we evaluated only assess CVD risk related to conventional CVD-RFs. Furthermore, RA patients without known CVD have high occurrence of atherosclerotic plaques even in the case of only moderate estimated absolute risk, justifying the use of carotid ultrasound as a supplement in CVD risk stratification [30].

The latest EULAR recommendations on CVD risk management underline that rheumatic disease activity should be controlled to lower overall risk of CVD [11]. RA-related characteristics may also complicate the interpretation of conventional CVD-RFs. The lipid paradox denotes the phenomena in which low lipid levels due to elevated inflammation is associated with an increased risk of CVD [31]. Thus, a future RA-specific CVD risk algorithm should possibly weight lipid levels according to the disease activity. Regarding CVD prediction models, if important CVD-RFs are left out or not weighted appropriately, then concordance will be impaired.

In this paper, we aimed to evaluate the influence of RA disease characteristics on the performance of risk age models in ranking individuals correctly as high(er)- or low(er)-risk individuals. However, our findings were inconclusive due to the lack of statistical power resulting from the small number of participants included and/or short observation time with few events occurring. Underreporting of CVD events during the follow-up time is also possible, especially since RA patients may suffer from asymptomatic CVD events [32]. The inconclusive results on the association of RA disease characteristics and the c-index values due to large standard errors could have been different with a longer follow-up time and more participants. In time-to-event analyses, consideration of informative and interval censoring is also required. Only data on disease activity and sDMARD and bDMARD treatment were available at baseline. Surprisingly, a high rate of RA patients was not using sDMARDs and bDMARDs at study inclusion. Although this should be considered before extrapolation of our results to other RA cohorts, this may be partly explained by that a high rate of RA patients included in these analyses had short disease duration (explaining why some were methotrexate naive) and also to differences across different nations (explaining why some were bDMARDs naïve). Another limitation to this multi-center study is the lack to control that BP measurements were conducted similarly. Data on family history of premature CVD were also lacking. Among eligible patients, estimation of risk age were not possible in 338–357 individuals when using prediction models without or with HDL-c, respectively, due to missing data on sBP (n = 114), TC (n = 205), HDL-c (n = 219), and current smoking (n = 119).

There are also limitations with c-index calculation since it reports concordance based on ranks and not on the magnitude of risk differences. Consequently, in the case of very similar and only slightly different risk ages across subjects, the CVD prediction model’s discriminatory ability will be impaired. Moreover, concordance only describes one feature regarding the predictive ability of a risk model. Calibration, a comparison of the number of expected events to the number of observed events, is another important property regarding validation of prediction models [33]. However, in contrast to models predicting absolute risk, calibration cannot be performed in prediction models using the risk age concept.

The risk age models we have validated are derived from the SCORE algorithms which calculate absolute risk of fatal CVD. In the original SCORE publication, the authors argued that developing a CVD prediction model based on non-fatal CVD events are prone to errors due to misclassification. Non-fatal events are also of clinical importance, and it has been suggested to convert SCORE with a multiplier to estimate fatal and non-fatal events [7, 34]. However, Jørstad et al. found that the ratio of risk of fatal to fatal plus non-fatal CVD was largely dependent on age and sex and, consequently, a fixed multiplication factor was not applicable [35]. Since risk age communicates the detrimental effects of modifiable CVD-RFs on overall CVD risk and/or life expectancy, it is an attractive concept, also informing patients on the benefit of optimizing CVD-RFs. In the review by Groenewegen et al., it is argued that the perspicuous risk age concept might improve communication about CVD risk and possibly patient adherence to CVD preventive strategies (e.g. lifestyle changes and/or cardio-protective medication) [12]. CVD risk assessment is especially important in RA due to the high prevalence of modifiable CVD-RFs [36,37,38]. However, whether the risk age is an intuitive concept and if it has incremental value beyond absolute and relative risk calculation needs further evaluation.

To our knowledge, this is the first study comparing the discriminative ability of the risk age models proposed for use as supplements to CVD risk evaluation in the ESC guidelines for the general population [7, 12]. Not surprisingly, our study supports the notion that risk age models perform similarly to the SCORE algorithms in ranking individuals correctly as high or low risk of CVD events. Despite that risk age estimations frequently differ 5 years or more, the current risk age models based on SCORE perform almost equivalently in terms of concordance.

Conclusions

Albeit different CVD risk age algorithms yield marked disparities in a substantial proportion of patients, the cardiovascular risk age and vascular age models have comparable performance in predicting CVD events in RA patients. Furthermore, their concordance is equivalent to the SCORE algorithms they are derived from. The influence of RA disease characteristics on the predictive ability of these prediction models remains inconclusive. Further evaluation is also required to assess whether use of risk age estimations in clinical practice is beneficial for CVD-RF reduction and, ultimately, prevention of CVD events.

Availability of data and materials

The dataset used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ACPA:

Anti-citrullinated protein antibodies

AntiHT:

Antihypertensive treatment

ATACC-RA:

A Trans-Atlantic Cardiovascular Consortium for Rheumatoid Arthritis

bDMARDs:

Biologic disease-modifying anti-rheumatic drugs

BMI:

Body mass index

CVD:

Cardiovascular disease

CVD-RFs:

CVD risk factors

c-statistics:

Concordance statistics

EULAR:

European League Against Rheumatism

ESC:

European Society of Cardiology

GC:

Glucocorticoids

HDL-c:

High-density lipoprotein cholesterol

LLT:

Lipid-lowering therapy

LDL-c:

Low-density lipoprotein cholesterol

RA:

Rheumatoid arthritis

RF:

Rheumatoid factor

SE:

Standard errors

sDMARDs:

Synthetic disease-modifying anti-rheumatic drugs

SCORE:

Systematic Coronary Risk Evaluation

sBP:

Systolic blood pressure

TC:

Total cholesterol

References

  1. Avina-Zubieta JA, Thomas J, Sadatsafavi M, et al. Risk of incident cardiovascular events in patients with rheumatoid arthritis: a meta-analysis of observational studies. Ann Rheum Dis. 2012;71(9):1524–9.

    Article  Google Scholar 

  2. Crowson CS, Matteson EL, Roger VL, et al. Usefulness of risk scores to estimate the risk of cardiovascular disease in patients with rheumatoid arthritis. Am J Cardiol. 2012;110(3):420–4.

    Article  Google Scholar 

  3. Crowson CS, Rollefstad S, Kitas GD, et al. Challenges of developing a cardiovascular risk calculator for patients with rheumatoid arthritis. PLoS One. 2017;12(3):e0174656.

    Article  Google Scholar 

  4. Arts EE, Popa C, Den Broeder AA, et al. Performance of four current risk algorithms in predicting cardiovascular events in patients with early rheumatoid arthritis. Ann Rheum Dis. 2015;74(4):668–74.

    Article  CAS  Google Scholar 

  5. Arts EE, Popa CD, Den Broeder AA, et al. Prediction of cardiovascular risk in rheumatoid arthritis: performance of original and adapted SCORE algorithms. Ann Rheum Dis. 2016;75(4):674–80.

    Article  CAS  Google Scholar 

  6. Damen JA, Hooft L, Schuit E, et al. Prediction models for cardiovascular disease risk in the general population: systematic review. BMJ. 2016;353:i2416.

    Article  Google Scholar 

  7. Piepoli MF, Hoes AW, Agewall S, et al. 2016 European Guidelines on cardiovascular disease prevention in clinical practice: The Sixth Joint Task Force of the European Society of Cardiology and Other Societies on Cardiovascular Disease Prevention in Clinical Practice (constituted by representatives of 10 societies and by invited experts): developed with the special contribution of the European Association for Cardiovascular Prevention & Rehabilitation (EACPR). Eur Heart J. 2016;37(29):2315–81.

    Article  Google Scholar 

  8. Conroy RM, Pyorala K, Fitzgerald AP, et al. Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. Eur Heart J. 2003;24(11):987–1003.

    Article  CAS  Google Scholar 

  9. Cooney MT, Dudina A, De Bacquer D, et al. How much does HDL cholesterol add to risk estimation? A report from the SCORE investigators. Eur J Cardiovasc Prev Rehabil. 2009;16(3):304–14.

    Article  Google Scholar 

  10. Thomsen T. HeartScore®: a new web-based approach to European cardiovascular disease risk management. London: SAGE Publications Sage; 2005.

    Google Scholar 

  11. Agca R, Heslinga SC, Rollefstad S, et al. EULAR recommendations for cardiovascular disease risk management in patients with rheumatoid arthritis and other forms of inflammatory joint disorders: 2015/2016 update. Ann Rheum Dis. 2017;276(1):17–28.

    Article  Google Scholar 

  12. Groenewegen K, Den Ruijter H, Pasterkamp G, et al. Vascular age to determine cardiovascular disease risk: a systematic review of its concepts, definitions, and clinical applications. Eur J Prev Cardiol. 2016;23(3):264–74.

    Article  CAS  Google Scholar 

  13. Cooney MT, Vartiainen E, Laatikainen T, et al. Cardiovascular risk age: concepts and practicalities. Heart. 2012;98(12):941–6.

    Article  Google Scholar 

  14. Cuende JI, Cuende N, Calaveras-Lagartos J. How to calculate vascular age with the SCORE project scales: a new method of cardiovascular risk evaluation. Eur Heart J. 2010;31(19):2351–8.

    Article  Google Scholar 

  15. Wibetoe G, Ikdahl E, Rollefstad S, et al. Discrepancies in risk age and relative risk estimations of cardiovascular disease in patients with inflammatory joint diseases. Int J Cardiol. 2018;252:201–6.

    Article  Google Scholar 

  16. Harrell FE, Lee KL, Mark DB. Tutorial in biostatistics multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15:361–87.

    Article  Google Scholar 

  17. Pencina MJ, D’Agostino RB. Evaluating discrimination of risk prediction models: the C statistic. Jama. 2015;314(10):1063–4.

    Article  CAS  Google Scholar 

  18. Singh JA, Saag KG, Bridges SL, et al. 2015 American College of Rheumatology guideline for the treatment of rheumatoid arthritis. Arthritis Rheum. 2016;68(1):1–26.

    Google Scholar 

  19. Prevoo ML, van’t Hof MA, Kuper HH, et al. Modified disease activity scores that include twenty-eight-joint counts. Development and validation in a prospective longitudinal study of patients with rheumatoid arthritis. Arthritis Rheum. 1995;38(1):44–8.

    Article  CAS  Google Scholar 

  20. Alba AC, Agoritsas T, Walsh M, et al. Discrimination and calibration of clinical prediction models: users’ guides to the medical literature. Jama. 2017;318(14):1377–84.

    Article  Google Scholar 

  21. Solomon DH, Kremer J, Curtis JR, et al. Explaining the cardiovascular risk associated with rheumatoid arthritis: traditional risk factors versus markers of rheumatoid arthritis severity. Ann Rheum Dis. 2010;69(11):1920–5.

    Article  Google Scholar 

  22. Ridker PM, Cushman M, Stampfer MJ, et al. Inflammation, aspirin, and the risk of cardiovascular disease in apparently healthy men. N Engl J Med. 1997;336(14):973–9.

    Article  CAS  Google Scholar 

  23. Roubille C, Richer V, Starnino T, et al. The effects of tumour necrosis factor inhibitors, methotrexate, non-steroidal anti-inflammatory drugs and corticosteroids on cardiovascular events in rheumatoid arthritis, psoriasis and psoriatic arthritis: a systematic review and meta-analysis. Ann Rheum Dis. 2015;74(3):480–9.

    Article  CAS  Google Scholar 

  24. Wei L, MacDonald TM, Walker BR. Taking glucocorticoids by prescription is associated with subsequent cardiovascular disease. Ann Intern Med. 2004;141(10):764–70.

    Article  Google Scholar 

  25. Westlake SL, Colebatch AN, Baird J, et al. Tumour necrosis factor antagonists and the risk of cardiovascular disease in patients with rheumatoid arthritis: a systematic literature review. Rheumatology (Oxford). 2011;50(3):518–31.

    Article  CAS  Google Scholar 

  26. Westlake SL, Colebatch AN, Baird J, et al. The effect of methotrexate on cardiovascular disease in patients with rheumatoid arthritis: a systematic literature review. Rheumatology (Oxford). 2010;49(2):295–307.

    Article  CAS  Google Scholar 

  27. Choi HK, Hernán MA, Seeger JD, et al. Methotrexate and mortality in patients with rheumatoid arthritis: a prospective study. Lancet. 2002;359(9313):1173–7.

    Article  CAS  Google Scholar 

  28. Barnabe C, Martin BJ, Ghali WA. Systematic review and meta-analysis: anti–tumor necrosis factor α therapy and cardiovascular events in rheumatoid arthritis. Arthritis Care Res. 2011;63(4):522–9.

    Article  CAS  Google Scholar 

  29. Crowson CS, Rollefstad S, Ikdahl E, Kitas GD, vanRiel P, Gabriel SE, Matteson EL, Kvien TK, Douglas K, Sandoo A, et al. Impact of risk factors associated with cardiovascular outcomes in patients with rheumatoid arthritis. Ann Rheum Dis. 2018;77:48–54.

  30. Corrales A, Gonzalez-Juanatey C, Peiro ME, et al. Carotid ultrasound is useful for the cardiovascular risk stratification of patients with rheumatoid arthritis: results of a population-based study. Ann Rheum Dis. 2014;73(4):722–7.

    Article  Google Scholar 

  31. Myasoedova E, Crowson CS, Kremers HM, et al. Lipid paradox in rheumatoid arthritis: the impact of serum lipid measures and systemic inflammation on the risk of cardiovascular disease. Ann Rheum Dis. 2011;70(3):482–7.

    Article  CAS  Google Scholar 

  32. Maradit-Kremers H, Crowson CS, Nicola PJ, et al. Increased unrecognized coronary heart disease and sudden deaths in rheumatoid arthritis: a population-based cohort study. Arthritis Rheum. 2005;52(2):402–11.

    Article  Google Scholar 

  33. Pencina MJ, D'Agostino RB. Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation. Stat Med. 2004;23(13):2109–23.

    Article  Google Scholar 

  34. van Dis I, Geleijnse JM, Boer JM, et al. Effect of including nonfatal events in cardiovascular risk estimation, illustrated with data from the Netherlands. Eur J Prev Cardiol. 2014;21(3):377–83.

    Article  Google Scholar 

  35. Jørstad HT, Colkesen EB, Boekholdt SM, et al. Estimated 10-year cardiovascular mortality seriously underestimates overall cardiovascular risk. Heart. 2016;102:63–8.

  36. Castaneda S, Martin-Martinez MA, Gonzalez-Juanatey C, et al. Cardiovascular morbidity and associated risk factors in Spanish patients with chronic inflammatory rheumatic diseases attending rheumatology clinics: baseline data of the CARMA Project. Semin Arthritis Rheum. 2015;44(6):618–26.

    Article  Google Scholar 

  37. Wibetoe G, Ikdahl E, Rollefstad S, et al. Cardiovascular disease risk profiles in inflammatory joint disease entities. Arthritis Res Ther. 2017;19(1):153.

    Article  Google Scholar 

  38. Jafri K, Bartels CM, Shin D, et al. Incidence and management of cardiovascular risk factors in psoriatic arthritis and rheumatoid arthritis: a population-based study. Arthritis Care Res. 2017;69(1):51–7.

    Article  Google Scholar 

Download references

Acknowledgements

We wish to acknowledge the contribution of all patients and involved health personnel. We also wish to acknowledge these additional members of ATACC-RA: Evangelia Zampeli, Alfonso Corrales, Elaine Husni, Ellen Romich, Torkell Ellingsen, Dzenan Masic, Mette Herly, John J. Carey, and Miriam O’Sullivan.

Funding

This work was supported by a collaborative agreement for independent research from Eli Lilly and grants from the Norwegian South East Health Authority (grant numbers 2013064, 2013010). Funding bodies had no role in the design of the study or the collection, analysis, or interpretation of data, nor in the writing of the manuscript.

Author information

Author notes

  1. Cynthia S. Crowson and Anne Grete Semb shared last authorship.

Authors and Affiliations

  1. Preventive Cardio-Rheuma clinic, Department of Rheumatology, Diakonhjemmet Hospital, PO Box 23, Vindern, N-01319, Oslo, Norway

    Grunde Wibetoe, Eirik Ikdahl, Silvia Rollefstad & Anne Grete Semb

  2. Department of Rheumatology, Diakonhjemmet Hospital, Oslo, Norway

    Joseph Sexton & Tore K. Kvien

  3. School of Sport, Exercise and Rehabilitation, University of Birmingham, Birmingham, UK

    George D. Kitas

  4. Radboud Institute for Health Sciences, IQ healthcare, Radboud University Medical Center, Nijmegen, The Netherlands

    Piet van Riel

  5. Rutgers Robert Wood Johnson Medical School, New Brunswick, NJ, USA

    Sherine Gabriel

  6. Dudley Group NHS Foundation Trust, West Midlands, UK

    George D. Kitas, Karen Douglas & Aamer Sandoo

  7. School of Sport, Health and Exercise Sciences, Bangor University, Bangor, UK

    Aamer Sandoo

  8. Department of Rheumatic Diseases, Radboud University Nijmegen Medical Centre, Nijmegen, Netherlands

    Elke E. Arts

  9. Department of Public Health and Clinical Medicine, Rheumatology, Umeå University, Umeå, Sweden

    Solveig Wållberg-Jonsson & Solbritt Rantapää Dahlqvist

  10. Division of Rheumatology, Harbor-UCLA Medical Center, Torrance, CA, USA

    George Karpouzas

  11. Vrije Universiteit Brussel, Brussels, Belgium

    Patrick H. Dessein

  12. Universitair Ziekenhuis Brussel, Brussels, Belgium

    Patrick H. Dessein

  13. Rheumatology, Universitair Ziekenhuis Brussel, Brussels, Belgium

    Linda Tsang

  14. University of Manitoba, Winnipeg, MB, Canada

    Hani El-Gabalawy & Carol A. Hitchon

  15. Instituto Nactional de Ciencias Médicas y Nutrición Salvador Zubirán, México City, Mexico

    Virginia Pascual-Ramos & Irazu Contreas-Yañes

  16. First Department of Propedeutic Internal Medicine, National and Kapodistrian University of Athens, Athens, Greece

    Petros P. Sfikakis

  17. Rheumatology, Hospital Universitario Marqués de Valdecilla, IDIVAL, Universidad de Cantabria, Santander, Spain

    Miguel A. González-Gay

  18. Rheumatology, Hospital Universitario, UANL, Monterrey, Mexico

    Iris J. Colunga-Pedraz

  19. Hospital Universitario, UANL, Monterrey, Mexico

    Dionicio A. Galarza-Delgado

  20. Cardiology, Hospital Universitario, UANL, Monterrey, Mexico

    Jose Ramon Azpiri-Lopez

  21. Division of Rheumatology, Department of Medicine, Mayo Clinic, Rochester, MN, USA

    Cynthia S. Crowson

Authors
  1. Grunde Wibetoe
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Joseph Sexton
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Eirik Ikdahl
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Silvia Rollefstad
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. George D. Kitas
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Piet van Riel
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Sherine Gabriel
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Tore K. Kvien
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Karen Douglas
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Aamer Sandoo
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Elke E. Arts
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Solveig Wållberg-Jonsson
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Solbritt Rantapää Dahlqvist
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. George Karpouzas
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Patrick H. Dessein
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Linda Tsang
    View author publications

    You can also search for this author in PubMed Google Scholar

  17. Hani El-Gabalawy
    View author publications

    You can also search for this author in PubMed Google Scholar

  18. Carol A. Hitchon
    View author publications

    You can also search for this author in PubMed Google Scholar

  19. Virginia Pascual-Ramos
    View author publications

    You can also search for this author in PubMed Google Scholar

  20. Irazu Contreas-Yañes
    View author publications

    You can also search for this author in PubMed Google Scholar

  21. Petros P. Sfikakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  22. Miguel A. González-Gay
    View author publications

    You can also search for this author in PubMed Google Scholar

  23. Iris J. Colunga-Pedraz
    View author publications

    You can also search for this author in PubMed Google Scholar

  24. Dionicio A. Galarza-Delgado
    View author publications

    You can also search for this author in PubMed Google Scholar

  25. Jose Ramon Azpiri-Lopez
    View author publications

    You can also search for this author in PubMed Google Scholar

  26. Cynthia S. Crowson
    View author publications

    You can also search for this author in PubMed Google Scholar

  27. Anne Grete Semb
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

GW, JS, and CSC performed the statistics. GW, JS, CSC, EI, SR, CSC, and AGS analyzed and interpreted the data. GW drafted the manuscript while all authors revised and approved the final manuscript.

Corresponding author

Correspondence to Grunde Wibetoe.

Ethics declarations

Ethics approval and consent to participate

Approval was granted by the ethical boards/committees at each center. Data were anonymized and aggregated before the analyses.

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wibetoe, G., Sexton, J., Ikdahl, E. et al. Prediction of cardiovascular events in rheumatoid arthritis using risk age calculations: evaluation of concordance across risk age models. Arthritis Res Ther 22, 90 (2020). https://doi.org/10.1186/s13075-020-02178-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13075-020-02178-z

Keywords

Arthritis Research & Therapy

ISSN: 1478-6362

Contact us