Skip to main content

Table 2 Discrimination, re-classification, and calibration assessment of ACC/AHA score versus models with biomarkers

From: Identification of novel biomarkers for the prediction of subclinical coronary artery atherosclerosis in patients with rheumatoid arthritis: an exploratory analysis

 

Discrimination

Calibration

Reclassification

AUC

p

H–L test

% net correct

Reclassification

NRI

p

IDI

p

Training cohort (n = 284)

 CAC > 100

  ACC/AHA

0.774 (0.701–0.846)

Ref

0.58

     

  ACC/AHA + cytokines

0.776 (0.696–0.856)

0.27

0.21

 

0.144 (0.026–0.261)

0.017

0.085 (0.046–0.125)

 < 0.001

  CAC < 100

   

0.7%

    

  CAC > 100

   

15.1%

    

  ACC/AHA + MRM

0.741 (0.534–0.948)

0.57

0.45

 

0.176 (− 0.023–0.376)

0.083

0.128 (0.065–0.192)

 < 0.001

  CAC < 100

   

0%

    

  CAC > 100

   

17.6%

    

  ACC/AHA + cytokines + MRM

0.840 (0.709–0.971)

0.37

0.78

 

0.235 (0.005–0.467)

0.046

0.181 (0.118–0.244)

 < 0.001

  CAC < 100

   

0%

    

  CAC > 100

   

23.5%

    

 CAC > 300

  ACC/AHA

0.852 (0.780–0.924)

Ref

0.19

     

  ACC/AHA + cytokines

0.885 (0.809–0.960)

0.24

0.85

 

0.315 (0.088–0.543)

0.007

0.213 (0.132–0.295)

 < 0.001

  CAC < 300

   

3.1%

    

  CAC > 300

   

34.6%

    

  ACC/AHA + MRM

0.849 (0.710–0.988)

0.69

0.77

 

0.124 (− 0.158–0.406)

0.39

0.068 (− 0.006–0.141)

0.072

  CAC < 300

   

1.9%

    

  CAC > 300

   

14.3%

    

  ACC/AHA + cytokines + MRM

0.940 (0.836–0.999)

0.13

0.45

 

0.552 (− 0.009–1.113)

0.054

0.399 (0.058–0.205)

0.002

  CAC < 300

   

1.9%

    

  CAC > 300

   

57.1%

    

Validation cohort (n = 277)

 CAC > 100

  ACC/AHA

0.816 (0.757–0.875)

Ref

0.037

     

  ACC/AHA + cytokines

0.813 (0.745–0.882)

0.70

0.47

 

0.070 (− 0.034–0.175)

0.19

0.024 (− 0.008–0.056)

0.15

  CAC < 100

   

1.5%

    

  CAC > 100

   

8.5%

    

  ACC/AHA + MRM

0.920 (0.821–0.999)

0.76

0.11

 

0.199 (− 0.056–0.454)

0.13

0.238 (0.149–0.323)

 < 0.001

  CAC < 100

   

5.1%

    

  CAC > 100

   

25.0%

    

  ACC/AHA + cytokines + MRM

0.941 (0.872–0.999)

0.20

0.46

 

0.322 (0.0014–0.631)

0.041

0.289 (0.187–0.391)

 < 0.001

  CAC < 100

   

5.3%

    

  CAC > 100

   

37.5%

    

 CAC > 300

  ACC/AHA

0.831 (0.761–0.903)

Ref

0.13

     

  ACC/AHA + cytokines

0.826 (0.747–0.904)

0.89

0.38

 

0.118 (− 0.008–0.245)

0.068

0.02740 (− 0.014–0.069)

0.19

  CAC < 300

   

0.0%

    

  CAC > 300

   

11.1%

    

  ACC/AHA + MRM

0.864 (0.670–0.999)

0.64

0.12

 

0.125 (− 0.120–0.370)

0.32

0.091 (0.025–0.157)

0.007

  CAC < 300

   

0.0%

    

  CAC > 300

   

12.5%

    

  ACC/AHA + cytokines + MRM

0.867 (0.651–0.999)

0.78

 < 0.001

 

0.125 (− 0.120–0.370)

0.32

0.150 (0.081–0.220)

 < 0.001

  CAC < 300

   

0.0%

    

  CAC > 300

   

12.5%

    
  1. Cytokines: osteopontin, cartilage glycoprotein-39, cystatin C, and chemokine (C–C motif) ligand 18
  2. MRM biomarkers: SerD1_NFGYTLR PON1_IQNILTEEPK Clusterin_IDSLLENDR
  3. p values in AUC rows represent the comparison of every model with the first one (ACC/AHA model) that is considered the reference one
  4. NRI and IDI are expressed as its value (95% confidence interval) and p value
  5. p value in the H–L test express the p value of the Hosmer–Lemeshow chi2 statistic test
  6. MRM data was only available for 140 patients of the cohorts
  7. ACC/AHA American College of Cardiology and American Heart Association Score, CAC coronary artery calcification, MRM multiple reaction monitoring, AUC area under the curve, NRI net reclassification index, IDI integrated discrimination improvement, H–L Hosmer–Lemeshow chi2 test
Back to article page

Arthritis Research & Therapy

ISSN: 1478-6362

Contact us