The validity of a rheumatoid arthritis medical records-based index of severity compared with the DAS28
© Solomon et al.; licensee BioMed Central Ltd. 2006
Received: 19 December 2005
Accepted: 14 February 2006
Published: 14 March 2006
The objective of this work was to assess the convergent validity of a previously developed rheumatoid arthritis medical records-based index of severity (RARBIS) by comparing it with the 28-joint Disease Activity Score (DAS28). This study was conducted in subjects within the Brigham and Women's Hospital Rheumatoid Arthritis Sequential Study (BRASS). We selected 100 patients with rheumatoid arthritis (RA) from the BRASS with DAS28 scores equally distributed in four quartiles. The medical records were reviewed to calculate the RARBIS, which includes indicators from the following categories: prior surgical history, radiologic and laboratory findings, clinical and functional status, and extra-articular manifestations. The Spearman correlation between the RARBIS and the DAS28 was assessed in the total study population and in relevant subgroups. We re-weighted on subscales and recalculated the RARBIS score. This was performed based on findings of correlations between the DAS28 and subscales; and also the result from a multiple linear regression with the DAS28 (as a dependent variable) and five subscales (as independent variables). The mean RARBIS was 4.36 (range 0–11). Among the total study cohort, the RARBIS was moderately correlated with the DAS28 (r = 0.41, 95% confidence interval [CI] 0.23–0.56). In subgroup analyses, including age, gender, rheumatoid factor status, and disease duration, we found no statistically significant differences in the correlations. After re-weighting, the correlation between the RARBIS and the DAS28 was somewhat improved (r = 0.48, 95% CI 0.31–0.62). In conclusion, the RARBIS correlated moderately well with the DAS28 in this population. The RARBIS has both face and convergent validity for patients with RA and relevant subgroups and may have application for medical records studies in patients with RA.
Rheumatoid arthritis (RA) is a chronic inflammatory disease that can lead to long-term joint damage resulting in chronic pain, loss of function, and disability . It causes substantial morbidity in most patients and premature mortality in many [2–5]. Some patients with severe RA may be at higher risk for complications such as infection, gastrointestinal problems, heart disease, and cancer [6, 7]. However, those complications may be related to adverse effects of drug therapies rather than to the effect of RA.
Several studies have reported serious but rare adverse effects of RA medications. For example, biologic agents that block the action of tumor necrosis factor-α have been investigated as the cause of serious infections, hematological cancers, and demyelinating disease [8–11]. Lymphoproliferative malignancies among users of disease modifying anti-rheumatic drugs have also been reported [12, 13].
Data on adverse drug events come predominantly from clinical trials, case reports, case series, and epidemiologic studies. Randomized clinical trials are limited in their ability to detect rare adverse effects because of small sample size, selection of patients least likely to experience toxicity, and short duration of follow-up. It is difficult to base causality assessment on case reports/series. Therefore, pharmacoepidemiologic studies can play a pivotal role in evaluating safety of medications used in RA. However, the severity of RA may affect the choice of medication and RA outcomes. Failing to control for RA severity in epidemiologic studies may lead to biased estimates of the association between RA drug treatment and RA outcomes. This type of bias, confounding by indication, is an important potential bias in many pharmacoepidemiologic studies [14, 15].
To measure RA disease severity in medical records, we defined a set of indicators of severe RA through an expert Delphi panel of rheumatologists . On the basis of their findings, we developed an RA medical records-based index of severity (RARBIS) . The goal of this project was to test the convergent validity of the RARBIS with another accepted RA measure. However, there is no standard criteria for RA severity that can be assessed from medical records.
Although disease activity and disease severity are not synonymous, we decided the correlation of the RARBIS with the 28-joint Disease Activity Score (DAS28), a widely used instrument that affects treatment decisions by rheumatologists in daily clinical practice. The DAS28 is a statistically derived index consisting of number of swollen joints, number of tender joints, erythrocyte sedimentation rate (ESR), and general health [18, 19]. Thus, recognizing the methodologic limitations of this approach, we chose to assess the convergent validity of the RARBIS by comparing it with the DAS28, a well accepted RA disease index.
Materials and methods
The Brigham and Women's Hospital Rheumatoid Arthritis Sequential Study (BRASS) is a cohort of patients with confirmed RA who receive care from rheumatologists in the Division of Rheumatology, Immunology and Allergy at our hospital. Every six months, patients are asked to complete questionnaires regarding general health information, medications for RA, health status, and surgical history for RA. Clinicians complete a similar questionnaire, including global assessment and joint counts. For our study, patients were identified from the BRASS cohort between March and October 2003. Identified patients during the study period were partitioned in quartiles based on their baseline DAS28 scores. We randomly selected 100 RA patients with the baseline DAS28 equally distributed in four quartiles.
Rheumatoid arthritis severity index
Any hand joint
Any foot joint
1 point each
(hips, knees, shoulder, elbow, wrist, ankle)
(maximum of 2)
Maximum score for category:
Maximum score for category:
Extra-articular manifestations subscale:
Pulmonary lung nodule
Maximum score for category:
Clinical status subscale:
Worst physician global rating: "doing poor"
Unable to do hobbies
Unable to work
Unable to care for self
Hours of morning stiffness <1
Data collection and processing
Electronic medical records were reviewed to collect information on demographic characteristics, clinical and functional status, laboratory test results, and radiology reports. Data on clinical status indicators and laboratory test results were collected for one year prior to baseline. If a patient's clinical and functional status changed during that period, the worst condition was recorded. When there was an expression indicating disease activity such as "flare up," "ongoing," and "active" in medical records, we counted it as having a flare. The number of flares in the last year was summed. If there was no information regarding clinical and functional status on the medical chart, we assumed a patient had no apparent clinical and functional manifestations during that period. The value associated with the most severe disease activity in the preceding year was recorded. Whether patients ever had any erosions and C1–C2 subluxation was examined in radiology reports. We obtained information on surgical history, extra-articular manifestations, physician's global assessment of arthritis activity, and medication use from a questionnaire at baseline in BRASS, which was completed by patients and physicians. If data were missing on radiology findings, laboratory tests, surgical history, or extra-articular manifestations, we assumed that no clinical information or radiologic/laboratory reports suggested that patients did not havesignificant RA symptoms at that time. The study was approved by the Institutional Review Board of Partners HealthCare (Boston, MA, USA).
To test the convergent validity of RARBIS as a measure of disease severity, the Spearman rank correlation between the RARBIS and the DAS28 was assessed in the total study population and in relevant subgroups, including age, gender, rheumatoid factor status, and disease duration. To examine whether different subscale weights improved the performance of the index, we re-weighted subscales and recalculated the RARBIS score. The original weights of the RARBIS were determined based on the finding of the Delphi panel rating . The surgical subscale was weighted more than the clinical subscale. The new weights were derived from the correlations between the DAS28 and subscales and the result from a multiple linear regression with the DAS28 as a dependent variable. Because clinical indicators and radiologic indicators were closely correlated with the DAS28 and the surgical history was not correlated with the DAS28, we up-weighted the clinical subscale and down-weighted the surgical subscale. Three different weighting systems included: exchanging the maximum scores of the clinical status subscale and the surgery subscale; up-weighting the clinical status subscale by a factor of two and removing the surgery subscale and the extra-articular manifestation subscale; multiplying each subscale by the regression coefficients of a linear regression of all subscales on the DAS28.
Patients characteristics and the RARBIS score
Characteristics of patients with rheumatoid arthritis (n = 100)
Number of Patients
Age, mean (SD (range)), years
59 (13.3 (25–86))
Age diagnosed for RA, mean (SD (range)), years
43 (14.3 (16–78))
Duration of RA, mean (SD (range)), years
15 (11.9 (0–50))
Number of rheumatology visits in last year, mean (SD (range))
4.5 (2.0 (1–12))
DAS28, mean (SD (range))
4.2 (1.6 (1.3–7.7))
Highest level of education: > high school
Physician global rating: poor
Hospitalized for RA in last year: yes
ACR Functional Classification* (worst in last year)
Class I (no limitation)
Class II (self-care, working, no hobbies)
Class III (self-care, not working, no hobbies)
Class IV (limited self-care, bed-bound)
Hours of morning stiffness† (worst in last year), hr
1 to 4
Number of flares in last year‡
1 to 4
Pulmonary nodule¶: ever
Joint erosion¶: ever
Distributions of subscales and total scores
Total RARBIS score
Total score with medication
Comparisons of the RARBIS with the DAS28
Spearman's rank correlation of the total RARBIS score with the DAS28
Total RARBIS score
0.23 – 0.56
0.24 – 0.57
-0.11 – 0.28
0.15 – 0.50
-0.19 – 0.20
-0.09 – 0.30
-0.21 – 0.18
Total score with medication
0.14 – 0.49
Correlations between the DAS28 and the total RARBIS score among subgroups
< 65 years (n = 65)
0.23 – 0.63
≥ 65 years (n = 35)
0.00 – 0.60
Male (n = 19)
0.09 – 0.79
Female (n = 81)
0.14 – 0.53
Negative (n = 27)
0.16 – 0.75
Positive (n = 67)
0.23 – 0.62
Duration of RA
< 5 years (n = 19)
-0.13 – 0.69
≥5 years (n = 81)
0.16 – 0.54
Correlations between the DAS28 and the revised RARBIS
The results of our study provide support for the convergent validity of the RARBIS with the DAS28. We are hopeful that the RARBIS can be used to help define RA severity but recognize that there are no well accepted measures of RA severity, making validation quite a challenge. RA severity is considered a complex measure determined by objective components such as disease activity (for example, tender/swollen joints and acute-phase reactants) and physical damage (for example, radiologic damage, and functional disability) and subjective components (for example, global health assessment, pain, grip strength, fatigue, and costs) [20, 21]. We chose to use the DAS28, a measure of disease activity, because it is commonly used for therapeutic decision-making.
Symmons and colleagues  developed a measure of overall status in RA composed of demographic details, activity score, damage score, and drug treatments . Bardwell and colleagues  reported a brief measure of severity for RA based on physician's rating of disease activity, functional impairment, and physical damage. Navarro-Cano and colleagues  measured RA disease severity using an RA component of the Duke Severity of Illness Checklist through a physician's assessment. A measure of RA functional status based on American College of Rheumatology standards  involves clinical assessment (for example, physical examination), laboratory tests (for example, ESR), and imaging procedures (for example, X-rays and magnetic resonance imaging), which may be the most accurate measure of RA severity. Unlike those measures, the RARBIS does not require a new physician's assessment and the information on indicators can be routinely collected from typical medical records. Thus, the RARBIS may have great utility for researchers using medical records.
The present study has several limitations. As we fully recognize and have noted, because there is no standard RA severity measure, we assessed the convergent, and not the criterion, validity of our index by comparing it with the DAS28. We assumed that the DAS28 should be highly correlated with RA severity because disease activity is deemed one of the core determinants of RA disease severity and the DAS28 includes patient-reported disease status. To enhance information for the RARBIS, we obtained information on surgical history, extra-articular manifestations, and physician's global assessment of arthritis activity from a questionnaire at baseline in BRASS. This modification did not change the properties of the index score in the present study.
We have examined the convergent validity of a medical records-based index of RA severity, the RARBIS. It is obtained simply by forming an arithmetic sum of indicators on a medical record. We propose it as a practical and useful tool for measuring RA severity. Because the RARBIS does not require a physician's assessment for its calculation, it is easily applied retrospectively to medical records. All of the data for the RARBIS are accessible from medical records. The ease of collecting these data is greatly enhanced by an integrated medical record that contains all laboratory, radiologic, and surgical information. In studies that assess associations between treatments and RA outcomes, the RARBIS will be useful to control for confounding by RA severity. Before our index can be recommended, it would be beneficial to further evaluate it in other populations as well as use other gold standards.
= Brigham and Women's Hospital Rheumatoid Arthritis Sequential Study
= confidence interval
= 28-joint Disease Activity Score
= erythrocyte sedimentation rate
= rheumatoid arthritis
= rheumatoid arthritis medical records-based index of severity
= standard deviation.
This work was supported by Engalitcheff Arthritis Outcomes Initiative (Arthritis Foundation, Maryland Chapter), NIH K23 AR48616, NIH R01 DA15507, NIH R55 AR48264, NIH K24 AR02123, and P60 AR47782.
- Grassi W, De Angelis R, Lamanna G, Cervini C: The clinical features of rheumatoid arthritis. Eur J Radiol. 1998, 27 (Suppl 1): S18-S24. 10.1016/S0720-048X(98)00038-2.View ArticlePubMedGoogle Scholar
- Lawrence RC, Helmick CG, Arnett FC, Deyo RA, Felson DT, Giannini EH, Heyse SP, Hirsch R, Hochberg MC, Hunder GG, et al: Estimates of the prevalence of arthritis and selected musculoskeletal disorders in the United States. Arthritis Rheum. 1998, 41: 778-799. 10.1002/1529-0131(199805)41:5<778::AID-ART4>3.0.CO;2-V.View ArticlePubMedGoogle Scholar
- Scott DL, Symmons DP, Coulton BL, Popert AJ: Long-term outcome of treating rheumatoid arthritis: results after 20 years. Lancet. 1987, 1: 1108-1111. 10.1016/S0140-6736(87)91672-2.View ArticlePubMedGoogle Scholar
- Pincus T, Brooks RH, Callahan LF: Prediction of long-term mortality in patients with rheumatoid arthritis according to simple questionnaire and joint count measures. Ann Intern Med. 1994, 120: 26-34.View ArticlePubMedGoogle Scholar
- Wolfe F, Mitchell DM, Sibley JT, Fries JF, Bloch DA, Williams CA, Spitz PW, Haga M, Kleinheksel SM, Cathey MA: The mortality of rheumatoid arthritis. Arthritis Rheum. 1994, 37: 481-494.View ArticlePubMedGoogle Scholar
- Solomon DH, Karlson EW, Rimm EB, Cannuscio CC, Mandl LA, Manson JE, Stampfer MJ, Curhan GC: Cardiovascular morbidity and mortality in women diagnosed with rheumatoid arthritis. Circulation. 2003, 107: 1303-1307. 10.1161/01.CIR.0000054612.26458.B2.View ArticlePubMedGoogle Scholar
- Gridley G, McLaughlin JK, Ekbom A, Klareskog L, Adami HO, Hacker DG, Hoover R, Fraumeni JF: Incidence of cancer among patients with rheumatoid arthritis. J Natl Cancer Inst. 1993, 85: 307-311.View ArticlePubMedGoogle Scholar
- Lee JH, Slifman NR, Gershon SK, Edwards ET, Schwieterman WD, Siegel JN, Wise RP, Brown SL, Udall JN, Braun MM: Life-threatening histoplasmosis complicating immunotherapy with tumor necrosis factor alpha antagonists infliximab and etanercept. Arthritis Rheum. 2002, 46: 2565-2570. 10.1002/art.10583.View ArticlePubMedGoogle Scholar
- Keane J, Gershon S, Wise RP, Mirabile-Levens E, Kasznica J, Schwieterman WD, Siegel JN, Braun MM: Tuberculosis associated with infliximab, a tumor necrosis factor alpha-neutralizing agent. N Engl J Med. 2001, 345: 1098-1104. 10.1056/NEJMoa011110.View ArticlePubMedGoogle Scholar
- Brown SL, Greene MH, Gershon SK, Edwards ET, Braun MM: Tumor necrosis factor antagonist therapy and lymphoma development: twenty-six cases reported to the Food and Drug Administration. Arthritis Rheum. 2002, 46: 3151-3158. 10.1002/art.10679.View ArticlePubMedGoogle Scholar
- Mohan N, Edwards ET, Cupps TR, Oliverio PJ, Sandberg G, Crayton H, Richert JR, Siegel JN: Demyelination occurring during anti-tumor necrosis factor alpha therapy for inflammatory arthritides. Arthritis Rheum. 2001, 44: 2862-2869. 10.1002/1529-0131(200112)44:12<2862::AID-ART474>3.0.CO;2-W.View ArticlePubMedGoogle Scholar
- Matteson EL, Hickey AR, Maguire L, Tilson HH, Urowitz MB: Occurrence of neoplasia in patients with rheumatoid arthritis enrolled in a DMARD Registry. Rheumatoid Arthritis Azathioprine Registry Steering Committee. J Rheumatol. 1991, 18: 809-814.PubMedGoogle Scholar
- Silman AJ, Petrie J, Hazleman B, Evans SJ: Lymphoproliferative cancer and other malignancy in patients with rheumatoid arthritis treated with azathioprine: a 20 year follow up study. Ann Rheum Dis. 1988, 47: 988-992.PubMed CentralView ArticlePubMedGoogle Scholar
- Walker AM: Confounding by indication. Epidemiology. 1996, 7: 335-336.PubMedGoogle Scholar
- Strom B: Pharmacoepidemiology. 2000, Philadelphia: John Wiley & Sons, 3View ArticleGoogle Scholar
- Cabral D, Katz JN, Weinblatt ME, Ting G, Avorn J, Solomon DH: Development and assessment of indicators of rheumatoid arthritis severity: results of a Delphi panel. Arthritis Rheum. 2005, 53: 61-66. 10.1002/art.20925.View ArticlePubMedGoogle Scholar
- Ting G, Schneeweiss S, Katz JN, Weinblatt ME, Cabral D, Scranton RE, Solomon DH: Performance of a rheumatoid arthritis records-based index of severity. J Rheumatol. 2005, 32: 1679-1687.PubMedGoogle Scholar
- van der Heijde DM, van't Hof M, van Riel PL, van de Putte LB: Development of a disease activity score based on judgment in clinical practice by rheumatologists. J Rheumatol. 1993, 20: 579-581.PubMedGoogle Scholar
- Prevoo ML, van't Hof MA, Kuper HH, van Leeuwen MA, van de Putte LB, van Riel PL: Modified disease activity scores that include twenty-eight-joint counts. Development and validation in a prospective longitudinal study of patients with rheumatoid arthritis. Arthritis Rheum. 1995, 38: 44-48.View ArticlePubMedGoogle Scholar
- Wolfe F: The prognosis of rheumatoid arthritis: assessment of disease activity and disease severity in the clinic. Am J Med. 1997, 103: 12S-8S. 10.1016/S0002-9343(97)90003-6.View ArticlePubMedGoogle Scholar
- Wolfe F, O'Dell JR, Kavanaugh A, Wilske K, Pincus T: Evaluating severity and status in rheumatoid arthritis. J Rheumatol. 2001, 28: 1453-1462.PubMedGoogle Scholar
- Symmons DP, Hassell AB, Gunatillaka KA, Jones PJ, Schollum J, Dawes PT: Development and preliminary assessment of a simple measure of overall status in rheumatoid arthritis (OSRA) for routine clinical use. QJM. 1995, 88: 429-437.PubMedGoogle Scholar
- Birrell FN, Hassell AB, Jones PW, Dawes PT: Why not use OSRA? A comparison of Overall Status in Rheumatoid Arthritis (RA) with ACR core set and other indices of disease activity in RA. J Rheumatol. 1998, 25: 1709-1715.PubMedGoogle Scholar
- Bardwell WA, Nicassio PM, Weisman MH, Gevirtz R, Bazzo D: Rheumatoid Arthritis Severity Scale: a brief, physician-completed scale not confounded by patient self-report of psychological functioning. Rheumatology (Oxford). 2002, 41: 38-45. 10.1093/rheumatology/41.1.38.View ArticleGoogle Scholar
- Navarro-Cano G, Del Rincon I, Pogosian S, Roldan JF, Escalante A: Association of mortality with disease severity in rheumatoid arthritis, independent of comorbidity. Arthritis Rheum. 2003, 48: 2425-2433. 10.1002/art.11127.View ArticlePubMedGoogle Scholar
- Hochberg MC, Change RW, Dwosh I, Lindsey S, Pincus T, Wolfe F: The American College of Rheumatology revised criteria for the classification of global functional status in rheumatoid arthritis. Arthritis Rheum. 1992, 35: 498-502.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.