Volume 4 Supplement 2
The determination and measurement of functional disability in rheumatoid arthritis
© BioMed Central Ltd 2002
Received: 10 December 2001
Accepted: 15 February 2002
Published: 8 April 2002
Although functional outcome is frequently discussed and written about, it is often not clear what functional outcome is and how it can be measured. This paper introduces the concept of latent and observed measures of functional disability, and distinguishes between disability as a process measure and disability as an outcome measure. Using the Health Assessment Questionnaire as the main functional outcome measure in rheumatoid arthritis, we propose and discuss several methods for determining disability, and describe the implications of altering the disability course.
Keywordsdisability functional disability Health Assessment Questionnaire outcome rheumatoid arthritis
Functional outcome in rheumatoid arthritis
Is a dichotomous or binary event that can be thought of as representing an underlying continuum
Is defined by a time variable
Is both a patient outcome and a disease outcome
May be defined by an observed or latent variable
Can be identified using area under the curve methods
Can be identified using the sustained level method
Outcomes are discrete or binary events. Work disability is such an event, as is reaching a certain level of Health Assessment Questionnaire (HAQ) [1, 2] impairment or having an average HAQ score of 2 for a period of 1 year. Although events are binary (0 or 1), they can be thought of as part of an underlying, unobserved continuum. For example, a patient can be increasingly work impaired until the point when the patient can no longer work and becomes work-disabled. At that point, the outcome changes from 0 to 1.
Outcomes are also events that are associated with and defined by duration of illness. For example, the proportion of patients work-disabled at 10 years is a meaningful description, but the proportion of patients work-disabled without a duration designator is meaningless and cannot be interpreted. In addition to requiring time as part of the definition of outcome, outcome implies a sense of permanency. Outcomes are irreversible (mortality, joint replacement) or are at least very difficult to reverse (work disability). For functional disability to truly be an outcome measure, it must be present for a sustained period at a defined level.
Outcomes can be further separated as to whether they are disease outcomes or patient outcomes. Although these groupings may overlap, patient outcomes refer to those outcomes that have meaning to the patient. For example, the level of functional disability or the ability to work are important patient outcomes, but the number of erosions or the level of interleukin-6 are not.
Outcomes, like variables, can be observed or latent. An observed variable can be measured directly, such as age, sex, or HAQ score. An observed outcome refers to events like work disability, death, the number of erosions, or the level of HAQ disability. Variables can also be unobserved or latent, in which case they represent the underlying construct or continuum that was mentioned earlier.
In many instances in rheumatology, we are forced to accept the variables we can observe rather than the underlying concepts we wish to measure. We do not have good measures for the latent variable functional ability, so we are forced to accept surrogates like HAQ score or functional scores from the Medical Outcomes Study Short Form 36 [3, 4] or Arthritis Impact Measurement Scales . When we accept surrogates, we introduce substantial error because these measures are only approximate measures of function or disability. The HAQ, for example, can be quite abnormal in individuals with little apparent functional loss, and can be normal in individuals with substantial and obvious dysfunction . Because of the problems in ascertaining a latent outcome, researchers often preferentially measure observed outcomes such as work disability [6–10], joint replacement surgery , income , or death [13–16]. Yet these outcomes also have their problems because they often take too long to occur, because they may not apply to all patients, and because they do not touch on the day-to-day substance of RA.
A number of approaches may be used to better define HAQ scores, including smoothing and summarizing or condensing. One method to better define HAQ scores involves measuring the area under the curve (AUC) of HAQ scores (long diagonal line of Figs 3 and 4). Notice that the irregularity of the HAQ scores (bottom of Fig. 3 and inset of Fig. 4) is removed by the AUC measurement. The AUC is a measurement of the sustained burden of functional loss on the individual. To use it as an outcome measure, a cut-off value must be chosen. For example, we might decide that a patient with 10 AUC units in 10 years or 8 AUC units in 7 years has sustained clinically important functional impairment.
One limitation of this method occurs when we are dealing with left censored data, as is often the case in rheumatology. In such an instance, we may choose to use as our measuring period (time variable) the time the patient is under our observation. We can alternatively choose to impute the AUC values before the patient came under our observation, perhaps using the average observed HAQ score. To do this, however, introduces additional error that may or may not be acceptable depending on the uses of the data.
Another method of determining outcome with the HAQ is to require that a certain value of the HAQ be sustained for a defined time period. In Figure 4 (inset), the horizontal bidirectional arrow indicates a sustained period of HAQ disability defined by a value of at least 2 for at least 2 years.
The investigator frequently does not have longitudinal data. Is it correct to take a single value or a few values and infer that they represent HAQ outcome? Given the variability of the HAQ scores in Figures 3 and 4, using a single measure will lead to an imprecise and inefficient measure of outcome. Additionally, it confounds the separate definitions of process and outcome measures.
Inferences about functional disability
All recent disease-modifying antirheumatic drugs have been shown to reduce HAQ disability over the duration of their clinical trials [19–23]. Is it reasonable to infer outcome differences based on shorter term results and results that come from clinical trials, knowing that clinical trials may not be representative of actual results in the community? The best that can be said is that it is a starting point, perhaps an indication of what we might expect to see if drugs actually worked as well in practice as they do in randomized clinical trials.
Using data from Figure 4, if the HAQ score was reduced by 0.25 units (an amount of reduction shown in most recent trials), then the total AUC of disability would be reduced from 36.28 disability years to 31.76 disability years, a reduction of 4.52 disability years. Using our definition of a HAQ score of 2 or greater for at least 2 years, disability would be postponed in this patient by 4.62 years. Small changes in HAQ levels can thus translate into important, clinically meaningful changes in outcome if all of the assumptions noted in the present paper hold.
The importance of longitudinal studies is that they provide the validation or refutation of the extrapolation of clinical results to the full population of RA patients in the community.
area under the curve
Health Assessment Questionnaire
- Fries JF, Spitz P, Kraines RG, Holman HR: Measurement of patient outcome in arthritis. Arthritis Rheum. 1980, 23: 137-145.PubMedView Article
- Wolfe F: A reappraisal of HAQ disability in rheumatoid arthritis. Arthritis Rheum. 2000, 43: 2751-2761. 10.1002/1529-0131(200012)43:12<2751::AID-ANR15>3.0.CO;2-6.PubMedView Article
- Keller SD, Majkut TC, Kosinski M, Ware JE: Monitoring health outcomes among patients with arthritis using the SF-36 health survey: overview. Med Care. 1999, 37: MS1-MS9. 10.1097/00005650-199905001-00001.PubMedView Article
- Ware JE, Sherbourne CD: The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992, 30: 473-483.PubMedView Article
- Meenan RF, Gertman PM, Mason JH: Measuring health status in arthritis. The arthritis impact measurement scales. Arthritis Rheum. 1980, 23: 146-152.PubMedView Article
- Sokka T, Pincus T: Markers for work disability in rheumatoid arthritis. J Rheumatol. 2001, 28: 1718-1722.PubMed
- Young A, Dixey J, Cox N, Davies P, Devlin J, Emery P, Gallivan S, Gough A, James D, Prouse P, Williams P, Winfield J: How does functional disability in early rheumatoid arthritis (RA) affect patients and their lives? Results of 5 years of follow-up in 732 patients from the Early RA Study (ERAS). Rheumatology (Oxford). 2000, 39: 603-611. 10.1093/rheumatology/39.6.603.View Article
- Jantti J, Aho K, Kaarela K, Kautiainen H: Work disability in an inception cohort of patients with seropositive rheumatoid arthritis: a 20 year study. Rheumatology (Oxford). 1999, 38: 1138-1141. 10.1093/rheumatology/38.11.1138.View Article
- Wolfe F, Hawley DJ: The longterm outcomes of rheumatoid arthritis: Work disability: a prospective 18 year study of 823 patients. J Rheumatol. 1998, 25: 2108-2117.PubMed
- Mau W, Bornmann M, Weber H: Work disability work in the first year of chronic polyarthritis. A comparison with members of the legal health insurance [in German]. Z Rheumatol. 1997, 56: 1-7. 10.1007/s003930050015.PubMed
- Wolfe F, Zwillich SH: The long-term outcomes of rheumatoid arthritis: a 23-year prospective, longitudinal study of total joint replacement and its predictors in 1,600 patients with rheumatoid arthritis. Arthritis Rheum. 1998, 41: 1072-1082. 10.1002/1529-0131(199806)41:6<1072::AID-ART14>3.0.CO;2-G.PubMedView Article
- Yelin E: The earnings, income, and assets of persons aged 51–61 with and without musculoskeletal conditions. J Rheumatol. 1997, 24: 2024-2030.PubMed
- Chehata JC, Hassell AB, Clarke SA, Mattey DL, Jones MA, Jones PW, Dawes PT: Mortality in rheumatoid arthritis: relationship to single and composite measures of disease activity. Rheumatology (Oxford). 2001, 40: 447-452. 10.1093/rheumatology/40.4.447.View Article
- Gabriel SE, Crowson CS, O'Fallon WM: Mortality in rheumatoid arthritis: have we made an impact in 4 decades?. J Rheumatol. 1999, 26: 2529-2533.PubMed
- Turesson C, Jacobsson L, Bergstrom U, Truedsson L, Sturfelt G: Predictors of extra-articular manifestations in rheumatoid arthritis. Scand J Rheumatol. 2000, 29: 358-364. 10.1080/030097400447552.PubMedView Article
- Wolfe F, Mitchell DM, Sibley JT, Fries JF, Bloch DA, Williams CA, Spitz PW, Haga M, Kleinheksel SM, Cathey MA: The mortality of rheumatoid arthritis. Arthritis Rheum. 1994, 37: 481-494.PubMedView Article
- Greenwood MC, Doyle DV, Ensor M: Does the Stanford Health Assessment Questionnaire have potential as a monitoring tool for subjects with rheumatoid arthritis?. Ann Rheum Dis. 2001, 60: 344-348. 10.1136/ard.60.4.344.PubMedPubMed CentralView Article
- Wolfe F, Pincus T, Fries JF: Usefulness of the HAQ in the clinic [letter]. Ann Rheum Dis. 2001, 60: 811-10.1136/ard.60.8.811.PubMedPubMed CentralView Article
- Wolfe F: Which HAQ is best? A comparison of the HAQ, MHAQ, and RA-HAQ, a difficult 8 item HAQ (DHAQ), and a rescored 20 item HAQ (HAQ20): analyses in 2,491 rheumatoid arthritis patients following leflunomide initiation. J Rheumatol. 2001, 28: 982-989.PubMed
- Smolen JS, Kalden JR, Scott DL, Rozman B, Kvien TK, Larsen A, Loew-Friedrich I, Oed C, Rosenburg R: Efficacy and safety of leflunomide compared with placebo and sulphasalazine in active rheumatoid arthritis: a double-blind, randomised, multi-centre trial. Lancet. 1999, 353: 259-266. 10.1016/S0140-6736(98)09403-3.PubMedView Article
- Lipsky PE, van der Heijde DM, St Clair EW, Furst DE, Breedveld FC, Kalden JR, Smolen JS, Weisman M, Emery P, Feldmann M, Harriman GR, Maini RN: Infliximab and methotrexate in the treatment of rheumatoid arthritis. Anti-Tumor Necrosis Factor Trial in Rheumatoid Arthritis with Concomitant Therapy Study Group. N Engl J Med. 2000, 343: 1594-1602. 10.1056/NEJM200011303432202.PubMedView Article
- Bresnihan B: The safety and efficacy of interleukin-1 receptor antagonist in the treatment of rheumatoid arthritis. Semin Arthritis Rheum. 2001, 30 (5 suppl 2): 17-20. 10.1053/sarh.2001.23701.PubMedView Article
- Bathon JM, Martin RW, Fleischmann RM, Tesser JR, Schiff MH, Keystone EC, Genovese MC, Wasko MC, Moreland LW, Weaver AL, Markenson J, Finck BK: A comparison of etanercept and methotrexate in patients with early rheumatoid arthritis. N Engl J Med. 2000, 343: 1586-1593. 10.1056/NEJM200011303432201.PubMedView Article