- Research article
- Open Access
Comprehensibility, reliability, validity, and responsiveness of the Thai version of the Health Assessment Questionnaire in Thai patients with rheumatoid arthritis
Arthritis Research & Therapyvolume 11, Article number: R129 (2009)
The Health Assessment Questionnaire Disability Index (HAQ-DI) is a commonly used instrument to assess functional status of patients with rheumatoid arthritis (RA). Translations and adaptations of the HAQ-DI have been carried out for use with RA patients in several countries. The objective of this study was to evaluate the psychometric properties of the Thai version of the HAQ-DI (Thai HAQ) in Thai patients with RA.
Comprehensibility of the Thai HAQ was assessed by 126 patients with RA from 6 medical centers in Thailand. Another group of 115 patients with active RA was enrolled to test the reliability (internal reliability and 1-week test-retest reliability), construct validity (correlations with other measures of RA disease activity), floor and ceiling effects, and sensitivity to change of the Thai HAQ at 3 months of treatment with disease-modifying antirheumatic drugs.
More than 98% of the patients regarded the Thai HAQ as comprehensible. The internal consistency of the Thai HAQ was satisfactory with the overall Cronbach alpha of 0.91. The test-retest reliability of the Thai HAQ was acceptable with the intraclass correlation coefficient of 0.89. Moderate correlations between the Thai HAQ and other outcomes of RA disease activity were observed, except erythrocyte sedimentation rate, with the Spearman correlation coefficients ranging from 0.42 to 0.57. The responsiveness of the Thai HAQ was moderate, with a standardized response mean of 0.75 (95% confidence interval 0.56 to 0.94).
The Thai HAQ is comprehensible, reliable, valid and sensitive to change in the evaluation of functional status of Thai patients with RA. The Thai HAQ is an essential tool to measure treatment effects and progression of disability in RA patients and should be applied in both clinical trials and routine clinical care settings.
The Stanford Health Assessment Questionnaire (HAQ) was originally developed to measure five important health outcomes in patients with chronic diseases [1, 2]. These dimensions include premature death, functional disability, pain and discomfort, adverse effects of treatment, and costs. The HAQ Disability Index (HAQ-DI), the HAQ section to evaluate functional capacity, is the most commonly used instrument for assessing disability in patients with rheumatoid arthritis (RA). The HAQ-DI is a predictive factor of future disability and joint damage in patients with RA [3–5]. Because it demonstrated sensitivity to change, the HAQ-DI was chosen by the Outcome Measures in Rheumatology Clinical Trials (OMERACT) and the American College of Rheumatology (ACR) to be incorporated into the core set of outcome measures of RA disease activity [6–8]. The HAQ-DI not only is considered an essential measure of disability in patients with RA in clinical trials, but also is used in clinical practice.
The HAQ-DI has been translated and adapted to suit the activities and cultures in diverse populations from more than 50 countries [9, 10]. As with the original HAQ-DI, a number of translations of the HAQ-DI into other languages have been proven to be reliable, valid, and sensitive to change. For the Thai version of the HAQ-DI (Thai HAQ), three items were adapted and two activities were added to the existing items to tailor the questionnaire to the lifestyle and culture of Thai people. The Thai HAQ was back-translated and tested for its validity and responsiveness in a pilot study at a tertiary care hospital in Thailand . However, psychometric validation of the Thai HAQ is still important if it is to be recommended as a standard instrument to measure long-term disability in Thai patients with RA. It is also needed for demonstrating the effectiveness of disease-modifying antirheumatic drug (DMARD) therapy, especially with the expensive biologics, and for use in guidelines to follow the patients over time. Thus, the objective of this study was to evaluate the comprehensiveness, reliability, validity, and responsiveness of the Thai HAQ in Thai-speaking patients with RA from different parts of the country.
Materials and methods
One hundred twenty-six adult patients who met the ACR 1987 revised criteria for the classification of RA  were included in the comprehensibility assessment of the Thai HAQ. These patients were enrolled from six medical centers in Thailand from January to April 2006 regardless of their disease activity. The comprehensibility questionnaire was self-reported by the patients. For older patients and those with poor eyesight, the responses were performed with the assistance of relatives who accompanied them and of rheumatology nurses at the clinics. The patients were asked whether they understood the 20 items from the eight domains of the Thai HAQ. The levels of comprehensibility for each item were categorized on a 4-point scale (0, not comprehensible; 1, slightly comprehensible; 2, moderately comprehensible; and 3, highly comprehensible). Scores of 2 or more for each item were regarded as comprehensible.
Reliability, validity, and responsiveness
From the same six institutes, 115 more patients with RA were consecutively selected between January 2006 and July 2007 to be included in this part of study. Each patient had to fulfill all of the following criteria: (a) met the ACR 1987 revised criteria for the classification of RA , (b) was at least 18 years of age, and (c) had active disease characterized by (i) at least six tender joints, (ii) at least six swollen joints, (iii) a Westergren erythrocyte sedimentation rate (ESR) of at least 28 mm/hour, and (iv) at study entry, just starting a non-biologic DMARD, an increase in the dose of a non-biologic DMARD, or the addition of another non-biologic DMARD. The patients were excluded if they were pregnant or breastfeeding, receiving prednisolone at a dose of more than 10 mg per day, or did not give informed consent. The mode of Thai HAQ administration was similar to that of the comprehensibility assessment. The assessments of reliability, validity, and responsiveness of the Thai HAQ were conducted in accordance with the OMERACT filter for outcome measures in RA . Both parts of the study protocols were approved by the ethics committees of each institute. This study was conducted in accordance with the Declaration of Helsinki. All patients were required to give written informed consent before entering this study.
The Thai HAQ
The Thai HAQ included 20 items from eight domains adapted from the original HAQ-DI to suit Thai culture and activities. The ability to perform an activity for each item is rated on a 4-level scale, in which the score ranges from 0 (no difficulty in performing that activity) to 3 (inability to perform that activity). The requirement of a device or physical assistance in any item increases the lower score to 2. To calculate the HAQ-DI score, the maximum scores from each domain were summed and divided by 8 to yield a score that ranged from 0 to 3. The higher score indicated greater disability.
Baseline characteristics of the studied patients were presented as number and percentage for discrete parameters and as mean and standard deviation (SD) for continuous parameters. Comprehensibility assessment of the Thai HAQ was presented as percentage of patients with moderate or high comprehensibility in the Thai HAQ.
Reliability was assessed by test-retest reliability and internal consistency. The test-retest reliability was performed with a 1-week interval. This interval was used because the patients would not be able to remember the first test and the effects of DMARDs added were not expected at 1 week of treatment. The patients completed the first Thai HAQ at their clinic visits. The second was sent to them by mail. Test-retest reliability of the Thai HAQ was analyzed using intraclass correlation coefficients (ICCs). The ICCs and their 95% confidence intervals (CIs) were calculated using a two-way random-effects model. An ICC value of 0.85 or higher was considered acceptable . Internal consistency among each domain of the Thai HAQ was evaluated by Cronbach alpha using the results from the first administration. The overall Cronbach alpha was calculated from all eight domains of the Thai HAQ. For each domain, Cronbach alpha was obtained by deleting that domain from the questionnaire .
Construct validity of the Thai HAQ was performed by correlating the baseline eight domains and total scores of the Thai HAQ with the following outcome measures of RA disease activity: number of tender joints (total 68 joints), number of swollen joints (66 joints), patient's assessment of pain, patient global assessment of disease activity, physician global assessment of disease activity, and ESR. Pain score and patient and physician global assessments of disease activity were measured on a 5-level categorical scale, in which the higher score indicated greater pain and worse disease status. The correlation coefficients used in this study were Spearman correlation coefficients. Correlation coefficients of greater than 0.6, of 0.6 to 0.3, and of less than 0.3 were considered strong, moderate, and weak correlations, respectively . The Thai HAQ was also evaluated for floor and ceiling effects. Floor and ceiling effects were considered to be present if at least 15% of the patients scored 0 (the lowest possible score) or 3 (the highest possible score), respectively, on the Thai HAQ .
Responsiveness of the Thai HAQ and other measures of RA disease activity was calculated from the baseline values and the values at month 3. To assess the responsiveness of the Thai HAQ and other parameters, the differences between baseline and month 3 scores were used for calculating the standardized response mean (SRM) from the formula:
The SRM value between 0.6 and 0.8 is considered moderate effect and clinically significant. The value of greater than 0.8 represents large effect [17, 18]. The statistical software used in this study was SPSS for Windows, version 11.0 (SPSS Inc., Chicago, IL, USA). The statistically significant level was determined as a P value of less than 0.05.
Demographic data of both groups of studied patients are shown in Table 1. The comprehensibility of the Thai HAQ was assessed by 126 patients, whose domiciles were distributed in all parts of the country. Twenty-six patients (20.6%) were from Bangkok. Among the others, 35 (27.8%) resided in Central Thailand, 23 (18.3%) in the North, 11 (8.7%) in the Northeast or East, and 31 (24.6%) in the Southern part of Thailand. The mean (SD) age of the studied patients was 50.5 (13.0) years. One hundred fourteen patients (90.5%) were women. Although 68.3% of the patients (86 patients) completed only primary education (that is, 6 years of formal education), more than 90% of the 126 patients scored each item of the Thai HAQ as moderately or highly comprehensible, as shown in Table 2.
Of the 115 patients with RA enrolled to test the reliability, validity, and responsiveness of the Thai HAQ, 99 (86.1%) were women. The mean (SD) age was 48.9 (11.9) years, and the mean (SD) disease duration was 68.9 (71.8) months. Rheumatoid factor was positive in 77%. The mean (SD) Thai HAQ score at baseline was 1.56 (0.75).
Internal consistency of the Thai HAQ was satisfactory, with the Cronbach alpha of 0.910 among all eight domains. Removal of each domain of the Thai HAQ did not produce a significant change in the Cronbach alpha. The highest alpha was 0.899 when the dressing domain was deleted and the lowest alpha was 0.886 when the reach or activity domain was excluded from the Thai HAQ.
Test-retest reliability of each domain and total Thai HAQ scores was acceptable. The average measure ICC of the Thai HAQ was 0.89 (95% CI 0.84 to 0.92). For each domain of the Thai HAQ, the estimates of ICC ranged from 0.77 to 0.87. The mean and SD of each domain of the Thai HAQ at baseline and day 7 as well as the ICCs and 95% CIs are shown in Table 3.
The Spearman correlation coefficients for construct validity of each domain of the Thai HAQ and total Thai HAQ scores are shown in Table 4. Moderate correlation was observed between the majority of Thai HAQ domains as well as the Thai HAQ and outcomes of RA disease activity. These correlation coefficients ranged from 0.30 to 0.57. The highest correlation coefficient was observed between the Thai HAQ and ACR functional class (correlation coefficient 0.57), whereas the lowest was seen between the Thai HAQ and ESR (correlation coefficient 0.37). ESR correlated weakly with four domains of the Thai HAQ (dressing and grooming, walking, grip, and activity domains). The grip and walking domains of the Thai HAQ also had weak correlations with the number of swollen joints, number of tender joints, and pain level.
Floor and ceiling effects of the Thai HAQ were not observed in the studied patients. At baseline, none (0%) scored 0 or 3 on the Thai HAQ. At 3 months of treatment, 6 patients (5.2%) scored 0 and 1 patient (0.9%) scored 3.
Responsiveness of the Thai HAQ and other measures of RA disease activity was moderate as the SRMs were 0.6 or higher, except for ESR. The SRM for the patient global assessment of disease activity was the highest (0.94), whereas that for the Thai HAQ was 0.75. The SRMs for the Thai HAQ compared with the other measures of RA disease activity are shown in Table 5.
Approximately 90% of the patients enrolled in this study were women. The high proportion of female patients with RA was observed across all six institutes (range 73.3% to 96.8%). This finding was because more women than men are affected by RA and because women with chronic rheumatic diseases in Thailand generally comply with long-term treatment better than men do.
Our study has shown that the Thai HAQ is comprehensible among Thai patients with RA recruited from different parts of Thailand. Despite the finding that more than 70% of the patients had a limited educational level, there was no significant variation in the comprehensibility of each item of the Thai HAQ. All 126 patients regarded nine items as comprehensible. Only one and two patients, respectively, rated eight and three items of the Thai HAQ as slightly comprehensible. Among the three items with the least comprehensibility, two of these ('get up from a chair without armrests' and 'reach a 2-kg object from an overhanging cupboard') are common activities in many urbanized populations. However, neither of these activities is considered common by older Thai people who get used to living in the traditional Thai style. The other item, sweep and mop, a common activity for Thai people, was rated as slightly comprehensible by two older patients with RA who no longer performed this activity. The comprehensibility of the Thai HAQ was higher than that of the Korean HAQ, which ranged from 76% to 98% .
The Thai HAQ scores that included and excluded the use of aids/devices or assistance varied between 0 and 0.25 (data not shown). Use of aids/devices or other people's assistance may enhance the HAQ-DI scores . In this study, most patients who required aids/devices or assistance scored that item 3, instead of 2, as they were unable to do that activity by themselves.
The Thai HAQ has been demonstrated to have satisfactory internal consistency with the Cronbach alpha of 0.910. The Cronbach alpha for each item of the Thai HAQ was also high and varied insignificantly. Our findings were comparable to the results from the HAQ-DI in other Asian countries, including South Korea , China , Kuwait , and Japan . The Cronbach alpha in these studies ranged from 0.86 to 0.95. Test-retest reliability of the Thai HAQ has been shown to be acceptable with the ICC of 0.89. The test-retest reliability of the Thai HAQ was less than those of the Korean and Japanese HAQs but was higher than the Chinese and Arabic HAQs. For each domain of the Thai HAQ, only the walking domain had an ICC of greater than 0.85. The mean scores of each domain of the Thai HAQ and total scores in the second administration were lower than those in the first visit. This finding was not explained by the effects of DMARDs added but might be caused by the advice from the physicians to rest the inflamed joints or the adjustment of nonsteroidal anti-inflammatory drugs and/or analgesics, which should take effect within 1 week.
The method of assessing test-retest reliability of the Thai HAQ by self-administration on the first visit and mailed response 1 week later was similar to those of the Korean and Japanese HAQ studies. Potential biases incurred from a mailed response, such as the incompleteness of filling out the questionnaire and failure to return the response, were avoided.
The Thai HAQ has been demonstrated to correlate moderately with the other measures of RA disease activity. The correlation coefficients between the Thai HAQ and patient global assessment of disease activity and ACR functional class were higher than those between the Thai HAQ and number of tender joints, number of swollen joints, physician global assessment of disease activity, and pain level. Weak correlations were found between the walking domain and number of swollen joints and between the grip domain and number of tender joints, number of swollen joints, and pain level. Newly designed devices (that is, car doors, faucets, and containers) and footwear and improvement of fabric quality (for the wring cloth item) may help improve the patient's ability to perform the activities in the grip and walking domains.
The lowest correlation coefficient was observed between the Thai HAQ and ESR. This finding corroborated with the results from the Arabic, Chinese, and Korean HAQs as ESR correlates better with RA disease duration, radiographic changes, and joint deformity than with functional disability . Three measures of RA disease activity, including patient and physician global assessments of disease activity and ACR functional class, had moderate correlation with all domains of the Thai HAQ. These correlations emphasized the importance of function on the overall health status of patients with RA.
Floor and ceiling effects of the Thai HAQ were not detected at either baseline or month 3 of treatment in this study. These effects were not investigated in the Arabic, Chinese, Japanese, or Korean HAQs. At month 3 of DMARD treatment, very few patients reported the lowest and highest possible scores. Six patients who reported the Thai HAQ score of 0 had significant improvement in their function after DMARD treatment. The only patient who scored 3 was an older patient who already had severe disability at baseline and did not respond to the increment of methotrexate dosage.
Responsiveness of the Thai HAQ measured as SRM was regarded as moderate effect and clinically significant. Large response means (SRM >0.8) were observed for the patient and physician global assessments of disease activity and for pain level. Moderate response means were found for the Thai HAQ (0.75) and number of swollen joints (0.64), whereas the number of tender joints and ACR functional class had the SRM closed to moderate effect (0.59). Our study has shown that patient-reported outcomes, including the Thai HAQ, were more efficient than physician-related outcomes, such as the numbers of tender and swollen joints, in detecting treatment effect. As expected, a small response mean was observed for the ESR (0.41).
This study, together with our previous work, demonstrates that the Thai HAQ has been shown to be comprehensible, reliable, valid, and sensitive to change in detecting disability in Thai patients with RA. Our findings have confirmed the validity of using the Thai HAQ as an instrument to measure functional status of RA patients after treatment with DMARDs or biologic agents or both in clinical trials and daily practice.
American College of Rheumatology
disease-modifying antirheumatic drug
erythrocyte sedimentation rate
Health Assessment Questionnaire
Health Assessment Questionnaire Disability Index
intraclass correlation coefficient
Outcome Measures in Rheumatology Clinical Trials
standardized response mean
- Thai HAQ:
Thai version of the Health Assessment Questionnaire Disability Index.
Fries JF, Spitz PW, Kraines RG, Holman HR: Measurement of patient outcome in arthritis. Arthritis Rheum. 1980, 23: 137-145. 10.1002/art.1780230202.
Fries JF, Spitz PW, Young DY: The dimensions of health outcomes: the health assessment questionnaire, disability and pain scales. J Rheumatol. 1982, 9: 789-793.
Cohen JD, Dougados M, Goupille P, Cantagrel A, Meyer O, Sibilia J, Daurès JP, Combe B: Health assessment questionnaire score is the best predictor of 5-year quality of life in early rheumatoid arthritis. J Rheumatol. 2006, 33: 1936-1941.
Lindqvist E, Saxne T, Geborek P, Eberhardt K: Ten year outcome in a cohort of patients with early rheumatoid arthritis: health status, disease process, and damage. Ann Rheum Dis. 2002, 61: 1055-1059. 10.1136/ard.61.12.1055.
Drossaers-Bakker KW, Zwinderman AH, Vliet Vlieland TP, Van Zeben D, Vos K, Breedveld FC, Hazes JM: Long-term outcome in rheumatoid arthritis: a simple algorithm of baseline parameters can predict radiographic damage, disability, and disease course at 12-year followup. Arthritis Rheum. 2002, 47: 383-390. 10.1002/art.10513.
Felson DT, Anderson JJ, Boers M, Bombardier C, Chernoff M, Fried B, Furst D, Goldsmith C, Kieszak S, Lightfoot R, Paulus H, Tugwell P, Weinblatt M, Widmark R, Williams HJ, Wolfe F: The American College of Rheumatology preliminary core set of disease activity measures for rheumatoid arthritis clinical trials. Arthritis Rheum. 1993, 36: 729-740. 10.1002/art.1780360601.
Boers M, Tugwell P, Felson DT, van Riel PL, Kirwan JR, Edmonds JP, Smolen JS, Khaltaev N, Muirden KD: World Health Organization and International League of Associations for Rheumatology core endpoints for symptom modifying antirheumatic drugs in rheumatoid arthritis clinical trials. J Rheumatol Suppl. 1994, 41: 86-89.
Boers M, Brooks P, Strand CV, Tugwell P: The OMERACT filter for Outcome Measures in Rheumatology. J Rheumatol. 1998, 25: 198-199.
Bruce B, Fries JF: The Stanford Health Assessment Questionnaire: a review of its history, issues, progress, and documentation. J Rheumatol. 2003, 30: 167-178.
Ramey D, Raynauld J, Fries J: The Health Assessment Questionnaire 1992: status and review. Arthritis Care Res. 1992, 5: 119-129. 10.1002/art.1790050303.
Osiri M, Deesomchok U, Tugwell P: Evaluation of functional ability of Thai patients with rheumatoid arthritis by the use of a Thai version of the Health Assessment Questionnaire. Rheumatology. 2001, 40: 555-558. 10.1093/rheumatology/40.5.555.
Arnett FC, Edworthy SM, Bloch DA, McShane DJ, Fries JF, Cooper NS, Healey LA, Kaplan SR, Liang MH, Luthra HS, Medsger TA, Mitchell DM, Neustadt DH, Pinals RS, Schaller JG, Sharp JT, Wilder RL, Hunder GG: The American Rheumatism Association 1987 revised criteria for the classification of rheumatoid arthritis. Arthritis Rheum. 1988, 31: 315-324. 10.1002/art.1780310302.
Streiner DL, Norman GR: Health Measurement Scales: A Practical Guide to Their Development and Use. 2005, New York: Oxford University Press, 3
Cronbach LJ: Coefficient α and the internal structure of tests. Psychometrika. 1951, 16: 297-334. 10.1007/BF02310555.
Hinkle DE, Wiersma W, Jurs SG: Applied Statistics for the Behavioral Sciences. 1998, Boston: Houghton Mifflin, 5
McHorney CA, Tarlov AR: Individual-patient monitoring in clinical practice: are available health status surveys adequate?. Qual Life Res. 1995, 4: 293-307. 10.1007/BF01593882.
Wells G, Li T, Maxwell L, Maclean R, Tugwell P: Responsiveness of patient reported outcomes including fatigue, sleep quality, activity limitation, and quality of life following treatment with abatacept for rheumatoid arthritis. Ann Rheum Dis. 2008, 67: 260-265. 10.1136/ard.2007.069690.
Meiorin S, Pistorio A, Ravelli A, Iusan SM, Filocamo G, Trail L, Oliveira S, Cuttica R, Espada G, Alessio M, Mihaylova D, Cortis E, Martini A, Ruperto N, Paediatric Rheumatology International Trials Organisation: Validation of the Childhood Health Assessment Questionnaire in active juvenile systemic lupus erythematosus. Arthritis Rheum. 2008, 59: 1112-1119. 10.1002/art.23912.
Bae SC, Cook EF, Kim SY: Psychometric evaluation of a Korean Health Assessment Questionnaire for clinical research. J Rheumatol. 1998, 25: 1975-1979.
Pincus T, Sokka T: Quantitative measures and indices to assess rheumatoid arthritis in clinical trials and clinical care. Rheum Dis Clin North Am. 2004, 30: 725-751. 10.1016/j.rdc.2004.08.001.
Koh ET, Seow A, Pong LY, Koh WH, Chan L, Howe HS, Lim TH, Low CK: Cross cultural adaptation and validation of the Chinese Health Assessment Questionnaire for use in rheumatoid arthritis. J Rheumatol. 1998, 25: 1705-1708.
Shebab D, al-Jarallah K, Moussa MA: Validation of the Arabic version of the Health Assessment Questionnaire (HAQ) in patients with rheumatoid arthritis. Rev Rhum Engl Ed. 1998, 65: 387-392.
Matsuda Y, Singh G, Yamanaka H, Tanaka E, Urano W, Taniguchi A, Saito T, Hara M, Tomatsu T, Kamatani N: Validation of a Japanese version of the Stanford Health Assessment Questionnaire in 3,763 patients with rheumatoid arthritis. Arthritis Rheum. 2003, 49: 784-788. 10.1002/art.11465.
The authors thank Chitr Sitthi-amorn, Thailand Research Fund Senior Research Scholar, for providing funding for this study and Peter Tugwell for reviewing the manuscript.
The authors declare that they have no competing interests.
MO initiated the concept and design of the study and collected, analyzed, and interpreted the data and prepared the manuscript and finalized it in accordance with the recommendations. JW, SU, PH, NK, and BS collected the data. All authors read and approved the final manuscript.