Patients and surgeons provide endorsement of core domains for total joint replacement clinical trials
Arthritis Research & Therapy volume 19, Article number: 267 (2017)
Our objective in this study was to examine whether stakeholders further endorse the core domain set proposed by the Outcome Measures in Rheumatology Trials (OMERACT) total joint replacement (TJR) working group.
We emailed a survey to 3810 hip/knee arthroplasty patients and 49 arthroplasty surgeons at a high-volume arthroplasty center to rate the importance of each core domain (i.e., pain, function, patient satisfaction, revision surgery, adverse events, and death) and two additional domains (i.e., cost and participation). Ratings were on a 1–9 scale, with 1–3 indicating limited or no importance for patients, 4–6 being important but not critical, and 7–9 being critical. We calculated median (IQR) values and compared ratings by sex, age, and participant type using the Wilcoxon rank-sum test.
The questionnaire was completed by 1295 patients (34%) and 21 surgeons (43%). Patient nonresponders were similar to responders in age (≥55 years, 85.7% vs. 88.6%), sex (female, 57.5% vs. 57.3%), and joint procedure (total hip replacement, 56.9% vs. 63.2%). Overall, all core domains and one noncore domain (i.e., participation) were confirmed as “critical” by both stakeholder groups. Cost was rated as only “important” but not “critical” by surgeons. A completed consensus for all the core domains persisted even when we stratified by sex, age, arthritis type, and the affected joint (knee vs. hip). We received suggestions for additional critical domains from 217 patients and 5 surgeons, prompting the inclusion of 2 research agenda items.
Our study confirmed a consensus rating of the OMERACT TJR core domain set as critical for patients. This broad endorsement should encourage the identification of candidate outcome instruments to further develop a TJR core measurement set that can harmonize reporting in TJR clinical trials.
Total joint replacement (TJR) is one of the most common and effective elective procedures performed worldwide on patients with end-stage arthritis refractory to medical treatment. The rate of TJR use and its associated health care costs, particularly total hip replacement (THR) and total knee replacement (TKR), are estimated to continue increasing owing to an ever-increasing aging population, the obesity epidemic, and the high prevalence of osteoarthritis (OA) [1,2,3,4,5,6,7,8,9]. The Outcome Measures in Rheumatology Trials (OMERACT) Total Joint Replacement Working Group previously reported that there is an observed lack of consistency in the outcomes measures and domains used in TJR clinical trials [10,11,12,13,14]. This heterogeneity hampers efforts to perform valid comparisons between TJR clinical trials, including the ability to conduct meta-analyses. Moreover, the need to adhere to the Comprehensive Care for Joint Replacement model makes efforts to harmonize these measures even more prudent .
Using a multistep, data-driven process detailed in previous publications [16,17,18,19,20] that mandated the input and consensus of a number of experts and key stakeholders (including patients), as well as the coleadership of orthopedic surgeons, methodologists, and trialists, the OMERACT Total Joint Replacement Working Group proposed six core domains that would help to standardize the reporting of TJR clinical trials. Once the core domain set is widely accepted, a validated measure (or more measures) of each core domain can be identified to create a standardized core measurement set using a data-driven, multistakeholder process similar to the process used earlier for core domains. These six domains, collectively labeled the TJR core domain set, include pain, function, patient satisfaction, revision surgery, adverse events, and death [16, 17]. The core domain set is meant to be reported in every hip/knee TJR clinical trial. The scope of TJR was limited to THR and TKR for this exercise, but it included all end-stage hip and knee arthritis refractory to medical treatment, including OA and rheumatoid arthritis (RA) .
The core domain set was recently endorsed by independent groups of orthopedic surgeons and patient partners, providing an important step toward a wider, international multistakeholder consensus [21, 22]. However, a wider dissemination of this domain set to a targeted and relevant audience is still needed. Independent consensus among relevant stakeholders is crucial for the progression of this field so that candidate outcome instruments can begin to be identified for development of a standardized measurement set for TJR. Thus, the objective of this study was to advance the consensus process by querying the same core domain set for two of the most relevant stakeholders: TJR surgeons and TJR patients.
We emailed a survey to all eligible patients who had undergone a primary hip or knee TJR in 2015 and had a valid email address available in the electronic health record, as well as to orthopedic surgeons at the Hospital for Special Surgery (HSS), a high-volume orthopedic center of excellence. Patients who had undergone either a bilateral hip or bilateral knee TJR in 2015 or more than one TJR (any joint) in 2015 were excluded. Patients who had undergone subsequent TJRs any time before administration of the survey in 2016 and 2017 were also excluded. To improve the response rate, after the initial administration of the survey, patients and surgeons were sent reminders every week for 3 weeks.
The eligible participants were asked to rate the importance of the six core domains on their own merit, without having to prioritize them. The participants were also asked to rate the importance of two optional areas: cost and patient participation in work and social activities. These additional domains were previous candidates for core domains, but after rounds of deliberations and discussions, these two areas were regarded as noncore [16,17,18]. Unlike the core domain set, these additional domains were not meant to be reported in every TJR clinical trial. Ratings for each domain were on a 1–9 scale, with 1–3 indicating limited or no importance for patients, 4–6 being important but not critical, and 7–9 being critical. Complete consensus was achieved if both patients and surgeons rated each and every core domain as “critical” (i.e., a rating of 7–9) . Otherwise, it would be considered incomplete consensus and would signal a need to modify the core domain set . In addition to the multiple-choice survey, participants were offered an opportunity to propose additional domains they considered to be critical for TJR clinical trials.
Summary statistics were calculated separately for the TJR patients and TJR surgeons. The median (IQR) ratings were calculated for each of the domains within each group. We also calculated the median (IQR) ratings for the following subgroups of TJR patients: male vs. female, < 55 years vs. ≥ 55 years, OA vs. RA, and THR vs. TKR. We compared ratings between the patients and surgeons, as well as between the different subgroups of patients, using the Wilcoxon rank-sum test. Additional comments proposed by the survey participants were coded into categories using Dedoose software . Ethical approval was provided by the HSS Institutional Review Board (IRB 2017-0040).
The survey was emailed to 3810 hip/knee arthroplasty patients and 49 hip/knee arthroplasty surgeons. We had to exclude 138 patients who had either a bilateral hip or knee TJR in 2015, 242 patients who had more than one TJR in 2015, and 412 patients who had subsequent TJRs in 2016 and 2017. We received completed questionnaires from 1295 patients (34%) and 21 (43%) surgeons. Patient nonresponders were similar to responders in age (≥55 years, 85.7% vs. 88.6%), sex (female, 57.5% vs. 57.3%), and joint procedure (THR, 56.9% vs. 63.2%). The proportion of male surgeons was > 95% among both responders and nonresponders. The patient cohort had slightly more females (57.3%), whereas the majority of surgeons were male (95.2%) (Table 1). The majority of patients (88.6%) and surgeons (57.1%) were ≥ 55 years of age (Table 1). Within the patient cohort, more respondents had THR procedures (63.2%) and OA (82.7%) (Table 1).
Overall, all six core domains were confirmed as “critical” by both patients and surgeons, achieving a median rating of 7, 8, or 9 (Table 2). Patients and surgeons also assessed the two additional domains of cost and participation (not core). Whereas the median score for patient participation was 8 for both groups, cost was rated as only “important” and not “critical” by surgeons (Table 2). The difference in median ratings for cost by the two cohorts was statistically significant (Table 2). A completed consensus for all the core domains persisted even when we analyzed the median ratings among the different patient subgroups (Table 3). All core domains were rated as “critical” when data were stratified by sex, age, arthritis type, and the affected joint (knee vs. hip). Notably, both cost and patient participation were rated as “critical” among all of the patient subgroups (Table 3).
Of 1295 patient participants, we received suggestions for additional critical domains from 217 (17%). Of these suggestions, 77 (36%) responses were considered replicates of the following existing domains: cost, patient satisfaction, and adverse events. Recovery and rehabilitation time after joint replacement surgery were recommended by 131 (60%) patient respondents (Table 4). In tandem with emphasizing physical recuperation, nine (4%) participants stressed the importance of one’s mental and psychological well-being, both before and after surgery. In contrast, of the surgeon participants, five (24%) suggested additional core domains. Three surgeons highlighted objective physical measurements such as flexibility, gait, and motion. One surgeon echoed the majority of patient responders by emphasizing time to recovery milestones, whereas another surgeon mentioned sport participation and sexual function.
Researchers in TJR clinical trials have reported heterogeneous outcomes that make it challenging if not impossible when efforts are made to combine and compare outcomes of various implants, surgical techniques, or other interventions across studies in a systematic review, meta-analysis, or comparative analysis [10, 11]. In an era of evidence-based medicine and rising health care costs, meta-analyses are important tools that not only allow comparative analyses but also can help establish the best practices and recommendations for patient care in the peri- and postoperative periods in patients undergoing TJR. A collaborative initiative among international registries has begun to establish a framework to start harmonizing outcome collection and reporting to facilitate value-based health care improvements in the treatment of hip and knee OA . However, such an effort has not yet been completed for hip/knee TJR clinical trials.
Our study helps advance these harmonizing efforts by providing data that demonstrate broad endorsement and consensus of the core domains by both patients undergoing TJR and surgeons performing these procedures. Without endorsement by these key stakeholders, meaningful uptake and adoption of these core domains would be unlikely. Core domains are slated to be reported in every clinical trial, regardless of the intervention and primary outcome. It is important to clarify that core domains and primary outcomes are not synonymous. Depending on the nature of the study, core domain measures may not be the defined primary outcome; the choice of primary study outcome will always depend on the study question. Reporting of core domains in all arthroplasty trials also does not mean that researchers cannot choose other secondary outcomes of relevance to their research question.
In this study, patient participation was suggested as a critical domain by both patients and surgeons. This result contrasts with that of past surgeon groups in which patient participation was consistently ranked as only “important” . It may be worth considering patient participation in the future as a core domain; however, it is already included as an additional domain in the current TJR domain set. We recommend that it be included as an outcome in studies focused on improving participation. Meanwhile, cost was critical only to patients, consistent with past observations in smaller cohorts [21, 22]. This difference between patients and surgeons suggests that cost should be included as an additional domain in studies purporting to be patient-centered. Interestingly, the patients’ free text comments strikingly echoed past patient cohorts’ proposals on recovery and rehabilitation, suggesting that further discussions are needed on whether these concepts should be included as important domains for TJR clinical trial reporting in the future . As a result of this study, we believe that it is prudent to add this domain to the research agenda ring of the current OMERACT domain set, which now expands the current “onion” of core outcomes for TJR clinical trials (Fig. 1). The core domain measures proposed by the surgeons (i.e., objective measures of gait and physical function) are already included in the current proposed core domain set that includes function, a domain that can be measured with objective and/or subjective measures. Similarly, flexibility is partially included in the domain of range of motion, which is included in the outermost ring under research agenda. Mental and physical recovery is already captured in the following existing core domains of pain, function, and patient satisfaction.
A notable strength of this study is the administration of the same survey to a large sample size of patient participants who have undergone primary TJR procedures, ensuring appropriate input by those most affected by TJR clinical trials. However, because our sample size included only patients who have undergone knee or hip procedures at a single, large tertiary orthopedic referral hospital, these conclusions cannot be generalized to other types of joint replacements or other hospital settings. Because we required a valid email address for patients among our inclusion criteria, findings may not be generalizable to all patients undergoing TJR. Moreover, because we did not routinely collect data on race, ethnicity, and income or other socioeconomic status markers, we could not stratify and make conclusions about how different subpopulations may have differing opinions and priorities. However, in a previous study, we demonstrated that expectations do not differ between African American and white individuals at HSS . For all of the core domains, the ratings were consistent with that of other patients and surgeon cohorts previously reported in the published literature, corroborating past results [17, 18, 21, 22]. However, considering the number of eligible participants, our response rate was relatively low. Yet, nonresponder and responder characteristics were similar enough to provide confidence in our findings. Owing to a large sample size, even small differences are statistically significant in some cases, even when median scores are the same. These findings should be interpreted with caution.
Our study confirms that both TJR surgeons and TJR patients agree that the OMERACT TJR core domains are of critical importance as outcome measures in TJR clinical trials. These results support a broad endorsement of, and encourage the identification of, candidate outcome instruments to develop a TJR standardized measurement set.
American College of Rheumatology
Hospital for Special Surgery
Outcome Measures in Rheumatology Trials
Total hip replacement
Total joint replacement
Total knee replacement
Kurtz S, Ong K, Lau E, Mowat F, Halpern M. Projections of primary and revision hip and knee arthroplasty in the United States from 2005 to 2030. J Bone Joint Surg Am. 2007;89:780–5.
Centers for Disease Control and Prevention (CDC). Prevalence and most common causes of disability among adults—United States, 2005. MMWR Morb Mortal Wkly Rep. 2009;58:421–6.
Ethgen O, Bruyère O, Richy F, Dardennes C, Reginster JYY. Health-related quality of life in total hip and total knee arthroplasty: a qualitative and systematic review of the literature. J Bone Joint Surg Am. 2004;86-A:963–74.
Skyttä ET, Jarkko L, Antti E, Huhtala H, Ville R. Increasing incidence of hip arthroplasty for primary osteoarthritis in 30- to 59-year-old patients. Acta Orthop. 2011;82:1–5.
Birrell F, Johnell O, Silman A. Projecting the need for hip replacement over the next three decades: influence of changing demography and threshold for surgery. Ann Rheum Dis. 1999;58:569–72.
Cram P, Lu X, Kates SL, Singh JA, Li Y, Wolf BR. Total knee arthroplasty volume, utilization, and outcomes among Medicare beneficiaries, 1991-2010. JAMA. 2012;308:1227–36.
Kurtz S, Mowat F, Ong K, Chan N, Lau E, Halpern M. Prevalence of primary and revision total hip and knee arthroplasty in the United States from 1990 through 2002. J Bone Joint Surg Am. 2005;87:1487–97.
Singh JA. Epidemiology of knee and hip arthroplasty: a systematic review. Open Orthop J. 2011;5:80–5.
Robertsson O, Dunbar MJ, Knutson K, Lidgren L. Past incidence and future demand for knee arthroplasty in Sweden: a report from the Swedish Knee Arthroplasty Register regarding the effect of past and future population changes on the number of arthroplasties performed. Acta Orthop Scand. 2009;71:376–80.
Riddle DL, Stratford PW, Bowman DH. Findings of extensive variation in the types of outcome measures used in hip and knee replacement clinical trials: a systematic review. Arthritis Care Res. 2008;59:876–83.
Riddle DL, Stratford PW, Singh JA, Strand VC. Variation in outcome measures in hip and knee arthroplasty clinical trials: a proposed approach to achieving consensus. J Rheumatol. 2009;36:2050–6.
Gossec L, Paternotte S, Bingham CO, Clegg DO, Coste P, Conaghan PG, et al. OARSI/OMERACT initiative to define states of severity and indication for joint replacement in hip and knee osteoarthritis: an OMERACT 10 Special Interest Group. J Rheumatol. 2011;38:1765–9.
Gossec L, Paternotte S, Maillefert JF, Combescure C, Conaghan PG, Davis AM, et al. The role of pain and functional impairment in the decision to recommend total joint replacement in hip and knee osteoarthritis: an international cross-sectional study of 1909 patients. Report of the OARSI-OMERACT Task Force on total joint replacement. Osteoarthritis Cartilage. 2011;19:147–54.
Wall PDH, Richards BL, Sprowson A, Buchbinder R, Singh JA. Do outcomes reported in randomised controlled trials of joint replacement surgery fulfil the OMERACT 2.0 Filter? A review of the 2008 and 2013 literature. Syst Rev. 2017;6:106.
Centers for Medicare & Medicaid Services (CMS). Advancing care coordination through episode payment models (EPMs); cardiac rehabilitation incentive payment model; and changes to the comprehensive care for joint replacement model (CJR). CMS-5519-P. Docket No. CMS-2016-0135. 82 Fed Reg. 180–651, 2017.
Singh JA, Dohm M, Sprowson AP, Wall PD, Richards BL, Gossec L, et al. Outcome domains and measures in total joint replacement clinical trials: can we harmonize them? An OMERACT collaborative initiative. J Rheumatol. 2015;42:2496–502.
Singh JA, Dowsey MM, Dohm M, Goodman SM, Leong AL, Scholte Voshaar MMJH, et al. Achieving consensus on total joint replacement trial outcome reporting using the OMERACT filter: endorsement of the final core domain set for total hip and total knee replacement trials for endstage arthritis. J Rheumatol. 2017;44:1723–6.
Singh JA, Dohm M. Towards consensus on the reporting of core outcome domains in total joint replacement clinical trials: the derivation of the preliminary core outcome domain set. J Arthritis. 2016;5:221. https://doi.org/10.4172/2167-7921.1000221.
Boers M, Brooks P, Strand CV, Tugwell P. The OMERACT filter for outcome measures in rheumatology. J Rheumatol. 1998;25:198–9.
Boers M, Kirwan JR, Gossec L, Conaghan PG, D’Agostino MA, Bingham CO, et al. How to choose core outcome measurement sets for clinical trials: OMERACT 11 approves filter 2.0. J Rheumatol. 2014;41:1025–30.
Singh JA, Dohm M, Choong PF. Consensus on draft OMERACT core domains for clinical trials of total joint replacement outcome by orthopaedic surgeons: a report from the International consensus on outcome measures in TJR trials (I-COMiTT) group. BMC Musculoskelet Disord. 2017;18:45.
Singh JA, Dowsey M, Choong PF. Patient endorsement of the Outcome Measures in Rheumatology (OMERACT) total joint replacement (TJR) clinical trial draft core domain set. BMC Musculoskelet Disord. 2017;18:111.
Sociocultural Research Consultants, LLC. Dedoose. Version 7.0.22 [web application for managing, analyzing, and presenting qualitative and mixed method research data]. Los Angeles, CA: Author; 2016.
Rolfson O, Wissig S, van Maasakkers L, Stowell C, Ackerman I, Ayers D, et al. Defining an international standard set of outcome measures for patients with hip or knee osteoarthritis: consensus of the International Consortium for Health Outcomes Measurement Hip and Knee Osteoarthritis Working Group. Arthritis Care Res. 2016;68:1631–9.
Goodman SM, Mandl LA, Parks ML, Zhang M, McHugh KR, Lee YYY, et al. Disparities in TKA outcomes: census tract data show interactions between race and poverty. Clin Orthop Relat Res. 2016;474:1986–95.
JAS has received research grants from Takeda Pharmaceuticals and Savient Pharmaceuticals and consultant’s fees from Savient Pharmaceuticals, Takeda Pharmaceuticals, Regeneron Pharmaceuticals, Merz Pharmaceuticals, Iroko Pharmaceuticals, Bioibérica, Crealta/Horizon Pharma, Allergan, WebMD, UBM LLC, and the American College of Rheumatology (ACR). JAS serves as the principal investigator for an investigator-initiated study funded by Horizon Pharma through a grant to DINORA, Inc., a 501(c)(3) entity. JAS is a member of the executive committee of OMERACT, an organization that develops outcome measures in rheumatology and receives arm’s-length funding from 36 companies; a member of the ACR Annual Meeting Planning Committee; chair of the ACR Meet-the-Professor, Workshop and Study Group Subcommittee; and a member of the Veterans Affairs Rheumatology Field Advisory Committee. JAS is the editor and director of the University of Alabama at Birmingham Cochrane Musculoskeletal Group Satellite Center on Network Meta-analysis. The other authors declare that they have no competing interests.
Availability of data and materials
The data supporting the conclusions of this article are included within the article. Further supporting data can be accessed by contacting the corresponding author (JS) at email@example.com.
Ethics approval and consent to participate
Ethical approval was provided by the institutional review board at the Hospital for Special Surgery (IRB 2017-0040). Patients and surgeons were emailed a link to the study survey with the option of choosing whether to complete the survey. Completion of the survey served as their consent.
Consent for publication
All authors consent to the publication of this article.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original version of this article was update to correct formatting errors within Table 2.
A correction to this article is available online at https://doi.org/10.1186/s13075-018-1509-z.
About this article
Cite this article
Hoang, A., Goodman, S.M., Navarro-Millán, I.Y. et al. Patients and surgeons provide endorsement of core domains for total joint replacement clinical trials. Arthritis Res Ther 19, 267 (2017). https://doi.org/10.1186/s13075-017-1476-9
- Outcomes measures
- Clinical trials