Skip to main content
Download PDF

Lack of replication of genetic predictors for the rheumatoid arthritis response to anti-TNF treatments: a prospective case-only study

Arthritis Research & Therapy volume 12, Article number: R72 (2010) Cite this article

Abstract

Introduction

We aimed to replicate the strong associations that a recent genome wide association study (GWAS) has found between 16 single nucleotide polymorphisms (SNPs) and response to anti-tumour necrosis factor (TNF) treatment in 89 patients with rheumatoid arthritis (RA). This study is very important because, according to published simulations, associations as strong as the reported ones will mean that these SNPs could be used as predictors of response at the individual level.

Methods

Disease activity score (DAS28) was evaluated in 151 anti-TNF treated patients with RA of Spanish ancestry at baseline and every 3 months thereafter. Genotypes of the 16 putative predictor SNPs were obtained by single-base extension. Association between the relative change in DAS28 and SNP genotypes was tested by linear regression. In addition, logistic regression was applied to compare genotypes in non-responders (n = 34) versus good-responders (n = 61) following the EULAR response criteria.

Results

None of the analyses showed any significant association between the 16 SNPs and response to anti-TNF treatments at 3 or 6 months. Results were also negative when only patients treated with infliximab (66.9% of the total) were separately analyzed. These negative results were obtained in spite of a very good statistical power to replicate the reported strong associations.

Conclusions

We still do not have any sound evidence of genetic variants associated with RA response to anti-TNF treatments. In addition, the possibility we had envisaged of using the results of a recent GWAS for prediction in individual patients should be dismissed.

Introduction

Anti-tumor necrosis factor (anti-TNF) therapies have revolutionized the treatment of rheumatoid arthritis (RA) [1, 2]. Three drugs of this type, infliximab, etanercept, and adalimumab, have been used with success in hundreds of thousands patients with RA around the world. New drugs targeting TNF are in development or have been recently approved [3]. The beneficial effects of these drugs include a better quality of life; control of inflammation, stiffness, and pain; and slowing progression to joint erosions and deformity. It seems also that they are able to decrease cardiovascular risk and overall mortality of patients with RA [4, 5]. However, there is a significant percentage of patients who do not obtain these advantageous effects [1–3]. In some of these patients, this lack of response is primary, from the start of the treatment, whereas others develop resistance to treatment after a period of initial response. Unfortunately, there are no useful predictors to forecast what the clinical response of a specific patient will be. This has led to an unsatisfactory trial-and-error approach in the selection of drugs, meaning that some patients will miss an effective treatment at a critical window of opportunity [6] and that health service resources will be wasted. In response to this challenge, multiple lines of research are looking for predictors of response to anti-TNF therapies among patient clinical features, synovial tissue biomarkers, blood proteins, or genetic variants [7–10]. Very promising, though preliminary, findings have been reported in this last field. Sixteen single-nucleotide polymorphisms (SNPs) with an important association with response to treatment were identified in a recent genome-wide association study (GWAS) [7]. In our view, the most remarkable aspect of these findings was the marked effect size of each SNP, with levels very rarely found in genetic studies of complex traits. All showed an odds ratio (OR) of more than 3.5 in the comparison between patients with good response and non-responders. Some of these SNPs showed effect sizes of an OR of more than 10. If confirmed, these effects, together with minor allele frequencies of more than 12%, will allow the prediction of response to anti-TNF treatments with great accuracy at the level of the individual patient [11]. The limitation of this study was that only 89 patients were included, and even very significant results in a study of this size are uncertain. Our objective has been to provide the necessary replication to these exciting findings with the expectation that at least a few of them will be confirmed. This will be a first step before proceeding to prospective clinical studies to assess their utility in clinical practice.

Materials and methods

Patients

A group of 151 patients with RA were followed prospectively at the Rheumatology Unit of the Hospital Clinico Universitario de Santiago to study the efficacy of anti-TNF therapy. All of them were of European (Spanish) ancestry. Only patients who were naïve with respect to biologic treatments were included. Patients were systematically evaluated at the initiation of therapy and every 3 months thereafter. Evaluations included painful and swollen joint counts, visual analog scales of pain, global health assessments by the patient and the physician, erythrocyte sedimentation rate (ESR), C-reactive protein (CRP), health assessment questionnaire (HAQ), and disease activity score using 28 joint counts (DAS28). Clinical characteristics are detailed in Table 1. All participants gave their informed consent for inclusion, and the study and procedures were approved by the clinical research ethics committee of Galicia.

Table 1 Clinical characteristics of the patients in this study and of those in the report by Liu and colleagues [7]
Full size table

Assessment of the efficacy of the treatment

We used the same procedures described in Liu and colleagues [7] to make our results comparable. Response to anti-TNF treatments was assessed with the DAS28 [12]. The primary outcome was the quantitative variable relDAS28, which is the relative change in DAS28 between baseline and the time of evaluation. Presented as a percentage, this variable is calculated as follows:

A secondary outcome was the European League Against Rheumatism (EULAR) response classification in good, moderate, or non-responders [13]. Good responders have ΔDAS28 of at least 1.2 and DAS28 at 3 months of not more than 3.2; moderate responders have (a) ΔDAS28 of at least 1.2 and DAS28 at 3 months of greater than 3.2 or (b) 0.6 < ΔDAS28 ≤ 1.2 and DAS28 at 3 months of not more than 5.1; and non-responders are those who do not fit into any of these categories.

Genotypes

A total of 16 SNPs from Liu and colleagues [7] were analyzed (Table 2). Genotypes were obtained by single-base extension with the SNaPshot Multiplex Kit (Applied Biosystems, Foster City, CA, USA) and specific primers and probes (available in Additional file 1). The genotype call rate was 99.79%, allele frequencies were in Hardy-Weinberg equilibrium, and concordant results for the 16 SNPs were obtained in the 21 samples that were genotyped twice.

Table 2 Relationship of relDAS28 and single-nucleotide polymorphism genotypes and comparison of allele frequencies between responders and non-responders
Full size table

Statistical analysis

Comparisons of the clinical characteristics of the RA patients included in the GWAS and in our study were done with the Student t test for data available as mean and standard deviation and with the chi-square test for contingency tables for frequency data. Analyses of the relationship between SNPs and treatment response were done as in Liu and colleagues [7] to make our results comparable in this aspect. Briefly, linear regression analysis between genotype data following a genetic additive model and relDAS28 as the continuous dependent variable was done. A t statistic was derived from the linear regression and used to calculate the P value of the association. This statistic is robust to deviations from normality of relDAS28. We also conducted logistic regression analysis between the groups of responders and non-responders. ORs and their 95% confidence intervals (CIs) were obtained using the non-responder group as the reference. This second analysis will be less powerful because the phenotype is transformed to a dichotomous variable and because the sample size is reduced by exclusion of the moderate responders. Statistical analyses were performed with a customized version of the Statistica 7.0 program (StatSoft, Inc., Tulsa, OK, USA). We visually explored the possibility that consideration of all of the SNPs jointly would discriminate between responder and non-responder patients. This analysis was done with the Co-Plot algorithm implemented in the Visual Co-Plot software [14, 15]. Estimation of the statistical power for the linear regression analysis was done by transforming the reported P values and the number of samples in the corresponding correlation coefficients (R2). The values of R2 and the number of samples in our study were used as input in the module for the F test in omnibus comparisons by linear regression of G*Power version 3.0.10 software [16].

Results

The aim of our study was to replicate the strong association of 16 SNPs with response to anti-TNF therapy reported in a recent GWAS [7]. Therefore, we used the same variables and type of analysis. Data from the 151 patients with RA are shown in Table 1. Some of the characteristics of our study population were different from those of the patients analyzed in the GWAS [7]. Specifically, our patients showed a lower percentage of rheumatoid factor positivity, higher positivity for anti-CCP (anti-cyclic citrullinated peptide) antibodies, and higher baseline HAQ and DAS28 levels. There were 70.2% of patients with high disease activity at baseline as assessed by a DAS28 of greater than 5.1. In spite of this high activity, there were 40.4% and 43.7% of good responders at 3 and 6 months, respectively, and only 22.5% and 21.8% of non-responders at 3 and 6 months, respectively. The percentages of responders and non-responders were similar in the two studies. In contrast, the proportion of patients treated with each of the three anti-TNF drugs was different (Table 1). In our cohort, most patients were treated with infliximab (66.9%), followed by etanercept (23.2%) and adalimumab (9.9%). We also checked that there was a good correlation between the variable used as primary outcome in our analysis, relDAS28, and the EULAR response classification (Figure 1), allowing for consistency in the analyses.

Figure 1
figure1

Good correlation between outcome variables: EULAR (European League Against Rheumatism) response classification and relDAS28. Medians, interquartile ranges, and non-outlier ranges are represented as dots, boxes, and whiskers, respectively. Empty dots represent outliers. relDAS28, relative change in disease activity score using 28 joint counts between baseline and time of evaluation.

Full size image

The relationship between the SNP genotypes and response to anti-TNF treatment at 3 months was evaluated by linear regression analysis between the genotypes and the continuous variable relDAS28. There was no association of any of the 16 SNPs with relDAS28 at 3 months (Table 2). Secondary analyses showed very similar results. Comparison of non-responders with good responders according to the EULAR criteria at 3 months did not show any significant association (Table 2). The most extreme OR (1.9, 95% CI 1.0 to 3.6) corresponded to rs437943 in the CNTDE1 locus but compared poorly with the previously reported OR (4.6, 95% CI 1.8 to 12.3). In addition, there was no association of relDAS28 with any of the 16 SNPs at 6 months or of the classification in responders and non-responders (Additional file 2). Finally, analysis of patients treated with infliximab, which represented 66.9% of our study, did not show any significant association between response and the SNPs (Additional file 2). Because of the small number of patients in the etanercept or adalimumab subgroups, no separate analyses of response to treatment were done. We also visually explored whether joint consideration of the 16 SNPs was able to discriminate between the different groups of patients according to their response to treatment, but patients with different responses did not show any clustering in identifiable groups in this analysis (Figure 2).

Figure 2
figure2

Multivariate visual analysis showing that 16 single-nucleotide polymorphisms were not able to separate rheumatoid arthritis patients classified according to their EULAR (European League Against Rheumatism) response. Responders are represented as blue dots, moderate responders as red dots, and non-responders as green dots. Yellow arrows represent the genotypes of each of the 16 single-nucleotide polymorphisms according to an additive model. This representation was obtained with Visual Co-Plot.

Full size image

To interpret the above results, it was critical to assess whether our study had enough statistical power to replicate the previously reported associations. Power for the weakest association in the GWAS, which corresponds to rs928655 (P = 3 × 10-5), was larger than 95% for a P value of 0.002. It is important to remark that ORs from the GWAS are very likely heavily biased upwards as a consequence of the winner's curse affecting any GWAS and especially those of small size [17, 18]. Therefore, this power estimate is valuable only in the context of the reported ORs taken at face value.

Discussion

There is a great need of good predictors for RA response to the anti-TNF treatments [1–3, 9]. The development and approval of new effective drugs for RA add to this urgency [3]. The recent GWAS from Liu and colleagues [7] was especially remarkable because it showed such strong associations that, according to published simulations [11], they could be used for prediction in individual patients. This is a characteristic that has not been found in any of the previous studies. However, the size of the study implied that results should be replicated before they could be taken at face value, as already acknowledged by the authors. We have tried to provide here the needed replication in the expectation that some of them will be confirmed and that validation in prospective studies will soon follow.

Unfortunately, in spite of the moderately larger sample size of our study and the corresponding very good power to detect this type of strong association, none of the associations was replicated. These results make it very unlikely that any of the 16 SNPs could have an association as strong as suggested by the previous GWAS [7]. It is possible that the differences between the patients with RA in the two studies could have had an effect on the lack of replication, but these differences were not large enough to completely explain the very divergent results. In addition, patients in the GWAS were predominantly of European ancestry as were all of the patients in our study. Therefore, it seems more likely that the original strong associations were due to random variation of allele frequencies in a study including more than 300,000 SNPs and to the heavy bias characteristic of GWASs of small sample size [17, 18]. This possibility was already considered by us before beginning this study, but we judged that some SNPs would be replicated given that they showed low P values, five of them with P values of less than 10-6 [7], and low P values are the best indication of the reproducibility of results [19].

Conclusions

Our negative results imply that we still do not have any strong evidence supporting a significant role of genetic variation in the response to anti-TNF treatments. In addition, our results imply that none of the SNPs in our study will be useful as individual predictors of response to anti-TNF therapy, but do not exclude a weaker association.

Acknowledgements

We thank Carmen Pena-Pena for her excellent technical assistance and Yolanda Lopez-Golan for her help in recruiting patients. MS-G is the recipient of an FPU predoctoral bursary of the Spanish Ministry of Education. MC is the recipient of an 'Isabel Barreto' bursary of the government of Galicia. This project was supported by an unrestricted grant from Roche Spain and by grants PI080744 and PI09/90744 from the Instituto de Salud Carlos III (Spain) with participation of funds from FEDER (European Union).

Abbreviations

anti-TNF:

anti-tumor necrosis factor

CI:

confidence interval

DAS28:

disease activity score using 28 joint counts

EULAR:

European League Against Rheumatism

GWAS:

genome-wide association study

HAQ:

health assessment questionnaire

OR:

odds ratio

RA:

rheumatoid arthritis

relDAS28:

relative change in disease activity score using 28 joint counts between baseline and time of evaluation

SNP:

single-nucleotide polymorphism

TNF:

tumor necrosis factor.

References

  1. 1.

    Chen YF, Jobanputra P, Barton P, Jowett S, Bryan S, Clark W, Fry-Smith A, Burls A: A systematic review of the effectiveness of adalimumab, etanercept and infliximab for the treatment of rheumatoid arthritis in adults and an economic evaluation of their cost-effectiveness. Health Technol Assess. 2006, 10: 1-229.

    Article  Google Scholar 

  2. 2.

    Moreland LW, Emery P: TNF[alpha]-inhibition in the treatment of rheumatoid arthritis. 2003, London: Martin Dunitz

    Google Scholar 

  3. 3.

    Rubbert-Roth A, Finckh A: Treatment options in patients with rheumatoid arthritis failing initial TNF inhibitor therapy: a critical review. Arthritis Res Ther. 2009, 11 (Suppl 1): S1-10.1186/ar2666.

    PubMed Central  Article  PubMed  Google Scholar 

  4. 4.

    Carmona L, Descalzo MA, Perez-Pampin E, Ruiz-Montesinos D, Erra A, Cobo T, Gomez-Reino JJ: All-cause and cause-specific mortality in rheumatoid arthritis are not greater than expected when treated with tumour necrosis factor antagonists. Ann Rheum Dis. 2007, 66: 880-885. 10.1136/ard.2006.067660.

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  5. 5.

    Dixon WG, Watson KD, Lunt M, Hyrich KL, Silman AJ, Symmons DP: Reduction in the incidence of myocardial infarction in patients with rheumatoid arthritis who respond to anti-tumor necrosis factor alpha therapy: results from the British Society for Rheumatology Biologics Register. Arthritis Rheum. 2007, 56: 2905-2912. 10.1002/art.22809.

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  6. 6.

    Finckh A, Liang MH, van Herckenrode CM, de Pablo P: Long-term impact of early treatment on radiographic progression in rheumatoid arthritis: a meta-analysis. Arthritis Rheum. 2006, 55: 864-872. 10.1002/art.22353.

    Article  PubMed  Google Scholar 

  7. 7.

    Liu C, Batliwalla F, Li W, Lee A, Roubenoff R, Beckman E, Khalili H, Damle A, Kern M, Furie R, Dupuis J, Plenge RM, Coenen MJ, Behrens TW, Carulli JP, Gregersen PK: Genome-wide association scan identifies candidate polymorphisms associated with differential response to anti-TNF treatment in rheumatoid arthritis. Mol Med. 2008, 14: 575-581.

    PubMed Central  CAS  Article  PubMed  Google Scholar 

  8. 8.

    Maxwell JR, Potter C, Hyrich KL, Barton A, Worthington J, Isaacs JD, Morgan AW, Wilson AG: Association of the tumour necrosis factor-308 variant with differential response to anti-TNF agents in the treatment of rheumatoid arthritis. Hum Mol Genet. 2008, 17: 3532-3538. 10.1093/hmg/ddn245.

    CAS  Article  PubMed  Google Scholar 

  9. 9.

    Skapenko A, Prots I, Schulze-Koops H: Prognostic factors in rheumatoid arthritis in the era of biologic agents. Nat Rev Rheumatol. 2009, 5: 491-496. 10.1038/nrrheum.2009.157.

    CAS  Article  PubMed  Google Scholar 

  10. 10.

    Plenge RM, Criswell LA: Genetic variants that predict response to anti-tumor necrosis factor therapy in rheumatoid arthritis: current challenges and future directions. Curr Opin Rheumatol. 2008, 20: 145-152. 10.1097/BOR.0b013e3282f5135b.

    CAS  Article  PubMed  Google Scholar 

  11. 11.

    Janssens AC, Moonesinghe R, Yang Q, Steyerberg EW, van Duijn CM, Khoury MJ: The impact of genotype frequencies on the clinical validity of genomic profiling for predicting common chronic diseases. Genet Med. 2007, 9: 528-535. 10.1097/GIM.0b013e31812eece0.

    Article  PubMed  Google Scholar 

  12. 12.

    Prevoo ML, van't Hof MA, Kuper HH, van Leeuwen MA, Putte van de LB, van Riel PL: Modified disease activity scores that include twenty-eight-joint counts. Development and validation in a prospective longitudinal study of patients with rheumatoid arthritis. Arthritis Rheum. 1995, 38: 44-48. 10.1002/art.1780380107.

    CAS  Article  PubMed  Google Scholar 

  13. 13.

    van Gestel AM, Prevoo ML, van't Hof MA, van Rijswijk MH, Putte van de LB, van Riel PL: Development and validation of the European League Against Rheumatism response criteria for rheumatoid arthritis. Comparison with the preliminary American College of Rheumatology and the World Health Organization/International League Against Rheumatism Criteria. Arthritis Rheum. 1996, 39: 34-40. 10.1002/art.1780390105.

    CAS  Article  PubMed  Google Scholar 

  14. 14.

    Bravata DM, Shojania KG, Olkin I, Raveh A: CoPlot: a tool for visualizing multivariate data in medicine. Stat Med. 2008, 27: 2234-2247. 10.1002/sim.3078.

    Article  PubMed  Google Scholar 

  15. 15.

    The Visual Co-Plot Homepage. [http://www.cs.huji.ac.il/~davidt/vcoplot/index.html]

  16. 16.

    Faul F, Erdfelder E, Lang AG, Buchner A: G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007, 39: 175-191.

    Article  PubMed  Google Scholar 

  17. 17.

    Ioannidis JP: Why most discovered true associations are inflated. Epidemiology. 2008, 19: 640-648. 10.1097/EDE.0b013e31818131e7.

    Article  PubMed  Google Scholar 

  18. 18.

    Xiao R, Boehnke M: Quantifying and correcting for the winner's curse in genetic association studies. Genet Epidemiol. 2009, 33: 453-462. 10.1002/gepi.20398.

    PubMed Central  Article  PubMed  Google Scholar 

  19. 19.

    Todd JA: Statistical false positive or true disease pathway?. Nat Genet. 2006, 38: 731-733. 10.1038/ng0706-731.

    CAS  Article  PubMed  Google Scholar 

Download references

Author information

Author notes

    Affiliations

    1. Laboratorio Investigacion 10 and Rheumatology Unit, Instituto de Investigacion Sanitaria-Hospital Clinico Universitario de Santiago, Travesia Choupana sn, Santiago de Compostela, 15706, Spain

      Marian Suarez-Gestal, Eva Perez-Pampin, Manuel Calaza, Juan J Gomez-Reino & Antonio Gonzalez

    2. Department of Medicine, University of Santiago de Compostela, San Francisco sn, Santiago de Compostela, 15782, Spain

      Juan J Gomez-Reino

    Authors
    1. Marian Suarez-Gestal
      View author publications

      You can also search for this author in PubMed Google Scholar

    2. Eva Perez-Pampin
      View author publications

      You can also search for this author in PubMed Google Scholar

    3. Manuel Calaza
      View author publications

      You can also search for this author in PubMed Google Scholar

    4. Juan J Gomez-Reino
      View author publications

      You can also search for this author in PubMed Google Scholar

    5. Antonio Gonzalez
      View author publications

      You can also search for this author in PubMed Google Scholar

    Corresponding author

    Correspondence to Antonio Gonzalez.

    Additional information

    Competing interests

    Roche Spain (Madrid, Spain) contributed to the funding of this project. However, the company had no input in the design of the study, the analysis, or the writing of the manuscript. The company did not have the right to early access to results or the right to interfere in any other way with the interpretation or reporting of the results. Therefore, the authors take exclusive and complete responsibility for the study.

    Authors' contributions

    MS-G participated in the design of the study, genotyped the samples, and participated in the interpretation of the results and in writing the manuscript. EP-P participated in the acquisition of clinical data and collection of samples and in the analysis and interpretation of results. MC participated in the statistical analysis and in the interpretation of results. JJG-R coordinated the acquisition of clinical data and participated in the analysis and interpretation of results. AG participated in the design of the study and in the coordination of acquisition of clinical data and collection of samples and supervised genotyping, statistical analysis, interpretation of results, and writing of the manuscript. All authors read and approved the final manuscript.

    Marian Suarez-Gestal, Eva Perez-Pampin contributed equally to this work.

    Electronic supplementary material

    Authors’ original submitted files for images

    Below are the links to the authors’ original submitted files for images.

    Authors’ original file for figure 1

    Authors’ original file for figure 2

    Rights and permissions

    Reprints and Permissions

    About this article

    Cite this article

    Suarez-Gestal, M., Perez-Pampin, E., Calaza, M. et al. Lack of replication of genetic predictors for the rheumatoid arthritis response to anti-TNF treatments: a prospective case-only study. Arthritis Res Ther 12, R72 (2010). https://doi.org/10.1186/ar2990

    Download citation

    Keywords

    • Rheumatoid Arthritis
    • Infliximab
    • Etanercept
    • Adalimumab
    • Genome Wide Association Study

    Arthritis Research & Therapy

    ISSN: 1478-6362

    Contact us