Performance of cytokine models in predicting SLE activity

Abstract

Background

Identification of universal biomarkers to predict systemic lupus erythematosus (SLE) flares is challenging due to the heterogeneity of the disease. Several biomarkers have been reported. However, the data of validated biomarkers to use as a predictor for lupus flares show variation. This study aimed to identify the biomarkers that are sensitive and specific to predict lupus flares.

Methods

One hundred and twenty-four SLE patients enrolled in this study and were prospectively followed up. The evaluation of disease activity achieved by the SLE disease activity index (SLEDAI-2K) and clinical SLEDAI (modified SLEDAI). Patients with active SLE were categorized into renal or non-renal flares. Serum cytokines were measured by multiplex bead-based flow cytometry. The correlation and logistic regression analysis were performed.

Results

Levels of IFN-α, MCP-1, IL-6, IL-8, and IL-18 significantly increased in active SLE and correlated with clinical SLEDAI. Complement C3 showed a weakly negative relationship with IFN-α and IL-18. IL-18 showed the highest positive likelihood ratios for active SLE. Multiple logistic regression analysis showed that IL-6, IL-8, and IL-18 significantly increased odds ratio (OR) for active SLE at baseline while complement C3 and IL-18 increased OR for active SLE at 12 weeks. IL-18 and IL-6 yielded higher sensitivity and specificity than anti-dsDNA and C3 to predict active renal and active non-renal, respectively.

Conclusion

The heterogeneity of SLE pathogenesis leads to different signaling mechanisms and mediates through several cytokines. The monitoring of cytokines increases the sensitivity and specificity to determine SLE disease activity. IL-18 predicts the risk of active renal SLE while IL-6 and IL-8 predict the risk of active non-renal. The sensitivity and specificity of these cytokines are higher than the anti-dsDNA or C3. We propose to use the serum level of IL-18, IL-6, and IL-8 to monitor SLE disease activity in clinical practice.

Background

Systemic lupus erythematosus (SLE) is a chronic autoimmune disease which affects several organ systems including, but not limited to, skin, joint, and renal. The heterogeneity of SLE manifestations arises from the interaction of genetic aberration, immunity, and associated environmental factors [1, 2]. The disturbances of innate and adaptive immunity lead to an increase in inflammatory cytokines, immune complex deposition, autoantibody production, and organ damage. The chronic inflammatory state can lead to morbidity and mortality in SLE patients, e.g., the severe renal flares associated with end-stage renal disease [3]. To decrease the devastating consequence in SLE, the early aggressive treatment of patients who are prone to develop disease flare will improve the long-term outcome.

Cytokines play vital roles in the differentiation, maturation, and activation of many immune lineages. These cytokines influence the gene expression of the immune cells and stimulate the inflammatory process in multiple organs. Several cytokines contribute to SLE pathogenesis [4,5,6]. Genome-wide association studies (GWAS) have identified several SLE susceptibility genes located in the pathway of type I interferon production and signaling [7]. SLE patients also show the increased expression of interferon-inducible genes in the peripheral blood mononuclear cells (PBMC) [7]. Other cytokines, including interleukin-6 (IL-6), interleukin-10 (IL-10), interleukin-17 (IL-17), and interferon-gamma (IFN-γ), play significant roles in SLE pathogenesis [8,9,10,11]. Serum cytokines of IFN- α, IL-6, IL-8, IL-17, and IL-18 correlate with SLE disease severity measured by Systemic Lupus Erythematosus Disease Activity Index (SLEDAI) [12,13,14,15,16]. Circulating IL-18 level is proposed to predict renal damage, which can potentially be a marker to foretell renal involvement and identify patients at risk of kidney failure [17].

The levels of anti-dsDNA and complement, a component in SLEDAI-2 K, have been commonly used to evaluate SLE disease activity [18]. However, these biomarkers do not consistently correlate with clinical SLE flares, especially non-renal manifestation, and there are no standard biomarkers for prediction of SLE flares at the moment [16, 19]. Thus, the monitoring of cytokines involved in lupus pathogenesis may be a beneficial tool to assess clinical SLE activity [4, 20]. Each SLE patient may exhibit the alteration of various cytokines depending on disease severity or type of organ involvement. Recent studies in the subgroup of SLE patients showed the expression of different cytokine profiles, which correlated with disease activity and specific clinical manifestations [21, 22]. Based on these findings, inspecting several cytokines instead of only one cytokine at the same time may increase the yield to predict SLE activity with specific organ involvement.

Our goals of the study were the identification of biomarkers that correlated with SLE disease activity. Once that biomarkers were recognized, we would identify and create a model that showed the best performance in prediction SLE activity. Here we measured the panel of 13 inflammatory cytokines including IL-1β, IFN-α, IFN-γ, TNF-α, MCP-1, IL-6, IL-8, IL-10, IL-12, IL-17, IL-18, IL-23, and IL-33 by multiplex cytokine assays using flow cytometry, verified the sensitivity and specificity, and compared the performance of these cytokines with conventional biomarkers (C3, C4, and anti-dsDNA) to predict SLE flare.

Methods

Study population

One-hundred and twenty-four SLE patients who followed up at Rheumatology Clinic during 2016–2017 were enrolled. All of the patients were older than 18 years and met the 1997 ACR criteria [23] or SLICC criteria 2012 [24] for the classification of SLE. The exclusion criteria are SLE patients with overlapping syndrome, a history of cancer, or an active infection. The collected data consisted of demographic information, clinical manifestations, laboratory tests, and treatment history. All patients received standard treatment according to their disease activity and degree of organ damage. The data were collected at the enrollment and up to 3 months of follow-up. The data on patients with active status and inactive status was assessed every 4 weeks, and at the 12th weeks, respectively. The study (ID 07-59-05) was approved by the Faculty of Medicine Ramathibodi Hospital ethics committee and conducted according to the guidelines of the Declaration of Helsinki. Each participant gave written informed consent before enrollment.

Since several cytokines were tested in this study, we selected the data of IL-6 from the paper to calculate the sample sizes [25]. Also, our previous cross-sectional study found that IL-6 is a cytokine that changed in the SLE patients and correlated with disease activity [16]. Sample size estimation for independent T-test was calculated with the formulation as follows: N = 2σ² (Z_{1 − α/2} + Z_{1 − β/2})²/δ² and α = 0.05, β = 0.2, δ = 58, σ = 190. Thus the sample sizes were 33 patients per SLE group (active or inactive). However, we did not know that the other cytokines measuring here will show the difference with the sample sizes calculated here. Thus, we enrolled the patients more (double of sample sizes) to increase the power of the study.

Measurement of SLE disease activity

SLE clinical disease activity was measured by the Systemic Lupus Erythematosus Disease Activity Index 2000 (SLEDAI-2K) and modified SLEDAI-2K [18], which is a validated tool for measuring disease activity at any given time-point. Physicians evaluated the SLEDAI-2K and modified SLEDAI-2K in each SLE patient visiting a lupus clinic. The clinically active disease was defined if the modified SLEDAI-2K score was ≥ 1, and the disease is clinically inactive if the modified SLEDAI-2K score was 0. The definition of renal active included proteinuria > 0.5 g/day, new or recent onset of proteinuria that increases > 0.5 g/day, cellular casts, red blood cell > 5/HPF, or white blood cells > 5/HPF (exclude infection). The definition of non-renal flare included all clinical parameters in modified SLEDAI with the exclusion of proteinuria, cellular cast, hematuria, and pyuria.

Measurement of serum cytokines

The sera of SLE patients were collected at the time of enrollment and were used to test for C3, C4, anti-dsDNA, and cytokines. The repeated freeze/thaw cycle was identified to affect the concentration of cytokines [26]. In this study, the stored sera were thawed for the first time and immediately stained with antibodies and subsequently quantified using a multiplex bead-based assay (#740809, LEGENDplex™, Biolegend Inc., USA). The assay can detect 13 of inflammatory cytokines/chemokines, including IL-1β, IFN-α, IFN-γ, TNF-α, MCP-1 (CCL2), IL-6, IL-8 (CXCL8), IL-10, IL-12p70, IL-17A, IL-18, IL-23, and IL-33. The staining procedures were performed as suggested by the manufacturer protocol. The flow cytometry was performed using BD FACSVerse™ (Becton Dickinson Biosciences, San Jose, USA). The flow cytometer raw data files (FCS 2.0, 3.0) were analyzed using the LEGENDplexTM Data Analysis Software. The signal value was detected on LEGENDplex chip platform, and the serum concentration was calculated according to the standard curve. The concentration range was 0–30,000 pg/ml for all 13 cytokines, and the sensitivity of detection achieved 0.01 pg/ml level. The coefficient of variation (CV) of the standard testing cross three batches of 13 cytokines showed the median (range) between 2.2 (1.19–4.21), 1.34 (0.79–4.91), and 2.67 (2.31–3.5). The cytokine data were analyzed at weeks 0, 4, 8, and 12 weeks for active SLE patients, and at 0 and 12 weeks for inactive SLE patients.

Statistical analysis

Statistical analysis was performed using STATA Statistics Data Analysis 14.0 computer software. The mean ± SD was used to describe normally distributed data, median and range for skewed data, and the percentage was used to represent categorical data. Mann-Whitney U test was used to compare the median from two groups if skewed distribution existed. Pearson’s correlation analyzed the correlations between serum cytokines and SLEDAI scores and showed a significant level (p value). The Bonferroni correction was performed to adjust the p value for multiple comparisons. Receiver operating characteristic (ROC) curves discriminated active from inactive SLE for each of serum cytokines, anti-dsDNA, C3, and C4. Logistic regression models were used to predict active SLE status and lupus nephritis. The results were considered statistically significant if the p value was < 0.05. The power of 0.8 was used to calculate the sample size for the primary outcome.

Results

Clinical characteristics of the study population

One-hundred and twenty-four patients participated in this study. Patients were categorized into active or inactive SLE based on the modified SLEDAI-2K. Of the total 124 patients, 51 cases (41%) have active SLE, whereas 73 cases (59%) have inactive SLE. Active and inactive SLE group had a median disease duration of 63.63 and 102.90 months, respectively. The median of clinical SLEDAI score at the baseline in the active group was 8 (Table 1). A major difference in clinical manifestation between active and inactive SLE was renal involvement. Thirty-one out of 51 patients (60%) in the active group showed symptoms and signs of lupus nephritis. The patients received different immunosuppressive agents, as indicated (Additional file 1: Table S1). The active SLE patients significantly received a higher dose of prednisolone and more usage of cyclophosphamide than the inactive SLE patients (Additional file 1: Table S1).

Table 1 Demographics and clinical characteristics of patients

Correlation of serum biomarkers and clinical SLEDAI score

SLE patients (both active and inactive) showed the difference in serum cytokine levels (IFN-α, MCP-1, IL-8, and IL-18) compared to normal controls at time 0 (Additional file 2: Table S2). Among all cytokines tested, the levels of MCP-1, IL-6, IL-8, and IL-18 were significantly higher in the active SLE patients compared with those in the inactive SLE (Table 2). Next, we determined the difference and the correlation of serum biomarkers between active and inactive SLE at time 0. We analyzed the correlation of these biomarkers with SLE clinical activity to show the correlation coefficient (R). The serum biomarkers that provided substantial correlation coefficient with clinical SLEDAI scores were C3, IFN-α, IL-6, IL-8, and IL-18 (Table 2). Also, IL-8, IL-18, and IL-6 yielded a higher correlation coefficient than standard biomarkers (C3, C4, and anti-dsDNA) as shown (Table 2). The graph demonstrated the correlation between these biomarkers and modified SLEDAI was shown (Additional file 6: Figure S1).

Table 2 Correlation of serum biomarkers and SLE disease activity

Furthermore, we analyzed the correlation between cytokines and the immunosuppressive drugs that patients received, which might suppress the level of cytokines (Additional file 3: Table S3). We did not observe the association between immunosuppressive drugs and cytokines. However, the dosage of prednisolone correlated positively with IL-8 and IL-18. The data suggested that the active SLE had higher levels of IL-8 and IL-18, and concurrently received a higher dose of prednisolone to control disease activity. Also, the factors that may affect the cytokine levels are age and gender. We analyzed the correlation between cytokines and these factors (Additional file 4: Table S4). Our data showed a negligible correlation (R <  0.2) between cytokines, age, and gender in SLE patients. The analyses suggested that the cytokine levels of SLE patients in this study most likely were modulated by clinical disease activity.

Association of serum biomarkers in SLE patients

The previous study showed that serum IL-6 correlates with modified SLEDAI but not anti-dsDNA, complement, and SLEDAI-2K [16]. We analyzed the correlation among cytokines that correlated with clinically active SLE and standard biomarkers (complement and anti-dsDNA). C3 correlated with only IFN-α while anti-dsDNA associated with IFN-α and MCP-1 (Table 3). The correlation analysis of IFN-α, MCP-1, IL-6, IL-8, and IL-18 showed significantly correlated among these cytokines to a certain degree (Table 3). The graphs of the correlation between these biomarkers were shown (Additional file 7: Figure S2). The data suggested that most of cytokines that correlated with SLE disease activity did not correlate with standard biomarkers. The combination of biomarkers may provide better sensitivity and specificity to predict SLE disease activity.

Table 3 The correlation of serum biomarkers in all SLE patients (N = 124)

Discrimination between active and inactive SLE by serum biomarkers

Although C3, C4, and anti-dsDNA are used as conventional biomarkers to monitor SLE disease activity and are the components in SLEDAI-2K, the sensitivity of these traditional biomarkers are still limited [27, 28]. The receiver operator characteristic (ROC) curves were portrayed to determine whether the selected biomarkers that correlated with clinical SLEDAI can predict the active and inactive clinical symptoms of SLE patients. The ROC curve analysis suggested that IL-8, IL-18, IL-6, IFN-α, and MCP-1 are sufficient to discriminate between active or inactive SLE (based on clinical SLEDAI score). Analysis of area under the curve (AUC) showed IL-18, IL-8, IL-6, and MCP-1 gave the higher AUC than C3, C4, and anti-dsDNA (Table 4).

Table 4 Performance of biomarkers to predict active SLE

Next, we selected the cut-off points of these biomarkers from ROC curves that yielded the highest sensitivity and specificity to predict SLE disease activity (both renal and non-renal). The ROC curves of these biomarkers were graphed and demonstrated (Additional file 8: Figure S3). Serum IL-18 had the highest AUC (0.801), and the cut-off at 50 pg/ml showed 70% sensitivity and 79.73% specificity (Table 4). The positive Likelihood Ratios (LR+) of IL-8, IL-18, IL-6, IFN-α, and MCP-1 are higher than the complement and anti-dsDNA (Table 4).

Predictors of SLE disease activity during follow-up by logistic regression analysis

SLE patients showed various clinical flares that may associate with different types of cytokine-mediated in the pathogenesis. We characterized the group of clinical SLE into three groups, i.e., active any clinical (active SLE), active renal, and active non-renal. Next, we analyzed the candidate biomarkers to use as a predictor of SLE disease flares and chose the primary variables from bivariate analyses that showed significant p value (< 0.05) for further analysis with the multiple logistic regression. Bivariate analyses yielded statistically significant OR for active SLE at the baseline by the following cytokines: IL-18, IL-8, IL-6, IFN-α, MCP-1, and C3 for active SLE (Table 5). Next, we selected the biomarkers that yielded the significant OR from bivariate logistic regression and analyzed OR using multiple regression analysis which showed that only three cytokines (IL-8, IL-18, and IL-6) that still had statistically significant OR for active SLE status at the baseline (Table 5). IL-18 and IL-6 increased OR for active renal and active non-renal, respectively (Table 5).

Table 5 Predictors of SLE disease activity by logistic regression analysis

Furthermore, we analyzed whether these biomarkers can predict the disease flare at 12 weeks, the data showed only IL-18 and C3 showed significantly OR to predict active SLE and active renal at 12 weeks (Table 5). Besides, IL-8 showed marginal but significant OR to predict non-renal flare at 12 weeks (Table 5). Next, we analyzed the patients at 4 and 8 weeks to examine if the cytokines could predict the flares at an earlier time (Additional file 5). We also obtained findings similar to the analysis at 12 weeks. C3 and IL-18 predicted future renal flares while IL-8 predicted future non-renal flares. IL-6 predicted non-renal flares at time 0 but did not predict future non-renal flares.

Sensitivity and specificity of biomarker models to predict SLE disease activity

Moreover, we analyzed the sensitivity, specificity, and likelihood ratio of the possible model of biomarkers to make the judgment for using these parameters in the clinical practice (Table 6). We selected the cytokines to create a model based on the significant data by multiple logistic regression analysis (Table 5). We compared the sensitivity and specificity of the conventional biomarkers and cytokines for the prediction of SLE disease activity. IL-18 showed higher sensitivity and specificity than a model of anti-dsDNA or C3 (standard model) to predict active SLE and active renal (Table 6). A model of IL-8 or IL-18 increased the specificity to predict active SLE at baseline. Also, IL-6 and IL-8 yielded higher sensitivity and specificity than a standard model to predict non-renal active at baseline and 12 weeks, respectively (Table 6).

Table 6 Sensitivity and specificity of models to predict SLE disease activity

Discussion

Autoantibody production from autoreactive cells is a hallmark of SLE and precedes before clinical onset [29]. The presence of autoantibody alone cannot initiate the SLE symptoms unless receiving the second unknown trigger [29]. Cytokine dysregulation can potentiate the loss of immune tolerance resulting in active clinical SLE and end-organ damage [5]. Previous studies showed that serum complement and anti-dsDNA do not always correlate with active SLE, especially non-renal involvement [16, 30]. The serum level of interleukin-6 does not associate with complement and anti-dsDNA but associates with the modified SLEDAI-2K [16]. Thus, we chose the modified SLEDAI-2K instead of SLEDAI-2K, which includes anti-dsDNA and complement, to classify the patients into active and inactive SLE and analyzed the correlation with the inflammatory cytokines. However, not all of the clinical manifestations of SLE are included in SLEDAI. Although several tools are available for clinical evaluation of SLE patients, our study selected modified SLEDAI to determine disease activity according to the user-friendly tool for the clinicians in routine practice. Thus, our study may not capture some clinical manifestations of SLE that do not include in the modified SLEDAI.

Serum cytokines, including IL-8, IL-18, IL-6, IFN-α, and MCP-1 were significantly higher in the active SLE patients than in the inactive ones. These cytokines have been shown the association with SLE disease activity [16, 31,32,33]. Also, IL-18 is a cytokine that can be detected in active clinical SLE with anti-dsDNA, hypocomplementemia, and arthritis [22]. However, the head-to-head comparisons of performance between these cytokines and conventional biomarkers (complement and anti-dsDNA) to predict the active clinical SLE have never been described. Our data showed that IL-6, IL-8, and IL-18 presented higher correlation coefficients with SLE disease activity than complement and anti-dsDNA. IL-18 yielded the highest sensitivity, while IL-8 gave the highest specificity to predict active SLE. Our data suggested that these inflammatory cytokines increase the sensitivity and specificity to predict SLE disease activity.

The previous study reported that the levels of IL-18 did not differ in SLE patients regardless of glucocorticoid usage. However, that study did not analyze the correlation of glucocorticoid dosage and IL-18 level [34]. The dosage of prednisolone correlated positively with levels of IL-18 in this study. The active patients had a high level of IL-18 and concurrently received a higher dose of a glucocorticoid to control the disease activity. The inactive patients had a low level of IL-18 and received a low dose of glucocorticoid. These three variables (disease activity, IL-18, and steroid dosage) correlated in a positive direction. However, the steroid can reduce IL-18 production in stimulated healthy PBMC [35]. These findings suggested that glucocorticoid was prescribed to control active SLE disease while IL-18 increased with SLE disease activity.

One of the difficult tasks during follow-up SLE patients is to control the disease activity and maintain a remission state. The biomarkers that can predict the disease flare at the next follow-up to guide the clinicians to adjust the medication would be very useful. Serum complements (C3 and C4) correlate with lupus nephritis, but they do not associate with total disease activity as well as SLE non-renal activity [27, 28]. The cytokines involved in the pathogenesis of SLE associated with non-renal disease activity [36]. Thus, we characterized the active clinical SLE into renal or non-renal manifestations and analyzed by several statistical methods, including correlation analysis with multiple testing correction, OR, sensitivity, specificity, and multiple-regression analysis. The sensitivities and specificities were reported here based on the discovery dataset, they may probably overestimate of the true value (inevitable overfitting) and that therefore this work is hypothesis-generating: a validation cohort is required to understand the true performance of the cytokines identified. Our data showed two subsets of cytokines that predicted renal and non-renal activity.

IL-6 and IL-18 increased the OR of active non-renal and renal flares, respectively. This result confirmed the previous works that showed the IL-6 is a sensitive marker for active non-renal SLE [16, 36]. The plasma concentration of IL-18 correlates with renal involvement in SLE [37]. The complement C3 level tends to be higher in the milder lupus nephritis than the severe proliferative nephritis [36]. Our patients in this cohort were followed up at the outpatient clinic, in which the severity of renal activity might not be very critical. However, we did see the significant OR of C3 to predict active renal SLE in this cohort. Also, IL-18 levels did change and show the significant OR to predict active renal SLE at time 0. The OR of IL-18 was higher than C3, which suggested the performance of IL-18 better than the complement as a biomarker for active renal SLE.

Furthermore, the analysis of data at 4, 8, and 12 weeks showed that C3 and IL-18 had significant OR to predict future renal active. Surprisingly, we found only IL-8 showed slightly increased OR of non-renal active at 4, 8, and 12 weeks. IL-8 can be used as a marker to predict future non-renal flares. IL-8 has been detected in the cerebrospinal fluid of patients with central neuropsychiatric lupus erythematosus [38]. Nucleosome activation in polymorphonuclear cells (PMN) can increase the secretion of IL-8, the chemoattractant for neutrophil recruitment [39]. The IL-8 initiates the neutrophil extracellular traps (NETs) which activate type I IFN production [40]. SLE patients have high levels of IL-8 together with the defect to degrade NETs resulting in the aggravation of the inflammatory processes [31, 41]. The rise of IL-8 may be the initial activation of the inflammatory process leading to clinical SLE flares and that is the reason why IL-8 can be used as a predictor for future SLE non-renal flare.

Our study conducted in patients with active disease and free of infection at the time of cytokine analysis. This study demonstrated the cytokine changed in the patients were mainly affected by SLE, and not because of the infection. One of the most difficult tasks for treating lupus patients is to differentiate the clinical manifestation between active disease and infection. The study of cytokines in SLE patients at risk to develop infection may demonstrate that the different patterns of cytokines changed, which will be a useful marker to differentiate between active SLE and SLE with infection. A longitudinal study is required to prove this concept. Although our study was conducted in a tertiary hospital in which patients were referred from several major regions in the country, our data showed common findings with the previous study; the correlation of IL-18 with renal disease activity and IL-6 with the non-renal disease have been described. Thus, we consider that our findings are global and can apply to SLE patients in other ethnic groups.

In brief, all of the analyses directed to the three cytokines (IL-6, IL-8, and IL-18) that predicted SLE disease activity with good sensitivity and specificity. IL-6 predicted non-renal flare at time 0 while IL-8 predicted future non-renal flare. IL-18 predicted renal flare at time 0 and future flare. The parameters that will help to select the cytokines to predict disease activity are urine protein and sediments: renal active, select IL-18, and non-renal active, select IL-6, and IL-8. A rapid diagnostic test to measure these cytokines would be a useful tool to monitor SLE disease activity.

Conclusion

Two sets of cytokines should be monitored to predict renal and non-renal flares in SLE. IL-18 predicted renal flare while IL-6 and IL-8 predicted non-renal flare. The performance of these cytokines to predict active clinical SLE is superior to complement and anti-dsDNA. IL-18, IL-8, and IL-6 should be used in addition to conventional biomarkers to increase the sensitivity and specificity to determine SLE activity.