Enhancing the reporting and transparency of rheumatology research: a guide to reporting guidelines
© BioMed Central Ltd 2013
Published: 28 February 2013
Manuscripts and abstracts from biomedical journals frequently do not contain proper information for meeting required standards and serving the multiple needs of their end users. Reporting guidelines and checklists help researchers to meet those standards by providing rules or principles for specific research areas. Rheumatology research includes a broad range of heterogeneous research areas, each with its own requirements, producing several distinct categories of articles. Our objectives with this article are to raise awareness of the existence and importance of reporting guidelines, to present a structured overview of reporting guidelines that rheumatology journals could apply, and to encourage their use by journal authors, editors, and reviewers, including those of Arthritis Research & Therapy. Internationally recognized reporting guidelines exist for a diversity of research areas. We encourage colleagues to consult the 'Enhancing the QUAlity and Transparency Of health Research' (EQUATOR) network when writing scientific papers. EQUATOR is an international initiative that seeks to improve the reliability and value of biomedical research literature by promoting transparent and accurate reporting of studies. We propose specific reporting guidelines for a number of study designs: animal research, randomized trials, reliability and agreement studies, systematic reviews with and without meta-analyses, diagnostic test accuracy studies, and also observational research including cross-sectional, cohort, and case-control studies. We encourage authors, editors, and reviewers to adhere to and enforce the use of the appropriate guidelines when writing, reading, and reviewing scientific papers.
Quite often, research reports and abstracts do not contain proper information for meeting required standards and serving the multiple needs of their end users , be they researchers or health care providers. Poor methodology and reporting are widespread . As a result, published studies often cannot be replicated by researchers, translated into clinical practice, or used to inform public health policy. Guidelines and checklists help researchers meet certain standards by providing sets of rules or principles for implementing best practices in a particular area .
Most trialists and many research managers know the advantages associated with using the CONSORT (CONsolidated Standards Of Reporting Trials) statement when writing a scientific paper. CONSORT is a statement intended to assess the validity of results from randomized controlled trials (RCTs) and to improve their reporting, enabling readers to understand a trial's design, conduct, analysis, and interpretations . However, many do not know about the umbrella organization that CONSORT is part of, the 'Enhancing the QUAlity and Transparency Of health Research' (EQUATOR) network . The EQUATOR network is an international initiative that seeks to improve the reliability and value of biomedical research literature by publishing a variety of different reporting guidelines that promote the transparent and accurate reporting of research studies .
The objectives of this commentary are to raise aware ness of the existence and importance of reporting guidelines within the various areas of research and to present them in a structured overview so that journal authors, editors, and reviewers - including those of Arthritis Research & Therapy - might more easily apply them.
Applying reporting guidelines
Reporting guidelines are statements that provide advice on how to report methods and findings of research . Usually in the form of a checklist, flow diagram or explicit text examples, they specify a minimum set of items required for a clear and transparent account of what was done and what was found in a study. Rheumatology and related research includes a broad range of heterogeneous research areas, each generating a category of articles with separate requirements. All reporting categories of articles should conform to the 'Uniform Requirements for Manuscripts Submitted to Biomedical Journals', developed by the International Committee of Medical Journal Editors . Nevertheless, guidelines can still be specifically tailored to different study types while conforming to these requirements, providing more focused guidance to writers and researchers - information that is valuable even at the protocol stage . It is not uncommon that scientists set up a research project in a manner that will inevitably lead to unsatisfactory reporting; that is, either the data are not there or are there in the wrong way.
The EQUATOR network library currently provides reporting guidelines for a number of study types, such as 'experimental studies', 'observational studies', 'diagnostic accuracy studies', 'biospecimen reporting', 'reliability and agreement studies', 'systematic reviews', 'qualitative research', 'mixed methods studies', 'economic evaluations', and 'quality improvement studies' .
Proposed subtitling and guidelines for various research project categories
Systematic reviews and meta-analyses
Diagnostic test studies
Reliability and agreement studies
Research in animal studies
Last part of suggested title (that is, Title Suffix)
A randomized controlled trial
A cross-sectional study
A cohort study
A case-control study
A systematic review and meta-analysis of randomized trials
A diagnostic accuracy study
A reliability and agreement study
An in vivo animal research study
Statement or guideline to consult
Table 1 reflects what we currently see as the most important statements that could apply for a journal like Arthritis Research & Therapy. The CONSORT statement will probably be perceived as the most obvious , and we are confident that most of our publishing research colleagues are aware of this statement already. We hope they agree that the use of the CONSORT statement checklist is helpful even for purposes such as structuring an article outline and for supervising junior colleagues and students preparing their first randomized controlled trial paper. The STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) statement describes what is important to report when writing an epidemiological paper . The STROBE statement consists of a checklist of 22 items relating to the title, abstract, introduction, methods, results, and discussion sections of articles . Of those 22 items, 18 are common to cohort studies, case-control studies, and cross-sectional studies, and 4 are specific to each of the 3 study designs. The STROBE statement intends to improve the reporting of all three study designs, thereby facilitating critical appraisal and interpretation of findings by reviewers, journal editors, and readers. The PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) statement is an evolution of the original QUOROM (Quality of Reporting of Meta-analyses) guideline on how to report systematic reviews and meta-analyses . The PRISMA statement focuses mainly on meta-analysis of randomized controlled trials but is also relevant for meta-analyses of observational studies; the PRISMA statement does not replace the MOOSE (Meta-analysis Of Observational Studies in Epidemiology) statement . The PRISMA statement consists of a 27-item checklist and a 4-phase flow diagram as a guide to authors.
Guidelines can also improve diagnostic test accuracy studies, which are often submitted to medical journals. The STARD (Standards for Reporting of Diagnostic Accuracy) statement aims to improve the quality of reporting of studies concerning diagnostic accuracy . STARD introduces a checklist of 25 items and suggests a flow diagram that authors can use to ensure that all relevant information is present. STARD contains a clarification of the meaning, rationale, and optimal use of each item on the checklist, as well as a short summary of the available evidence on bias and applicability .
An essential requirement of all outcome measures in biomedical research is that they be valid and reproducible. Overall reproducibility concerns the degree to which repeated measurements provide the same results. Reproducibility covers both agreement and reliability - concepts that are not easily distinguished from each other. Reliability may be defined as the ratio of variability between subjects (for example, patients) or objects (for example, ultrasound assessments) to the total variability of all measurements in the sample; reliability can be defined as the ability of a measurement to differentiate between subjects or objects . On the other hand, agreement is the degree to which scores or ratings are identical. Both concepts are important, because they provide information about the quality of measurements. Reliability is highly dependent on the heterogeneity of the study sample, while the agreement, based on measurement error, is more a pure characteristic of the measurement instrument . Partly overlapping the STARD statement, GRRAS (Guidelines for Reporting Reliability and Agreement Studies) includes a checklist with 15 issues that should be addressed when reliability and agreement are reported .
Finally, the ARRIVE (Animals in Research: Reporting In Vivo Experiments) guidelines  address previous inadequacies of biomedical journals that provided little or no guidance on what information to report when describing animal research. The ARRIVE guidelines consist of a checklist of 20 items describing the minimum information that all scientific publications reporting research using animals should include .
We anticipate some researchers would be looking for a general statement on 'Bench research' (that is, research exclusively conducted in laboratory settings), which unfortunately is not available yet - perhaps due to the multitude of different research methods that are difficult to standardize across disciplines. However, the REporting recommendations for tumour MARKer prognostic studies (REMARK) would be recommended in oncology  - principles that may also be applicable in rheumatology. Research in human biospecimens should follow the recommendations from BRISQ (Biospecimen Reporting for Improved Study Quality), which aims at improving the quality of research that uses human tissues subjected to collection, processing, and storage; it is crucial that information on the handling of biospecimens be reported in a thorough, accurate, and standardized manner .
The aim of medical research is to advance scientific knowledge and thereby lead to more rational decision making and improvements in treating and preventing disease . Despite the effort of researchers, editors, and peer reviewers, the quality of health-research reporting in journal articles has room for improvement . We present six statements and guidelines that rheumatology journals like Arthritis Research & Therapy would benefit from endorsing in the future. These six statements and guidelines, presented in Table 1, cover broad areas, such as how to report findings from randomized trials, observational studies, systematic reviews and meta-analyses, diagnostic tests, reliability and agreement studies, and animal studies. The statements specify a minimum set of items for reporting and can improve the accuracy and transparency of publications, thus facilitating easier and more reliable appraisal of quality and relevance .
Different researchers have different opinions about the role of publication guidelines . In our experience, which is shared by many others, adherence to guidelines, even at the protocol stage, adds important details to the creative process, as it helps researchers consider what they will write in their final paper of the research project they propose, for instance in the 'Methods section' . Following CONSORT, many other guidelines were developed; currently, there are probably 100 available for reporting different types of health research. Reporting guidelines may be regarded as a help for authors, editors and reviewers, and in particular, less-experienced younger colleagues.
A conventional view sees guidelines as a means of helping researchers to publish results as clearly as possible, in a way that facilitates interpretation and comparison with results from similar studies, and most guidelines are easy to employ . Whatever the view on guidelines, clear reporting eases replication of studies, which is a fundamental principle in developing and applying scientific knowledge. Professor Doug Altman published in 2002 a thought-provoking article in JAMA titled 'Poor-Quality Medical Research - What Can Journals Do' , in which he encouraged researchers and journal editors to remember that a study should not mislead; otherwise it could adversely affect clinical practice and future research .
We believe that the ability to self-correct is a prudent feature of science. Self-correction is often impeded by destruction of evidence, production of faulty evidence, and/or distortion of evidence . Proper and accurate reporting of scientific data, results, and interpretations is key to ensuring that these impediments are addressed. Therefore, we encourage research colleagues (whether acting as authors or reviewers) and journal editors to endorse the use of guidelines and checklists as a critical filter when planning, performing, presenting, and publishing research data. One way of self-correction is to consider how the results should be reported properly and accurately as early as in the conception of a research project . By integrating the recommendations early in the life cycle of the study, many methodological mistakes can be avoided that inevitably lead to unsatisfactory reporting, and will ultimately result in higher value of the study. We strongly believe that using these mechanisms from project conception to publication creates win-win situations for all end users: researchers, clinicians, and patients.
The abundance of available biomedical scientific literature and the increasing number of published articles - in rheumatology as in other fields - create a need for consistency in reporting in order to enhance evidence synthesis, ease clinical decision making, and inform healthcare policy makers. Internationally recognized reporting guidelines exist for a diversity of research areas, and we encourage authors, editors, and reviewers to adhere to and enforce the use of the appropriate guidelines when writing, reading, and reviewing scientific papers.
Animals in Research Reporting In Vivo Experiments
CONsolidated Standards Of Reporting Trials
Enhancing the QUAlity and Transparency Of health Research
Preferred Reporting Items for Systematic reviews and Meta-Analyses
Standards for Reporting of Diagnostic Accuracy
Strengthening the Reporting of Observational Studies in Epidemiology.
The Parker Institute is supported by grants from the Oak Foundation.
- Chan AW, Altman DG: Epidemiology and reporting of randomised trials published in PubMed journals. Lancet. 2005, 365: 1159-1162. 10.1016/S0140-6736(05)71879-1.View ArticlePubMedGoogle Scholar
- Altman DG: Poor-quality medical research: what can journals do. JAMA. 2002, 287: 2765-2767. 10.1001/jama.287.21.2765.View ArticlePubMedGoogle Scholar
- Simera I, Moher D, Hoey J, Schulz KF, Altman DG: A catalogue of reporting guidelines for health research. Eur J Clin Invest. 2010, 40: 35-53. 10.1111/j.1365-2362.2009.02234.x.View ArticlePubMedGoogle Scholar
- Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.PubMed CentralView ArticlePubMedGoogle Scholar
- Altman DG, Simera I, Hoey J, Moher D, Schulz K: EQUATOR: reporting guidelines for health research. Lancet. 2008, 371: 1149-1150. 10.1016/S0140-6736(08)60505-X.View ArticlePubMedGoogle Scholar
- International Committee of Medical Journal Editors. [http://www.icmje.org/]
- Christensen R, Langberg H: Statistical principles for prospective study protocols: design, analysis, and reporting. Int J Sports Phys Ther. 2012, 7: 504-511.PubMed CentralPubMedGoogle Scholar
- EQUATOR Network. [http://www.equator-network.org/]
- Vandenbroucke JP, von EE, Altman DG, Gotzsche PC, Mulrow CD, Pocock SJ, Poole C, Schlesselman JJ, Egger M: Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): explanation and elaboration. Ann Intern Med. 2007, 147: W163-W194.View ArticlePubMedGoogle Scholar
- Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Ann Intern Med. 2009, 151: W65-W94.View ArticlePubMedGoogle Scholar
- Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB: Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA. 2000, 283: 2008-2012. 10.1001/jama.283.15.2008.View ArticlePubMedGoogle Scholar
- Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Moher D, Rennie D, de Vet HC, Lijmer JG: The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med. 2003, 138: W1-12.View ArticlePubMedGoogle Scholar
- Kottner J, Audige L, Brorson S, Donner A, Gajewski BJ, Hrobjartsson A, Roberts C, Shoukri M, Streiner DL: Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. J Clin Epidemiol. 2011, 64: 96-106. 10.1016/j.jclinepi.2010.03.002.View ArticlePubMedGoogle Scholar
- de Vet HC, Terwee CB, Knol DL, Bouter LM: When to use agreement versus reliability measures. J Clin Epidemiol. 2006, 59: 1033-1039. 10.1016/j.jclinepi.2005.10.015.View ArticlePubMedGoogle Scholar
- Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG: Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. PLoS Biol. 2010, 8: e1000412-10.1371/journal.pbio.1000412.PubMed CentralView ArticlePubMedGoogle Scholar
- McShane LM, Altman DG, Sauerbrei W, Taube SE, Gion M, Clark GM: Reporting recommendations for tumor marker prognostic studies (REMARK). J Natl Cancer Inst. 2005, 97: 1180-1184. 10.1093/jnci/dji237.View ArticlePubMedGoogle Scholar
- Moore HM, Kelly AB, Jewell SD, McShane LM, Clark DP, Greenspan R, Hayes DF, Hainaut P, Kim P, Mansfield EA, Potapova O, Riegman P, Rubinstein Y, Seijo E, Somiari S, Watson P, Weier HU, Zhu C, Vaught J: Biospecimen reporting for improved study quality (BRISQ). Cancer Cytopathol. 2011, 119: 92-101. 10.1002/cncy.20147.View ArticlePubMedGoogle Scholar
- Vandenbroucke JP: STREGA, STROBE, STARD, SQUIRE, MOOSE, PRISMA, GNOSIS, TREND, ORION, COREQ, QUOROM, REMARK... and CONSORT: for whom does the guideline toll. J Clin Epidemiol. 2009, 62: 594-596. 10.1016/j.jclinepi.2008.12.003.View ArticlePubMedGoogle Scholar
- Ioannidis JP: Why most published research findings are false. PLoS Med. 2005, 2: e124-10.1371/journal.pmed.0020124.PubMed CentralView ArticlePubMedGoogle Scholar