Advertisement

Elevating the Quality of Disability and Rehabilitation Research: Mandatory Use of the Reporting Guidelines

      An audio podcast accompanies this article.
      With the remarkable growth of disability- and rehabilitation-related research in the last decade, it is imperative that we support the highest quality research possible. With cuts in research funding, rehabilitation research is now under a microscope like never before, and it is critical that we put our best foot forward.
      To ensure the quality of the disability and rehabilitation research that is published, the 28 rehabilitation journals simultaneously publishing this editorial (see acknowledgments) have agreed to take a more aggressive stance on the use of reporting guidelines.
      Physical Therapy, the Journal of Orthopaedic & Sports Physical Therapy, the Journal of Physiotherapy, and the European Journal of Physical and Rehabilitation Medicine have already successfully required reporting guidelines, one for as many as 10 years.
      Research reports must contain sufficient information to allow readers to understand how a study was designed and conducted, including variable definitions, instruments and other measures, and analytical techniques.
      • Moher D.
      • Simera I.
      • Schulz K.F.
      • Hoey J.
      • Altman D.G.
      Helping editors, peer reviewers and authors improve the clarity, completeness and transparency of reporting health research.
      For review articles, systematic or narrative, readers should be informed of the rationale and details behind the literature search strategy. Too often articles fail to include their standard for inclusion and their criteria for evaluating quality of the studies.
      • Simera I.
      • Altman D.G.
      • Moher D.
      • Schulz K.F.
      • Hoey J.
      Guidelines for reporting health research: the EQUATOR network's survey of guideline authors.
      As noted by Doug Altman, co-originator of the Consolidated Standards of Reporting Trials (CONSORT) statement and head of the Centre for Statistics in Medicine at Oxford University: “Good reporting is not an optional extra: it is an essential component of good research…we all share this obligation and responsibility.”

      Altman D. Why we need transparent reporting of health research. Excerpt from a presentation delivered at the launch of the EQUATOR Network, June 2008. Available at: http://www.equator-network.org/2008/06/26/achieving-transparency-in-reporting-health-research/. Accessed January 9, 2013.

      What are Reporting Guidelines?

      Reporting guidelines are documents that assist authors in reporting research methods and findings. They are typically presented as checklists or flow diagrams that lay out the core reporting criteria required to give a clear account of a study's methods and results. The intent is not just that authors complete a specific reporting checklist but that they ensure that their articles contain key elements. Reporting guidelines should not be seen as an administrative burden; rather, they are a template by which an author can construct their articles more completely.
      Reporting guidelines have been developed for almost every study design. More information on the design, use, and array of reporting guidelines can be found on the website for the Enhancing the Quality and Transparency of Health Research (EQUATOR) network,

      EQUATOR network. Available at: www.equator-network.org. Accessed October 21, 2013.

      an important organization that promotes improvements in the accuracy and comprehensiveness of reporting. Examples include the following:
      There is accumulating evidence that the use of reporting guidelines improves the quality of research. Turner et al
      • Turner L.
      • Shamseer L.
      • Altman D.G.
      • Schulz K.F.
      • Moher D.
      Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane review.
      established that the use of the CONSORT statement improved the completeness of reporting in randomized controlled trials. Diagnostic accuracy studies appeared to show improvement in reporting standards when the STARD guidelines were applied.
      • Smidt N.
      • Rutjes A.W.
      • van der Windt D.A.
      • et al.
      The quality of diagnostic accuracy studies since the STARD statement: has it improved?.
      Early evidence also suggests that inclusion of reporting standards during peer review raises manuscript quality.
      • Cobo E.
      • Cortés J.
      • Ribera J.M.
      • et al.
      Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial.
      The International Committee of Medical Journal Editors now encourages all journals to monitor reporting standards and collect associated reporting guideline checklists in the process.

      International Committee of Medical Journal Editors. Preparing a manuscript for submission to a medical journal. Available at: http://www.icmje.org/manuscript_a.html. Accessed October 21, 2013.

      Furthermore, the National Library of Medicine also now actively promotes the use of reporting guidelines.

      U.S. National Library of Medicine. Research reporting guidelines and initiatives: by organization. Available at: http://www.nlm.nih.gov/services/research_report_guide.html. Accessed October 21, 2013.

      How will Reporting Guidelines be Integrated Into Manuscript Flow?

      By January 1, 2015, all of the journals publishing this editorial will have worked through implementation and the mandatory use of guidelines and checklists will be firmly in place. Because each journal has its unique system for managing submissions, there may be several ways that these reporting requirements will be integrated into the manuscript flow. Some journals will make adherence to reporting criteria and associated checklists mandatory for all submissions. Other journals may require them only when the article is closer to acceptance for publication. In any case, the onus will be on the author not only to ensure the inclusion of the appropriate reporting criteria but also to document evidence of inclusion through the use of the reporting guideline checklists. Authors should consult the Instructions for Authors of participating journals for more information.
      We hope that simultaneous implementation of this new reporting requirement will send a strong message to all disability and rehabilitation researchers of the need to adhere to the highest standards when performing and disseminating research. Although we expect that there will be growing pains with this process, we hope that within a short period, researchers will begin to use these guidelines during the design phases of their research, thereby improving their methods. The potential benefits to authors are obvious: articles are improved through superior reporting of a study's design and methods, and the usefulness of the article to readers is enhanced. Reporting guidelines also allow for greater transparency in reporting how studies were conducted and can help, hopefully, during the peer review process to expose misleading or selective reporting. Reporting guidelines are an important tool to assist authors in the structural development of a manuscript, eventually allowing an article to realize its full potential.

      Acknowledgments

      As this issue went to press, the following Editors agreed to participate in the initiative to mandate reporting guidelines and publish this Position Statement in their respective journals. As a collective group, we encourage others to adopt these guidelines and welcome them to share this editorial with their readerships.
      • Sharon A. Gutman, PhD, OTR
      • Editor-in-Chief
      • American Journal of Occupational Therapy
      • Walter R. Frontera, MD, PhD
      • Editor-in-Chief
      • American Journal of Physical Medicine and Rehabilitation
      • Leighton Chan, MD, MPH, and Allen W. Heinemann, PhD
      • Co-Editors-in-Chief
      • Archives of Physical Medicine and Rehabilitation
      • Helene J. Polatajko, PhD, OT(C)
      • Editor-in-Chief
      • Canadian Journal of Occupational Therapy
      • Derick T. Wade, MD
      • Editor-in-Chief
      • Clinical Rehabilitation
      • Suzanne McDermott, PhD, and Margaret A. Turk, MD
      • Co-Editors-in-Chief
      • Disability and Health Journal
      • Stefano Negrini, MD
      • Editor-in-Chief
      • European Journal of Physical and Rehabilitation Medicine
      • Steven Vogel, DO(Hon)
      • Editor-in-Chief
      • The International Journal of Osteopathic Medicine
      • Črt Marinček, MD, PhD
      • Editor-in-Chief
      • International Journal of Rehabilitation Research
      • M. Solomonow, PhD, MD(hon)
      • Editor-in-Chief
      • Journal of Electromyography & Kinesiology
      • Paolo Bonato, PhD
      • Editor-in-Chief
      • Journal of NeuroEngineering and Rehabilitation
      • Edelle [Edee] Field-Fote, PT, PhD
      • Editor-in-Chief
      • Journal of Neurologic Physical Therapy
      • Guy G. Simoneau, PhD, PT

      • Editor-in-Chief
      • Journal of Orthopaedic & Sports Physical Therapy (JOSPT)
      • Mark Elkins, PhD, MHSc, BA, BPhty
      • Editor-in-Chief
      • Journal of Physiotherapy
      • Stacieann C. Yuhasz, PhD

      • Editor-in-Chief

      • Journal of Rehabilitation Research and Development
      • Bengt H. Sjölund, MD, DMSc
      • Editor-in-Chief
      • Journal of Rehabilitation Medicine
      • Carl G. Mattacola, PhD, ATC
      • Editor-in-Chief
      • Journal of Sport Rehabilitation
      • Ann Moore, PhD and Gwendolen Jull, PhD
      • Co-Editors-in-Chief
      • Manual Therapy
      • Randolph J. Nudo, PhD
      • Editor-in-Chief
      • Neurorehabilitation & Neural Repair
      • Kathleen Matuska, PhD, OTR/L
      • Editor-in-Chief
      • Occupational Therapy Journal of Research: Occupation, Participation, and Health
      • Ann F Van Sant, PT, PhD
      • Editor-in-Chief
      • Pediatric Physical Therapy
      • Greg Carter, MD
      • Consulting Editor
      • Physical Medicine and Rehabilitation Clinics of North America
      • Rebecca L. Craik, PT, PhD
      • Editor-in-Chief
      • Physical Therapy
      • Dina Brooks, PhD
      • Scientific Editor
      • Physiotherapy Canada
      • Stuart M. Weinstein, MD
      • Editor-in-Chief
      • PM&R
      • Elaine L. Miller, PhD, RN
      • Editor-in-Chief
      • Rehabilitation Nursing
      • Elliot J. Roth, MD
      • Editor-in-Chief
      • Topics in Stroke Rehabilitation
      • Dilşad Sindel, MD
      • Editor-in-Chief
      • Turkish Journal of Physical Medicine and Rehabilitation

      Supplementary data

      References

        • Moher D.
        • Simera I.
        • Schulz K.F.
        • Hoey J.
        • Altman D.G.
        Helping editors, peer reviewers and authors improve the clarity, completeness and transparency of reporting health research.
        BMC Med. 2008; 6: 13
        • Simera I.
        • Altman D.G.
        • Moher D.
        • Schulz K.F.
        • Hoey J.
        Guidelines for reporting health research: the EQUATOR network's survey of guideline authors.
        PLoS Med. 2008; 5: e139
      1. Altman D. Why we need transparent reporting of health research. Excerpt from a presentation delivered at the launch of the EQUATOR Network, June 2008. Available at: http://www.equator-network.org/2008/06/26/achieving-transparency-in-reporting-health-research/. Accessed January 9, 2013.

      2. EQUATOR network. Available at: www.equator-network.org. Accessed October 21, 2013.

        • Turner L.
        • Shamseer L.
        • Altman D.G.
        • Schulz K.F.
        • Moher D.
        Does use of the CONSORT Statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane review.
        Syst Rev. 2012; 1: 60
        • Smidt N.
        • Rutjes A.W.
        • van der Windt D.A.
        • et al.
        The quality of diagnostic accuracy studies since the STARD statement: has it improved?.
        Neurology. 2006; 67: 792-797
        • Cobo E.
        • Cortés J.
        • Ribera J.M.
        • et al.
        Effect of using reporting guidelines during peer review on quality of final manuscripts submitted to a biomedical journal: masked randomised trial.
        BMJ. 2011; 343: d6783
      3. International Committee of Medical Journal Editors. Preparing a manuscript for submission to a medical journal. Available at: http://www.icmje.org/manuscript_a.html. Accessed October 21, 2013.

      4. U.S. National Library of Medicine. Research reporting guidelines and initiatives: by organization. Available at: http://www.nlm.nih.gov/services/research_report_guide.html. Accessed October 21, 2013.