Advertisement
From the editors’ desk| Volume 97, ISSUE 7, P1051-1052, July 2016

What to Do With “Moderate” Reliability and Validity Coefficients?

  • Marcel W. Post
    Correspondence
    Corresponding author Marcel W. Post, PhD, De Hoogstraat Rehabilitation, Rembrandtkade 10, 3583TM Utrecht, The Netherlands.
    Affiliations
    University of Groningen, University Medical Center Groningen, Department of Rehabilitation Medicine, Groningen; and Brain Center Rudolf Magnus and Center of Excellence in Rehabilitation Medicine, University Medical Center Utrecht and De Hoogstraat, Utrecht, The Netherlands
    Search for articles by this author
Published:April 16, 2016DOI:https://doi.org/10.1016/j.apmr.2016.04.001

      Abstract

      Clinimetric studies may use criteria for test-retest reliability and convergent validity such that correlation coefficients as low as .40 are supportive of reliability and validity. It can be argued that moderate (.40–.60) correlations should not be interpreted in this way and that reliability coefficients <.70 should be considered as indicative of unreliability. Convergent validity coefficients in the .40 to .60 or .40 to .70 range should be considered as indications of validity problems, or as inconclusive at best. Studies on reliability and convergent should be designed in such a way that it is realistic to expect high reliability and validity coefficients. Multitrait multimethod approaches are preferred to study construct (convergent-divergent) validity.

      Keywords

      List of abbreviations:

      ICC (intraclass correlation coefficient), RMD (Rehabilitation Measures Database), SCIRE (Spinal Cord Injury Rehabilitation Evidence)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Kozlowski A.J.
        • Singh R.
        • Victorson D.
        • et al.
        Agreement between responses from community-dwelling persons with stroke and their proxies on the NIH Neurological Quality of Life (Neuro-QoL) Short Forms.
        Arch Phys Med Rehabil. 2015; 96: 1986-1992
        • Carod-Artal F.J.
        • Ferreira Coral L.
        • Stieven Trizotto D.
        • Menezes Moreira C.
        Self- and proxy-report agreement on the Stroke Impact Scale.
        Stroke. 2009; 40: 3308-3314
        • Nunnally J.C.
        • Bernstein I.H.
        Psychometric theory.
        McGraw-Hill, New York1994
        • McGraw K.O.
        • Wong S.P.
        Forming inferences about some intraclass correlation coefficients.
        Psychol Methods. 1996; 1: 30-46
        • Fitzpatrick R.
        • Davey C.
        • Buxton M.J.
        • Jones D.R.
        Evaluating patient-based outcome measures for use in clinical trials.
        Health Technol Assess. 1998; 2 (1-74): i-iv
        • Terwee C.B.
        • Bot S.D.
        • de Boer M.R.
        • et al.
        Quality criteria were proposed for measurement properties of health status questionnaires.
        J Clin Epidemiol. 2007; 60: 34-42
        • Streiner D.L.
        • Norman G.R.
        Health measurement scales: a practical guide to their development and use.
        5th ed. Oxford Univ Pr, Oxford2008
        • Nunnally J.C.
        Psychometric theory.
        McGraw-Hill, New York1978
        • McDowell I.
        • Newell C.
        Measuring health. A guide to rating scales and questionnaires.
        Oxford Univ Pr, Oxford1987