Advertisement
Original research| Volume 99, ISSUE 8, P1499-1506, August 2018

Download started.

Ok

Interrater and Intrarater Reliability of the Balance Computerized Adaptive Test in Patients With Stroke

  • Author Footnotes
    ∗ Hsieh and Chiang contributed equally to this work.
    Hsin-Yu Chiang
    Footnotes
    ∗ Hsieh and Chiang contributed equally to this work.
    Affiliations
    Department of Occupational Therapy, College of Medicine, Fu Jen Catholic University, New Taipei City, Taiwan
    Search for articles by this author
  • Wen-Shian Lu
    Affiliations
    School of Occupational Therapy, Chung Shan Medical University, Taichung, Taiwan

    Occupational Therapy Room, Chung Shan Medical University Hospital, Taichung, Taiwan
    Search for articles by this author
  • Wan-Hui Yu
    Correspondence
    Corresponding author Wan-Hui Yu, PhD, Department of Occupational Therapy, College of Medical and Health Science, Asia University, 500, Lioufeng Rd, Wufeng, Taichung 41354, Taiwan.
    Affiliations
    Department of Occupational Therapy, College of Medical and Health Science, Asia University, Taichung, Taiwan
    Search for articles by this author
  • I-Ping Hsueh
    Affiliations
    School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan

    Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, Taipei, Taiwan
    Search for articles by this author
  • Author Footnotes
    ∗ Hsieh and Chiang contributed equally to this work.
    Ching-Lin Hsieh
    Footnotes
    ∗ Hsieh and Chiang contributed equally to this work.
    Affiliations
    Department of Occupational Therapy, College of Medical and Health Science, Asia University, Taichung, Taiwan

    School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan

    Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, Taipei, Taiwan
    Search for articles by this author
  • Author Footnotes
    ∗ Hsieh and Chiang contributed equally to this work.
Published:April 10, 2018DOI:https://doi.org/10.1016/j.apmr.2018.03.011

      Abstract

      Objective

      To examine the interrater and intrarater reliability of the Balance Computerized Adaptive Test (Balance CAT) in patients with chronic stroke having a wide range of balance functions.

      Design

      Repeated assessments design (1wk apart).

      Setting

      Seven teaching hospitals.

      Participants

      A pooled sample (N=102) including 2 independent groups of outpatients (n=50 for the interrater reliability study; n=52 for the intrarater reliability study) with chronic stroke.

      Interventions

      Not applicable.

      Main Outcome Measures

      Balance CAT.

      Results

      For the interrater reliability study, the values of intraclass correlation coefficient, minimal detectable change (MDC), and percentage of MDC (MDC%) for the Balance CAT were .84, 1.90, and 31.0%, respectively. For the intrarater reliability study, the values of intraclass correlation coefficient, MDC, and MDC% ranged from .89 to .91, from 1.14 to 1.26, and from 17.1% to 18.6%, respectively.

      Conclusions

      The Balance CAT showed sufficient intrarater reliability in patients with chronic stroke having balance functions ranging from sitting with support to independent walking. Although the Balance CAT may have good interrater reliability, we found substantial random measurement error between different raters. Accordingly, if the Balance CAT is used as an outcome measure in clinical or research settings, same raters are suggested over different time points to ensure reliable assessments.

      Keywords

      List of abbreviations:

      ANOVA (analysis of variance), BBS (Berg Balance Scale), CAT (computerized adaptive test), ICC (intraclass correlation coefficient), LOA (limits of agreement), MDC (minimal detectable change), MDC% (percentage of minimal detectable change), PASS (Postural Assessment Scale for Stroke Patients)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Tyson S.F.
        • Hanley M.
        • Chillala J.
        • Selley A.B.
        • Tallis R.C.
        The relationship between balance, disability, and recovery after stroke: predictive validity of the Brunel Balance Assessment.
        Neurorehabil Neural Repair. 2007; 21: 341-346
        • Berg K.
        • Wood-Dauphine S.
        • Williams J.
        • Gayton D.
        Measuring balance in the elderly: preliminary development of an instrument.
        Physiother Can. 1989; 41: 304-311
        • Benaim C.
        • Pérennou D.A.
        • Villy J.
        • Rousseaux M.
        • Pelissier J.Y.
        Validation of a standardized assessment of postural control in stroke patients the Postural Assessment Scale for Stroke Patients (PASS).
        Stroke. 1999; 30: 1862-1868
        • Mao H.F.
        • Hsueh I.P.
        • Tang P.F.
        • Sheu C.F.
        • Hsieh C.L.
        Analysis and comparison of the psychometric properties of three balance measures for stroke patients.
        Stroke. 2002; 33: 1022-1027
        • Hsueh I.P.
        • Chen J.H.
        • Wang C.H.
        • et al.
        Development of a computerized adaptive test for assessing balance function in patients with stroke.
        Phys Ther. 2010; 90: 1336-1344
        • Wainer H.
        Computerized adaptive testing: a primer.
        Lawrence Erlbaum Associates, Mahwan2000
        • Yu W.H.
        • Hsueh I.P.
        • Hou W.H.
        • Wang Y.H.
        • Hsieh C.L.
        A comparison of responsiveness and predictive validity of two balance measures in patients with stroke.
        J Rehabil Med. 2012; 44: 176-180
        • Chen C.H.
        • Lin S.F.
        • Yu W.H.
        • Lin J.H.
        • Chen H.L.
        • Hsieh C.L.
        Comparison of the test-retest reliability of the Balance Computerized Adaptive Test and a computerized posturography instrument in patients with stroke.
        Arch Phys Med Rehabil. 2014; 95: 1477-1483
        • Gliner J.A.
        • Morgan G.A.
        • Harmon R.J.
        Measurement reliability.
        J Am Acad Child Adolesc Psychiatry. 2001; 40: 486-488
        • Hobart J.
        Rating scales for neurologists.
        J Neurol Neurosurg Psychiatry. 2003; 74: iv22-iv26
        • Portney L.G.
        • Watkins M.P.
        Foundations of clinical research: applications to practice.
        3rd ed. Pearson Prentice Hall, Upper Saddle River2009
        • Koo T.K.
        • Li M.Y.
        A guideline of selecting and reporting intraclass correlation coefficients for reliability research.
        J Chiropr Med. 2016; 15: 155-163
        • Andresen E.M.
        Criteria for assessing the tools of disability outcomes research.
        Arch Phys Med Rehabil. 2000; 81: S15-S20
        • Bland J.M.
        • Altman D.G.
        Statistical methods for assessing agreement between two methods of clinical measurement.
        Lancet. 1986; 1: 307-310
        • Bland J.M.
        • Altman D.G.
        Measuring agreement in method comparison studies.
        Stat Methods Med Res. 1999; 8: 135-160
        • Atkinson G.
        • Nevill A.M.
        Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine.
        Sports Med. 1998; 26: 217-238
        • Haley S.M.
        • Fragala-Pinkham M.A.
        Interpreting change scores of tests and measures used in physical therapy.
        Phys Ther. 2006; 86: 735-743
        • Chen H.M.
        • Hsieh C.L.
        • Sing Kai L.
        • Liaw L.J.
        • Chen S.M.
        • Lin J.H.
        The test-retest reliability of 2 mobility performance tests in patients with chronic stroke.
        Neurorehabil Neural Repair. 2007; 21: 347-352
        • Lee Y.C.
        • Yu W.H.
        • Lin Y.F.
        • Hsueh I.P.
        • Wu H.C.
        • Hsieh C.L.
        Reliability and responsiveness of the activities of daily living computerized adaptive testing system in patients with stroke.
        Arch Physical Med Rehabil. 2014; 95: 2055-2063
        • Yu W.H.
        • Chen K.L.
        • Huang S.L.
        • Lu W.S.
        • Lee S.C.
        • Hsieh C.L.
        Intrarater and interrater reliability of the Hierarchical Balance Short Forms in patients with stroke.
        Arch Physical Med Rehabil. 2016; 97: 2137-2145
        • Fitzpatrick R.
        • Davey C.
        • Buxton M.J.
        • Jones D.R.
        Evaluating patient-based outcome measures for use in clinical trials.
        Health Technol Assess. 1998; 2 (1-74): i-iv
        • Frost M.H.
        • Reeve B.B.
        • Liepa A.M.
        • Stauffer J.W.
        • Hays R.D.
        What is sufficient evidence for the reliability and validity of patient-reported outcome measures?.
        Value Health. 2007; 10: S94-S105
        • Hafner B.J.
        • Morgan S.J.
        • Askew R.L.
        • Salem R.
        Psychometric evaluation of self-report outcome measures for prosthetic applications.
        J Rehabil Res Dev. 2016; 53: 797-812
        • Chen Y.M.
        • Huang Y.J.
        • Huang C.Y.
        • et al.
        Test-retest reliability and minimal detectable change of two simplified 3-point balance measures in patients with stroke.
        Eur J Phys Rehabil Med. 2017; 53: 719-724
        • Lee Y.C.
        • Yu W.H.
        • Hsueh I.P.
        • Chen S.S.
        • Hsieh C.L.
        Test-retest reliability and responsiveness of the Barthel Index-based Supplementary Scales in patients with stroke.
        Eur J Phys Rehabil Med. 2017; 53: 710-718
        • Hsueh I.P.
        • Chen K.L.
        • Chou Y.T.
        • Wang Y.H.
        • Hsieh C.L.
        Individual-level responsiveness of the original and short-form postural assessment scale for stroke patients.
        Phys Ther. 2013; 93: 1377-1382
        • Ottenbacher K.J.
        • Mann W.C.
        • Granger C.V.
        • Tomita M.
        • Hurren D.
        • Charvat B.
        Inter-rater agreement and stability of functional assessment in the community-based elderly.
        Arch Phys Med Rehabil. 1994; 75: 1297-1301