Advertisement
Original research| Volume 99, ISSUE 4, P676-683, April 2018

Development of a Computerized Adaptive Testing System of the Functional Assessment of Stroke

  • Gong-Hong Lin
    Affiliations
    School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan
    Search for articles by this author
  • Yi-Jing Huang
    Affiliations
    School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan
    Search for articles by this author
  • Shih-Chieh Lee
    Affiliations
    School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan
    Search for articles by this author
  • Author Footnotes
    ∗ Huang and Hsieh contributed equally to this work.
    Sheau-Ling Huang
    Footnotes
    ∗ Huang and Hsieh contributed equally to this work.
    Affiliations
    School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan

    Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, Taipei, Taiwan
    Search for articles by this author
  • Author Footnotes
    ∗ Huang and Hsieh contributed equally to this work.
    Ching-Lin Hsieh
    Correspondence
    Corresponding author Ching-Lin Hsieh, PhD, School of Occupational Therapy, College of Medicine, National Taiwan University, F4, No. 17, Xuzhou Rd, Zhongzheng District, Taipei City 100, Taiwan.
    Footnotes
    ∗ Huang and Hsieh contributed equally to this work.
    Affiliations
    School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan

    Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, Taipei, Taiwan

    Department of Occupational Therapy, College of Medical and Health Science, Asia University, Taichung, Taiwan
    Search for articles by this author
  • Author Footnotes
    ∗ Huang and Hsieh contributed equally to this work.
Published:October 14, 2017DOI:https://doi.org/10.1016/j.apmr.2017.09.116

      Abstract

      Objective

      To develop a computerized adaptive testing system of the Functional Assessment of Stroke (CAT-FAS) to assess upper- and lower-extremity (UE/LE) motor function, postural control, and basic activities of daily living with optimal efficiency and without sacrificing psychometric properties in patients with stroke.

      Design

      Simulation study.

      Setting

      One rehabilitation unit in a medical center.

      Participants

      Patients with subacute stroke (N=301; mean age, 67.3±10.9; intracranial infarction, 74.5%).

      Interventions

      Not applicable.

      Main Outcome Measures

      The UE and LE subscales of the Fugl-Meyer Assessment, Postural Assessment Scale for Stroke Patients, and Barthel Index.

      Results

      The CAT-FAS adopting the optimal stopping rule (limited reliability increase of <.010) had good Rasch reliability across the 4 domains (.88–.93) and needed few items for the whole administration (8.5 items on average). The concurrent validity (CAT-FAS vs original tests, Pearson r=.91–.95) and responsiveness (standardized response mean, .65–.76) of the CAT-FAS were good in patients with stroke.

      Conclusions

      We developed the CAT-FAS, and our results support that the CAT-FAS has sufficient efficiency, reliability, concurrent validity, and responsiveness in patients with stroke. The CAT-FAS can be used to simultaneously assess patients' functions of UE, LE, postural control, and basic activities of daily living using, on average, no more than 10 items; this efficiency is useful in reducing the assessment burdens for both clinicians and patients.

      Keywords

      List of abbreviations:

      BADL (basic activities of daily living), BI (Barthel Index), CAT (computerized adaptive testing), CI (confidence interval), FAS (Functional Assessment of Stroke), FMA (Fugl-Meyer Assessment), LE (lower extremity), LRI (limited reliability increase), PASS (Postural Assessment Scale for Stroke Patients), SRM (standardized response mean), UE (upper extremity)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Langhorne P.
        • Coupar F.
        • Pollock A.
        Motor recovery after stroke: a systematic review.
        Lancet Neurol. 2009; 8: 741-754
        • Kim S.S.
        • Lee H.J.
        • You Y.Y.
        Effects of ankle strengthening exercises combined with motor imagery training on the timed up and go test score and weight bearing ratio in stroke patients.
        J Phys Ther Sci. 2015; 27: 2303-2305
        • Lum P.S.
        • Burgar C.G.
        • Shor P.C.
        • Majmundar M.
        • Van der Loos M.
        Robot-assisted movement training compared with conventional therapy techniques for the rehabilitation of upper-limb motor function after stroke.
        Arch Phys Med Rehabil. 2002; 83: 952-959
        • Pandian S.
        • Arya K.N.
        • Kumar D.
        Does motor training of the nonparetic side influences balance and function in chronic stroke? A pilot RCT.
        ScientificWorldJournal. 2014; 2014: 769726
        • Fugl-Meyer A.R.
        • Jaasko L.
        • Leyman I.
        • Olsson S.
        • Steglind S.
        The post-stroke hemiplegic patient. 1: A method for evaluation of physical performance.
        Scand J Rehabil Med. 1975; 7: 13-31
        • Benaim C.
        • Perennou D.A.
        • Villy J.
        • Rousseaux M.
        • Pelissier J.Y.
        Validation of a standardized assessment of postural control in stroke patients: the Postural Assessment Scale for Stroke Patients (PASS).
        Stroke. 1999; 30: 1862-1868
        • Mahoney F.I.
        • Barthel D.W.
        Functional evaluation: the Barthel Index.
        Md State Med J. 1965; 14: 61-65
        • Duffy L.
        • Gajree S.
        • Langhorne P.
        • Stott D.J.
        • Quinn T.J.
        Reliability (inter-rater agreement) of the Barthel Index for assessment of stroke survivors systematic review and meta-analysis.
        Stroke. 2013; 44: 462-468
        • Mao H.F.
        • Hsueh I.P.
        • Tang P.F.
        • Sheu C.F.
        • Hsieh C.L.
        Analysis and comparison of the psychometric properties of three balance measures for stroke patients.
        Stroke. 2002; 33: 1022-1027
        • Lin J.H.
        • Hsueh I.P.
        • Sheu C.F.
        • Hsieh C.L.
        Psychometric properties of the sensory scale of the Fugl-Meyer Assessment in stroke patients.
        Clin Rehabil. 2004; 18: 391-397
        • Wang Y.L.
        • Lin G.H.
        • Huang Y.J.
        • Chen M.H.
        • Hsieh C.L.
        Refining three measures to construct an efficient Functional Assessment of Stroke.
        Stroke. 2017; 48: 1630-1635
        • Hsueh I.P.
        • Chen J.H.
        • Wang C.H.
        • et al.
        Development of a computerized adaptive test for assessing balance function in patients with stroke.
        Phys Ther. 2010; 90: 1336-1344
        • Hsueh I.P.
        • Chen J.H.
        • Wang C.H.
        • Hou W.H.
        • Hsieh C.L.
        Development of a computerized adaptive test for assessing activities of daily living in outpatients with stroke.
        Phys Ther. 2013; 93: 681-693
        • Wong A.W.
        • Heinemann A.W.
        • Miskovic A.
        • Semik P.
        • Snyder T.M.
        Feasibility of computerized adaptive testing for collection of patient-reported outcomes after inpatient rehabilitation.
        Arch Phys Med Rehabil. 2014; 95: 882-891
        • Lai J.S.
        • Cella D.
        • Choi S.
        • et al.
        How item banks and their application can influence measurement practice in rehabilitation medicine: a PROMIS fatigue item bank example.
        Arch Phys Med Rehabil. 2011; 92: S20-S27
        • Hou W.H.
        • Shih C.L.
        • Chou Y.T.
        • et al.
        Development of a computerized adaptive testing system of the Fugl-Meyer motor scale in stroke patients.
        Arch Phys Med Rehabil. 2012; 93: 1014-1020
        • Gladstone D.J.
        • Danells C.J.
        • Black S.E.
        The Fugl-Meyer Assessment of motor recovery after stroke: a critical review of its measurement properties.
        Neurorehabil Neural Repair. 2002; 16: 232-240
        • Hsueh I.P.
        • Lin J.H.
        • Jeng J.S.
        • Hsieh C.L.
        Comparison of the psychometric characteristics of the functional independence measure, 5 item Barthel index, and 10 item Barthel index in patients with stroke.
        J Neurol Neurosurg Psychiatry. 2002; 73: 188-190
        • Hsueh I.P.
        • Lee M.M.
        • Hsieh C.L.
        Psychometric characteristics of the Barthel activities of daily living index in stroke patients.
        J Formos Med Assoc. 2001; 100: 526-532
        • Pardasaney P.K.
        • Ni P.
        • Slavin M.D.
        • et al.
        Computer-adaptive balance testing improves discrimination between community-dwelling elderly fallers and nonfallers.
        Arch Phys Med Rehabil. 2014; 95: 1320-1327.e1
        • Reckase M.
        Multidimensional item response theory.
        Springer, New York2009
        • Segall D.O.
        General ability measurement: an application of multidimensional item response theory.
        Psychometrika. 2001; 66: 79-97
        • Bartolo M.
        • De Nunzio A.M.
        • Sebastiano F.
        • et al.
        Arm weight support training improves functional motor outcome and movement smoothness after stroke.
        Funct Neurol. 2014; 29: 15-21
        • El-Helow M.
        • Zamzam M.
        • Fathalla M.
        • et al.
        Efficacy of modified constraint-induced movement therapy in acute stroke.
        Eur J Phys Rehabil Med. 2015; 51: 371-379
        • Kojović J.
        • Djurić-Jovičić M.
        • Došen S.
        • Popović M.B.
        • Popović D.B.
        Sensor-driven four-channel stimulation of paretic leg: functional electrical walking therapy.
        J Neurosci Methods. 2009; 181: 100-105
        • Rao N.
        • Zielke D.
        • Keller S.
        • et al.
        Pregait balance rehabilitation in acute stroke patients.
        Int J Rehabil Res. 2013; 36: 112-117
        • Mohan U.
        • Kumar K.V.
        • Suresh B.
        • Misri Z.
        • Chakrapani M.
        Effectiveness of mirror therapy on lower extremity motor recovery, balance and mobility in patients with acute stroke: a randomized sham-controlled pilot trial.
        Ann Indian Acad Neurol. 2013; 16: 634-639
        • Efron B.
        • Tibshirani R.
        Bootstrap methods for standard errors, confidence intervals, and other measures of statistical sccuracy.
        Stat Sci. 1986; 1: 54-75
        • Mokkink L.B.
        • Terwee C.B.
        • Patrick D.L.
        • et al.
        The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes.
        J Clin Epidemiol. 2010; 63: 737-745
        • May K.
        • Nicewander W.A.
        Measuring change conventionally and adaptively.
        Educ Psychol Meas. 1998; 58: 882-897
        • Fieo R.A.
        • Austin E.J.
        • Starr J.M.
        • Deary I.J.
        Calibrating ADL-IADL scales to improve measurement accuracy and to extend the disability construct into the preclinical range: a systematic review.
        BMC Geriatr. 2011; 11: 42