Advertisement

Development of a Computerized Adaptive Testing System for Assessing 5 Functions in Patients with Stroke: A Simulation and Validation Study

Published:October 26, 2018DOI:https://doi.org/10.1016/j.apmr.2018.09.122

      Abstract

      Objective

      The authors aimed to develop and validate the Computerized Adaptive Testing System for Assessing 5 Functions in Patients with Stroke (CAT-5F) based on the Barthel Index (BI), Postural Assessment Scale for Stroke patients (PASS), and Stroke Rehabilitation Assessment of Movement (STREAM) to improve the efficiency of assessment. The purposes of the CAT-5F assessment are to describe patients’ levels of impairments or disabilities in the 5 functions and to serve as an outcome measure in patients with stroke.

      Design

      This is a data-mining study based on data from a previous study using simulation analysis to develop and validate the CAT-5F.

      Setting

      One rehabilitation unit in a medical center in Taiwan served as the setting for this study.

      Participants

      Data were retrieved from totals of 540 (initial assessment) and 309 (discharge assessment) participants with stroke assessed in a previous study. The assessment data (N=540) were from the BI, PASS, and STREAM.

      Interventions

      Not applicable.

      Main Outcome Measures

      The outcome measures for this study were from BI, PASS, and STREAM.

      Results

      The CAT-5F using the optimal stopping rule (limited reliability increased <0.010) had good Rasch reliability across the 5 functions (0.86-0.96) and needed 12.7 items, on average, for the whole administration. The concurrent validity (Pearson product-moment correlation coefficient, r=0.91-0.96) and responsiveness (standardized response mean=0.33-0.91) of the CAT-5F were sufficient in the patients.

      Conclusion

      The CAT-5F has sufficient administrative efficiency, reliability, concurrent validity, and responsiveness to simultaneously assess basic activities of daily living, postural control, upper extremity/lower extremity motor functions, and mobility in patients with stroke.

      Keywords

      List of abbreviations:

      ADL (activities of daily living), BADL (basic activities of daily living), BI (Barthel Index), CAT (computerized adaptive testing), CAT-5F (Computerized Adaptive Testing System for Assessing 5 Functions in Patients with Stroke), FIM-M (Functional Independence Measure-motor scale), LE (lower-extremity), PASS (Postural Assessment Scale for Stroke patients), SRM (standardized response mean), STREAM (Stroke Rehabilitation Assessment of Movement), UE (upper-extremity)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Sorrentino G.
        • Sale P.
        • Solaro C.
        • Rabini A.
        • Cerri C.G.
        • Ferriero G.
        Clinical measurement tools to assess trunk performance after stroke: a systematic review.
        Eur J Phys Rehabil Med. 2018; 54: 772-784
        • Sangha H.
        • Lipson D.
        • Foley N.
        • et al.
        A comparison of the Barthel Index and the Functional Independence Measure as outcome measures in stroke rehabilitation: patterns of disability scale usage in clinical trials.
        Int J Rehabil Res. 2005; 28: 135-139
        • Gor-Garcia-Fogeda M.D.
        • Molina-Rueda F.
        • Cuesta-Gomez A.
        • Carratala-Tejada M.
        • Alguacil-Diego I.M.
        • Miangolarra-Page J.C.
        Scales to assess gross motor function in stroke patients: a systematic review.
        Arch Phys Med Rehabil. 2014; 95: 1174-1183
        • Benaim C.
        • Perennou D.A.
        • Villy J.
        • Rousseaux M.
        • Pelissier J.Y.
        Validation of a standardized assessment of postural control in stroke patients: the Postural Assessment Scale for Stroke Patients (PASS).
        Stroke. 1999; 30: 1862-1868
        • Mahoney F.I.
        • Barthel D.W.
        Functional evaluation: the Barthel Index.
        Md State Med J. 1965; 14: 61-65
        • Daley K.
        • Mayo N.
        • Danys I.
        • et al.
        The Stroke Rehabilitation Assessment of Movement (STREAM): refining and validating the content.
        Physiother Can. 1997; 49: 269-278
        • Powers W.J.
        • Rabinstein A.A.
        • Ackerson T.
        • et al.
        2018 guidelines for the early management of patients with acute ischemic stroke: a guideline for healthcare professionals from the American Heart Association/American Stroke Association.
        Stroke. 2018; 49: e46-e110
        • Winstein C.J.
        • Stein J.
        • Arena R.
        • et al.
        Guidelines for adult stroke rehabilitation and recovery.
        Stroke. 2016; 47: e98-e169
        • Hsueh I.-P.
        • Hsu M.-J.
        • Sheu C.-F.
        • Lee S.
        • Hsieh C.-L.
        • Lin J.-H.
        Psychometric comparisons of 2 versions of the Fugl-Meyer Motor Scale and 2 versions of the Stroke Rehabilitation Assessment of Movement.
        Neurorehabil Neural Repair. 2008; 22: 737-744
        • Hsueh I.-P.
        • Lee M.-M.
        • Hsieh C.-L.
        Psychometric characteristics of the Barthel activities of daily living index in stroke patients.
        J Formos Med Assoc. 2001; 100: 526-532
        • Mao H.-F.
        • Hsueh I.-P.
        • Tang P.-F.
        • Sheu C.-F.
        • Hsieh C.-L.
        Analysis and comparison of the psychometric properties of three balance measures for stroke patients.
        Stroke. 2002; 33: 1022-1027
        • Hsueh I.-P.
        • Chen J.-H.
        • Wang C.-H.
        • et al.
        Development of a computerized adaptive test for assessing balance function in patients with stroke.
        Phys Ther. 2016; 90: 1336-1344
        • Hsueh I.-P.
        • Chen J.-H.
        • Wang C.-H.
        • Hou W.-H.
        • Hsieh C.-L.
        Development of a computerized adaptive test for assessing activities of daily living in outpatients with stroke.
        Phys Ther. 2013; 93: 681-693
        • Hou W.-H.
        • Shih C.-L.
        • Chou Y.-T.
        • et al.
        Development of a computerized adaptive testing system of the Fugl-Meyer motor scale in stroke patients.
        Arch Phys Med Rehabil. 2012; 93: 1014-1020
        • Weiss D.J.
        • Kingsbury G.G.
        Application of computerized adaptive testing to educational problems.
        JEM. 1984; 21: 361-375
        • Papuga M.
        • Dasilva C.
        • McIntyre A.
        • Mitten D.
        • Kates S.
        • Baumhauer J.
        Large-scale clinical implementation of PROMIS computer adaptive testing with direct incorporation into the electronic medical record.
        Health Systems. 2017; 7: 1-12
        • Koh C.-L.
        • Pan S.-L.
        • Jeng J.-S.
        • et al.
        Predicting recovery of voluntary upper extremity movement in subacute stroke patients with severe upper extremity paresis.
        PLoS One. 2015; 10e0126857
        • Hsueh I.-P.
        • Wang W.-C.
        • Wang C.-H.
        • et al.
        A simplified stroke rehabilitation assessment of movement instrument.
        Phys Ther. 2006; 86: 936-943
        • Wang Y.-L.
        • Lin G.-H.
        • Huang Y.-J.
        • Chen M.-H.
        • Hsieh C.-L.
        Refining 3 measures to construct an efficient Functional Assessment of Stroke.
        Stroke. 2017; 48: 1630-1635
        • Hsueh I.-P.
        • Wang W.-C.
        • Sheu C.-F.
        • Hsieh C.-L.
        Rasch analysis of combining two indices to assess comprehensive ADL function in stroke patients.
        Stroke. 2004; 35: 721-726
        • Linacre J.
        A user’s guide to Winstep.
        MESA Press, Chicago2009
        • Lin G.-H.
        • Huang Y.-J.
        • Lee S.-C.
        • Huang S.-L.
        • Hsieh C.-L.
        Development of a computerized adaptive testing system of the Functional Assessment of Stroke.
        Arch Phys Med Rehabil. 2018; 99: 676-683
        • Hsueh I.-P.
        • Lin J.-H.
        • Jeng J.-S.
        • Hsieh C.-L.
        Comparison of the psychometric characteristics of the functional independence measure, 5 item Barthel index, and 10 item Barthel index in patients with stroke.
        J Neurol Neurosurg Psychiatry. 2002; 73: 188-190
        • Wang C.-H.
        • Hsieh C.-L.
        • Dai M.-H.
        • Chen C.-H.
        • Lai Y.-F.
        Inter-rater reliability and validity of the Stroke Rehabilitation Assessment of Movement (STREAM) instrument.
        J Rehabil Med. 2002; 34: 20-24
        • Wu M.
        • Adams R.
        • Wilson M.
        • Haldane S.
        ACER ConQuest 2.0: general item response modelling software.
        ([computer program manual]) Australian Council for Educational Research Ltd, Camberwell, Australia2007
        • Reckase M.
        Multidimensional item response theory.
        Springer, New York, NY2009
        • Gibbons L.E.
        • Fredericksen R.
        • Batey D.S.
        • et al.
        Validity assessment of the PROMIS fatigue domain among people living with HIV.
        AIDS Res Ther. 2017; 14: 21
        • Salter K.
        • Jutai J.
        • Teasell R.
        • Foley N.
        • Bitensky J.
        • Bayley M.
        Issues for selection of outcome measures in stroke rehabilitation: ICF activity.
        Disabil Rehabil. 2005; 27: 315-340
        • De Vet H.C.
        • Bouter L.M.
        • Bezemer P.D.
        • Beurskens A.J.
        Reproducibility and responsiveness of evaluative outcome measures: theoretical considerations illustrated by an empirical example.
        Int J Technol Assess Health Care. 2001; 17: 479-487
        • Bartolo M.
        • De Nunzio A.M.
        • Sebastiano F.
        • et al.
        Arm weight support training improves functional motor outcome and movement smoothness after stroke.
        Funct Neurol. 2014; 29: 15-21
        • El-Helow M.R.
        • Zamzam M.L.
        • Fathalla M.M.
        • et al.
        Efficacy of modified constraint-induced movement therapy in acute stroke.
        Eur J Phys Rehabil Med. 2015; 51: 371-379
        • Kojović J.
        • Djurić-Jovičić M.
        • Došen S.
        • Popović M.B.
        • Popović D.B.
        Sensor-driven four-channel stimulation of paretic leg: functional electrical walking therapy.
        J Neurosci Methods. 2009; 181: 100-105
        • Mohan U.
        • Babu S.K.
        • Kumar K.V.
        • Suresh B.
        • Misri Z.
        • Chakrapani M.
        Effectiveness of mirror therapy on lower extremity motor recovery, balance and mobility in patients with acute stroke: a randomized sham-controlled pilot trial.
        Ann Indian Acad Neurol. 2013; 16: 634-639
        • Rao N.
        • Zielke D.
        • Keller S.
        • et al.
        Pregait balance rehabilitation in acute stroke patients.
        Int J Rehabil Res. 2013; 36: 112-117
        • Linacre J.M.
        A user’s guide to WINSTEPS MINISTEP Rasch-model computer programs.
        MESA Press, Chicago2006
        • Kwon S.
        • Hartzema A.G.
        • Duncan P.W.
        • Min-Lai S.
        Disability measures in stroke: relationship among the Barthel Index, the Functional Independence Measure, and the Modified Rankin Scale.
        Stroke. 2004; 35: 918-923
        • Hachisuka K.
        • Okazaki T.
        • Ogata H.
        Self-rating Barthel index compatible with the original Barthel index and the Functional Independence Measure motor score.
        JUOEH. 1997; 19: 107-121