Advertisement
ORIGINAL RESEARCH|Articles in Press

Development of a 13-item Short Form for Fugl-Meyer Assessment of Upper Extremity Scale Using a Machine Learning Approach

  • Gong-Hong Lin
    Affiliations
    International Ph.D. Program in Gerontology and Long-Term Care, College of Nursing, Taipei Medical University, Taipei, Taiwan
    Search for articles by this author
  • Inga Wang
    Affiliations
    Department of Rehabilitation Sciences & Technology, University of Wisconsin-Milwaukee, Milwaukee, WI
    Search for articles by this author
  • Shih-Chieh Lee
    Affiliations
    Department of Occupational Therapy, College of Medicine, National Cheng Kung University, Tainan, Taiwan

    School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan

    Institute of Long-Term Care, MacKay Medical College, New Taipei City, Taiwan
    Search for articles by this author
  • Chien-Yu Huang
    Footnotes
    Affiliations
    School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan

    Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, Taipei, Taiwan
    Search for articles by this author
  • Yi-Ching Wang
    Affiliations
    School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan
    Search for articles by this author
  • Ching-Lin Hsieh
    Correspondence
    Corresponding author Ching-Lin Hsieh, Rm. 418, 4F, No. 17, Xuzhou Rd, School of Occupational Therapy, Taipei, Taiwan (R.O.C.).
    Footnotes
    Affiliations
    School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan

    Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, Taipei, Taiwan

    Department of Occupational Therapy, College of Medical and Health Science, Asia University, Taichung, Taiwan
    Search for articles by this author
  • Author Footnotes
    1 Ching-Lin Hsieh and Chien-Yu Huang contributed equally to the work as co-corresponding authors.
Published:January 31, 2023DOI:https://doi.org/10.1016/j.apmr.2023.01.005

      Abstract

      Objective

      To develop and validate a short form of the Fugl-Meyer Assessment of Upper Extremity Scale (FMA-UE) using a machine learning approach (FMA-UE-ML). In addition, scores of items not included in the FMA-UE-ML were predicted.

      Design

      Secondary data from a previous study, which assessed individuals post-stroke using the FMA-UE at 4 time points: 5-30 days post-stroke screen, 2-month post-stroke baseline assessment, 6-month post-stroke assessment, and 12-month post-stroke assessment.

      Setting

      Rehabilitation units in hospitals.

      Participants

      A total of 408 individuals post-stroke (N=408).

      Interventions

      Not applicable.

      Main Outcome Measures

      The 30-item FMA-UE.

      Results

      We established 29 candidate versions of the FMA-UE-ML with different numbers of items, from 1 to 29, and examined their concurrent validity and responsiveness. We found that the responsiveness of the candidate versions obviously declined when the number of items was less than 13. Thus, the 13-item version was selected as the FMA-UE-ML. The concurrent validity was good (intra-class correlation coefficients ≥0.99). The standardized response means of the FMA-UE-ML and FMA-UE were 0.54-0.88 and 0.52-0.91, respectively. The Pearson's rs between the change scores of the FMA-UE-ML and those of the FMA-UE were 0.96-0.98. The predicted item scores had acceptable to good accuracy (Kappa=0.50-0.92).

      Conclusions

      The FMA-UE-ML seems a promising short form to improve administrative efficiency while retaining good concurrent validity and responsiveness. In addition, the FAM-UE-ML can provide all item scores of the FMA-UE for users.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Kwakkel G
        • Kollen BJ
        • Krebs HI.
        Effects of robot-assisted therapy on upper limb recovery after stroke: a systematic review.
        Neurorehabil Neural Repair. 2008; 22: 111-121
        • Nakayama H
        • Jørgensen HS
        • Raaschou HO
        • Olsen TS.
        Recovery of upper extremity function in stroke patients: the Copenhagen Stroke Study.
        Arch Phys Med Rehabil. 1994; 75: 394-398
        • Lawrence ES
        • Coshall C
        • Dundas R
        • et al.
        Estimates of the prevalence of acute stroke impairments and disability in a multiethnic population.
        Stroke. 2001; 32: 1279-1284
        • Kamper D
        • Schmit B
        • Rymer W.
        Effect of muscle biomechanics on the quantification of spasticity.
        Ann Biomed Eng. 2001; 29: 1122-1134
        • Botte MJ
        • Nickel VL
        • AKEsoN WH.
        Spasticity and contracture. Physiologic aspects of formation.
        Clin Orthop Relat Res. 1988; 233: 7-18
        • Blennerhassett JM
        • Gyngell K
        • Crean R.
        Reduced active control and passive range at the shoulder increase risk of shoulder pain during inpatient rehabilitation post-stroke: an observational study.
        J Physiother. 2010; 56: 195-199
        • Kalichman L
        • Ratmansky M.
        Underlying pathology and associated factors of hemiplegic shoulder pain.
        Am J Phys Med Rehabil. 2011; 90: 768-780
        • Gladstone DJ
        • Danells CJ
        • Black SE.
        The Fugl-Meyer assessment of motor recovery after stroke: a critical review of its measurement properties.
        Neurorehabil Neural Repair. 2002; 16: 232-240
        • Hsueh IP
        • Hsieh CL.
        Responsiveness of two upper extremity function instruments for stroke inpatients receiving rehabilitation.
        Clin Rehabil. 2002; 16: 617-624
        • Hsueh IP
        • Hsu MJ
        • Sheu CF
        • Lee S
        • Hsieh CL
        • Lin JH.
        Psychometric comparisons of 2 versions of the Fugl-Meyer Motor Scale and 2 versions of the Stroke Rehabilitation Assessment of Movement.
        Neurorehabil Neural Repair. 2008; 22: 737-744
        • Lin JH
        • Hsu MJ
        • Sheu CF
        • et al.
        Psychometric comparisons of 4 measures for assessing upper-extremity function in people with stroke.
        Phys Ther. 2009; 89: 840-850
        • Chen KL
        • Chen CT
        • Chou YT
        • Shih CL
        • Koh CL
        • Hsieh CL.
        Is the long form of the Fugl-Meyer motor scale more responsive than the short form in patients with stroke?.
        Arch Phys Med Rehabil. 2014; 95: 941-949
        • Duncan Millar J
        • van Wijck F
        • Pollock A
        • Ali M
        Outcome measures in post-stroke arm rehabilitation trials: do existing measures capture outcomes that are important to stroke survivors, carers, and clinicians?.
        Clin Rehabil. 2019; 33: 737-749
        • Santisteban L
        • Térémetz M
        • Bleton J-P
        • Baron J-C
        • Maier MA
        • Lindberg PG.
        Upper limb outcome measures used in stroke rehabilitation studies: a systematic literature review.
        PLoS One. 2016; 11e0154792
        • Veerbeek JM
        • Langbroek-Amersfoort AC
        • Van Wegen EE
        • Meskers CG
        • Kwakkel G.
        Effects of robot-assisted therapy for the upper limb after stroke: a systematic review and meta-analysis.
        Neurorehabil Neural Repair. 2017; 31: 107-121
        • Lin GH
        • Huang CY
        • Lee SC
        • et al.
        A 10-item Fugl-Meyer Motor Scale based on machine learning.
        Phys Ther. 2021; 101: pzab036
        • Lin GH
        • Huang YJ
        • Lee SC
        • Huang SL
        • Hsieh CL.
        Development of a computerized adaptive testing system of the functional assessment of stroke.
        Arch Phys Med Rehabil. 2018; 99: 676-683
        • Hsieh YW
        • Hsueh IP
        • Chou YT
        • Sheu CF
        • Hsieh CL
        • Kwakkel G.
        Development and validation of a short form of the Fugl-Meyer motor scale in patients with stroke.
        Stroke. 2007; 38: 3052-3054
        • Hou WH
        • Shih CL
        • Chou YT
        • et al.
        Development of a computerized adaptive testing system of the Fugl-Meyer motor scale in stroke patients.
        Arch Phys Med Rehabil. 2012; 93: 1014-1020
        • Wang YL
        • Lin GH
        • Huang YJ
        • Chen MH
        • Hsieh CL.
        Refining 3 measures to construct an efficient functional assessment of stroke.
        Stroke. 2017; 48: 1630-1635
        • Lin GH
        • Li CY
        • Sheu CF
        • et al.
        Using machine learning to develop a short-form measure assessing 5 functions in patients with stroke.
        Arch Phys Med Rehabil. 2022; 103: 1574-1581
        • Gonzalez O.
        Psychometric and machine learning approaches to reduce the length of scales.
        Multivar Behav Res. 2021; 56: 903-919
        • Langener AM
        • Kramer AW
        • van den Bos W
        • Huizenga HM.
        A shortened version of Raven's standard progressive matrices for children and adolescents.
        Br J Dev Psychol. 2022; 40: 35-45
        • Davagdorj K
        • Pham VH
        • Theera-Umpon N
        • Ryu KH.
        XGBoost-based framework for smoking-induced noncommunicable disease prediction.
        Int J Environ Res Public Health. 2020; 17: 6513
        • Jiang YQ
        • Cao SE
        • Cao S
        • et al.
        Preoperative identification of microvascular invasion in hepatocellular carcinoma by XGBoost and deep learning.
        J Cancer Res Clin Oncol. 2021; 147: 821-833
        • Duncan PW
        • Sullivan KJ
        • Behrman AL
        • et al.
        Protocol for the Locomotor Experience Applied Post-stroke (LEAPS) trial: a randomized controlled trial.
        BMC Neurol. 2007; 7: 39
        • Duncan PW
        • Lai SM
        • Bode RK
        • Perera S
        • DeRosa J.
        Stroke Impact Scale-16: a brief assessment of physical function.
        Neurology. 2003; 60: 291-296
        • Woodbury ML
        • Velozo CA
        • Richards LG
        • Duncan PW.
        Rasch analysis staging methodology to classify upper extremity movement impairment after stroke.
        Arch Phys Med Rehabil. 2013; 94: 1527-1533
        • Woodbury ML
        • Velozo CA
        • Richards LG
        • Duncan PW
        • Studenski S
        • Lai SM.
        Dimensionality and construct validity of the Fugl-Meyer Assessment of the upper extremity.
        Arch Phys Med Rehabil. 2007; 88: 715-723
        • Gholamy A
        • Kreinovich V
        • Kosheleva O.
        Why 70/30 or 80/20 relation between training and testing sets: a pedagogical explanation.
        IJITAS. 2018; 11: 105-111
        • Chen T
        • Guestrin C.
        XGBoost: a scalable tree boosting system.
        in: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, California, USA2016
        • Ar FM
        • Jaasko L
        • Leyman I
        • Olsson S
        • Steglind S.
        The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance.
        Scand J Rehabil Med. 1975; 7: 13-31
        • Lundquist CB
        • Maribo T.
        The Fugl–Meyer assessment of the upper extremity: reliability, responsiveness and validity of the Danish version.
        Disabil Rehabil. 2017; 39: 934-939
        • Platz T
        • Pinkowski C
        • van Wijck F
        • Kim I-H
        • Di Bella P
        • Johnson G
        Reliability and validity of arm function assessment with standardized guidelines for the Fugl-Meyer Test, Action Research Arm Test and Box and Block Test: a multicentre study.
        Clin Rehabil. 2005; 19: 404-411
        • Uchida K
        • Kouno J
        • Yoshimura S
        • et al.
        Development of machine learning models to predict probabilities and types of stroke at prehospital stage: the Japan Urgent Stroke Triage Score Using Machine Learning (JUST-ML).
        Transl Stroke Res. 2022; 13: 370-381
        • Darabi N
        • Hosseinichimeh N
        • Noto A
        • Zand R
        • Abedi V.
        Machine learning-enabled 30-day readmission model for stroke patients.
        Front Neurol. 2021; 12638267
        • Koo TK
        • Li MY.
        A guideline of selecting and reporting intraclass correlation coefficients for reliability research.
        J Chiropr Med. 2016; 15: 155-163
        • Cohen J.
        Statistical power analysis for the behavioral sciences.
        L. Erlbaum Associates, Hillsdale, N.J1988
        • de Vet HCW
        • Terwee CB
        • Mokkink LB
        • Knol DL.
        Measurement in medicine: a practical guide.
        Cambridge University Press, Cambridge2011
        • Cohen J.
        A coefficient of agreement for nominal scales.
        Educ Psychol Meas. 1960; 20: 37-46
        • Sivan M
        • O’Connor RJ
        • Makower S
        • Levesley M
        • Bhakta B
        Systematic review of outcome measures used in the evaluation of robot-assisted upper limb exercise in stroke.
        J Rehabil Med. 2011; 43: 181-189