Advertisement
ORIGINAL RESEARCH| Volume 102, ISSUE 11, P2185-2192.e2, November 2021

Development of the Computerized Adaptive Test of Motor Development (MD-CAT) Adopting Multidimensional Rasch Analysis

  • Kuan-Lin Chen
    Affiliations
    Department of Occupational Therapy, College of Medicine, National Cheng Kung University, Tainan City, Taiwan

    Department of Physical Medicine and Rehabilitation, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan City, Taiwan

    Institute of Allied Health Sciences, College of Medicine, National Cheng Kung University, Tainan City, Taiwan
    Search for articles by this author
  • Chien-Yu Huang
    Affiliations
    Department of Occupational Therapy, College of Medicine, I-Shou University, Kaohsiung City, Taiwan

    School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei City, Taiwan
    Search for articles by this author
  • Cheng-Te Chen
    Affiliations
    Department of Educational Psychology and Counseling, National Tsing Hua University, Hsinchu, Taiwan
    Search for articles by this author
  • Julie Chi Chow
    Affiliations
    Department of Pediatrics, Chi Mei Medical Center, Tainan, Taiwan

    School of Medicine, Kaohsiung Medical University, Kaohsiung, Taiwan
    Search for articles by this author
  • Willy Chou
    Correspondence
    Corresponding author Willy Chou, MD, Chief Director, Department of Physical Medicine and Rehabilitation, Chi-Mei Medical Center, No.606, Jiaxing Village, Jiali District, Tainan City 72263, Taiwan.
    Affiliations
    Department of Physical Medicine and Rehabilitation, Chung Shan Medical Center, Taiwan

    Department of Physical Medicine and Rehabilitation, Chi Mei Medical Center, Tainan, Taiwan
    Search for articles by this author

      Abstract

      Objective

      This study aimed to develop the Computerized Adaptive Test of Motor Development (MD-CAT) in preschool children based on multidimensional Rasch analysis.

      Design

      A retrospective study with cross-sectional design.

      Setting

      A medical center.

      Participants

      A total of 1738 children (N=1738).

      Interventions

      Not applicable.

      Main Outcome Measures

      MD-CAT.

      Results

      Multidimensional Rasch analysis was used to develop the item bank of the MD-CAT. The item bank of the MD-CAT contained 74 items, with 44 and 30 items, respectively, for the subscales of gross and fine motor skills. High correlation existed between the 2 subscales (r=0.96). Three stopping rules were set for the MD-CAT: (1) the person reliability achieved 0.95 or the limited reliability increase by <0.01; (2) at least 3 items were assessed in each dimension; and (3) the number of items used for assessment reached 16. Based on the 3 stopping rules, the MD-CAT had high correlations with its total test length (r=0.87-0.98 for the 2 dimensions), indicating sufficient construct validity. The MD-CAT also had adequate diagnostic validity (area under the curve=0.72-0.93) and efficiency (an average of 3-6 items used for the assessment).

      Conclusions

      The MD-CAT has high precision and efficiency, good construct validity, and high diagnostic validity. The results of our study indicate that the MD-CAT can be useful in clinical practice and in research as a diagnostic measure.

      Keywords

      List of abbreviations:

      AUC (area under the curve), CAT (computerized adaptive test), CDIIT (Comprehensive Developmental Inventory for Infants and Toddlers), DQ (developmental quotient), EAP/PV (expected a posteriori/plausible value), FM-CAT (Computerized Adaptive Test of Fine Motor Skills), GM-CAT (Computerized Adaptive Test of Gross Motor Skills), MD-CAT (Computerized Adaptive Test of Motor Development), MNSQ (mean square), MRM (multidimensional Rasch modeling)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Case Smith J
        The relationships among sensorimotor components, fine motor skill, and functional performance in preschool children.
        Am J Occup Ther. 1995; 49: 645-652
        • McHale K
        • Cermak SA.
        Fine motor activities in elementary school: preliminary findings and provisional implications for children with fine motor problems.
        Am J Occup Ther. 1992; 46: 898-903
        • Folio MR
        • Fewell RR.
        Peabody Developmental Motor Scales: examininer's manual.
        2nd ed. PRO-ED, Inc, Austin2000
        • Wang TM
        • Su CW
        • Liao HF
        • Lin LY
        • Chou KS
        • Lin AH.
        The standardization of the comprehensive developmental inventory for the infants and toddlers.
        Psychol Test. 1998; 45: 19-46
        • Nellis L
        • Gridley BE.
        Review of the Bayley Scales of Infant Development—second edition.
        J Sch Psychol. 1994; 32: 201-209
        • Piper MC
        • Pinnell LE
        • Darrah J
        • Maguire T
        • Byrne PJ.
        Construction and validation of the Alberta Infant Motor Scale (AIMS).
        Can J Public Heal Rev Can Sante Publique. 1991; 83: S46-S50
        • Liao HF
        • Yao G
        • Wang TM
        Concurrent validity in Taiwan of the Comprehensive Developmental Inventory for Infants and Toddlers who were full-term infants.
        Percept Mot Skills. 2008; 107: 29-44
        • Liao HF
        • Pan YL.
        Test-retest and inter-rater reliability for the Comprehensive Developmental Inventory for Infants and Toddlers diagnostic and screening tests.
        Early Hum Dev. 2005; 81: 927-937
        • Huang CY
        • Tung LC
        • Chou YT
        • Wu HM
        • Chen KL
        • Hsieh CL.
        Development of a computerized adaptive test of children's gross motor skills.
        Arch Phys Med Rehabil. 2018; 99: 512-520
        • Huang CY
        • Tung LC
        • Chou YT
        • Chou W
        • Chen KL
        • Hsieh CL.
        Improving the utility of the fine motor skills subscale of the comprehensive developmental inventory for infants and toddlers: a computerized adaptive test.
        Disabil Rehabil. 2018; 40: 2803-2809
        • Oberer N
        • Gashaj V
        • Roebers CM.
        Motor skills in kindergarten: internal structure, cognitive correlates and relationships to background variables.
        Hum Mov Sci. 2017; 52: 170-180
        • Seashore HG.
        Some relationships of fine and gross motor abilities.
        Res Quarterly Am Assoc Heal Phys Educ Recreat. 1942; 13: 259-274
        • Lam Sam K
        • Li C
        • Kai Lo S
        Validation of the Mental Retardation Attitude Inventory-Revised (MRAI-R): a multidimensional Rasch analysis.
        Int J Soc Sci Humanit. 2015; 6: 519-524
        • McDonald SE
        • Ma L
        • Green KE
        • et al.
        Evaluation of the Parent-Report Inventory of Callous-Unemotional Traits in a sample of children recruited from intimate partner violence services: a multidimensional Rasch analysis.
        J Clin Psychol. 2018; 74: 418-441
        • Pretz CR
        • Kean J
        • Heinemann AW
        • Kozlowski AJ
        • Bode RK
        • Gebhardt E.
        A multidimensional Rasch analysis of the Functional Independence Measure based on the National Institute on Disability, Independent Living, and Rehabilitation Research Traumatic Brain Injury Model Systems National Database.
        J Neurotrauma. 2016; 33: 1358-1362
        • Chien CW
        • Bond TG.
        Measurement properties of fine motor scale of Peabody Developmental Motor Scales: a Rasch analysis.
        Am J Phys Med Rehabil. 2009; 88: 376-386
        • Scalise K.
        Crowdsourcing and education with relation to the knowledge economy.
        Int J Web-Based Learn Teach Technol. 2011; 6: 1-13
        • Wang TM.
        The Comprehensive Developmental Inventory for Infants and Toddlers Manual. Revised version.
        Taipei Special Education Division Ministry Education; Taipei. 2003;
        • Fangyu LI
        • Hua HE.
        Assessing the accuracy of diagnostic tests.
        Shanghai Arch Psychiatry. 2018; 30: 207
        • Gunel MK
        • Mutlu A
        • Tarsuslu T
        • Livanelioglu A.
        relationship among the Manual Ability Classification System (MACS), the Gross Motor Function Classification System (GMFCS), and the functional status (WeeFIM) in children with spastic cerebral palsy.
        Eur J Pediatr. 2009; 168: 477-485
        • Compagnone E
        • Maniglio J
        • Camposeo S
        • et al.
        Functional classifications for cerebral palsy: correlations between the gross motor function classification system (GMFCS), the manual ability classification system (MACS) and the communication function classification system (CFCS).
        Res Dev Disabil. 2014; 35: 2651-2657
        • Carnahan KD
        • Arner M
        • Hägglund G.
        Association between gross motor function (GMFCS) and manual ability (MACS) in children with cerebral palsy. A population-based study of 359 children.
        BMC Musculoskelet Disord. 2007; 8: 50
        • Wong S
        • Chan K
        • Wong V
        • Wong W.
        Use of chopsticks in Chinese children.
        Child Care Health Dev. 2002; 28: 157-161
        • Beckmann JT
        • Hung M
        • Bounsanga J
        • Wylie JD
        • Granger EK
        • Tashjian RZ.
        Psychometric evaluation of the PROMIS Physical Function Computerized Adaptive Test in comparison to the American Shoulder and Elbow Surgeons score and Simple Shoulder Test in patients with rotator cuff disease.
        J Shoulder Elb Surg. 2015; 24: 1961-1967
        • Avery LM
        • Russell DJ
        • Raina PS
        • Walter SD
        • Rosenbaum PL.
        Rasch analysis of the Gross Motor Function Measure: validating the assumptions of the Rasch model to create an interval-level measure.
        Arch Phys Med Rehabil. 2003; 84: 697-705