Archives of Physical Medicine and Rehabilitation
Volume 87, Issue 9 , Pages 1223-1229 , September 2006

Measurement Precision and Efficiency of Multidimensional Computer Adaptive Testing of Physical Functioning Using the Pediatric Evaluation of Disability Inventory

  • Stephen M. Haley, PhD, PT

      Affiliations

    • Health and Disability Research Institute, Boston University, Boston, MA
    • Corresponding Author InformationReprint requests to Stephen M. Haley, PhD, PT, Health and Disability Research Institute, Boston University, 53 Bay State Rd, Boston, MA 02215
  • ,
  • Pengsheng Ni, MD, MPH

      Affiliations

    • Health and Disability Research Institute, Boston University, Boston, MA
  • ,
  • Larry H. Ludlow, PhD

      Affiliations

    • Educational Research, Measurement and Evaluation Department, Lynch School of Education, Boston College, Boston MA
  • ,
  • Maria A. Fragala-Pinkham, MS, PT

      Affiliations

    • Research Center for Children with Special Health Care Needs, Franciscan Hospital for Children, Boston, MA

References 

  1. Ziviani J , Ottenbacher K , Shephard K , Foreman S , Astbury W , Ireland P . Concurrent validity of the Functional Independence Measure for children (WeeFIM) and the Pediatric Evaluation of Disabilities Inventory in children with developmental disabilities and acquired brain injuries . Phys Occup Ther Pediatr . 2001;21:91–101
  2. Ottenbacher KJ , Msall ME , Lyon N , et al.   Functional assessment and care of children with neurodevelopmental disabilities . Am J Phys Med Rehabil . 2000;79:114–123
  3. Ostensjo S , Carlberg EB , Vollestad NK . Everyday functioning in young children with cerebral palsy (functional skills, caregiver assistance, and modifications of the environment) . Dev Med Child Neurol . 2003;45:603–612
  4. Msall ME . Tools for measuring daily activities in children (promoting independence and developing a language for child disability) . Pediatrics . 2002;109:317–319
  5. Lollar DJ , Simeonsson RJ , Nanda U . Measures of outcome for children and youth . Arch Phys Med Rehabil . 2000;81(12 Suppl 2):S46–S52
  6. Revicki DA , Cella DF . Health status assessment for the twenty-first century (item response theory, item banking and computer adaptive testing) . Qual Life Res . 1997;6:595–600
  7. Wainer H . Computerized adaptive testing (a primer) . Mahwah: Lawrence Erlbaum Associates; 2000;
  8. Haley SM , Ni PS , Fragala-Pinkham MA , Skrinar AM , Corzo D . A computer adaptive testing approach for assessing physical functioning in children and adolescents . Dev Med Child Neurol . 2005;47:113–120
  9. Haley SM , Raczek AE , Coster WJ , Dumas HM , Fragala-Pinkham MA . Assessing mobility in children using a computer adaptive testing version of the Pediatric Evaluation of Disability Inventory (PEDI) . Arch Phys Med Rehabil . 2005;86:932–939
  10. DeMars C . Measuring higher education outcomes with a multidimensional Rasch model . J Appl Meas . 2004;5:350–361
  11. Segall D . Multidimensional adaptive testing . Psychometrika . 1996;61:231–354
  12. Luecht R . Multidimensional computerized adaptive testing in a certification or licensure context . Appl Psychol Meas . 1996;20:389–404
  13. Ackerman TA , Gierl MJ , Walker CR . An NCME instructional module on using multidimensional item response theory to evaluate educational and psychological tests . Educ Meas Issues Pract . 2003;37–53 Fall:
  14. Gardner W , Kelleher KJ , Pajer KA . Multidimensional adaptive testing for mental health problems in primary care . Med Care . 2002;40:812–823
  15. de la Torre J , Patz R . Making the most of what we have (a practical application of multidimensional item response theory in test scoring) . J Educ Behav Stat . 2005;30:295–311
  16. Wang WC , Chen PH . Implementation and measurement efficiency of multidimensional computerized adaptive testing . Appl Psychol Meas . 2004;28:295–316
  17. Haley SM , Coster WJ , Ludlow LH , Haltiwanger JT , Andrellos PA . Pediatric Evaluation of Disability Inventory (development, standardization and administration manual) . Boston: Trustees of Boston Univ; 1992;
  18. Haley SM , Fragala-Pinkham MA , Ni P , Skrinar AM , Kaye EM . Pediatric physical functioning reference curves . Pediatr Neurol . 2004;31:333–341
  19. Haley S , Fragala MA , Aseltine R , Ni PS , Skrinar AM . Development of a disease-specific instrument for Pompe disease . Pediatr Rehabil . 2003;6:77–84
  20. Muthen B , Muthen L . Mplus user’s guide . Los Angeles: Muthen & Muthen; 2001;
  21. Bentler P . Comparative fit indices in structural models . Psychol Bull . 1990;107:238–246
  22. Tucker L , Lewis C . A reliability coefficient for maximum likelihood factor analysis . Psychometrika . 1973;38:1–10
  23. Steiger JH , Lind J . Statistically-based tests for the number of common factors . Iowa City (IA): The Psychometric Society; 1980; Presented to: May 30;
  24. March H , Balla J , Hau K . An evaluation of increment fit indices (a clarification of mathematical and empirical properties) . In:  Marcoulides G ,  Schumaker RE editor. Advanced structural equation modeling (issues and techniques) . Mahwah: Lawrence Erlbaum; 1996;p. 315–353
  25. Browne M , Cudeck R . Alternative ways of assessing model fit . In:  Long K editors. Testing structural equation modeling . Thousand Oaks: Sage; 1993;
  26. Yen WM . Scaling performance assessments (strategies for managing local item dependence) . J Educ Meas . 1993;30:187–213
  27. Adams RJ , Wilson MR , Wang WC . The multidimensional random coefficients multinomial logit . Appl Psychol Meas . 1997;21:46–75
  28. Wu ML , Adams RJ . ConQuest (computer software and manual) . Melbourne: Australian Council for Educational Research; 1998;
  29. Bond TG , Fox CM . The question of model fit . In:  Bond T ,  Fox C editor. Applying the Rasch model (fundamental measurement in the human sciences) . Mahwah: Lawrence Erlbaum Associates; 2001;p. 173–187
  30. Zumbo B . A handbook on the theory and methods of differential item functioning (DIF) . Ottawa: Directorate of Human Resources Research and Evaluation; 1999;
  31. Luecht R . Computer-adaptive testing . In:  Everett B ,  Howell D editor. Encyclopedia of statistics in behavioral science . New York: Wiley; 2004;
  32. Hambleton R , Zaal J . Advances in educational and psychological testing (theory and applications) . Boston: Kluwer Academic; 1991;
  33. Haley SM , Coster WJ , Andres PL , Kosinski M , Ni PS . Score comparability of short forms and computerized adaptive testing (simulation study with the activity measure for post-acute care) . Arch Phys Med Rehabil . 2004;85:661–666
  34. Wang S , Wang T . Precision of Warm’s weighted likelihood estimates for a polytomous model in computerized adaptive testing . Appl Psychol Meas . 2001;25:317–331
  35. Cook KF , Monahan PO , McHorney CA . Delicate balance between theory and practice (health status assessment and item response theory) . Med Care . 2003;41:571–574
  36. Haley S , Ni P , Fragala-Pinkham M , Skrinar AM , Corzo D . A computer adaptive testing approach for assessing physical functioning in children and adolescents . Dev Med Child Neurol . 2005;47:113–120

 Supported by the National Institute for Child Health and Development, National Institutes of Health (independent scientist award no. K02 HD45354-01) and Genzyme Corporation.A commercial party having a direct financial interest in the results of the research supporting this article has conferred or will confer a financial benefit upon the author or 1 or more of the authors. Haley has a stock interest in CRE Care LLC, which distributes the Pediatric Evaluation of Disability Inventory products.

PII: S0003-9993(06)00470-9

doi: 10.1016/j.apmr.2006.05.018

Archives of Physical Medicine and Rehabilitation
Volume 87, Issue 9 , Pages 1223-1229 , September 2006