Advertisement
Original article| Volume 96, ISSUE 1, P98-104, January 2015

Download started.

Ok

Classical Test Theory and Rasch Analysis Validation of the Upper Limb Functional Index in Subjects With Upper Limb Musculoskeletal Disorders

Published:September 17, 2014DOI:https://doi.org/10.1016/j.apmr.2014.08.022

      Abstract

      Objective

      To perform a comprehensive analysis of the psychometric properties and dimensionality of the Upper Limb Functional Index (ULFI) using both classical test theory and Rasch analysis (RA).

      Design

      Prospective, single-group observational design.

      Setting

      Freestanding rehabilitation center.

      Participants

      Convenience sample of Italian-speaking subjects with upper limb musculoskeletal disorders (N=174).

      Interventions

      Not applicable.

      Main Outcome Measures

      The Italian version of the ULFI. Data were analyzed using parallel analysis, exploratory factor analysis, and RA for evaluating dimensionality, functioning of rating scale categories, item fit, hierarchy of item difficulties, and reliability indices.

      Results

      Parallel analysis revealed 2 factors explaining 32.5% and 10.7% of the response variance. RA confirmed the failure of the unidimensionality assumption, and 6 items out of the 25 misfitted the Rasch model. When the analysis was rerun excluding the misfitting items, the scale showed acceptable fit values, loading meaningfully to a single factor. Item separation reliability and person separation reliability were .98 and .89, respectively. Cronbach alpha was .92.

      Conclusions

      RA revealed weakness of the scale concerning dimensionality and internal construct validity. However, a set of 19 ULFI items defined through the statistical process demonstrated a unidimensional structure, good psychometric properties, and clinical meaningfulness. These findings represent a useful starting point for further analyses of the tool (based on modern psychometric approaches and confirmatory factor analysis) in larger samples, including different patient populations and nationalities.

      Keywords

      List of abbreviations:

      CTT (classical test theory), DASH (Disability of the Arm, Shoulder, and Hand), MnSq (mean square), PCA (principal component analysis), RA (Rasch analysis), ULFI (Upper Limb Functional Index)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Franchignoni F.
        • Salaffi F.
        Generic and specific measures for outcome assessment in orthopaedic and rheumatologic rehabilitation.
        in: Barat M. Franchignoni F. Assessment in physical medicine and rehabilitation – views and perspectives. Maugeri Foundation Books, Pavia2004: 45-78
        • Reeve B.B.
        • Wyrwich K.W.
        • Wu A.W.
        • et al.
        ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research.
        Qual Life Res. 2013; 22: 1889-1905
        • Gabel C.P.
        • Michener L.A.
        • Burkett B.
        • Neller A.
        The Upper Limb Functional Index: development and determination of reliability, validity, and responsiveness.
        J Hand Ther. 2006; 19: 328-348
        • Beaton D.E.
        • Katz J.N.
        • Fossel A.H.
        • Wright J.G.
        • Tarasuk V.
        • Bombardier C.
        Measuring the whole or the parts? Validity, reliability, and responsiveness of the Disabilities of the Arm, Shoulder and Hand outcome measure in different regions of the upper extremity.
        J Hand Ther. 2001; 14: 128-146
        • Hudak P.L.
        • Amadio P.C.
        • Bombardier C.
        Development of an upper extremity outcome measure: the DASH (disabilities of the arm, shoulder and hand) [corrected]. The Upper Extremity Collaborative Group (UECG).
        Am J Ind Med. 1996; 29: 602-608
        • Beaton D.E.
        • Wright J.G.
        • Kats J.N.
        Development of the QuickDASH: comparison of three item-reduction approaches.
        J Hand Surg [Am]. 2005; 87: 1038-1046
        • Gabel C.P.
        • Michener L.A.
        • Melloh M.
        • Burkett B.
        Modification of the upper limb functional index to a three-point response improves clinimetric properties.
        J Hand Ther. 2010; 23: 41-51
        • Belvedere S.L.
        • de Morton N.A.
        Application of Rasch analysis in health care is increasing and is applied for variable reasons in mobility instruments.
        J Clin Epidemiol. 2010; 63: 1287-1297
        • Leung Y.Y.
        • Png M.E.
        • Conaghan P.
        • Tennant A.
        A systematic literature review on the application of Rasch analysis in musculoskeletal disease – a special interest group report of OMERACT 11.
        J Rheumatol. 2014; 41: 159-164
      1. Sartorio F, Moroso M, Vercelli S, et al. Cross-cultural adaptation and validation of the Upper Limb Functional Index (ULFI-I). G Ital Med Lav Erg; in press.

        • Beaton D.E.
        • Bombardier C.
        • Guillemin F.
        • Ferraz M.B.
        Guidelines for the process of cross-cultural adaptation of self-report measures.
        Spine. 2000; 25: 3186-3191
        • Bland J.M.
        • Altman D.G.
        Cronbach’s alpha.
        BMJ. 1997; 314: 572
        • McHorney C.A.
        • Ware Jr., J.E.
        • Lu J.F.
        • Sherbourne C.D.
        The MOS 36-Item Short-Form Health Survey (SF-36): III. Tests of data quality, scaling assumptions, and reliability across diverse patient groups.
        Med Care. 1994; 32: 40-66
        • Timmerman M.E.
        • Lorenzo-Seva U.
        Dimensionality assessment of ordered polytomous items with parallel analysis.
        Psychol Methods. 2011; 16: 209-220
        • ten Berge J.M.
        • Kiers H.A.
        A numerical approach to the approximate and the exact minimum rank of a covariance matrix.
        Psychometrika. 1991; 56: 309-315
        • Lorenzo-Seva U.
        • Ferrando P.J.
        FACTOR: a computer program to fit the exploratory factor analysis model.
        Behav Res Methods. 2006; 38: 88-91
        • Andrich D.
        A rating formulation for ordered response categories.
        Psychometrika. 1978; 43: 561-573
        • Linacre J.M.
        Optimizing rating scale category effectiveness.
        J Appl Meas. 2002; 3: 85-106
        • Wolfe E.W.
        • Smith Jr., E.V.
        Instrument development tools and activities for measure validation using Rasch models: part II–validation activities.
        J Appl Meas. 2007; 8: 204-234
        • Bond T.G.
        • Fox C.M.
        Applying the Rasch model - fundamental measurement in the human sciences.
        2nd ed. Lawrence Erlbaum Associates, Mahwah2007
        • Tesio L.
        Measuring behaviours and perceptions: Rasch analysis as a tool for rehabilitation.
        J Rehabil Med. 2003; 35: 105-115
        • Linacre J.M.
        Rasch power analysis: size vs. significance: infit and outfit mean-square and standardized chi-square fit statistic.
        Rasch Meas Trans. 2003; 17: 1918
      2. Linacre JM. A user’s guide to Winsteps-Ministep: Rasch-model computer programs. Program manual 3.68.0. Chicago: WINSTEPS.com; 2009.

        • Fisher Jr., W.P.
        Rating scale instrument quality criteria.
        Rasch Meas Trans. 2007; 21: 1095
        • Hamasaki T.
        • Demers L.
        • Filiatrault J.
        • Aubin G.
        A cross-cultural adaptation of the Upper Limb Functional Index in French Canadian.
        J Hand Ther. 2014; 27 (quiz 253): 247-252
        • Cuesta-Vargas A.I.
        • Gabel P.C.
        Cross-cultural adaptation, reliability and validity of the Spanish version of the upper limb functional index.
        Health Qual Life Outcomes. 2013; 11: 126
        • Velicer W.F.
        • Eaton C.A.
        • Fava J.L.
        Construct explication through factor or component analysis: a review and evaluation of alternative procedures for determining the number of factors or components.
        in: Goffin R.D. Helmes E. Problems and solutions in human assessment. Springer, New York2000: 41-71
        • Tennant A.
        • Pallant J.F.
        Unidimensionality matters! (A tale of two Smiths?).
        Rasch Meas Trans. 2006; 20: 1048-1051
        • Franchignoni F.
        • Giordano A.
        • Sartorio F.
        • Vercelli S.
        • Pascariello B.
        • Ferriero G.
        Suggestions for refinement of the Disabilities of the Arm, Shoulder and Hand Outcome Measure (DASH): a factor analysis and Rasch validation study.
        Arch Phys Med Rehabil. 2010; 91: 1370-1377
        • Streiner D.L.
        • Norman G.R.
        Health measurement scales. A practical guide to their development and use.
        4th ed. Oxford Univ Pr, Oxford2008
        • Marais I.
        • Andrich D.
        Formalizing dimension and response violations of local independence in the unidimensional Rasch model.
        J Appl Meas. 2008; 9: 200-215