Advertisement

Development and Calibration of the TBI-QOL Ability to Participate in Social Roles and Activities and TBI-QOL Satisfaction With Social Roles and Activities Item Banks and Short Forms

Published:August 29, 2019DOI:https://doi.org/10.1016/j.apmr.2019.07.015

      Abstract

      Objective

      To develop traumatic brain injury (TBI)-optimized versions of the Quality of Life in Neurological Disorders (Neuro-QoL) Ability to Participate in Social Roles and Activities and Satisfaction with Social Roles and Activities item banks, evaluate the psychometric properties of the item banks developed for adults with TBI, develop short form and computer adaptive test (CAT) versions, and report information to facilitate research and clinical applications.

      Design

      We used a mixed methods design to develop and evaluate Ability to Participate in Social Roles and Activities and Satisfaction with Social Roles and Activities items. Focus groups defined the constructs, cognitive interviews guided item revisions, and confirmatory factor analysis and item response theory methods helped calibrate item banks and evaluate differential item functioning related to demographic and injury characteristics.

      Setting

      Five TBI Model Systems centers in the United States.

      Participants

      Community-dwelling adults with TBI (N=556).

      Interventions

      None.

      Outcome Measures

      Traumatic Brain Injury–Quality of Life (TBI-QOL) Ability to Participate in Social Roles and Activities and TBI-QOL Satisfaction with Social Roles and Activities item banks.

      Results

      Forty-five Ability to Participate in Social Roles and Activities and 41 Satisfaction with Social Roles and Activities items demonstrated good psychometric properties. Although some of the items are new, most were drawn from analogous banks in the Neuro-QoL measurement system. Consequently, the 2 TBI-QOL item banks were linked to the Neuro-QoL metric, and scores are comparable with the general population. All CAT and short forms correlated highly (>0.90) with the full item banks and demonstrate comparable construct coverage and measurement error.

      Conclusion

      The TBI-QOL Ability to Participate in Social Roles and Activities and TBI-QOL Satisfaction with Social Roles and Activities item banks are TBI-optimized versions of the Neuro-QoL Ability to Participate in Social Roles and Activities and Satisfaction with Social Roles and Activities item banks and demonstrate excellent measurement properties in individuals with TBI. These measures, particularly in CAT or short form format, are suitable for efficient and precise measurement of social outcomes in clinical and research applications.

      Keywords

      List of abbreviations:

      CAT (computer adaptive test), CFA (confirmatory factor analysis), CFI (comparative fit index), DIF (differential item functioning), GRM (graded response model), IRT (item response theory), Neuro-QoL (Quality of Life in Neurological Disorders), PROMIS (Patient Reported Outcome Measurement Information System), RMSEA (root mean square error of approximation), TBI (traumatic brain injury), TBI-QOL (Traumatic Brain Injury–Quality of Life measurement system), TLI (Tucker-Lewis index)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Heinemann A.W.
        • Tulsky D.
        • Dijkers M.
        • et al.
        Issues in participation measurement in research and clinical applications.
        Arch Phys Med Rehabil. 2010; 91: S72-S76
        • Heinemann A.W.
        Measurement of participation in rehabilitation research.
        Arch Phys Med Rehabil. 2010; 91: S1-S4
        • World Health Organization
        International classification of functioning, disability, and health: ICF.
        . 2001; 1.0 (Available at:)
        • Kostanjsek N.
        Use of The International Classification of Functioning, Disability and Health (ICF) as a conceptual framework and common language for disability statistics and health information systems.
        BMC Public Health. 2011; 11: S3
        • CARF International
        Quality standards.
        (Available at:)
        http://www.carf.org/Accreditation/QualityStandards/
        Date: 2018
        Date accessed: August 2, 2018
        • National Quality Forum
        Measure Applications Partnership: finding common ground for healthcare priorities: families of measures for assessing affordability, population health, and person- and family-centered care.
        (Available at:)
        • Walker N.
        • Mellick D.
        • Brooks C.A.
        • Whiteneck G.G.
        Measuring participation across impairment groups using the Craig Handicap Assessment Reporting Technique.
        Am J Phys Med Rehabil. 2003; 82: 936-941
        • Whiteneck G.G.
        • Charlifue S.W.
        • Gerhart K.A.
        • Overholser J.D.
        • Richardson G.N.
        Quantifying handicap: a new measure of long-term rehabilitation outcomes.
        Arch Phys Med Rehabil. 1992; 73: 519-526
        • Brown M.
        • Dijkers M.P.
        • Gordon W.A.
        • Ashman T.
        • Charatz H.
        • Cheng Z.
        Participation objective, participation subjective: a measure of participation combining outsider and insider perspectives.
        J Head Trauma Rehabil. 2004; 19: 459-481
        • Whiteneck G.G.
        • Dijkers M.P.
        • Heinemann A.W.
        • et al.
        Development of the participation assessment with recombined tools-objective for use after traumatic brain injury.
        Arch Phys Med Rehabil. 2011; 92: 542-551
        • Heinemann A.W.
        • Lai J.S.
        • Magasi S.
        • et al.
        Measuring participation enfranchisement.
        Arch Phys Med Rehabil. 2011; 92: 564-571
        • Heinemann A.W.
        • Magasi S.
        • Bode R.K.
        • et al.
        Measuring enfranchisement: importance of and control over participation by people with disabilities.
        Arch Phys Med Rehabil. 2013; 94: 2157-2165
        • Fish J.
        Assessment of Life Habits (LIFE-H).
        in: Kreutzer J.S. DeLuca J. Caplan B. Encyclopedia of Clinical Neuropsychology, New York: Springer2011
        • Whiteneck G.
        • Dijkers M.P.
        Difficult to measure constructs: conceptual and methodological issues concerning participation and environmental factors.
        Arch Phys Med Rehabil. 2009; 90: S22-S35
        • Hahn E.A.
        • Devellis R.F.
        • Bode R.K.
        • et al.
        Measuring social health in the patient-reported outcomes measurement information system (PROMIS): item bank development and testing.
        Qual Life Res. 2010; 19: 1035-1044
        • Gershon R.C.
        • Lai J.S.
        • Bode R.
        • et al.
        Neuro-QOL: quality of life item banks for adults with neurological disorders: item development and calibrations based upon clinical and general population testing.
        Qual Life Res. 2012; 21: 475-486
        • Tulsky D.S.
        • Kisala P.A.
        An Overview of the Traumatic Brain Injury - Quality of Life (TBI-QOL) Measurement System.
        J Head Trauma Rehabil. 2019; 34: 281-288
        • Tulsky D.S.
        • Kisala P.A.
        The Spinal Cord Injury--Quality of Life (SCI-QOL) measurement system: development, psychometrics, and item bank calibration.
        J Spinal Cord Med. 2015; 38: 251-256
        • Tulsky D.S.
        • Kisala P.A.
        • Victorson D.
        • et al.
        Methodology for the development and calibration of the SCI-QOL item banks.
        J Spinal Cord Med. 2015; 38: 270-287
        • Tulsky D.S.
        • Kisala P.A.
        • Victorson D.
        • et al.
        Developing a contemporary patient-reported outcomes measure for spinal cord injury.
        Arch Phys Med Rehabil. 2011; 92: S44-S51
        • Tulsky D.S.
        • Kisala P.A.
        • Victorson D.
        • et al.
        Overview of the Spinal Cord Injury--Quality of Life (SCI-QOL) measurement system.
        J Spinal Cord Med. 2015; 38: 257-269
        • Carlozzi N.E.
        • Ready R.E.
        • Frank S.
        • et al.
        Patient-reported outcomes in Huntington's disease: Quality of life in neurological disorders (Neuro-QoL) and Huntington's disease health-related quality of life (HDQLIFE) physical function measures.
        Mov Disord. 2017; 32: 1096-1102
        • Brooks J.C.
        • Shavelle R.M.
        • Strauss D.J.
        • Hammond F.M.
        • Harrison-Felix C.L.
        Long-term survival after traumatic brain injury part II: life expectancy.
        Arch Phys Med Rehabil. 2015; 96: 1000-1005
        • Hart T.
        • Sherer M.
        • Temkin N.
        • et al.
        Participant-proxy agreement on objective and subjective aspects of societal participation following traumatic brain injury.
        J Head Trauma Rehabil. 2010; 25: 339-348
        • Magasi S.
        • Wong A.
        • Miskovic A.
        • Tulsky D.
        • Heinemann A.W.
        Mobility device quality affects participation outcomes for people with disabilities: a structural equation modeling analysis.
        Arch Phys Med Rehabil. 2018; 99: 1-8
        • Wong A.W.K.
        • Ng S.
        • Dashner J.
        • et al.
        Relationships between environmental factors and participation in adults with traumatic brain injury, stroke, and spinal cord injury: a cross-sectional multi-center study.
        Qual Life Res. 2017; 26: 2633-2645
        • Eton D.T.
        • Cella D.
        • Yount S.E.
        • Davis K.M.
        Validation of the functional assessment of cancer therapy--lung symptom index-12 (FLSI-12).
        Lung Cancer. 2007; 57: 339-347
        • Carlozzi N.E.
        • Tulsky D.S.
        • Kisala P.A.
        Traumatic brain injury patient-reported outcome measure: identification of health-related quality-of-life issues relevant to individuals with traumatic brain injury.
        Arch Phys Med Rehabil. 2011; 92: S52-S60
        • Tulsky D.S.
        • Kisala P.A.
        • Victorson D.
        • et al.
        TBI-QOL: development and calibration of item banks to measure patient reported outcomes following traumatic brain injury.
        J Head Trauma Rehabil. 2016; 31: 40-51
      1. Patient-reported outcome measurement information system. Instrument development and validation scientific standards.
        (Version 2.0. Available at:)
        • Reckase M.
        Adapative testing: the evolution of a good idea.
        Educ Meas Issues Pract. 1989; 8: 11-15
        • Kisala P.A.
        • Tulsky D.S.
        Opportunities for CAT applications in medical rehabilitation: development of targeted item banks.
        J Appl Meas. 2010; 11: 315-330
        • Eremenco S.L.
        • Cella D.
        • Arnold B.J.
        A comprehensive method for the translation and cross-cultural validation of health status questionnaires.
        Eval Health Prof. 2005; 28: 212-232
        • MetaMetrics
        The LEXILE framework for reading.
        MetaMetrics Inc, Durham1995
        • Novack T.A.
        • Dowler R.N.
        • Bush B.A.
        • Glen T.
        • Schneider J.J.
        Validity of the orientation log, relative to the Galveston Orientation and Amnesia Test.
        J Head Trauma Rehabil. 2000; 15: 957-961
        • Williams D.H.
        • Levin H.S.
        • Eisenberg H.M.
        Mild head injury classification.
        Neurosurgery. 1990; 27: 422-428
        • Bentler P.M.
        Comparative fit indexes in structural models.
        Psychol Bull. 1990; 107: 238-246
        • Tucker L.R.
        • Lewis C.
        A reliability coefficient for maximum likelihood factor analysis.
        Psychometrika. 1973; 38: 1-10
      2. Steiger JH, Lind JC. Statistically based tests for the number of common factors. Paper presented at: annual meeting of the Psychometric Society. 1980; Iowa City, IA.

        • Steiger J.H.
        Notes on the Steiger-Lind (1980) Handout.
        Struct Equ Modeling. 2016; 23: 777-781
        • Hu Lt
        • Bentler P.M.
        Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives.
        Struct Equ Modeling. 1999; 6: 1-55
        • Bentler P.M.
        • Bonett D.G.
        Significance tests and goodness of fit in the analysis of covariance structures.
        Psychol Bull. 1980; 88: 588
        • Samejima F.
        Estimation of latent ability using a response pattern of graded scores.
        Psychometrika. 1969; 34: 1-97
        • Orlando M.
        • Thissen D.
        Further investigation of the performance of S-X2: an item fit index for use with dichotomous item response theory models.
        Appl Psychol Meas. 2003; 27: 289-298
        • Choi S.W.
        • Gibbons L.E.
        • Crane P.K.
        Lordif: an R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations.
        J Stat Softw. 2011; 39: 1
        • Erlebach R.
        • Pagnamenta A.
        • Klinzing S.
        • et al.
        Age-related outcome of patients after traumatic brain injury: a single-center observation.
        Minerva Anestesiol. 2017; 83: 1169-1177
        • Muscara F.
        • Catroppa C.
        • Eren S.
        • Anderson V.
        The impact of injury severity on long-term social outcome following paediatric traumatic brain injury.
        Neuropsychol Rehabil. 2009; 19: 541-561
        • Colantonio A.
        • Harris J.E.
        • Ratcliff G.
        • Chase S.
        • Ellis K.
        Gender differences in self reported long term outcomes following moderate to severe traumatic brain injury.
        BMC Neurol. 2010; 10: 102
        • Kim S.H.
        • Cohen A.S.
        • Alagoz C.
        • Kim S.
        DIF detection and effect size measures for polytomously scored items.
        J Educ Meas. 2007; 44: 93-116
        • Muthén L.K.
        • Muthén B.O.
        Mplus user's guide. 6th ed.
        Muthén & Muthén, Los Angeles1998-2010
        • Stocking M.L.
        • Lord F.M.
        Developing a common metric in item response theory.
        Appl Psychol Meas. 1983; 7: 201-210
        • Choi S.W.
        Firestar: computerized adaptive testing simulation program for polytomous item response theory models.
        Appl Psychol Meas. 2009; 33: 644-645
        • Gershon R.
        • Rothrock N.E.
        • Hanrahan R.T.
        • Jansky L.J.
        • Harniss M.
        • Riley W.
        The development of a clinical outcomes survey research application: Assessment CenterSM.
        Qual Life Res. 2010; 19: 677-685
        • Harris P.A.
        • Taylor R.
        • Thielke R.
        • Payne J.
        • Gonzalez N.
        • Conde J.G.
        Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support.
        J Biomed Inform. 2009; 42: 377-381
        • Corrigan J.D.
        • Cuthbert J.P.
        • Whiteneck G.G.
        • et al.
        Representativeness of the Traumatic Brain Injury Model Systems National Database.
        J Head Trauma Rehabil. 2012; 27: 391-403