Advertisement

Applying a Bookmarking Approach to Setting Clinically Relevant Interpretive Standards for the Spinal Cord Injury–Functional Index/Capacity Basic Mobility and Self-Care Item Bank Scores

Published:November 24, 2020DOI:https://doi.org/10.1016/j.apmr.2020.08.026

      Abstract

      Objectives

      To develop clinically relevant interpretive standards for the Spinal Cord Injury–Functional Index/Capacity (SCI-FI/C) Basic Mobility and Self-Care item bank scores.

      Design

      Modified “bookmarking” standard-setting methodology, including 2 stakeholder consensus meetings with individuals with spinal cord injury (SCI) and SCI clinicians, respectively, and a final, combined (consumers and clinicians) “convergence” meeting.

      Setting

      Two SCI Model System centers in the United States.

      Participants

      Fourteen adults who work with individuals with traumatic SCI and 14 clinicians who work with individuals with SCI.

      Main Outcome Measures

      Placement of bookmarks between vignettes based on SCI-FI Basic Mobility and Self-Care T scores. Bookmarks were placed between vignettes representing “No Problems,” “Mild Problems,” “Moderate Problems,” and “Severe Problems” for each item bank.

      Results

      Each consensus group resulted in a single set of scoring cut points for the SCI-FI/C Basic Mobility and Self-Care item banks. The cut points were similar but not identical between the consumer and clinician groups, necessitating a final convergence meeting. For SCI-FI/C Basic Mobility, the convergence group agreed on cut scores of 61.25 (no problems/mild problems), 51.25 (mild problems/moderate problems), and 41.25 (moderate problems/severe problems). For SCI-FI/C Self-Care, the convergence group agreed on cut scores of 56.25 (no/mild), 51.25 (mild/moderate), and 38.75 (moderate/severe).

      Conclusions

      The results of this study provide straightforward interpretive guidelines for SCI researchers and clinicians using the SCI-FI/C Basic Mobility and Self-Care instruments. These results are appropriate for the full bank, computer adaptive test, and short-form versions of the SCI-FI/C Basic Mobility and Self-Care item banks.

      Keywords

      List of abbreviations:

      CAT (computerized adaptive test), IRT (item response theory), PRO (patient-reported outcome), PROMIS (Patient Reported Outcomes Measurement Information System), SCI (spinal cord injury), SCI-FI (Spinal Cord Injury–Functional Index), SCI-FI/C (Spinal Cord Injury–Functional Index/Capacity), SCI-QOL (Spinal Cord Injury–Quality of Life), SF (Short Form)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Weaver F.M.
        • Hammond R.C.
        • Guihan M.
        • Hendricks R.D.
        Department of veterans affairs quality enhancement research initiative for spinal cord injury.
        Med Care. 2000; 38: S82-S91
        • Wollaars M.M.
        • Post M.W.
        • van Asbeck F.W.
        • Brand N.
        Spinal cord injury pain: the influence of psychologic factors and impact on quality of life.
        Clin J Pain. 2007; 23: 383-391
        • Barker R.N.
        • Kendall M.D.
        • Amsters D.I.
        • Pershouse K.J.
        • Haines T.P.
        • Kuipers P.
        The relationship between quality of life and disability across the lifespan for people with spinal cord injury.
        Spinal Cord. 2009; 47: 149-155
        • Hammell K.W.
        Quality of life after spinal cord injury: a meta-synthesis of qualitative findings.
        Spinal Cord. 2007; 45: 124-139
        • Hammell K.W.
        Quality of life among people with high spinal cord injury living in the community.
        Spinal Cord. 2004; 42: 607-620
        • Tulsky D.S.
        • Kisala P.A.
        • Victorson D.
        • et al.
        Overview of the Spinal Cord Injury - Quality of Life (SCI-QOL) measurement system.
        J Spinal Cord Med. 2015; 38: 257-269
        • Jette A.M.
        • Slavin M.D.
        • Ni P.
        • et al.
        Development and initial evaluation of the SCI-FI/AT.
        J Spinal Cord Med. 2015; 38: 409-418
        • Tulsky D.S.
        • Jette A.M.
        • Kisala P.A.
        • et al.
        Spinal cord injury-functional index: item banks to measure physical functioning in individuals with spinal cord injury.
        Arch Phys Med Rehabil. 2012; 93: 1722-1732
        • Jette A.M.
        • Tulsky D.S.
        • Ni P.
        • et al.
        Development and initial evaluation of the spinal cord injury-functional index.
        Arch Phys Med Rehabil. 2012; 93: 1733-1750
        • Kisala P.
        The Validation and Responsiveness of the SCI-FI and SCI-QOL Item Banks. In Kisala, P. (chair), New Developments in the SCI-QOL/SCI-FI Measurement System. Symposium presented at the 90th American Congress of Rehabilitation Medicine annual conference, Orlando, FL.
        November 2013
        • Fyffe D.
        • Kalpakjian C.Z.
        • Slavin M.
        • et al.
        Clinical interpretation of the Spinal Cord Injury Functional Index (SCI-FI).
        J Spinal Cord Med. 2016; 39: 527-534
        • Sinha R.
        • Slavin M.D.
        • Kisala P.A.
        • Ni P.
        • Tulsky D.S.
        • Jette A.M.
        Functional ability level development and validation: providing clinical meaning for Spinal Cord Injury Functional Index scores.
        Arch Phys Med Rehabil. 2015; 96: 1448-1457
        • Lewis D.M.
        • Mitzel H.C.
        • Green D.R.
        • Patz R.J.
        The Bookmark standard setting procedure.
        McGraw-Hill, Monterey, CA1999
        • Karantonis A.
        • Sireci S.G.
        The bookmark standard-setting method: a literature review.
        Educ Meas Issues Pract. 2006; 25: 4-12
        • Heinemann A.W.
        • Nitsch K.P.
        • Ehrlich-Jones L.
        • et al.
        Effects of an implementation intervention to promote use of patient-reported outcome measures on clinicians' perceptions of evidence-based practice, implementation leadership, and team functioning.
        J Contin Educ Health Prof. 2019; 39: 103-111
        • Cook K.F.
        • Cella D.
        • Reeve B.B.
        PRO-bookmarking to estimate clinical thresholds for patient-reported symptoms and function.
        Med Care. 2019; 57: S13-S17
        • Cook K.F.
        • Victorson D.E.
        • Cella D.
        • Schalet B.D.
        • Miller D.
        Creating meaningful cut-scores for Neuro-QOL measures of fatigue, physical functioning, and sleep disturbance using standard setting with patients and providers.
        Qual Life Res. 2015; 24: 575-589
        • Cella D.
        • Cook K.
        • Victorson D.
        • Miller D.
        Doc, how bad is it? Setting standards for severity of patient-reported outcomes data using item banks from PROMIS and Neuro-QOL.
        Qual Life Res. 2014; 23: 2-3
        • Cella D.
        • Choi S.
        • Garcia S.
        • et al.
        Setting standards for severity of common symptoms in oncology using the PROMIS item banks and expert judgment.
        Qual Life Res. 2014; 23: 2651-2661
        • Embretson S.E.
        • Reise S.P.
        Item response theory for psychologists.
        Lawrence Erlbaum Associates, Inc., Mahwah, NJ2000
        • De Ayala R.J.
        The theory and practice of item response theory.
        Guilford Publications, New York2013
        • Rowe G.
        • Wright G.
        The Delphi technique as a forecasting tool: issues and analysis.
        Int J Forecast. 1999; 15: 351-371
        • Tulsky D.
        • Kisala P.
        SCI-FI structure and recent advances.
        Arch Phys Med Rehabil. 2022; 103: 185-190
        • Snyder C.F.
        • Aaronson N.K.
        • Choucair A.K.
        • et al.
        Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations.
        Qual Life Res. 2012; 21: 1305-1314