Advertisement
ORIGINAL RESEARCH| Volume 103, ISSUE 6, P1105-1112, June 2022

Inpatient Rehabilitation Facility Change in Self-Care and Change in Mobility Quality Measures: Development and Reliability and Validity Testing

  • Anne Deutsch
    Correspondence
    Corresponding author Anne Deutsch, PhD, RN, CRRN, RTI International, 307 Waverley Oaks Rd, Suite 101, Waltham, MA 02452-8413.
    Affiliations
    Comprehensive Health Innovation, Research, and Policy Division, RTI International, Waltham, Massachusetts

    Center for Rehabilitation Outcomes Research, Shirley Ryan AbilityLab, Chicago, Illinois

    Department of Physical Medicine and Rehabilitation, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
    Search for articles by this author
  • Lauren Palmer
    Affiliations
    Comprehensive Health Innovation, Research, and Policy Division, RTI International, Waltham, Massachusetts
    Search for articles by this author
  • Molly Vaughan
    Affiliations
    Health Advance, RTI International, Waltham, Massachusetts
    Search for articles by this author
  • Author Footnotes
    ⁎ Current affiliation for Tara McMullen: Veteran's Affairs, Baltimore, Maryland.
    Tara McMullen
    Footnotes
    ⁎ Current affiliation for Tara McMullen: Veteran's Affairs, Baltimore, Maryland.
    Affiliations
    Division of Post-Acute Care, Center for Clinical Standards and Quality (CCSQ), Centers for Medicare and Medicaid Services, Baltimore, Maryland
    Search for articles by this author
  • Author Footnotes
    † Current affiliation for Amol Karmarkar: Department of Physical Medicine and Rehabilitation, School of Medicine, Virginia Commonwealth University, Richmond, Virginia and Sheltering Arms Institute, Richmond, Virginia.
    Amol Karmarkar
    Footnotes
    † Current affiliation for Amol Karmarkar: Department of Physical Medicine and Rehabilitation, School of Medicine, Virginia Commonwealth University, Richmond, Virginia and Sheltering Arms Institute, Richmond, Virginia.
    Affiliations
    RTI International, Waltham, Massachusetts
    Search for articles by this author
  • Sophia Kwon
    Affiliations
    Comprehensive Health Innovation, Research, and Policy Division, RTI International, Waltham, Massachusetts
    Search for articles by this author
  • Melvin J. Ingber
    Affiliations
    Comprehensive Health Innovation, Research, and Policy Division, RTI International, Waltham, Massachusetts
    Search for articles by this author
  • Author Footnotes
    ⁎ Current affiliation for Tara McMullen: Veteran's Affairs, Baltimore, Maryland.
    † Current affiliation for Amol Karmarkar: Department of Physical Medicine and Rehabilitation, School of Medicine, Virginia Commonwealth University, Richmond, Virginia and Sheltering Arms Institute, Richmond, Virginia.
Published:February 07, 2022DOI:https://doi.org/10.1016/j.apmr.2021.12.031

      Abstract

      Objective

      To describe the development, implementation and reliability and validity testing of the inpatient rehabilitation facility (IRF) Change in Self-Care and Change in Mobility quality measures.

      Design

      We describe the activities involved in developing and implementing the 2 facility-level quality measures, including public comment opportunities. We examined facility-level reliability using split-half testing and Pearson product-moment correlations, Spearman rank correlations, and intraclass correlation coefficients (ICC2,1). We examined validity by comparing facility-level quality measure scores and facility disease-specific certification status.

      Setting

      All 1117 IRFs in the United States with at least 20 Medicare stays that ended in 2017.

      Participants

      Facility-level quality measure scores (N=1117) were derived from data from 427,517 (self-care) and 427,956 (mobility) Medicare fee-for-service and Medicare Advantage IRF patient stays in 2017.

      Interventions

      Not applicable.

      Main Outcome Measures

      Facility-level Change in Self-Care and Change in Mobility quality measure scores and facility Disease-Specific Certification for Stroke Rehabilitation from The Joint Commission were used in validity analysis.

      Results

      The split-half quality measure scores showed strong, positive correlations for the facility-level self-care (Pearson=0.903, Spearman=0.884, ICC=0.903, P<.0001) and mobility (Pearson=0.903, Spearman=0.884, ICC= 0.903, P<.0001) quality measure scores, providing evidence of reliability. ICCs remained strong when stratifying by provider volume. IRFs with stroke certification had slightly higher mean and median quality measure scores than IRFs without certification, and IRFs with the higher quality measure scores tended to have a higher percentage of certified IRFs.

      Conclusions

      Our analyses support the reliability and validity of the Change in Self-Care and Change in Mobility quality measure scores in IRFs.

      Keywords

      List of abbreviations:

      CMS (Centers for Medicare and Medicaid Services), ICC (intraclass correlation coefficient), IRF (inpatient rehabilitation facility), IRF-PAI (Inpatient Rehabilitation Facility Patient Assessment Instrument), NQF (National Quality Forum), SNF (skilled nursing facility)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

      1. Centers for Medicare and Medicaid Services. Inpatient rehabilitation facility (IRF) quality reporting program (QRP). Available at: https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/IRF-Quality-Reporting. Accessed October 30, 2021.

        • Department of Health and Human Services
        Medicare program; inpatient rehabilitation facility prospective payment system for federal fiscal year 2012; changes in size and square footage of inpatient rehabilitation units and inpatient psychiatric units; final rule.
        Fed Regist. 2011; 76: 47836-47915
      2. Centers for Medicare and Medicaid Services. Quality measures: how they are developed, used, & maintained. Available at: https://www.cms.gov/files/document/quality-measures-how-they-are-developed-used-maintained.pdf. Accessed March 20, 2020.

        • Donabedian A.
        The quality of care: how can it be assessed?.
        JAMA. 1988; 260: 1743-1748
        • Deutsch A
        • Kline T
        • Kelleher C
        • et al.
        Analysis of crosscutting medicare functional status quality metrics using the Continuity and Assessment Record and Evaluation (CARE) item set-final report.
        RTI International, Washington (DC)2012
      3. Gage B, Constantine R, Aggarwal J, et al. The development and testing of the Continuity Assessment Record and Evaluation (CARE) item set, volume 1 of 3. Waltham: RTI International; 2012.

      4. Gage B, Smith L, Ross J, et al. The development and testing of the Continuity Assessment Record and Evaluation (CARE) item set: final report on reliability testing, volume 2 of 3. Waltham: RTI International; 2012.

        • Smith L
        • Deutsch A
        • Barch D
        • et al.
        Continuity Assessment Record and Evaluation (CARE) item set: video reliability testing.
        RTI International, Waltham2012
        • Smith L
        • Deutsch A
        • Hand L
        • et al.
        Continuity Assessment Record and Evaluation (CARE) item set: additional provider-type specific interrater reliability analyses.
        RTI International, Waltham2012
        • National Quality Forum
        MAP 2015 considerations for selection of measures for federal programs: post-acute/long-term care.
        National Quality Forum, Washington (DC)2015
      5. Deutsch A, McMullen T, Vaughan M, Palmer L, Kwon S, Ingber M. The change in self-care score quality measure for inpatient rehabilitation facilities: exclusion criteria and the risk-adjustment model. Arch Phys Med Rehabil; in press.

      6. Deutsch A, Palmer L, Schwartz C, Vaughan M, McMullen T. Self-care and mobility abilities of inpatient rehabilitation facility medicare patients and validity testing of the standardized self-care and mobility data elements. Arch Phys Med Rehabil; in press.

        • Vaughan M
        • Deutsch A
        • McMullen T
        • Palmer L
        • Kwon S
        • Ingber M.
        The change in mobility score quality measure for inpatient rehabilitation facilities: exclusion criteria and the risk-adjustment model.
        Arch Phys Med Rehabil. 2021; (in press)
      7. Centers for Medicare and Medicaid Services. Compare. Available at: < https://www.medicare.gov/care-compare/ >. Accessed November 12, 2021.

        • RTI International.
        Inpatient rehabilitation facility quality reporting program measure calculations and reporting user’s manual version 3.1.
        RTI International, Waltham2019
        • Glance LG
        • Joynt Maddox K
        • Johnson K
        • et al.
        National Quality Forum guidelines for evaluating the scientific acceptability of risk-adjusted clinical outcome measures: a report from the National Quality Forum Scientific Methods Panel.
        Ann Surg. 2020; 271: 1048-1055
        • Spatz ES
        • Lipska KJ
        • Dai Y
        • et al.
        Risk-standardized acute admission rates among patients with diabetes and heart failure as a measure of quality of accountable care organizations: rationale, methods, and early results.
        Med Care. 2016; 54: 528
        • Polit DF
        • Yang F.
        Measurement and the measurement of change: a primer for the health professions.
        2016 (Wolters Kluwer Philadelphia, PA)
        • Walters SJ.
        Quality of life outcomes in clinical trials and health-care evaluation: a practical guide to analysis and interpretation. Vol 84.
        John Wiley & Sons, 2009