Advertisement
Original research| Volume 101, ISSUE 2, P297-308, February 2020

PROMIS Physical Function Short Forms Display Item- and Scale-Level Characteristics at Least as Good as the Roland Morris Disability Questionnaire in Patients With Chronic Low Back Pain

  • Alessandro Chiarotto
    Correspondence
    Corresponding author Alessandro Chiarotto, PT, MSc, PhD, Department of Health Sciences, Faculty of Science, Amsterdam Movement Sciences Research Institute, VU University De Boelelaan 1085, Room U-601, 1081HV, Amsterdam, The Netherlands.
    Affiliations
    Department of Health Sciences, Faculty of Science, Amsterdam Movement Sciences Research Institute, VU University, Amsterdam, The Netherlands

    Department of General Practice, Erasmus MC, University Medical Center, Rotterdam, The Netherlands
    Search for articles by this author
  • Leo D. Roorda
    Affiliations
    Amsterdam Rehabilitation Research Center, Reade, Amsterdam, The Netherlands
    Search for articles by this author
  • Martine H. Crins
    Affiliations
    Amsterdam Rehabilitation Research Center, Reade, Amsterdam, The Netherlands
    Search for articles by this author
  • Maarten Boers
    Affiliations
    Amsterdam Rheumatology and Immunology Center, VU University Medical Center, Amsterdam, The Netherlands

    Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, Amsterdam UMC, VU University Medical Center, Amsterdam, The Netherlands
    Search for articles by this author
  • Raymond W. Ostelo
    Affiliations
    Department of Health Sciences, Faculty of Science, Amsterdam Movement Sciences Research Institute, VU University, Amsterdam, The Netherlands

    Department of General Practice, Erasmus MC, University Medical Center, Rotterdam, The Netherlands
    Search for articles by this author
  • Caroline B. Terwee
    Affiliations
    Department of Health Sciences, Faculty of Science, Amsterdam Movement Sciences Research Institute, VU University, Amsterdam, The Netherlands
    Search for articles by this author
Published:November 02, 2019DOI:https://doi.org/10.1016/j.apmr.2019.09.018

      Abstract

      Objective

      To compare dimensionality, item-level characteristics, scale-level reliability, and construct validity of PROMIS Physical Function short forms (PROMIS-PF) and 24-item Roland Morris Disability Questionnaire (RMDQ-24) in patients with chronic low back pain (LBP).

      Design

      Cross-sectional study.

      Setting

      Secondary care center for rehabilitation and rheumatology.

      Participants

      Patients with nonspecific LBP ≥3 months (N=768). Mean age was 49±13 years, 77% were female, and 54% displayed pain for more than 5 years.

      Interventions

      Not applicable.

      Main Outcome Measures

      Dutch versions of the 4-, 6-, 8-, 10-, and 20-item PROMIS-PF and of the RMDQ-24.

      Results

      PROMIS-PF-6, PROMIS-PF-8, and RMDQ-24 exhibited sufficient unidimensionality (confirmatory factor analysis: comparative fit index>0.950, Tucker-Lewis index>0.950, root means square error of approximation<0.060), whereas the other instruments did not. All instruments were free of local dependence except PROMIS-PF-20 with 4 item pairs with clear residual correlations. Mokken scale analysis found 1 nonmonotone item for PROMIS-PF-20 and 8 for RMDQ-24 (ie, the probability of endorsing these items was not increasing with increasing level on the underlying construct). PROMIS-PF-20 displayed 2 misfitting items (S-χ2 P value>.001). Two-parameter item response theory models found 2 items with low discrimination for RMDQ-24. All other instruments had adequate fit statistics and item parameters. PROMIS-PF-20 displayed the best scale-level reliability. Construct validity was sufficient for all instruments as all hypotheses on expected correlations with other instruments and differences between relevant subgroups were met.

      Conclusions

      PROMIS-PF-6, PROMIS-PF-8, and RMDQ-24 exhibited better unidimensionality, whereas PROMIS-PF-4, PROMIS-PF-6, PROMIS-PF-8, and PROMIS-PF-10 showed superior item-level characteristics. PROMIS-PF-20 was the instrument with the best scale-level reliability. This study warrants assessment of other measurement properties of PROMIS-PF short forms in comparison with disease-specific physical functioning instruments in LBP.

      Keywords

      List of abbreviations:

      CAT (computerized adaptive testing), CFA (confirmatory factor analysis), COSMIN (consensus-based standards for the selection of health measurement instruments), IRT (item response theory), LBP (low back pain), NRS (numeric rating scale), PROM (patient-reported outcome measure), RMDQ-24 (24-item Roland Morris Disability Questionnaire), PROMIS (Patient Reported Outcomes Measurement Information System), PROMIS-PF (Patient Reported Outcomes Measurement Information System Physical Function), PROMIS-PF-4 (4-item PROMIS Physical Function short form), PROMIS-PF-6 (6-item PROMIS Physical Function short form), PROMIS-PF-8 (8-item PROMIS Physical Function short form), PROMIS-PF-10 (10-item PROMIS Physical Function short form), PROMIS-PF-20 (20-item PROMIS Physical Function short form), PROMIS-GH-10 (10-item PROMIS Global Health short form)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Vos T.
        • Allen C.
        • Arora M.
        • et al.
        Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990-2015: a systematic analysis for the Global Burden of Disease Study 2015.
        Lancet. 2016; 388: 1545-1602
        • Chiarotto A.
        • Deyo R.A.
        • Terwee C.B.
        • et al.
        Core outcome domains for clinical trials in non-specific low back pain.
        Eur Spine J. 2015; 24: 1127-1142
        • Chapman J.R.
        • Norvell D.C.
        • Hermsmeyer J.T.
        • et al.
        Evaluating common outcomes for measuring treatment success for chronic low back pain.
        Spine. 2011; 36: 54-68
        • Black N.
        Patient reported outcome measures could help transform healthcare.
        BMJ. 2013; 346: f167
        • Coulter A.
        Measuring what matters to patients.
        BMJ. 2017; 356: j816
        • Froud R.
        • Patel S.
        • Rajendran D.
        • et al.
        A systematic review of outcome measures use, analytical approaches, reporting methods, and publication volume by year in low back pain trials published between 1980 and 2012: respice, adspice, et prospice.
        PLoS One. 2016; 11e0164573
        • Chiarotto A.
        • Boers M.
        • Deyo R.A.
        • et al.
        Core outcome measurement instruments for clinical trials in non-specific low back pain.
        Pain. 2018; 159: 481-495
        • Chiarotto A.
        • Terwee C.B.
        • Ostelo R.W.
        Choosing the right outcome measurement instruments for patients with low back pain.
        Best Pract Res Clin Rheumatol. 2016; 30: 1003-1020
        • Dworkin R.H.
        • Turk D.C.
        • Farrar J.T.
        • et al.
        Core outcome measures for chronic pain clinical trials: IMMPACT recommendations.
        Pain. 2005; 113: 9-19
        • Taylor A.M.
        • Phillips K.
        • Patel K.V.
        • et al.
        Assessment of physical function and participation in chronic pain clinical trials: IMMPACT/OMERACT recommendations.
        Pain. 2016; 157: 1836-1850
        • Longo U.G.
        • Loppini M.
        • Denaro L.
        • Maffulli N.
        • Denaro V.
        Rating scales for low back pain.
        Br Med Bull. 2010; 94: 81-144
        • Roland M.
        • Morris R.
        A study of the natural history of back pain: part I: development of a reliable and sensitive measure of disability in low-back pain.
        Spine. 1983; 8: 141-144
        • Roland M.
        • Morris R.
        A study of the natural history of back pain. Part I: development of a reliable and sensitive measure of disability in low-back pain.
        Spine (Phila Pa 1976). 1983; 8: 141-144
        • Grotle M.
        • Brox J.I.
        • Vøllestad N.K.
        Functional status and disability questionnaires: what do they assess?: a systematic review of back-specific outcome questionnaires.
        Spine. 2005; 30: 130-140
        • Chiarotto A.
        • Maxwell L.J.
        • Terwee C.B.
        • Wells G.A.
        • Tugwell P.
        • Ostelo R.W.
        Roland-Morris Disability Questionnaire and Oswestry Disability Index: which has better measurement properties for measuring physical functioning in nonspecific low back pain? Systematic review and meta-analysis.
        Phys Ther. 2016; 96: 1620-1637
        • Geere J.H.
        • Geere J.A.
        • Hunter P.R.
        Meta-analysis identifies back pain questionnaire reliability influenced more by instrument than study design or population.
        J Clin Epidemiol. 2013; 66: 261-267
        • Chiarotto A.
        • Ostelo R.W.
        • Boers M.
        • Terwee C.B.
        A systematic review highlights the need to investigate the content validity of patient-reported outcome measures for physical functioning in low back pain.
        J Clin Epidemiol. 2018; 95: 73-93
        • Cella D.
        • Riley W.
        • Stone A.
        • et al.
        The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008.
        J Clin Epidemiol. 2010; 63: 1179-1194
        • Cella D.
        • Yount S.
        • Rothrock N.
        • et al.
        The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years.
        Med Care. 2007; 45: 3
        • Cella D.
        • Gershon R.
        • Lai J.S.
        • Choi S.
        The future of outcomes measurement: item banking, tailored short-forms, and computerized adaptive assessment.
        Qual Life Res. 2007; 16: 133-141
        • DeWalt D.A.
        • Rothrock N.
        • Yount S.
        • Stone A.A.
        Evaluation of item candidates: the PROMIS qualitative item review.
        Med Care. 2007; 45: 12
        • Reeve B.B.
        • Hays R.D.
        • Bjorner J.B.
        • et al.
        Psychometric evaluation and calibration of health-related quality of life item banks: plans for the Patient-Reported Outcomes Measurement Information System (PROMIS).
        Med Care. 2007; 45: 22-31
        • Fries J.F.
        • Cella D.
        • Rose M.
        • Krishnan E.
        • Bruce B.
        Progress in assessing physical function in arthritis: PROMIS short forms and computerized adaptive testing.
        J Rheumatol. 2009; 36: 2061-2066
        • Bruce B.
        • Fries J.
        • Lingala B.
        • Hussain Y.N.
        • Krishnan E.
        Development and assessment of floor and ceiling items for the PROMIS physical function item bank.
        Arthritis Res Ther. 2013; 15: R144
        • Bruce B.
        • Fries J.F.
        • Ambrosini D.
        • et al.
        Better assessment of physical function: item improvement is neglected but essential.
        Arthritis Res Ther. 2009; 11: R191
        • Rose M.
        • Bjorner J.B.
        • Gandek B.
        • Bruce B.
        • Fries J.F.
        • Ware J.E.
        The PROMIS Physical Function item bank was calibrated to a standardized metric and shown to improve measurement efficiency.
        J Clin Epidemiol. 2014; 67: 516-526
        • Crins M.H.P.
        • Terwee C.B.
        • Klausch T.
        • et al.
        The Dutch-Flemish PROMIS Physical Function item bank exhibited strong psychometric properties in patients with chronic pain.
        J Clin Epidemiol. 2017; 87: 47-58
        • Hung M.
        • Clegg D.O.
        • Greene T.
        • Saltzman C.L.
        Evaluation of the PROMIS physical function item bank in orthopaedic patients.
        J Orthop Res. 2011; 29: 947-953
        • Hung M.
        • Hon S.D.
        • Franklin J.D.
        • et al.
        Psychometric properties of the PROMIS physical function item bank in patients with spinal disorders.
        Spine. 2014; 39: 158-163
        • Oude Voshaar M.A.
        • Peter M.
        • Glas C.A.
        • et al.
        Calibration of the PROMIS Physical Function item bank in Dutch patients with rheumatoid arthritis.
        PLoS One. 2014; 9: e92367
      1. A brief guide to the PROMIS Physical Function instruments.
        (Available at:) (Accessed April 26, 2019)
        • Deyo R.A.
        • Dworkin S.F.
        • Amtmann D.
        • et al.
        Report of the NIH Task Force on research standards for chronic low back pain.
        J Pain. 2014; 15: 569-585
        • Hays R.D.
        • Spritzer K.L.
        • Fries J.F.
        • Krishnan E.
        Responsiveness and minimally important difference for the Patient-Reported Outcomes Measurement Information System (PROMIS) 20-item physical functioning short form in a prospective observational study of rheumatoid arthritis.
        Ann Rheum Dis. 2015; 74: 104-107
        • Lee A.C.
        • Driban J.B.
        • Price L.L.
        • Harvey W.F.
        • Rodday A.M.
        • Wang C.
        Responsiveness and minimally important differences for 4 Patient-Reported Outcomes Measurement Information System short forms: Physical Function, Pain Interference, Depression, and Anxiety in Knee Osteoarthritis.
        J Pain. 2017; 18: 1096-1110
        • Merriwether E.N.
        • Rakel B.A.
        • Zimmerman M.B.
        • et al.
        Reliability and construct validity of the Patient-Reported Outcomes Measurement Information System (PROMIS) instruments in women with fibromyalgia.
        Pain Med. 2016; 18: 1485-1495
        • Wahl E.
        • Gross A.
        • Chernitskiy V.
        • et al.
        Validity and responsiveness of a 10-item Patient-Reported Measure of Physical Function in a rheumatoid arthritis clinic population.
        Arthritis Res Ther. 2017; 69: 338-346
        • Rose M.
        • Bjorner J.B.
        • Becker J.
        • Fries J.
        • Ware J.
        Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS).
        J Clin Epidemiol. 2008; 61: 17-33
        • Mokkink L.B.
        • Terwee C.B.
        • Patrick D.L.
        • et al.
        The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes.
        J Clin Epidemiol. 2010; 63: 737-745
        • Prinsen C.A.
        • Vohra S.
        • Rose M.R.
        • et al.
        How to select outcome measurement instruments for outcomes included in a “Core Outcome Set”–a practical guideline.
        Trials. 2016; 17: 449
        • Mislevy R.J.
        • Wu P.K.
        Missing responses and IRT ability estimation: omits, choice, time limits, and adaptive testing.
        ETS Research Report Series. 1996; : 1996
        • Terwee C.
        • Roorda L.
        • De Vet H.
        • et al.
        Dutch-Flemish translation of 17 item banks from the patient-reported outcomes measurement information system (PROMIS).
        Qual Life Res. 2014; 23: 1733-1741
      2. PROMIS Instrument Development and Validation Scientific Standards version 2.0.
        (Available at:) (Accessed April 26, 2019)
        • Kent P.
        • Lauridsen H.H.
        Managing missing scores on the Roland Morris Disability Questionnaire.
        Spine. 2011; 36: 1878-1884
        • Clement R.C.
        • Welander A.
        • Stowell C.
        • et al.
        A proposed set of metrics for standardized outcome reporting in the management of low back pain.
        Acta Orthop. 2015; 86: 523-533
        • Hays R.D.
        • Bjorner J.B.
        • Revicki D.A.
        • Spritzer K.L.
        • Cella D.
        Development of physical and mental health summary scores from the patient-reported outcomes measurement information system (PROMIS) global items.
        Qual Life Res. 2009; 18: 873-880
        • Bryan S.
        • Davis J.
        • Broesch J.
        • et al.
        Choosing your partner for the PROM: a review of evidence on patient-reported outcome measures for use in primary and community care.
        Health Policy. 2014; 10: 38-51
        • Oak S.R.
        • Strnad G.J.
        • Bena J.
        • et al.
        Responsiveness comparison of the EQ-5D, PROMIS Global Health, and VR-12 Questionnaires in knee arthroscopy.
        Orthop J Sports Med. 2016; 4 (2325967116674714)
        • Chiarotto A.
        • Maxwell L.J.
        • Ostelo R.W.
        • Boers M.
        • Tugwell P.
        • Terwee C.B.
        Measurement properties of Numeric Rating Scale, Visual Analogue Scale and Pain Severity subscale of Brief Pain Inventory in patients with low back pain: a systematic review.
        J Pain. 2019; 20: 245-263
        • DeMars C.
        Item response theory.
        Oxford University Press, New York2010
        • Embretson S.E.
        • Reise S.P.
        Item response theory.
        Psychology Press, Hoboken2013
        • Rosseel Y.
        Lavaan: an R package for structural equation modeling and more. Version 0.5–12 (BETA).
        J Stat Softw. 2012; 48: 1-36
        • Mokken R.J.
        A theory and procedure of scale analysis: with applications in political research.
        Walter de Gruyter, Berlin1971
        • Sijtsma K.
        • Molenaar I.W.
        Introduction to nonparametric item response theory.
        Sage, Thousand Oaks2002
        • Paap M.C.
        • Meijer R.R.
        • Cohen-Kettenis P.T.
        • et al.
        Why the factorial structure of the SCL-90-R is unstable: comparing patient groups with different levels of psychological distress using Mokken Scale Analysis.
        Psychiatry Res. 2012; 200: 819-826
        • van der Ark L.A.
        New developments in Mokken scale analysis in R.
        J Stat Softw. 2012; 48: 1-27
        • Samejima F.
        Estimation of latent ability using a response pattern of graded scores.
        Psychometrika. 1970; 35: 139
        • Thissen D.
        • Orlando M.
        Item response theory for items scored in two categories.
        in: Thissen D. Wainer H. Test scoring. Lawrence Erlbaum Associates, Mahwah2001: 73-140
        • Chalmers R.P.
        mirt: a multidimensional item response theory package for the R environment.
        J Stat Softw. 2012; 48: 1-29
        • Petrillo J.
        • Cano S.J.
        • McLeod L.D.
        • Coon C.D.
        Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examples.
        Value Health. 2015; 18: 25-34
        • Sijtsma K.
        Correcting fallacies in validity, reliability, and classification.
        Int J Test. 2009; 9: 167-194
        • Rizopoulos D.
        ltm: an R package for latent variable modeling and item response theory analyses.
        J Stat Softw. 2006; 17: 1-25
        • de Vet H.C.
        • Terwee C.B.
        • Mokkink L.B.
        • Knol D.L.
        Measurement in medicine: a practical guide.
        Cambridge University Press, Cambridge2011
        • Reeve B.B.
        • Wyrwich K.W.
        • Wu A.W.
        • et al.
        ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research.
        Qual Life Res. 2013; 22: 1889-1905
        • Kato K.
        • Sullivan P.F.
        • Evengård B.
        • Pedersen N.L.
        Chronic widespread pain and its comorbidities: a population-based study.
        Arch Intern Med. 2006; 166: 1649-1654
        • Beckmann J.T.
        • Hung M.
        • Voss M.W.
        • Crum A.B.
        • Bounsanga J.
        • Tyser A.R.
        Evaluation of the patient-reported outcomes measurement information system upper extremity computer adaptive test.
        J Hand Surg Am. 2016; 41: 739-744
        • Hays R.D.
        • Spritzer K.L.
        • Amtmann D.
        • et al.
        Upper-extremity and mobility subdomains from the Patient-Reported Outcomes Measurement Information System (PROMIS) adult Physical Functioning item bank.
        Arch Phys Med Rehabil. 2013; 94: 2291-2296
        • Braeken J.
        A boundary mixture approach to violations of conditional independence.
        Psychometrika. 2011; 76: 57-76
        • Wainer H.
        • Kiely G.L.
        Item clusters and computerized adaptive testing: a case for testlets.
        J Educ Meas. 1987; 24: 185-201
        • Wells G.
        • Beaton D.E.
        • Tugwell P.
        • et al.
        Updating the OMERACT filter: discrimination and feasibility.
        J Rheumatol. 2014; 41: 1005-1010
        • Kopec J.A.
        • Esdaile J.M.
        • Abrahamowicz M.
        • et al.
        The Quebec Back Pain Disability Scale. Measurement properties.
        Spine. 1995; 20: 341-352
        • Boers M.
        • Brooks P.
        • Strand C.V.
        • Tugwell P.
        The OMERACT filter for Outcome Measures in Rheumatology.
        J Rheumatol. 1998; 25: 198-199