Advertisement

Magnitude and Variability of Stroke Patient-Proxy Disagreement Across Multiple Health Domains

Published:October 05, 2020DOI:https://doi.org/10.1016/j.apmr.2020.09.378

      Abstract

      Objectives

      To quantify the extent and variability of bias introduced when caregivers, or proxies, complete patient-reported outcome measures (PROM) on behalf of stroke patients.

      Design

      Cross-sectional survey study conducted between July 2018 and November 2019.

      Setting

      Ambulatory clinic of a cerebrovascular center or rehabilitation unit.

      Participants

      A consecutive sample of stroke patients (N=200) and their proxies who were able and willing to complete PROMs. Proxies completed PROMs as they believed the patient would answer.

      Interventions

      Not applicable.

      Main Outcome Measures

      PROMs included Neuro-QoL cognitive function, PROMIS physical function, social role satisfaction, anxiety, fatigue, pain interference, sleep disturbance, Patient Health Questionnaire-9 translated to PROMIS Depression, and PROMIS Global Health.

      Results

      The study included 200 stroke patients (age, 62.2±13.3; 41.5% women) and their proxies (age 56.5±13.9; 70% women, 72% spouses). Proxies reported worse functioning and more symptoms across all PROM domains compared with patients (average difference, 0.3-3.0 T score points). Reliability between dyad responses was moderate across all domains (intraclass correlation coefficients (2,1), 0.49-0.76) and effect sizes were small (d=0.04-0.35). Cognitive function, anxiety, and depression had the lowest agreement, whereas physical function, pain, and sleep had the highest agreement based on the Bland-Altman method. At the individual level, a large proportion of dyads had meaningfully different scores across domains (range, 40%-57%; dyads differed >5 T score points). Few predictors of disagreement were identified through multinomial regression models.

      Conclusions

      At the aggregate level, small differences were detected between stroke patient-proxy pairs, with lower agreement on more subjective domains. At the individual level, a large proportion of dyads reported meaningfully different scores on all domains, affecting the interpretability of proxy responses on PROMs in a clinical setting.

      Keywords

      List of abbreviations:

      ANOVA (analysis of variance), CAT (computer adaptive tests), ICC (intraclass correlation coefficient), mRS (modified Rankin scale), PROMIS (Patient Reported Outcome Measurement Information System), PROM (patient-reported outcome measure)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Stewart J.C.
        • Cramer S.C.
        Patient-reported measures provide unique insights into motor function after stroke.
        Stroke. 2013; 44: 1111-1116
        • Ali M.
        • Fulton R.
        • Quinn T.
        • Brady M.
        • Collaboration V.
        How well do standard stroke outcome measures reflect quality of life? A retrospective analysis of clinical trial data.
        Stroke. 2013; 44: 3161-3165
        • Katzan I.L.
        • Thompson N.R.
        • Lapin B.
        • Uchino K.
        Added value of patient-reported outcome measures in stroke clinical practice.
        J Am Heart Assoc. 2017; 6e005356
        • Mayo N.E.
        • Wood-Dauphinee S.
        • Cote R.
        • Durcan L.
        • Carlton J.
        Activity, participation, and quality of life 6 months poststroke.
        Arch Phys Med Rehabil. 2002; 83: 1035-1042
        • Choi-Kwon S.
        • Kim J.S.
        Poststroke fatigue: an emerging, critical issue in stroke medicine.
        Int J Stroke. 2011; 6: 328-336
        • De Wit L.
        • Putman K.
        • Baert I.
        • et al.
        Anxiety and depression in the first six months after stroke. A longitudinal multicentre study.
        Disabil Rehabil. 2008; 30: 1858-1866
        • Jonsson A.C.
        • Lindgren I.
        • Hallstrom B.
        • Norrving B.
        • Lindgren A.
        Prevalence and intensity of pain after stroke: a population based study focusing on patients' perspectives.
        J Neurol Neurosurg Psychiatry. 2006; 77: 590-595
        • Katzan I.L.
        • Thompson N.R.
        • Uchino K.
        • Lapin B.
        The most affected health domains after ischemic stroke.
        Neurology. 2018; 90: e1364-e1371
        • Cella D.
        • Riley W.
        • Stone A.
        • et al.
        The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008.
        J Clin Epidemiol. 2010; 63: 1179-1194
        • Katzan I.L.
        • Thompson N.
        • Uchino K.
        Innovations in stroke: the use of PROMIS and NeuroQoL scales in clinical stroke trials.
        Stroke. 2016; 47: e27-30
        • Katzan I.L.
        • Lapin B.
        PROMIS GH (Patient-Reported Outcomes Measurement Information System Global Health) scale in stroke: a validation study.
        Stroke. 2018; 49: 147-154
        • Lapin B.
        • Thompson N.R.
        • Schuster A.
        • Katzan I.L.
        Clinical utility of patient-reported outcome measurement information system domain scales.
        Circ Cardiovasc Qual Outcomes. 2019; 12e004753
        • Katzan I.L.
        • Schuster A.
        • Bain M.
        • Lapin B.
        clinical symptom profiles after mild-moderate stroke.
        J Am Heart Assoc. 2019; 8e012421
        • Williams L.S.
        • Bakas T.
        • Brizendine E.
        • et al.
        How valid are family proxy assessments of stroke patients' health-related quality of life?.
        Stroke. 2006; 37: 2081-2085
        • Sneeuw K.C.
        • Sprangers M.A.
        • Aaronson N.K.
        The role of health care providers and significant others in evaluating the quality of life of patients with chronic disease.
        J Clin Epidemiol. 2002; 55: 1130-1143
        • Hoe J.
        • Katona C.
        • Orrell M.
        • Livingston G.
        Quality of life in dementia: care recipient and caregiver perceptions of quality of life in dementia: the LASER-AD study.
        Int J Geriatr Psychiatry. 2007; 22: 1031-1036
        • Neumann P.J.
        • Araki S.S.
        • Gutterman E.M.
        The use of proxy respondents in studies of older adults: lessons, challenges, and opportunities.
        J Am Geriatr Soc. 2000; 48: 1646-1654
        • Dorman P.J.
        • Waddell F.
        • Slattery J.
        • Dennis M.
        • Sandercock P.
        Are proxy assessments of health status after stroke with the EuroQol questionnaire feasible, accurate, and unbiased?.
        Stroke. 1997; 28: 1883-1887
        • Howland M.
        • Allan K.C.
        • Carlton C.E.
        • Tatsuoka C.
        • Smyth K.A.
        • Sajatovic M.
        Patient-rated versus proxy-rated cognitive and functional measures in older adults.
        Patient Relat Outcome Meas. 2017; 8: 33-42
        • Carod-Artal F.J.
        • Ferreira Coral L.
        • Stieven Trizotto D.
        • Menezes Moreira C.
        Self- and proxy-report agreement on the Stroke Impact Scale.
        Stroke. 2009; 40: 3308-3314
        • Oczkowski C.
        • O'Donnell M.
        Reliability of proxy respondents for patients with stroke: a systematic review.
        J Stroke Cerebrovasc Dis. 2010; 19: 410-416
        • Duncan P.W.
        • Lai S.M.
        • Tyler D.
        • Perera S.
        • Reker D.M.
        • Studenski S.
        Evaluation of proxy responses to the Stroke Impact Scale.
        Stroke. 2002; 33: 2593-2599
        • Pickard A.S.
        • Johnson J.A.
        • Feeny D.H.
        • Shuaib A.
        • Carriere K.C.
        • Nasser A.M.
        Agreement between patient and proxy assessments of health-related quality of life after stroke using the EQ-5D and Health Utilities Index.
        Stroke. 2004; 35: 607-612
        • Lapin B.R.
        • Thompson N.R.
        • Schuster A.
        • Katzan I.L.
        Patient versus proxy response on global health scales: no meaningful DIFference.
        Qual Life Res. 2019; 28: 1585-1594
        • Kroenke K.
        • Spitzer R.L.
        • Williams J.B.
        The PHQ-9: validity of a brief depression severity measure.
        J Gen Intern Med. 2001; 16: 606-613
        • Choi S.W.
        • Schalet B.
        • Cook K.F.
        • Cella D.
        Establishing a common metric for depressive symptoms: linking the BDI-II, CES-D, and PHQ-9 to PROMIS depression.
        Psychol Assess. 2014; 26: 513-527
        • Hays R.D.
        • Bjorner J.B.
        • Revicki D.A.
        • Spritzer K.L.
        • Cella D.
        Development of physical and mental health summary scores from the patient-reported outcomes measurement information system (PROMIS) global items.
        Qual Life Res. 2009; 18: 873-880
      1. HealthMeasures Reference Populations.
        (Available at:)
      2. HealthMeasures Score Cut Points.
        (Available at:)
        • Pickard A.S.
        • Knight S.J.
        Proxy evaluation of health-related quality of life: a conceptual framework for understanding multiple proxy perspectives.
        Med Care. 2005; 43: 493-499
        • Quinn T.J.
        • Dawson J.
        • Walters M.
        Dr John Rankin; his life, legacy and the 50th anniversary of the Rankin Stroke Scale.
        Scott Med J. 2008; 53: 44-47
        • Harris P.A.
        • Taylor R.
        • Thielke R.
        • Payne J.
        • Gonzalez N.
        • Conde J.G.
        Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support.
        J Biomed Inform. 2009; 42: 377-381
        • Shrout P.E.
        • Fleiss J.L.
        Intraclass correlations: uses in assessing rater reliability.
        Psychol Bull. 1979; 86: 420-428
        • Bland J.M.
        • Altman D.G.
        Statistical methods for assessing agreement between two methods of clinical measurement.
        Lancet. 1986; 1: 307-310
        • Walter S.D.
        • Eliasziw M.
        • Donner A.
        Sample size and optimal designs for reliability studies.
        Stat Med. 1998; 17: 101-110
        • Cohen J.
        Statistical power analysis for the behavioral sciences.
        Taylor & Francis, Philadelphia2013
        • Koo T.K.
        • Li M.Y.
        A guideline for selecting and reporting intraclass correlation coefficients for reliability research.
        J Chiropr Med. 2016; 15: 155-163
        • Jette A.M.
        • Ni P.
        • Rasch E.K.
        • et al.
        Evaluation of patient and proxy responses on the activity measure for postacute care.
        Stroke. 2012; 43: 824-829
        • Hays R.D.
        • Vickrey B.G.
        • Hermann B.P.
        • et al.
        Agreement between self reports and proxy reports of quality of life in epilepsy patients.
        Qual Life Res. 1995; 4: 159-168
        • Todorov A.
        • Kirchner C.
        Bias in proxies' reports of disability: data from the National Health Interview Survey on disability.
        Am J Public Health. 2000; 90: 1248-1253
        • Hung S.Y.
        • Pickard A.S.
        • Witt W.P.
        • Lambert B.L.
        Pain and depression in caregivers affected their perception of pain in stroke patients.
        J Clin Epidemiol. 2007; 60: 963-970
        • Skolarus L.E.
        • Sanchez B.N.
        • Morgenstern L.B.
        • et al.
        Validity of proxies and correction for proxy use when evaluating social determinants of health in stroke patients.
        Stroke. 2010; 41: 510-515
        • Ediebah D.E.
        • Reijneveld J.C.
        • Taphoorn M.J.
        • et al.
        Impact of neurocognitive deficits on patient-proxy agreement regarding health-related quality of life in low-grade glioma patients.
        Qual Life Res. 2017; 26: 869-880
        • Segawa E.
        • Schalet B.
        • Cella D.
        A comparison of computer adaptive tests (CATs) and short forms in terms of accuracy and number of items administrated using PROMIS profile.
        Qual Life Res. 2020; 29: 213-221