Understanding Health-related Quality of Life in Caregivers of Civilians and Service Members/Veterans With Traumatic Brain Injury: Establishing the Reliability and Validity of PROMIS Mental Health Measures



      To provide important reliability and validity data to support the use of the Patient-Reported Outcomes Measurement Information System (PROMIS) mental health measures in caregivers of civilians or service members/veterans (SMVs) with traumatic brain injury (TBI).


      Patient-reported outcome surveys administered through an electronic data collection platform.


      Three TBI model systems rehabilitation hospitals, an academic medical center, and a military medical treatment facility.


      Caregivers (N=560) of individuals with a documented TBI (344 civilians and 216 military).


      Not applicable.

      Main Outcome Measures

      PROMIS anxiety, depression, and anger item banks.


      Internal consistency for all the PROMIS Mental Health item banks was very good (all α>.86) and 3-week test-retest reliability was good to adequate (ranged from .65 to .85). Convergent validity and discriminant validity of the PROMIS measures were also supported. Caregivers of individuals who were low functioning had worse emotional health-related quality of life (HRQOL) (as measured by the 3 PROMIS measures) than caregivers of high-functioning individuals, supporting known groups validity. Finally, levels of distress, as measured by the PROMIS measures, were elevated for those caring for low-functioning individuals in both samples (rates ranged from 26.2% to 43.6% for caregivers of low-functioning individuals).


      Results support the reliability and validity of the PROMIS anxiety, depression, and anger item banks in caregivers of civilians and SMVs with TBI. Ultimately, these measures can be used to provide a standardized assessment of HRQOL because it relates to mental health in these caregivers.


      List of abbreviations:

      CAS (Caregiver Appraisal Scale), CAT (Computer Adaptive Test), HRQOL (health-related quality of life), MHC (mental health composite), MPAI-4 (Mayo-Portland Adaptability Inventory-Fourth Edition), PHC (physical health composite), PROMIS (Patient-Reported Outcomes Measurement Information System), SF (short form), SMV (service member/veteran), TBI (traumatic brain injury), ZBI (Zarit Burden Interview)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'


      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


        • Langlois J.A.
        • Kegler S.R.
        • Butler J.A.
        • et al.
        Traumatic brain injury-related hospital discharges. Results from a 14-state surveillance system, 1997.
        MMWR Surveill Summ. 2003; 52: 1-20
        • DVBIC
        DoD worldwide numbers for TBI.
        (Available at:) (Accessed February 17, 2015)
        • Corrigan J.D.
        • Cuthbert J.P.
        • Harrison-Felix C.
        • et al.
        US population estimates of health and social outcomes 5 years after rehabilitation for traumatic brain injury.
        J Head Trauma Rehabil. 2014; 29: E1-E9
        • Cuthbert J.P.
        • Pretz C.R.
        • Bushnik T.
        • et al.
        Ten-year employment patterns of working age individuals after moderate to severe traumatic brain injury: a National Institute on Disability and Rehabilitation Research Traumatic Brain Injury Model Systems study.
        Arch Phys Med Rehabil. 2015; 96: 2128-2136
        • Dahm J.
        • Ponsford J.
        Long-term employment outcomes following traumatic brain injury and orthopaedic trauma: a ten-year prospective study.
        J Rehabil Med. 2015; 47: 932-940
        • Jourdan C.
        • Bayen E.
        • Pradat-Diehl P.
        • et al.
        A comprehensive picture of 4-year outcome of severe brain injuries. Results from the PariS-TBI study.
        Ann Phys Rehabil Med. 2016; 59: 100-106
        • Verhaeghe S.
        • Defloor T.
        • Grypdonck M.
        Stress and coping among families of patients with traumatic brain injury: a review of the literature.
        J Clin Nurs. 2005; 14: 1004-1012
        • Kolakowsky-Hayner S.A.
        • Miner K.D.
        • Kreutzer J.S.
        Long-term life quality and family needs after traumatic brain injury.
        J Head Trauma Rehabil. 2001; 16: 374-385
        • Norup A.
        • Kristensen K.S.
        • Poulsen I.
        • Mortensen E.L.
        Evaluating clinically significant changes in health-related quality of life: a sample of relatives of patients with severe traumatic brain injury.
        Neuropsychol Rehabil. 2017; 27: 196-215
        • Norup A.
        • Kristensen K.S.
        • Siert L.
        • Poulsen I.
        • Mortensen E.L.
        Neuropsychological support to relatives of patients with severe traumatic brain injury in the sub-acute phase.
        Neuropsychol Rehabil. 2011; 21: 306-321
        • Norup A.
        • Siert L.
        • Lykke Mortensen E.
        Emotional distress and quality of life in relatives of patients with severe brain injury: the first month after injury.
        Brain Inj. 2010; 24: 81-88
        • Norup A.
        • Welling K.L.
        • Qvist J.
        • Siert L.
        • Mortensen E.L.
        Depression, anxiety and quality-of-life among relatives of patients with severe brain injury: the acute phase.
        Brain Inj. 2012; 26: 1192-1200
        • Arango-Lasprilla J.C.
        • Nicholls E.
        • Villasenor Cabrera T.
        • Drew A.
        • Jimenez-Maldonado M.
        • Martinez-Cortes M.L.
        Health-related quality of life in caregivers of individuals with traumatic brain injury from Guadalajara, Mexico.
        J Rehabil Med. 2011; 43: 983-986
        • Carlozzi N.E.
        • Brickell T.A.
        • French L.M.
        • et al.
        Caring for our wounded warriors: a qualitative examination of health-related quality of life in caregivers of individuals with military-related traumatic brain injury.
        J Rehabil Res Dev. 2016; 53: 669-680
        • Carlozzi N.E.
        • Kratz A.L.
        • Sander A.M.
        • et al.
        Health-related quality of life in caregivers of individuals with traumatic brain injury: development of a conceptual model.
        Arch Phys Med Rehabil. 2015; 96: 105-113
        • Cella D.F.
        Measuring quality of life in palliative care.
        Semin Oncol. 1995; 22: 73-81
        • Norup A.
        • Siert L.
        • Mortensen E.L.
        Neuropsychological intervention in the acute phase: a pilot study of emotional wellbeing of relatives of patients with severe brain injury.
        J Rehabil Med. 2013; 45: 827-834
        • Oddy M.
        • Humphrey M.
        • Uttley D.
        Stresses upon the relatives of head-injured patients.
        Br J Psychiatry. 1978; 133: 507-513
        • Gillen R.
        • Tennen H.
        • Affleck G.
        • Steinpreis R.
        Distress, depressive symptoms, and depressive disorder among caregivers of patients with brain injury.
        J Head Trauma Rehabil. 1998; 13: 31-43
        • Livingston M.G.
        • Brooks D.N.
        • Bond M.R.
        Patient outcome in the year following severe head injury and relatives’ psychiatric and social functioning.
        J Neurol Neurosurg Psychiatry. 1985; 48: 876-881
        • Marsh N.V.
        • Kersel D.A.
        • Havill J.H.
        • Sleigh J.W.
        Caregiver burden at 6 months following severe traumatic brain injury.
        Brain Inj. 1998; 12: 225-238
        • Kinsella G.
        • Packer S.
        • Olver J.
        Maternal reporting of behaviour following very severe blunt head injury.
        J Neurol Neurosurg Psychiatry. 1991; 54: 422-426
        • Kreutzer J.S.
        • Gervasio A.H.
        • Camplair P.S.
        Patient correlates of caregivers’ distress and family functioning after traumatic brain injury.
        Brain Inj. 1994; 8: 211-230
        • Griffin J.M.
        • Lee M.K.
        • Bangerter L.R.
        • et al.
        Burden and mental health among caregivers of veterans with traumatic brain injury/polytrauma.
        Am J Orthopsychiatry. 2017; 87: 139-148
        • Ponsford J.
        • Olver J.
        • Ponsford M.
        • Nelms R.
        Long-term adjustment of families following traumatic brain injury where comprehensive rehabilitation has been provided.
        Brain Inj. 2003; 17: 453-468
        • Norup A.
        • Petersen J.
        • Mortensen E.L.
        Relatives of patients with severe brain injury: growth curve analysis of anxiety and depression the first year after injury.
        Brain Inj. 2015; 29: 822-829
        • Florian V.
        • Katz S.
        • Lahav V.
        Impact of traumatic brain damage on family dynamics and functioning: a review.
        Brain Inj. 1989; 3: 219-233
        • Lezak M.D.
        Psychological implications of traumatic brain-damage for the patients family.
        Rehabil Psychol. 1986; 31: 241-250
        • Stern J.M.
        • Sazbon L.
        • Becker E.
        • Costeff H.
        Severe behavioural disturbance in families of patients with prolonged coma.
        Brain Inj. 1988; 2: 259-262
        • Perlesz A.
        • Kinsella G.
        • Crowe S.
        Psychological distress and family satisfaction following traumatic brain injury: injured individuals and their primary, secondary, and tertiary carers.
        J Head Trauma Rehabil. 2000; 15: 909-929
        • Saban K.L.
        • Mathews H.L.
        • Collins E.G.
        • et al.
        The man I once knew: grief and inflammation in female partners of veterans with traumatic brain injury.
        Biol Res Nurs. 2016; 18: 50-59
        • Bayen E.
        • Jourdan C.
        • Ghout I.
        • et al.
        Objective and subjective burden of informal caregivers 4 years after a severe traumatic brain injury: results from the PariS-TBI study.
        J Head Trauma Rehabil. 2016; 31: E59-E67
        • Kreutzer J.S.
        • Gervasio A.H.
        • Camplair P.S.
        Primary caregivers’ psychological status and family functioning after traumatic brain injury.
        Brain Inj. 1994; 8: 197-210
        • Marsh N.V.
        • Kersel D.A.
        • Havill J.H.
        • Sleigh J.W.
        Caregiver burden at 1 year following severe traumatic brain injury.
        Brain Inj. 1998; 12: 1045-1059
        • Ergh T.C.
        • Hanks R.A.
        • Rapport L.J.
        • Coleman R.D.
        Social support moderates caregiver life satisfaction following traumatic brain injury.
        J Clin Exp Neuropsychol. 2003; 25: 1090-1101
        • Coleman R.D.
        • Rapport L.J.
        • Ergh T.C.
        • Hanks R.A.
        • Ricker J.H.
        • Millis S.R.
        Predictors of driving outcome after traumatic brain injury.
        Arch Phys Med Rehabil. 2002; 83: 1415-1422
        • Mazlan M.
        • Ghani S.
        • Tan K.F.
        • Subramanian P.
        Life satisfaction and strain among informal caregivers of patients with traumatic brain injury in Malaysia.
        Disabil Rehabil. 2016; 38: 2198-2205
        • Manskow U.S.
        • Sigurdardottir S.
        • Roe C.
        • et al.
        Factors affecting caregiver burden 1 year after severe traumatic brain injury: a prospective nationwide multicenter study.
        J Head Trauma Rehabil. 2015; 30: 411-423
        • Sander A.M.
        • Maestas K.L.
        • Clark A.N.
        • Havins W.N.
        Predictors of emotional distress in family caregivers of persons with traumatic brain injury: a systematic review.
        Brain Impairment. 2013; 14: 113-129
        • Sander A.M.
        • Maestas K.L.
        • Sherer M.
        • Malec J.F.
        • Nakase-Richardson R.
        Relationship of caregiver and family functioning to participation outcomes after postacute rehabilitation for traumatic brain injury: a multicenter investigation.
        Arch Phys Med Rehabil. 2012; 93: 842-848
        • Anderson M.I.
        • Parmenter T.R.
        • Mok M.
        The relationship between neurobehavioural problems of severe traumatic brain injury (TBI), family functioning and the psychological well-being of the spouse/caregiver: path model analysis.
        Brain Inj. 2002; 16: 743-757
        • Rotondi A.J.
        • Sinkule J.
        • Balzer K.
        • Harris J.
        • Moldovan R.
        A qualitative needs assessment of persons who have experienced traumatic brain injury and their primary family caregivers.
        J Head Trauma Rehabil. 2007; 22: 14-25
        • Douglas J.M.
        • Spellacy F.J.
        Indicators of long-term family functioning following severe traumatic brain injury in adults.
        Brain Inj. 1996; 10: 819-839
        • Rivara J.M.
        • Jaffe K.M.
        • Polissar N.L.
        • Fay G.C.
        • Liao S.
        • Martin K.M.
        Predictors of family functioning and change 3 years after traumatic brain injury in children.
        Arch Phys Med Rehabil. 1996; 77: 754-764
        • Phelan S.M.
        • Griffin J.M.
        • Hellerstedt W.L.
        • et al.
        Perceived stigma, strain, and mental health among caregivers of veterans with traumatic brain injury.
        Disabil Health J. 2011; 4: 177-184
        • Powell J.M.
        • Wise E.K.
        • Brockway J.A.
        • Fraser R.
        • Temkin N.
        • Bell K.R.
        Characteristics and concerns of caregivers of adults with traumatic brain injury.
        J Head Trauma Rehabil. 2017; 32: E33-E41
        • Adams D.
        • Dahdah M.
        Coping and adaptive strategies of traumatic brain injury survivors and primary caregivers.
        NeuroRehabilitation. 2016; 39: 223-237
        • Petranovich C.L.
        • Wade S.L.
        • Taylor H.G.
        • et al.
        Long-term caregiver mental health outcomes following a predominately online intervention for adolescents with complicated mild to severe traumatic brain injury.
        J Pediatr Psychol. 2015; 40: 680-688
        • Hanks R.A.
        • Rapport L.J.
        • Vangel S.
        Caregiving appraisal after traumatic brain injury: the effects of functional status, coping style, social support and family functioning.
        NeuroRehabilitation. 2007; 22: 43-52
        • Struchen M.A.
        • Atchison T.B.
        • Roebuck T.M.
        • Caroselli J.S.
        • Sander A.M.
        A multidimensional measure of caregiving appraisal: validation of the Caregiver Appraisal Scale in traumatic brain injury.
        J Head Trauma Rehabil. 2002; 17: 132-154
        • Derogatis L.R.
        Brief symptom inventory 18 (BSI 18): administration, scoring, and procedures manual.
        NCS Pearson Inc, Minneapolis2001
        • Derogatis L.R.
        Symptom checklist-90-R (SCL-90-R).
        NCS Assessments, Minneapolis, MN1975
        • Snaith R.P.
        • Bridge G.W.K.
        • Hamilton M.
        The Leeds Scales for the self-assessment of anxiety and depression.
        Psychological Test Publication, London1976
      1. Amtmann D, Cook K, Johnson KL, Cella D. The NIH roadmap and PROMIS initiative: applications to rehabilitation medicine. Arch Phys Med Rehabil; in press.

        • Cella D.
        • Yount S.
        • Rothrock N.
        • et al.
        The Patient-Reported Outcomes Measurement Information System (PROMIS): 567 progress of an NIH roadmap cooperative group during its first two years.
        Med Care. 2007; 45: S3
        • Hanauer D.A.
        • Mei Q.
        • Law J.
        • Khanna R.
        • Zheng K.
        Supporting information retrieval from electronic health records: a report of University of Michigan’s nine-year experience in developing and using the Electronic Medical Record Search Engine (EMERSE).
        J Biomed Inform. 2015; 55: 290-300
        • Corrigan J.D.
        • Cuthbert J.P.
        • Whiteneck G.G.
        • et al.
        Representativeness of the Traumatic Brain Injury Model Systems National Database.
        J Head Trauma Rehabil. 2012; 27: 391-403
        • Pilkonis P.A.
        • Choi S.W.
        • Reise S.P.
        • Stover A.M.
        • Riley W.T.
        • Cella D.
        Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): depression, anxiety, and anger.
        Assessment. 2011; 18: 263-283
        • Hays R.D.
        • Sherbourn C.D.
        • Mazel R.
        User’s manual for the Medical Outcomes Study (MOS) core measures of health-related quality of life.
        RAND Corporation, Santa Monica1995
        • Lawton M.P.
        • Kleban M.H.
        • Moss M.
        • Rovine M.
        • Glicksman A.
        Measuring caregiving appraisal.
        J Gerontol. 1989; 44: P61-P71
        • Zarit S.H.
        • Reever K.E.
        • Bach-Peterson J.
        Relatives of the impaired elderly: correlates of feelings of burden.
        Gerontologist. 1980; 20: 649-655
        • Malec J.F.
        • Kragness M.
        • Evans R.W.
        • Finlay K.L.
        • Kent A.
        • Lezak M.D.
        Further psychometric evaluation and revision of the Mayo-Portland Adaptability Inventory in a national sample.
        J Head Trauma Rehabil. 2003; 18: 479-492
        • Carlozzi N.E.
        • Kallen M.A.
        • Hanks R.
        • et al.
        The TBI-CareQOL measurement system: development and preliminary validation of health-related quality of life measures for caregivers of civilians and service members/veterans with traumatic brain injury.
        Arch Phys Med Rehabil. 2019; 100: S1-S12
        • Bulmer M.G.
        Principles of statistics.
        Dover Publications, New York1979
        • Cohen J.
        Statistical power analysis for the behavioral sciences.
        2nd ed. Academic Press, New York1988
        • DeVellis R.
        Scale development: theory and applications.
        4th ed. Sage, Los Angeles2017
        • Cramer D.
        • Howitt D.L.
        The Sage dictionary of statistics.
        Sage, Thousand Oaks, CA2004
        • Andresen E.M.
        Criteria for assessing the tools of disability outcomes research.
        Arch Phys Med Rehabil. 2000; 81: S15-S20
        • Campbell D.T.
        • Fiske D.W.
        Convergent and discriminant validation by the multitrait-multimethod matrix.
        Psychol Bull. 1959; 56: 81-105
        • DeVellis R.F.
        Classical test theory.
        Med Care. 2006; 44: S50-S59
        • Malec J.
        The Center for Outcome Measurement in Brain Injury. The Mayo-Portland Adaptability Inventory.
        (Available at:) (Accessed July 27, 2017)
        • Hahn E.A.
        • Dewalt D.A.
        • Bode R.K.
        • et al.
        New English and Spanish social health measures will facilitate evaluating health determinants.
        Health Psychol. 2014; 33: 490-499
        • Heaton R.K.
        • Miller S.W.
        • Taylor J.T.
        • Grant I.
        Revised comprehensive norms for an expanded Halstead-Reitan Battery: demographically adjusted neuropsychological norms for African American and Caucasian adults.
        Psychological Assessment Resources, Inc, Lutz, FL2004
        • Dempster A.P.
        • Laird N.M.
        • Rubin D.B.
        Maximum likelihood from incomplete data via Em algorithm.
        J R Stat Soc Series B Stat Methodol. 1977; 39: 1-38