Advertisement

Diagnostic Accuracy of the Veteran Affairs' Traumatic Brain Injury Screen

Published:January 17, 2018DOI:https://doi.org/10.1016/j.apmr.2017.11.017

      Abstract

      Objective

      To comprehensively estimate the diagnostic accuracy and reliability of the Department of Veterans Affairs (VA) Traumatic Brain Injury (TBI) Clinical Reminder Screen (TCRS).

      Design

      Cross-sectional, prospective, observational study using the Standards for Reporting of Diagnostic Accuracy criteria.

      Setting

      Three VA Polytrauma Network Sites.

      Participants

      Operation Iraqi Freedom, Operation Enduring Freedom veterans (N=433).

      Main Outcome Measures

      TCRS, Comprehensive TBI Evaluation, Structured TBI Diagnostic Interview, Symptom Attribution and Classification Algorithm, and Clinician-Administered Posttraumatic Stress Disorder (PTSD) Scale.

      Results

      Forty-five percent of veterans screened positive on the TCRS for TBI. For detecting occurrence of historical TBI, the TCRS had a sensitivity of .56 to .74, a specificity of .63 to .93, a positive predictive value (PPV) of 25% to 45%, a negative predictive value (NPV) of 91% to 94%, and a diagnostic odds ratio (DOR) of 4 to 13. For accuracy of attributing active symptoms to the TBI, the TCRS had a sensitivity of .64 to .87, a specificity of .59 to .89, a PPV of 26% to 32%, an NPV of 92% to 95%, and a DOR of 6 to 9. The sensitivity was higher for veterans with PTSD (.80–.86) relative to veterans without PTSD (.57–.82). The specificity, however, was higher among veterans without PTSD (.75–.81) relative to veterans with PTSD (.36–.49). All indices of diagnostic accuracy changed when participants with questionably valid (QV) test profiles were eliminated from analyses.

      Conclusions

      The utility of the TCRS to screen for mild TBI (mTBI) depends on the stringency of the diagnostic reference standard to which it is being compared, the presence/absence of PTSD, and QV test profiles. Further development, validation, and use of reproducible diagnostic algorithms for symptom attribution after possible mTBI would improve diagnostic accuracy.

      Keywords

      List of abbreviations:

      AOC (alteration of consciousness), BTBIS (Brief Traumatic Brain Injury Screen), CAPS (Clinician-Administered PTSD Scale), CTBIE (Comprehensive TBI Evaluation), DOR (diagnostic odds ratio), LOC (loss of consciousness), mTBI (mild traumatic brain injury), NPV (negative predictive value), OEF/OIF (Operation Enduring Freedom and Operation Iraqi Freedom), PCL (PTSD Checklist), PCL-M (PTSD Checklist–Military), PPV (positive predictive value), PTSD (posttraumatic stress disorder), QV (questionably valid), SACA (Symptom Attribution and Classification Algorithm), STDI (Structured TBI Diagnostic Interview), TBI (traumatic brain injury), TCRS (TBI Clinical Reminder Screen), VA (Veterans Affairs)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Donnelly K.
        • Donnelly J.
        • Dunnam M.
        • et al.
        Reliability, sensitivity and specificity of the VA traumatic brain injury screening tool.
        J Head Trauma Rehabil. 2011; 26: 439-453
        • Cifu D.
        • Cohen M.
        • Lew H.
        • Jaffee M.
        • Sigford B.
        The history and evolution of traumatic brain injury rehabilitation in military service members and veterans.
        Am J Phys Med Rehabil. 2010; 89: 688-693
        • Schwab K.A.
        • Ivins B.
        • Cramer G.
        • et al.
        Screening for traumatic brain injury in troops returning from deployment in Afghanistan and Iraq: initial investigation of the usefulness of a short screening tool for traumatic brain injury.
        J Head Trauma Rehabil. 2007; 22: 377-389
        • Schwab K.A.
        • Baker G.
        • Ivins B.J.
        • Sluss-Tiller M.
        • Lux W.
        • Warden D.
        The Brief Traumatic Brain Injury Screen (BTBIS): investigating the validity of a self-report instrument for detecting traumatic brain injury (TBI) in troops returning from deployment in Afghanistan and Iraq.
        Neurology. 2006; 66: A235
        • Zollman F.S.
        • Starr C.
        • Kondiles B.
        • Cyborski C.
        • Larson E.B.
        The Rehabilitation Institute of Chicago Military Traumatic Brain Injury Screening Instrument: determination of sensitivity, specificity, and predictive value.
        J Head Trauma Rehabil. 2014; 29: 99-107
        • Terrio H.P.
        • Nelson L.A.
        • Betthauser L.M.
        • Harwood J.E.
        • Brenner L.A.
        Postdeployment traumatic brain injury screening questions: sensitivity, specificity, and predictive values in returning soldiers.
        Rehabil Psychol. 2011; 56: 26-31
        • Belanger H.G.
        • Vanderploeg R.D.
        • Soble J.R.
        • Richardson M.
        • Groer S.
        Validity of the Veterans Health Administration's traumatic brain injury screen.
        Arch Phys Med Rehabil. 2012; 93: 1234-1239
        • Belanger H.G.
        • Vanderploeg R.D.
        • Sayer N.
        Screening for remote history of mild traumatic brain injury in VHA: a critical literature review.
        J Head Trauma Rehabil. 2016; 31: 204-214
        • United States Government Accountability Office
        VA Healthcare: mild traumatic brain injury screening and evaluation implemented for OEF/OIF veterans, but challenges remain Washington: US Government.
        2008
        • Pape T.L.
        • High Jr., W.M.
        • St Andre J.
        • et al.
        Diagnostic accuracy studies in mild traumatic brain injury: a systematic review and descriptive analysis of published evidence.
        PM R. 2013; 5: 856-881
        • Bossuyt B.
        Interpreting diagnostic test accuracy studies.
        Semin Hematol. 2008; 45: 189-195
        • Bossuyt P.
        • Reitsma J.
        • Bruns D.
        • et al.
        Standards for Reporting of Diagnostic Accuracy. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD Initiative.
        Clin Chem. 2003; 49: 1-6
        • American Congress of Rehabilitation Medicine
        Definition of mild traumatic brain injury.
        J Head Trauma Rehabil. 1993; 8: 86-87
        • Scholten J.
        • Sayer N.
        • Vanderploeg R.
        • Bidelspach D.
        • Cifu D.
        Analysis of US Veterans Health Administration comprehensive evaluations for traumatic brain injury in Operation Enduring Freedom and Operation Iraqi Freedom veterans.
        Brain Inj. 2012; 26: 1177-1184
        • Belanger H.G.
        • Uomoto J.M.
        • Vanderploeg R.D.
        The Veterans Health Administration's (VHA's) Polytrauma System of Care for mild traumatic brain injury: costs, benefits, and controversies.
        J Head Trauma Rehabil. 2009; 24: 4-13
        • Sigford B.
        “To care for him who shall have borne the battle and for his widow and his orphan” (Abraham Lincoln): the Department of Veterans Affairs Polytrauma System of Care.
        Arch Phys Med Rehabil. 2008; 89: 160-162
        • Pape T.L.
        • Herrold A.A.
        • Smith B.
        • et al.
        Algorithm for symptom attribution and classification following possible mild traumatic brain injury.
        J Head Trauma Rehabil. 2016; 31: E10-E22
        • Inman T.H.
        • Berry D.T.
        Cross-validation of indicators of malingering: a comparison of nine neuropsychological tests, four tests of malingering, and behavioral observations.
        Arch Clin Neuropsychol. 2002; 17: 1-23
        • Weathers F.W.
        • Keane T.M.
        • Davidson J.R.
        Clinician-Administered PTSD Scale: a review of the first ten years of research.
        Depress Anxiety. 2001; 13: 132-156
        • Arbisi P.
        • Ben-Porath Y.
        • McNulty J.
        The ability of the MMPI-2 to detect feigned PTSD within the context of compensation seeking.
        Psychol Serv. 2006; 3: 249-261
        • Cicerone K.
        • Kalamar K.
        Persistent post-concussion syndrome: the structure of subjective complaints after mild traumatic brain injury.
        J Head Trauma Rehabil. 1995; 10: 1-17
        • Bazarian J.J.
        • Donnelly K.
        • Peterson D.R.
        • Warner G.C.
        • Zhu T.
        • Zhong J.
        The relation between posttraumatic stress disorder and mild traumatic brain injury acquired during Operations Enduring Freedom and Iraqi Freedom.
        J Head Trauma Rehabil. 2013; 28: 1-12
        • National Center for Injury Prevention and Control
        Report to Congress on mild traumatic brain injury in the United States: steps to prevent a serious public health problem.
        Centers for Disease Control and Prevention, Atlanta2003
        • Blake D.
        • Weathers F.
        • Nagy L.
        • et al.
        The development of a Clinician-Administered PTSD Scale.
        J Trauma Stress. 1995; 8: 75-90
        • American Psychiatric Association
        Diagnostic and Statistical Manual of Mental Disorders (DSM-V).
        American Psychiatric Association, Washington (DC)2013
        • Weathers F.W.
        • Blake D.D.
        • Schnurr P.P.
        • Kaloupek D.G.
        • Marx B.P.
        • Keane T.M.
        The Clinician-Administered PTSD Scale for DSM-5 (CAPS-5).
        (Available at:) (Accessed October 15, 2016)
        • Glas A.S.
        • Lijmer J.G.
        • Prins M.H.
        • Bonsel G.J.
        • Bossuyt P.M.
        The diagnostic odds ratio: a single indicator of test performance.
        J Clin Epidemiol. 2003; 56: 1129-1135
        • Fortier C.B.
        • Amick M.M.
        • Kenna A.
        • Milberg W.P.
        • McGlinchey R.E.
        Correspondence of the Boston Assessment of Traumatic Brain Injury-Lifetime (BAT-L) clinical interview and the VA TBI screen.
        J Head Trauma Rehabil. 2015; 30: E1-E7
        • Vanderploeg R.D.
        • Belanger H.G.
        Stability and validity of the Veterans Health Administration's Traumatic Brain Injury Clinical Reminder Screen.
        J Head Trauma Rehabil. 2015; 30: E29-E39
        • Gordis L.
        Epidemiology.
        Saunders, Philadelphia2009
        • Hui S.L.
        • Walter S.D.
        Estimating the error rates of diagnostic tests.
        Biometrics. 1980; 36: 167-171
        • Collins J.
        • Huynh M.
        Estimation of diagnostic test accuracy without full verification: a review of latent class methods.
        Stat Med. 2014; 33: 4141-4169
        • Dickstein B.D.
        • Weathers F.W.
        • Angkaw A.C.
        • et al.
        Diagnostic utility of the Posttraumatic Stress Disorder (PTSD) Checklist for identifying full and partial PTSD in active-duty military.
        Assessment. 2015; 22: 289-297
        • Vanderploeg R.D.
        • Cooper D.B.
        • Belanger H.G.
        • et al.
        Screening for postdeployment conditions: development and cross-validation of an embedded validity scale in the Neurobehavioral Symptom Inventory.
        J Head Trauma Rehabil. 2014; 29: 1-10
        • Kim E.
        • Lauterbach E.C.
        • Reeve A.
        • et al.
        Neuropsychiatric complications of traumatic brain injury: a critical review of the literature (a report by the ANPA Committee on Research).
        J Neuropsychiatry Clin Neurosci. 2007; 19: 106-127
        • McHugo G.J.
        • Krassenbaum S.
        • Donley S.
        • Corrigan J.D.
        • Bogner J.
        • Drake R.E.
        The prevalence of traumatic brain injury among people with co-occurring mental health and substance use disorders.
        J Head Trauma Rehabil. 2017; 32: E65-E74
        • Olson-Madden J.H.
        • Brenner L.A.
        • Matarazzo B.B.
        • Signoracci G.M.
        Identification and treatment of TBI and co-occurring psychiatric symptoms among OEF/OIF/OND veterans seeking mental health services within the state of Colorado: establishing consensus for best practices.
        Community Ment Health J. 2013; 49: 220-229
        • Brenner L.A.
        • Homaifar B.Y.
        • Olson-Madden J.H.
        • et al.
        Prevalence and screening of traumatic brain injury among veterans seeking mental health services.
        J Head Trauma Rehabil. 2013; 28: 21-30
        • Terrio H.
        Traumatic brain injury screening: preliminary findings in a US army brigade combat team.
        J Head Trauma Rehabil. 2009; 24: 14-23
        • Bliese P.D.
        • Wright K.M.
        • Adler A.B.
        • Cabrera O.
        • Castro C.A.
        • Hoge C.W.
        Validating the primary care Posttraumatic Stress Disorder Screen and the Posttraumatic Stress Disorder Checklist with soldiers returning from combat.
        J Consult Clin Psychol. 2008; 76: 272-281
        • Arbisi P.A.
        • Kaler M.E.
        • Kehle-Forbes S.M.
        • Erbes C.R.
        • Polusny M.A.
        • Thuras P.
        The predictive validity of the PTSD Checklist in a nonclinical sample of combat-exposed National Guard troops.
        Psychol Assess. 2012; 24: 1034-1040
        • Sumpter R.E.
        • McMillan T.M.
        Misdiagnosis of post-traumatic stress disorder following severe traumatic brain injury.
        Br J Psychiatry. 2005; 186: 423-426
        • IOM
        Returning home from Iraq and Afghanistan: preliminary assessment of readjustment needs of veterans, service members, and their families.
        The National Academies Pr, Washington (DC)2010
        • Corrigan J.D.
        • Bogner J.
        Initial reliability and validity of the Ohio State University TBI Identification Method.
        J Head Trauma Rehabil. 2007; 22: 318-329
        • Bogner J.
        • Corrigan J.D.
        Reliability and predictive validity of the Ohio State University TBI Identification Method with prisoners.
        J Head Trauma Rehabil. 2009; 24: 279-291
        • Corrigan J.D.
        • Bogner J.
        • Holloman C.
        Lifetime history of traumatic brain injury among persons with substance use disorders.
        Brain Inj. 2012; 26: 139-150
        • Ferguson P.L.
        • Pickelsimer E.E.
        • Corrigan J.D.
        • Bogner J.A.
        • Wald M.
        Prevalence of traumatic brain injury among prisoners in South Carolina.
        J Head Trauma Rehabil. 2012; 27: E11-E20