| | Comparison of the Traumatic Brain Injury (TBI) Model Systems National Dataset to a Population-Based Cohort of TBI HospitalizationsAbstract Corrigan JD, Selassie AW, Lineberry LA, Millis SR, Wood KD, Pickelsimer EE, Rosenthal M. Comparison of the Traumatic Brain Injury (TBI) Model Systems national dataset to a population-based cohort of TBI hospitalizations. ObjectiveTo determine whether severity alone accounts for differences observed between a population-based cohort of acute care hospitalizations for traumatic brain injury (TBI) and the Traumatic Brain Injury Model Systems (TBIMS) national dataset. DesignProspective cohort. SettingAcute care hospitals in South Carolina and TBIMS rehabilitation centers. ParticipantsSubjects enrolled in the TBIMS national dataset and the South Carolina TBI Follow-up Registry (SCTBIFR). InterventionsNot applicable. Main Outcome MeasuresComparable variables in the 2 datasets included demographic characteristics, etiology of injury, initial Glasgow Coma Scale score, Abbreviated Injury Scale score for the head region derived from International Classification of Diseases codes, presence of computed tomography (CT) abnormalities, acute hospital length of stay, and payer source. ResultsAs hypothesized, TBIMS participants showed greater initial injury severity, frequency of abnormal CT scans, and longer lengths of acute care hospitalization, explaining over 75% of cohort membership. Counter to a priori hypotheses, when all other factors were held constant, there were also differences in racial and ethnic background and insurance payer source. ConclusionsDifferences between the TBIMS cohort and patients acutely hospitalized with TBI are primarily due to injury severity; however, an additional difference in payer source may need to be taken into account when generalizing findings. Results showed that TBIMS and SCTBIFR datasets are complementary, each having different strengths for understanding factors that impact long-term recovery after TBI. Recommendations are made for methodologic improvements in both data collection for the TBIMS and future outcome surveillance. WITHIN THE PAST 25 years, traumatic brain injury (TBI) has emerged as a leading cause of disability in the United States and other parts of the world. Recent estimates by the Centers for Disease Control and Prevention (CDC) indicate that approximately 5.3 million Americans are living with a TBI-related disability, with 80,000 to 90,000 more people annually incurring long-term disability as a result of these injuries.1 The paucity of population-based studies, or large, multisite long-term outcomes studies, has limited the capabilities of the health care systems in the United States to recognize and address the multifaceted needs of persons with disability due to TBI and their families.2 Both CDC3 and the National Institutes of Health2 have called for additional resources to allow long-term and population-based studies that will provide a basis for solving the larger societal issues resulting from this so-called “silent epidemic.” The Traumatic Brain Injury Model Systems (TBIMS) has been funded by the National Institute on Disability and Rehabilitation Research (NIDRR), U.S. Department of Education, since 1987. At the core of this program is a prospective, multicenter, longitudinal data collection protocol allowing research on the course of recovery and long-term outcomes after TBI. The TBIMS has been a substantial source of research on acute rehabilitation and long-term outcomes for people with TBI. TBIMS researchers have generated over 500 peer-reviewed articles since the inception of the program. The TBIMS dataset, and outcome measures derived from it, are increasingly used by researchers as a basis of comparison.4, 5 The TBIMS program has consisted of rehabilitation centers in the United States that are successful in funding competitions held every 5 years. Although selection of sites on a competitive basis may be an advantage both in the volumes of subjects available and the output from collaborators, a resulting weakness is that the TBIMS national dataset is not population based.6 The TBIMS inclusion criteria limit the dataset to persons 16 years and older who receive comprehensive inpatient rehabilitation as part of a systematic continuum of care, including acute neurotrauma services in a designated TBIMS center. Within the parameters of the inclusion criteria, the cohort is determined by the referral patterns for the participating centers. Because centers are not selected based on population sampling, the cohort in the national dataset cannot be presumed to be representative of the entire population of patients receiving acute rehabilitation for TBI in the United States. Ideally, to determine how representative the TBIMS cohort is, a comparison would be conducted between the TBIMS dataset and population-based data for patients receiving acute rehabilitation for TBI. Unfortunately, we have found no population-based data for making such a comparison. Corrigan and Thurman6 observed this deficiency, and suggested that population-based TBI surveillance sponsored by the National Center for Injury Prevention and Control at CDC may provide an opportunity to gain insight into TBIMS sample characteristics by comparing selected premorbid, injury-related, and follow-up indices with population-based estimates of the same variables. Since 1995, CDC has supported a multistate system for surveillance of acute hospitalization for TBI. Currently, 12 participating state health departments collect statewide information on TBI-related hospital admissions and deaths in order to describe the epidemiology of these injuries and improve TBI prevention efforts. In addition, CDC has supported follow-up TBI registries in 2 states in order to study outcomes up to 3 years after hospitalization in a representative sample of patients with TBI, age 15 and older. Although CDC’s follow-up registries appear to provide a means for evaluating the representativeness of the TBIMS national dataset, the cohorts of patients differ in 1 fundamental characteristic—CDC follow-up registry patients received acute hospitalization for an injury that includes TBI, whereas the TBIMS patients have been admitted for acute rehabilitation. Persons hospitalized with TBI who are transferred to acute rehabilitation have TBI of greater initial severity than those who receive acute hospital care only.7 Thus, when comparing injury-related characteristics, the a priori expectation would be that the TBIMS cohort will differ in the severity of injury from the population of patients hospitalized. Consequent differences also might be observed in cause of injury, premorbid conditions, or age, at least when injury severity is not taken into account via statistical techniques. When cohorts are defined by the medical care received, there can also be differences that reflect the social and economic exigencies of the service delivery systems from which the cohorts are captured. In the case of TBI, greater severity of injury will be represented in the sample when cohorts are drawn from hospital emergency departments, acute hospital admissions, or comprehensive acute rehabilitation programs, respectively. Social and economic differences affecting service system use might result in observed differences for income, education, insurance status, or racial and ethnic minority status. The extent of these secondary influences on the composition of the rehabilitation population is not known. In the current project, we sought to evaluate the representativeness of the TBIMS national dataset by determining whether severity alone accounts for differences observed between it and a cohort based on acute hospitalization for TBI, specifically the South Carolina TBI Follow-up Registry (SCTBIFR). Several characteristics of the SCTBIFR make it a desirable cohort for this comparison. First, public health researchers have developed a population-based TBI surveillance system that captures all patients with a primary or secondary diagnosis of TBI who are discharged from all 62 nonfederal, acute care hospitals in the state. The system is legally mandated to collect information on all persons with TBI, thus assuring population-wide coverage. Second, the state has developed and maintained a TBI follow-up registry since 1998 in order to study a representative sample of persons with TBI identified in the surveillance database. This sample provides a basis for comparison along variables that are not available from hospital discharge data. Third, as is evident in table 1, the demographic and etiologic distributions of TBI in South Carolina are comparable with the distributions of the entire United States as determined from the National Hospital Discharge Survey.1 South Carolina has a higher percentage of blacks and persons eligible for Medicaid than the nation, and fewer people from Hispanic backgrounds.8 Finally, a number of variables in the SCTBIFR are comparable with the variables in the TBIMS, thus allowing systematic comparison. Our a priori hypotheses were that the TBIMS and SCTBIFR cohorts would differ significantly in the initial severity of TBI, as well as variables directly associated with severity, specifically the presence of abnormal computed tomography (CT) findings and the length of stay (LOS) in the acute care hospital. When severity-related differences are accounted for, we did not expect other demographic or injury-related differences between the 2 cohorts. Methods  The primary objectives of the TBIMS are to: (1) develop and demonstrate a model system of care for persons with TBI, stressing continuity and comprehensiveness of care; (2) track the long-term outcomes of persons who go through these systems; and (3) establish and maintain a centralized, standardized database designed to achieve the first 2 objectives. Prior to 1998, no more than 5 centers were funded for participation in the TBIMS national dataset. In 1998, 12 new centers were funded, increasing enrollment in the dataset to approximately 500 new cases per year. Since 2002, 16 centers have been funded throughout the United States. Although each local TBIMS center has unique attributes, the common denominator throughout the program is that all research participants experience both acute care and acute inpatient rehabilitation within designated hospitals in the local system of care. In addition, all centers collect a common core dataset consisting of variables that characterize the participant throughout inpatient care and at follow-up intervals. The dataset includes demographic and injury-related characteristics; diagnoses; selected medical, neuropsychologic, and psychologic conditions; and functional outcomes, including quality of life and community integration. The core dataset has varied over the years and currently consists of 112 variables collected during initial hospitalization and 88 variables collected at follow-up years 1, 2, 5, and every 5 years thereafter. The definition of TBI used for the TBIMS national dataset has been based on the CDC’s original case definition: “damage to brain tissue caused by an external mechanical force, as evidenced by loss of consciousness due to brain trauma, posttraumatic amnesia, skull fracture, or objective neurologic findings that can be reasonably attributed to TBI on physical examination or mental status examination.”9(p2) Eligible research participants provide informed consent (or have consent provided by an authorized proxy). After consent, a subject’s acute hospital medical record is abstracted for information about injury-related characteristics, timing of milestones in recovery of consciousness, and medical complications encountered. Data are collected contemporaneously during the comprehensive rehabilitation stay, and include demographic characteristics, premorbid functioning, functional status at admission and discharge, and cost of services received. The follow-up interviews include sociodemographic status, subsequent injury and hospitalization, functional independence, employment, substance use, and subjective well-being. At the time of the present study, the TBIMS database included over 5000 participants. CDC’s TBI surveillance activities have the overarching purpose of collecting data from acute care hospitals to ascertain the incidence, etiology, risk factors, severity, and outcomes of TBI in a statewide population.3 In accordance with the CDC case definition, TBI is defined for surveillance purposes as any discharge with a primary or secondary diagnosis of skull fracture and/or intracranial injury, including concussion.11, 12 Acknowledging a need to acquire additional information about TBI outcomes, in 1995 CDC funded the Colorado Department of Public Health and Environment to conduct population-based follow-up of residents hospitalized with a diagnosis of TBI. In 1998, CDC funded the South Carolina Department of Health and Environmental Control as the second state to implement a statewide TBI follow-up system. The SCTBIFR became an extension to South Carolina’s surveillance of persons who are hospitalized in acute care facilities or treated and released from the emergency department after acquiring TBI. SCTBIFR’s specific objectives were: (1) to determine the proportion of persons with TBI who report cognitive, behavioral and emotional, and neurosomatic deficits during the follow-up period, (2) to identify specific functional limitations (disability) by person and injury characteristics, (3) to determine level of life satisfaction, (4) to assess the mortality experience of the cohort during the follow-up period, and (5) to identify unmet needs and barriers to receiving services. SCTBIFR defined a case of TBI in accordance with the CDC case definition for TBI.11, 12 For case identification purposes, nature of injury codes (N-codes) 800.0–801.9, 803.0–804.9, 850.0–854.1, and 959.01 from the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM), were included. The SCTBIFR cohort comprised a random sample of all persons, age 15 and older, in the South Carolina TBI Surveillance System who were discharged alive from acute care hospitals in the previous year. Potential participants were stratified into high (Abbreviated Injury Scale [AIS] score for the head ≥3) or low (AIS head score of 2) TBI severity. The initial sample had a sampling ratio of 2:1 high to low severity. Health information specialists from the South Carolina Department of Health and Environmental Control acquired extended variables from the eligible participants’ hospital medical records to validate the existing data and to gather predischarge history and additional medical information. SCTBIFR conducted the first annual interview approximately 12 months after the participant’s hospital discharge. The domains assessed included general health status, pre-existing health conditions, difficulties performing activities of daily living and instrumental activities of daily living, depressive symptoms, services and unmet needs, alcohol and drug use, pre- and postinjury employment, living situation, marital status, education level, health insurance coverage, personal income, transportation, life satisfaction, cognition, social integration, and social support. The SCTBIFR eligible sample consisted of 3715 of 9688 randomly selected patients discharged from acute care facilities from January 1, 1999, through June 30, 2002. First year follow-up interviews were conducted on 2118 participants from May 2000 through July 2003. Proxy respondents reported for 285 participants. We used the 1-year cohorts for both the SCTBIFR and the TBIMS for this study. The limited number of variables available from hospital discharge data used in the South Carolina TBI Surveillance System are augmented through medical record review. At follow-up, cases included in the SCTBIFR had substantially more data collected including variables necessary for the comparisons needed in the current study. For the SCTBIFR, 43% of the participants eligible for follow-up could not be located, refused to participate, died, became incarcerated, or otherwise were unable to complete the follow-up interview. Characteristics of nonrespondents were accounted for in the weighting of the year 1 cohort.12 Effects of potential bias due to loss to follow-up were further mitigated by also using the year 1 follow-up cohort for the TBIMS, which had a 74.6% follow-up rate. Based on Corrigan et al,13 comparison of dropout rates among 3 longitudinal studies, including the TBIMS, variables most likely to be associated with loss to follow-up were socioeconomic disadvantage, a history of substance abuse, and a violent injury etiology. They also observed that severe motor deficits made it more likely that a person will be found for follow-up after 1 year. To integrate the SCTBIFR and TBIMS datasets, we developed a process to determine which variables in both datasets were comparable. Working from codebooks of variables for each program, we further examined those with apparently similar domains for their actual content and methods used to elicit responses. Corresponding levels for comparable variables in each dataset, including instances in which levels were combined to establish equivalence, were identified for an integrated dataset. A variable was created from available information to indicate whether a participant was expected to be working prior to their injury (whether or not they actually were). A participant was expected to be working if they were between the ages of 18 and 65, were not a student, homemaker, resident of specialized housing, or retired and not working. Prior competitive employment was defined as the number of hours worked per week before their injury for participants expected to be working (if not expected, competitive employment was shown as missing rather than zero). Postinjury competitive employment was the number of hours worked per week after their injury, again, if they were expected to be working. For each case, we determined injury severity by translating the ICD-9-CM diagnosis codes into an AIS score for the head region using ICDMAP-90 software.a ICDMAP-90 is severity scoring software that computes the severity of the trauma from ICD-9-CM nature of injury codes using an internal translation scheme that takes the patient’s age and clinical descriptors (the fifth digits of ICD-9-CM codes) into account.14 When the fifth digit was missing, we assigned the least severe rating. The AIS classifies over 2000 injuries according to the body region of injury (eg, head, chest, extremity), type of structure injured (eg, nerve, vessel, bone), location of injury within the body region (eg, femur, tibia, talus), and nature of injury (eg, abrasion, burn, crush).14 Consistent with the manually assigned AIS, ICDMAP-90 derived AIS scores grade each injury according to its associated threat to life on an ordinal scale from 1 (minor) to 6 (unsurvivable).14, 15, 16 Analysis Some categories within variables were combined into meaningful groups to reduce the likelihood of disproportionate distributions between and within the 2 cohorts. The effects of these decisions were evaluated by splitting the integrated dataset into test and validation sets, then conducting repetitive analyses under different groupings of the variables and model assumptions. When categorizing continuous variables resulted in loss of information, or when model assumptions required continuous data, variables were left as both continuous and categorical. Missing and unknown data were ignored when missingness appeared to be at random (no biasing factor was observed between the 2 sources of data). We measured associations using chi-square tests to compare nominal and categorical variables and Student t test and analysis of variance were used to compare the means of continuous data between the data sources. Decision rules for statistical significance were based on a P value of α less than .05. In addition, a P value and 95% confidence interval (CI) were generated for the point estimates. Explanatory multivariable analysis was used, using logistic regression, to determine which variables best explained cohort membership between the 2 datasets while controlling for other variables in the model. Given that our intent was to understand the influence of each variable in describing cohort membership, after ruling out multicolinearity with a test of tolerance, all variables were entered simultaneously under the assumption of equal importance.17 The least significant variables were eliminated one at a time using the Wald test P values and the log likelihood chi-square test. A model was considered final when further elimination of a variable attained significance. Interaction terms were evaluated in stratified analysis and incorporated in the logistic analysis. An interaction term was deemed significant when Wald test P values were less than .05. The predictive validity and fit of the model were evaluated with max rescaled R2 and the Hosmer-Lemeshow test, respectively.17, 18 Results  Univariate Comparisons Comparisons between crude frequencies for the 2 cohorts were computed for 21 variables. Results of these univariate comparisons are shown in table 2. Analyses revealed multiple differences between the SCTBIFR and TBIMS cohorts. SCTBIFR had greater numbers of Medicare and uninsured patients, whereas the TBIMS had greater numbers of Medicaid patients. A significant difference in education was observed for the unknown category, with the TBIMS having a higher rate. The 2 cohorts differed significantly for persons expected to be working, with 75% of the TBIMS cohort expected to be working, whereas 60% were expected in the SCTBIFR. The 2 cohorts were similar in marital status, though the SCTBIFR cohort had more persons who had been widowed, whereas the TBIMS had more persons who had never been married. Differences in age for the 2 cohorts appeared to be a primary contributor to these differences. | | |  | Variables | SCTBIFR (N=2118) | TBIMS (N=3125) |  |
|---|
 | % | 95% CI | % | 95% CI |  |
|---|
 | Age (y) | | | | |  |  | 15−19 | 15.5 | 12.9–18.1 | 16.3 | 13.7–18.9 |  |  | 20−24 | 10.6 | 8.2–13.0 | 16.0 | 13.6–18.4 |  |  | 25−34 | 13.2 | 10.6–15.8 | 19.0 | 16.4–21.6 |  |  | 35−44 | 14.7 | 12.0–17.4 | 19.6 | 16.9–22.3 |  |  | 45−54 | 13.7 | 11.2–16.2 | 13.1 | 10.6–15.6 |  |  | 55−64 | 8.8 | 6.8–10.8 | 7.8 | 5.8–9.8 |  |  | 65−74 | 8.6 | 6.8–10.4 | 4.5 | 2.7–6.3 |  |  | 75+ | 15.0 | 12.8–17.2 | 3.6 | 1.4–5.8 |  |  | Mean (95% CI) | 44.9 | 43.9–45.7 | 36.7 | 35.6–37.8 |  |  | Sex | | | | |  |  | Male | 60.6 | 57.2–64.0 | 72.6 | 69.2–76.0 |  |  | Female | 39.4 | 36.0–42.9 | 27.4 | 24.0–30.8 |  |  | Race | | | | |  |  | White | 76.4 | 73.4–79.6 | 67.4 | 64.2–70.6 |  |  | Black | 21.2 | 18.2–24.2 | 22.8 | 19.8–25.8 |  |  | Asian | 0.4 | −0.4 to 1.2 | 2.4 | 1.6–3.2 |  |  | Hispanic | 1.8 | 0.5–3.1 | 6.0 | 4.7–7.3 |  |  | Other | 0.3 | −0.2 to 0.9 | 1.5 | 0.9–2.1 |  |  | Payer | | | | |  |  | Medicare | 24.4 | 21.7–27.1 | 8.5 | 5.8–11.2 |  |  | Medicaid | 14.3 | 11.5–17.1 | 26.5 | 23.6–29.2 |  |  | Worker’s compensation | 3.7 | 2.2–5.2 | 5.8 | 4.3–7.3 |  |  | Other government | 1.5 | 0.7–2.3 | 0.7 | −0.1 to 1.5 |  |  | Private/commercial | 43.5 | 39.9–47.1 | 50.2 | 46.6–53.8 |  |  | Uninsured | 12.0 | 10.0–14.0 | 4.2 | 2.2–6.2 |  |  | Other | 0.6 | −0.4 to 1.6 | 4.1 | 3.1–5.1 |  |  | Education | | | | |  |  | ≤8y | 9.3 | 7.3–11.3 | 6.7 | 4.7–8.7 |  |  | 9−11y | 24.2 | 21.1–27.3 | 25.0 | 21.9–28.1 |  |  | 12y or GED | 32.8 | 29.4–36.2 | 30.9 | 27.5–34.3 |  |  | Some college | 21.3 | 18.3–24.3 | 23.1 | 20.1–26.1 |  |  | College graduate | 11.7 | 9.4–14.0 | 10.3 | 8.0–12.6 |  |  | Unknown | 0.7 | −0.4 to 1.8 | 4.0 | 3.0–5.0 |  |  | Expected to be working preinjury | | | | |  |  | Yes | 59.9 | 56.5–63.3 | 75.9 | 72.5–79.3 |  |  | No | 40.1 | 36.7–43.5 | 24.1 | 20.7–24.5 |  |  | Marital status | | | | |  |  | Married | 37.5 | 32.3–39.1 | 31.2 | 27.8–34.6 |  |  | Divorced | 11.2 | 8.9–13.5 | 12.0 | 9.7–13.3 |  |  | Widowed | 11.9 | 9.9–13.9 | 3.2 | 1.2–5.2 |  |  | Separated | 4.4 | 2.9–5.9 | 4.1 | 2.6–5.6 |  |  | Never been married | 36.7 | 33.2–40.2 | 49.6 | 46.0–53.1 |  |  | Cause of injury | | | | |  |  | Vehicular | 51.7 | 48.1–55.3 | 58.1 | 54.5–61.7 |  |  | Violence | 7.9 | 5.7–10.1 | 14.9 | 12.6–17.1 |  |  | Sports | 2.1 | 1.1–3.1 | 1.3 | 0.3–2.3 |  |  | Pedestrian | 2.2 | 0.8–3.6 | 7.2 | 5.8–8.6 |  |  | Fall/flying object | 31.1 | 28.0–34.2 | 17.7 | 14.6–20.8 |  |  | Other | 5.0 | 3.7–6.3 | 0.8 | −0.4 to 2.1 |  |  | AIS head region | | | | |  |  | 2 | 31.2 | 28.2–34.2 | 12.5 | 9.5–15.5 |  |  | 3 | 22.5 | 19.7–25.3 | 11.3 | 8.5–14.1 |  |  | 4 | 42.8 | 39.2–46.4 | 58.6 | 55.0–62.2 |  |  | 5−6 | 3.5 | 1.4–5.6 | 17.6 | 15.5–19.7 |  |  | GCS score | | | | |  |  | 3−8 | 9.8 | 7.3–12.3 | 19.5 | 17.0–22.0 |  |  | 9−12 | 6.4 | 4.5–8.3 | 10.0 | 8.1–11.9 |  |  | 13−15 | 40.6 | 37.2–44.0 | 25.4 | 22.0–28.8 |  |  | Other/unknown | 43.2 | 39.6–46.8 | 45.1 | 41.5–48.7 |  |  | CT | | | | |  |  | Normal | 28.8 | 25.9–31.7 | 10.4 | 7.5–13.3 |  |  | Abnormal | 55.7 | 52.5–58.9 | 79.6 | 76.3–82.9 |  |  | Unknown | 15.5 | 13.3–17.7 | 10.0 | 7.6–12.6 |  |  | Work hours preinjury⁎ | 43.4 | 42.8–44.0 | 31.7 | 30.4–33.0 |  |  | Acute LOS⁎ | 8.1 | 7.3–9.0 | 21.2 | 20.3–22.1 |  | | | |
The 2 cohorts were similar in the proportions injured in vehicular crashes or sports-related incidents. More persons in the TBIMS cohort had been injured by violent means or as pedestrians. In contrast, more persons in the SCTBIFR cohort were injured in falls. The AIS scores differed at all levels, with the SCTBIFR having a higher proportion of AIS 2 and 3 injuries, whereas the TBIMS had a higher proportion of AIS 4, 5, and 6 injuries. For the Glasgow Coma Scale (GCS), the TBIMS had a higher proportion of participants with scores of 3 to 8 and a lower proportion with scores of 13 to 15. The proportion of participants in the TBIMS who did not have a GCS score due to chemical paralysis or intubation was comparable to the SCTBIFR proportion of participants for whom GCS scores were lacking for various reasons. As found with other measures associated with severity, the TBIMS cohort had a larger proportion of participants with an abnormal CT finding, whereas the SCTBIFR had more participants with normal or unknown findings. Comparisons between continuous variables indicated that the mean age was higher for the SCTBIFR, but acute hospital LOS was significantly lower. Among participants expected to be working prior to their injury, the SCTBIFR cohort worked an average of 10 hours more a week prior to their injury. Multivariable Analyses Multivariable analyses allowed comparison between cohorts when all other variables were held constant. As shown in table 3, there were significant differences in cohort membership; however, many of the differences observed in the crude comparisons were no longer significant. The most important variables for distinguishing cohort membership were the severity indices. As one would expect from the composition of the reference populations from which the cohorts were drawn, the TBIMS cohort was more likely to have greater initial injury severity, abnormal CT scan, and extended LOS in acute care than the SCTBIFR cohort. These 3 severity indices as a group explained well over 75% of the cohort membership. The mean acute hospital LOS, after controlling for severity and insurance status, was 20.3 days (95% CI, 19.7−21.0) for TBIMS versus 9.9 days (95% CI, 9.2−10.6) for SCTBIFR. In the multivariable logistic model, the parameter estimate for acute hospital LOS indicated that the TBIMS cohort was twice as likely as the SCTBIFR cohort to have a mean difference of 10 days in acute care hospital stay after adjusting for other covariates. Likewise, the odds of having an abnormal CT scan were 2.4 times higher in the TBIMS cohort than in the SCTBIFR. Initial GCS score was not included in the final multivariable model due to its multicolinearity with AIS scores. Alternative models including either GCS or AIS indicated that the AIS score contributed more to distinguishing cohort membership. Beyond injury severity, the only additional characteristics that had strong explanatory power to differentiate cohort membership were racial and ethnic background and payer status. There was a 1.5 times greater likelihood that a black participant would be a cohort member of the SCTBIFR, whereas Hispanic participants were 4 times more likely to be in the TBIMS. These differences were consistent with ways in which South Carolina differs in racial and ethnic composition from the United States overall, with the TBIMS cohort appearing more similar to national estimates.1 For payer source there was nearly a 5-fold increased likelihood for an SCTBIFR cohort member to be without health insurance when compared with TBIMS participants, and a 2.3 times increased likelihood to be covered under Medicare. There was more than a 3-fold greater likelihood that TBIMS payer source was unknown. There were no significant differences in the likelihood of members of the 2 cohorts having Medicaid or private insurance coverage. The 2 cohorts varied only minimally in other aspects. A difference was observed for cause of injury, with the TBIMS cohort showing a modestly greater likelihood of violence-related etiologies, but the SCTBIFR was slightly more likely to include persons who had fallen or been struck by a flying object. Persons who were expected to be working before sustaining TBI were modestly more likely to be cohort members of TBIMS. Though significant, there was only a slight difference between the cohorts in marital status. A large but uninterpretable difference was evident for participants whose education was unknown. Discussion  A long-expressed concern about the TBIMS has been its sampling strategy and the impact of that strategy on statistical findings from the TBIMS data, especially the extent to which results from the TBIMS reflect the more general population of persons receiving comprehensive rehabilitation for TBI. Our results showed that the TBIMS database differed from the population-based cohort of the SCTBIFR in expected ways, in most respects. The most apparent difference was in injury severity, as assessed by the AIS, GCS, CT scan, and LOS in the acute hospital. Injury severity variables accounted for 75% of the difference in cohort membership. The proportion of TBIMS subjects in the most severe AIS strata was 4 times that for SCTBIFR (17% vs 4%). In contrast, the SCTBIFR had twice the proportion of subjects in the least severe AIS strata (31% vs 14%). Among subjects with GCS scores, the TBIMS had almost twice the proportion of moderate and severe injuries as the SCTBIFR (29% vs 16%). Furthermore, though approximately 45% of both cohorts did not have GCS scores, for the TBIMS subjects the missing values were due to chemical paralysis and intubation, suggesting a much higher proportion of more serious TBI. Although the current study could not empirically test the representativeness of the TBIMS cohort relative to the population of patients receiving acute rehabilitation, it does confirm that severity is the primary source of difference from the population of patients receiving acute hospitalization. Assessing the role of injury severity in these 2 cohorts was complicated by several factors, including the TBIMS and SCTBIFR having emphasized different measures of injury severity and the inherent limitations of all injury severity scales. Although the TBIMS uses the GCS as one of its primary measures of injury severity, the substantial proportion of patients who are acutely intubated or chemically paralyzed complicates use of the standard GCS rating for research purposes. GCS data are essentially missing for this group of TBIMS participants. In the SCTBIFR, a similarly high rate of missing GCS data occurs because the data are not present in the medical record. Although the GCS has been quite useful in predicting mortality and identifying patients more likely to benefit from trauma care, it has been somewhat more limited in predicting functional outcome.19, 20 In addition, GCS is dynamic, changing dramatically during the early, acute phase. There can be substantial variability due simply to how and when GCS is collected, adding “noise” to GCS data. In contrast, with the ability to convert ICD-9-CM diagnoses into AIS scores for the head, this indicator of severity was available for the vast majority of subjects in both cohorts. We observed variability across TBIMS centers in the thoroughness of ICD coding—some centers submitted more ICD codes per case than others. Additionally, not all centers routinely provided the fifth digit subclassification in the ICD coding. It is not possible to convert ICD codes that are missing fifth digit without making assumptions (in our case by using the lowest severity) about the underlying injury severity that cannot be independently verified. These factors may have decreased the precision of the AIS in the current analyses. Although the greater completeness of the AIS variable makes it far more suitable for statistical modeling, questions remain regarding whether it has predictive utility to assess long-term disability. The results clearly suggest that the TBIMS should further evaluate both the methodology and the utility of the AIS as calculated with ICDMAP-90 software. Although the AIS has been shown to be associated with mortality, LOS, and return to employment, it has not been widely used in medical rehabilitation. The TBIMS database would benefit from another index of injury severity that is both valid and available for most participants. A compelling reason is the inability to assess GCS when patients are intubated, chemically paralyzed, heavily intoxicated, and when there are massive craniofacial injuries. Furthermore, the findings suggested that multiple indicators of injury severity may be needed. For example, even after controlling for insurance status, the mean acute hospital LOS remained substantially higher for the TBIMS cohort across all levels of AIS. Co-occurring injuries and comorbid conditions certainly contribute to longer LOS, if not to long-term outcomes.21 There are several valid indices of both comorbid conditions and co-occurring injury that can be compiled from diagnostic codes22, 23; however, the TBIMS database has historically captured only ICD-9-CM head and neck injury diagnostic codes. A tremendous amount of additional injury information could be obtained if all ICD-9-CM diagnoses were collected from medical records. Capturing these additional injury and comorbid data could assist in interpreting the GCS and AIS, and provide a more comprehensive picture of injury severity and other medical conditions that may impact recovery after TBI. These additions to the TBIMS would involve minimal cost and allow coding of 9 AIS body regions affected by the injury. Our findings suggested that there were differences between the TBIMS and the SCTBIFR that were not attributable to injury severity alone. Univariate comparisons of the crude frequencies revealed that, in comparison to the TBIMS cohort, persons in the SCTBIFR cohort were more likely to be older, white, injured in a fall, retired or otherwise not expected to be working, and either to have Medicare or no insurance. On the other hand, persons in the TBIMS cohort, when compared with the SCTBIFR cohort, were more likely to be younger, expected to be working, from minority groups other than black, to have had a violence-related injury, and to have some type of health insurance. Multivariable analyses suggested that most of these differences were correlates of injury severity. For example, older adults who were injured due to falls received acute hospitalization but not comprehensive rehabilitation due to the lesser severity of their injury. Likewise, the preponderance of whites in the SCTBIFR cohort as was noted in the univariate analysis showed reversal in the multivariate analysis due to the confounding effect of the other covariates in the model. The degree of confounding indicated a 2.7-fold underestimation of the odds that blacks would be more likely to be represented in SCTBIFR than the TBIMS cohort. Likewise, multivariable analyses indicated Hispanics were under-represented in the SCTBIFR. The lower composition of blacks and higher composition of Hispanics in the TBIMS are more consistent with national population estimates and do not appear to be a basis for concern regarding the representativeness of TBIMS data. Differences between the 2 cohorts in insurance payer also could not be accounted for by injury severity. The SCTBIFR cohort was 5 times more likely to be uninsured than the TBIMS cohort, and more than 2 times as likely to have Medicare. The higher level of admission of Medicare patients for acute hospital care may be attributed to the vulnerability of the elderly for serious complications and the extra healing time needed for good recovery.24 Given that all other variables were held constant including age and severity, however, this finding could also represent an overpropensity to provide acute hospital care solely due to Medicare being a favorable payer source.25 For rehabilitation care, Medicare coverage is not as unequivocally advantageous, especially for patients with more severe illness and for whom there may be alternate placement available in skilled nursing facilities.26 The finding for those who have no insurance is both more pronounced and more difficult to interpret. Although many rehabilitation centers, including TBIMS sites, admit patients who have no insurance at time of injury and subsequently assist them to become eligible for Medicaid, a corresponding greater likelihood of TBIMS participants being covered by Medicaid was not observed. Indeed, though not statistically significant, SCTBIFR members were also more likely to be on Medicaid. Other studies have found that after controlling for injury severity, uninsured persons have significantly lower rates of acute hospital admission when compared with patients with insurance.27, 28, 29, 30 One might extrapolate from these findings that a proportion of persons with TBI who do not have health insurance coverage do not receive the comprehensive rehabilitation required by their injuries. If true, this finding represents a likely health disparity related to socioeconomic status—some uninsured people in need of comprehensive rehabilitation are not receiving it. Although it is not possible to determine if the under-representation of the uninsured in the TBIMS is due solely to inability to pay, this finding warrants further investigation on a prospective basis where additional clinical and sociodemographic parameters can be measured and examined. A major challenge in comparing the TBIMS and SCTBIFR was deriving a common set of variables on which to base comparisons. Although both projects had different aims and objectives, standard demographic, injury-related, and outcome variables were collected. Yet, these standard variables were often scaled differently and it was not always possible to recode the variables to make them comparable across databases. Data collection is obviously time-consuming and expensive. Consideration might be given to developing a core set of evidence-tested variables that could be recommended for use in all TBI studies. The proliferation of idiosyncratic, “boutique” databases precludes meaningful comparisons across projects. A major limitation of this study was our inability to compare functional outcome between the cohorts. Both databases assessed functional outcome but the variables were not comparable. Measuring functional outcome is crucial for understanding the relationship between injury severity and morbidity, assessing the effectiveness of interventions, and assisting in resource allocation. The ability to “anchor” the TBIMS national dataset, or other samples based on use of postacute services, would be greatly facilitated by accurate and complete information on services received after acute hospitalization. The analyses conducted in this project indicate that receiving rehabilitation may not be solely a function of injury-related consequences. Having population-based estimates of patients with TBI receiving postacute rehabilitation services would provide additional insight into the epidemiology of service use. Future TBI outcome surveillance projects should evaluate the feasibility of collecting information on inpatient, subacute, and outpatient rehabilitation services, including points in time when services were received. The feasibility of ascertaining the actual facilities or services used should also be considered, so that programmatic characteristics such as admission policies, medical and therapy services provided, and accreditation by the Commission on Accreditation of Rehabilitation Facilities or Medicare certification could be evaluated. The utility of the integrated dataset created for this project extends beyond attempts to characterize the samples involved. Combining datasets focusing on acute hospitalization and acute rehabilitation provides an opportunity for examining outcomes that are highly affected by injury severity. The combined dataset includes large numbers of participants representing both the most and least severe cases. Neither dataset alone has the sample size for examining the full continuum of injury severity. For instance, an examination of hours employed 1 year after injury reveals very different results for the 2 samples, with relatively small numbers of participants in the worst and best outcome categories for the SCTBIFR and TBIMS, respectively. The combined dataset also includes a more complete representation of subjects at the more severe ends of the spectrum because the SCTBIFR includes some patients not captured via rehabilitation samples. Together, there is adequate sample size to robustly characterize risk factors across the range of severity. Further analyses of comparable outcome variables may shed new light on the consequences of TBI and provide a more comprehensive perspective for public policy recommendations. Study Limitations Limitations of the study included the potential for bias created by subjects lost to follow-up, missing values for some data elements, and the overall small number of variables that were comparable in the 2 datasets. The 1-year datasets for both the SCTBIFR and the TBIMS cohort were affected by participants who were not available for the follow-up interview. The loss of participants introduces the potential for systematic bias when the reasons for being lost differentially affect certain subgroups of participants or selected variables.13 When data are used to estimate population rates, weighting can be used to compensate for nonrandom effects of loss to follow-up. When relationships are being examined for variables collected at 1 year, however, bias can occur if the variable of interest is associated with the factor affecting loss to follow-up.13, 31 In the current study, being uninsured and violent injury etiology were variables of interest that were potentially associated with both loss to follow-up and dataset membership. Modeling was limited by incomplete data for some variables, especially in the TBIMS dataset. Greater problems in data collection can be anticipated with datasets drawn from clinical versus administrative datasets. The use of a “missing” category reduced the loss of subjects for analysis; however, this approach also limits interpretation due to uncertainty about the meaning of the category. Finally, as noted above, modeling would have been enriched by having a greater number and variety of variables that were comparable in the 2 datasets and available for analysis. Most notable was the lack of shared variables reflecting premorbid and co-occurring conditions. Conclusions  Given the confines of the comparisons that were possible, results of this study provide support for the representativeness of the TBIMS dataset when studying factors that impact recovery after TBI rehabilitation. The study further underscores the relative benefits of both population-based follow-up registries that have been funded by the National Center for Injury Prevention and Control at CDC and the longitudinal dataset for persons with more severe TBI that has been funded through the NIDRR TBIMS program. A benefit of the TBIMS dataset is its focus on persons with more severe injuries who are likely to have longer-term consequences. Whereas the current study compared only year-1 cohorts, the TBIMS is designed to provide longitudinal data on outcomes spanning many years. Sampling designed to represent the population of persons with TBI (in this case, hospitalized patients in South Carolina) is essential for identifying issues related to demographic distributions and, as suggested by the current results, social disparities. The study showed the potential for complementary use of longitudinal and population-based data collection protocols. Finally, the current study also suggested areas for methodologic improvements in both the TBIMS dataset and future population-based outcome surveillance.18 Supplier Acknowledgment  The contents of this study are solely the responsibility of the authors and do not necessarily represent the official views of the funding agencies. References  1. 1Langlois JA, Rutland-Brown W, Thomas KE. Traumatic brain injury in the United States: emergency department visits, hospitalizations, and deaths. Atlanta: Centers for Disease Control and Prevention, National Center for Injury Prevention and Control; 2004;. 2. 2Rehabilitation of persons with traumatic brain injury. NIH Consen Statement. 1998;16:1–41. 3. 3Division of Acute Care Rehabilitation Research and Disability PreventionCenters for Disease Control and Prevention. Traumatic brain injury in the United States: a report to Congress. Atlanta: CDC; 1999;. 4. 4Office of Inspector GeneralDepartment of Veterans Affairs. Healthcare inspection: health status of and services for Operation Enduring Freedom/Operation Iraqi Freedom veterans after traumatic brain injury rehabilitation. Washington (DC): VA Office of Inspector General; 2006;. 5. 5Wood RL, Rutterford NA. Demographic and cognitive predictors of long-term psychosocial outcome following traumatic brain injury. J Int Neuropsychol Soc. 2006;12:350–358. MEDLINE 6. 6Corrigan J, Thurman D. Relating NIDRR’s TBI Model Systems and CDC’s TBI Surveillance. Presented to: Traumatic Brain Injury in the 21st Century: Learning from Models of Research and Service Delivery; 1999 Dec 2-4; Bethesda (MD). 7. 7Johnston MV, Hall KM. Outcomes evaluation in TBI rehabilitation part I: overview and system principles. Arch Phys Med Rehabil. 1994;75(12 Spec No):SC1–SC9. MEDLINE 8. 8US Census Bureau. 2005 American community survey. Data profile highlights. Available at: http://factfinder.census.gov/servlet/ACSSAFFFacts. Accessed January 3, 2007. 9. 9Harrison-Felix C, Newton C, Hall K, Kreutzer J. Descriptive findings from the traumatic brain injury model systems national data base. J Head Trauma Rehabil. 1996;11(5):1–14.
CrossRef
11. 11Thurman DJ, Sniezek JE, Johnson D, Greenspan A, Smith SM. Guidelines for surveillance of central nervous system injury. Atlanta: Centers for Disease Control and Prevention; 1995;. 12. 12Centers for Disease Control and Prevention. Annual data submissions standard information. Presented to: Grantees’ Meeting; 1998 May 4; Atlanta (GA). 12. 12Selassie A, Pickelsimer E, Furguson P, Gravelle W, Gu J. Weighting of data. In: South Carolina traumatic brain injury follow-up registry manual of operations. Charleston: Medical University of South Carolina; 2004;p. 118–121. 13. 13Corrigan J, Harrison-Felix C, Bogner J, Dijkers M, Terrill M, Whiteneck G. Systematic bias in traumatic brain injury outcome studies because of loss to follow-up. Arch Phys Med Rehabil. 2003;84:153–160. Abstract |
Full-Text PDF (87 KB)
|
CrossRef
14. 14Committee on Injury Scaling. The abbreviated injury scale 1990 revision. Des Plaines: Association for the Advancement of Automotive Medicine; 1990;. 15. 15Petrucelli E, States JD, Hames LN. The abbreviated injury scale: evolution, usage and future adaptability. Accid Anal Prev. 1981;13:25–35. 16. 16Johns Hopkins University and Tri-Analytics Inc. ICDMAP-90 software user’s guide. Baltimore: Johns Hopkins Univ; 1997;. 17. 17Allison P. Multicollinearity. In: Logistic regression: theory and application. Cary: SAS Institute Inc; 2001;. 18. 18Hosmer DW, Lemeshow S. Hosmer-Lemeshow test. In: Applied logistic regression. 2nd ed.. New York: John Wiley & Sons; 2000;p. 14–156. 19. 19Zafonte R, Hammond F, Mann N, Wood D, Black K, Millis S. Relationship between Glasgow Coma Scale and functional outcome. Am J Phys Med Rehabil. 1996;75:364–369. MEDLINE |
CrossRef
20. 20Zafonte R, Hammond F, Mann N, Wood D, Millis S, Black K. Revised Trauma Score: an additive predictor of disability following traumatic brain injury?. Am J Phys Med Rehabil. 1996;75:456–461. MEDLINE |
CrossRef
21. 21Dikmen S, Temkin N, Machamer J, Holubkov A, Fraser R, Winn H. Employment following traumatic head injuries. Arch Neurol. 1994;51:177–186. MEDLINE 22. 22Elixhauser A, Steiner C, Harris DR, Coffey RM. Comorbidity measures for use with administrative data. Med Care. 1998;36:8–27. MEDLINE |
CrossRef
23. 23Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1997;40:273–283. 24. 24Baker SP, O’Neill B, Ginsburg MJ, Li G. The injury fact book. 2nd ed.. New York: Oxford Univ Pr; 1992;. 25. 25Friedman B, Sood N, Engstrom K, McKenzie D. New evidence on hospital profitability by payer group and the effects of payer generosity. Int J Health Care Financ Econ. 2004;4:231–246. 26. 26Hoffman JM, Doctor JN, Chan L, Whyte J, Jha A, Dikmen S. Potential impact of the new Medicare prospective payment system on reimbursement for traumatic brain injury inpatient rehabilitation. Arch Phys Med Rehabil. 2003;84:1165–1172. Abstract | Full Text |
Full-Text PDF (150 KB)
|
CrossRef
27. 27Haas JS, Goldman L. Acutely injured patients with trauma in Massachusetts: differences in care and mortality, by insurance status. Am J Public Health. 1994;84:1605–1608. MEDLINE |
CrossRef
28. 28Selassie A, Pickelsimer E, Frazier L, Ferguson P. The effect of insurance status, race, and gender on ED disposition of persons with traumatic brain injury. Am J Emerg Med. 2004;22:465–473. Abstract | Full Text |
Full-Text PDF (194 KB)
|
CrossRef
29. 29Selassie A, McCarthy M, Pickelsimer E. The influence of insurance, race, and gender on emergency department disposition. Acad Emerg Med. 2003;10:1260–1270. MEDLINE |
CrossRef
30. 30Sox CM, Burstin HR, Edwards RA, O’Neil AC, Brennan TA. Hospital admission through the emergency department: does insurance status matter?. Am J Med. 1998;105:506–512. Abstract | Full Text |
Full-Text PDF (74 KB)
|
CrossRef
31. 31Corrigan J, Bogner J, Mysiw W, Clinchot D, Fugate L. Systematic bias in outcome studies of persons with traumatic brain injury. Arch Phys Med Rehabil. 1997;78:142–147. a Department of Physical Medicine and Rehabilitation, Ohio State University, Columbus, OH b Department of Biostatistics, Bioinformatics & Epidemiology, Medical University of South Carolina, Charleston, SC c Wayne State University, Detroit, MI d The Traumatic Brain Injury National Data Center, Kessler Medical Rehabilitation Research and Education Corp, West Orange, NJ. Reprint requests to John D. Corrigan, PhD, Dept of Physical Medicine and Rehabilitation, Ohio State University, 480 W 9th Ave, Columbus, OH 43210
Supported by the Centers for Disease Control and Prevention and the National Institute on Disability and Rehabilitation Research to the Traumatic Brain Injury National Data Center (grant no. H133A011403), the Ohio Regional TBI Model System (grant no. H133A020503), the South Carolina Traumatic Brain Injury Follow-up Registry (award no. U17/CCU421926), and, in part, by the Henry H. Kessler Foundation (Traumatic Brain Injury National Data Center). No commercial party having a direct financial interest in the results of the research supporting this article has or will confer a benefit upon the authors or upon any organization with which the authors are associated. PII: S0003-9993(07)00011-1 doi:10.1016/j.apmr.2007.01.010 © 2007 American Congress of Rehabilitation Medicine and the American Academy of Physical Medicine and Rehabilitation. Published by Elsevier Inc. All rights reserved. | |
|