Archives of Physical Medicine and Rehabilitation
Volume 90, Issue 11, Supplement , Pages S52-S59 , November 2009

Methodological Quality of Research on Cognitive Rehabilitation After Traumatic Brain Injury

  • Keith D. Cicerone, PhD

      Affiliations

    • Department of Cognitive Rehabilitation, JFK-Johnson Rehabilitation Institute, Edison, NJ
    • Department of Physical Medicine and Rehabilitation, JFK-Johnson Rehabilitation Institute, Edison, NJ
    • Robert Wood Johnson Medical School, New Brunswick, NJ
    • Corresponding Author InformationReprint requests to Keith D. Cicerone, PhD, 2048 Oak Tree Rd, Edison, NJ 08820
    • ,
  • Joanne Azulay, PhD

      Affiliations

    • Department of Cognitive Rehabilitation, JFK-Johnson Rehabilitation Institute, Edison, NJ
    • ,
  • Charlotte Trott, PhD

      Affiliations

    • Department of Cognitive Rehabilitation, JFK-Johnson Rehabilitation Institute, Edison, NJ

References 

  1. DeLisa JA. 1997 (Issues and challenges for physiatry in the coming decade). Arch Phys Med Rehabil. 1997;80:1–12
  2. Woolf SH. Practice guidelines: a new reality in medicine, II: methods of developing guidelines. Arch Int Med. 1993;152:946–952
  3. Eddy DM. Practice policies: guidelines for methods. JAMA. 1990;263:1839–1841
  4. Atkins D, Eccles M, Fottorp S, et al. Systems for grading the quality of evidence and the strength of recommendations I: critical appraisal of existing approaches. BMC Health Serv Res. 2004;4:38
  5. Carney N, Chestnut RM, Maynard H, Mann NC, Hefland M. Effect of cognitive rehabilitation on outcomes for persons with traumatic brain injury: a systematic review. J Head Trauma Rehabil. 1999;14:277–307
  6. Cicerone KD, Dahlberg C, Kalmar K, et al. Evidence-based cognitive rehabilitation: recommendations for clinical practice. Arch Phys Med Rehabil. 2000;81:1596–1615
  7. Cicerone KD, Dahlberg C, Malec JF, et al. Evidence-based cognitive rehabilitation: updated review of the literature from 1998 through 2002. Arch Phys Med Rehabil. 2005;86:1681–1692
  8. Cappa SF, Benke T, Clarke S, Rossi B, Stemmer B, van Heugten CM. EFNS Guidelines on cognitive rehabilitation: report of an EFNS Task Force. Eur J Neurol. 2003;10:11–23
  9. Sohlberg MM, Avery J, Kennedy M, et al. Practice guidelines for direct attention training. J Med Speech Lang Pathol. 2003;11:19–39
  10. Sohlberg MM, Kennedy M, Avery J, et al. Evidence-based practice for the use of external aids as a memory compensation technique. J Med Speech Lang Pathol. 2003;15:xv–xlix
  11. Kennedy MR, Coelho C, Turkstra L, et al. Intervention for executive functions after traumatic brain injury: a systematic review, meta-analysis and clinical recommendations. Neuropsychol Rehabil. 2008;18:257–299
  12. Jutai JW, Bhogal SK, Foley NC, Bayley M, Teasell RW, Speechley MR. Treatment of visual perceptual disorders post stroke. Topics Stroke Rehabil. 2003;10:77–106
  13. Pierce SR, Buxbaum LJ. Treatments of unilateral neglect: a review. Arch Phys Med Rehabil. 2002;83:256–268
  14. Bowen A, Lincoln NB, Dewey M. Cognitive rehabilitation for spatial neglect following stroke. Cochrane Database Syst Rev. 2002;2:CD003586
  15. Lincoln NB, Majid MJ, Weyman N. Cognitive rehabilitation for attention deficits following stroke. Cochrane Database Syst Rev. 2000;4:CD002842
  16. Majid MJ, Lincoln NJ, Weyman N. Cognitive rehabilitation for memory deficits following stroke. Cochrane Database Syst Rev. 2000;3:CD002293
  17. McCormack J, Greenhalgh T. Seeing what you want to see in randomized controlled trials: versions and perversions of UKPDS data. BMJ. 2000;320:1720–1723
  18. Moja LP, Telaro E, D'Amico R, Moschetti I, Coe L, Liberati A. Assessment of methodological quality of primary studies by systematic reviews: results of the metaquality study cross sectional study. BMJ. 2005;330:1053–1055
  19. Atkins D, Best D, Briss PA, et al. Grading quality of evidence and strength of recommendations. BMJ. 2004;328:1490–1497
  20. Kunz R, Oxman AD. The unpredictability paradox: review of empirical comparisons of randomized and non-randomised clinical trials. BMJ. 1998;317:1185–1190
  21. Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias: dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995;273:408–412
  22. Hewitt K, Hahn S, Torgerson DJ, Watson J, Bland JM. Adequacy and reporting of allocation concealment: review of recent trials published in four general medical journals. BMJ. 2005;330:1057–1058
  23. Horwitz RI, Viscoli CM, Clemens JD, Sadock RT. Developing improved observational methods for evaluating therapeutic effectiveness. Am J Med. 1990;89:630–638
  24. Guyatt GH, Juniper EF, Walter SF, Griffith LE, Goldstein RS. Interpreting treatment effects in randomized trials. BMJ. 1998;316:690–693
  25. Jadad AR, Moore RA, Carrol D, et al. Assessing the quality of randomized clinical trials: is blinding necessary?. Controlled Clin Trials. 1996;17:1–12
  26. Edlund W, Gronseth G, So Y, Franklin G. Clinical practice guideline process manual (American Academy of Neurology). http://www.aan.com/globals/axon/assets/3749.pdf2004;Accessed: October 15, 2008
  27. Gordon WA, Zafonte R, Cicerone K, et al. Traumatic brain injury rehabilitation: state of the science. Am J Phys Med Rehabil. 2006;85:343–382
  28. van Tulder MW, Assendelft WJ, Koes BW, Bouter LM. Method guidelines for systematic reviews in the Cochrane Collaboration Back Review Group for spinal disorders. Spine. 1997;22:2323–2330
  29. van Tulder MW, AFurlan A, Bombardier C, Bouter LM. Updated method guidelines for systematic reviews in the Cochrane Collaboration Back Review Group. Spine. 2003;28:1290–1299
  30. Steultjens EM, Dekker J, Bouter LM, van de Nes JC, Cup EH, van den Ende CH. Occupational therapy for stroke patients: a systematic review. Stroke. 2003;34:676–687
  31. Turner-Stokes L, Disler PB, Nair A, Wade DT. Multi-disciplinary rehabilitation for acquired brain injury in adults of working age. Cochrane Database Syst Rev. 2005;3:CD004170
  32. Cicerone KD, Dahlberg C, Kalmar K, et al. Evidence-based cognitive rehabilitation: updated review of the literature from 2003 through 2008. In press.
  33. Berg I, Konning-Haanstra M, Deelman B. Long term effects of memory rehabilitation: a controlled study. Neuropsychol Rehabil. 1991;1:97–111
  34. Cheng SK, Man DW. Management of impaired self-awareness in persons with traumatic brain injury. Brain Inj. 2006;20:621–628
  35. Dahlberg CA, Cusick CP, Hawley LA, et al. Treatment efficacy of social communication skills training after traumatic brain injury: a randomized treatment and deferred treatment controlled trial. Arch Phys Med Rehabil. 2007;88:1561–1573
  36. Dirette DK, Jinojosa J, Carnevale GJ. Comparison of remedial and compensatory interventions for adults with acquired brain injuries. J Head Trauma Rehabil. 1999;14:595–601
  37. Dou ZL, Man DW, Ou HN, Zheng JL, Tam SF. Computerized errorless learning-based memory rehabilitation for Chinese patients with brain injury: a preliminary quasi-experimental clinical design study. Brain Inj. 2006;20:219–225
  38. Fasotti L, Kovacs F, Eling PA, Brouwer WH. Time pressure management as a compensatory strategy training after closed head injury. Neuropsychol Rehabil. 2000;10:47–65
  39. Goverover Y, Johnston MV, Toglia J, DeLuca J. Treatment to improve self-awareness in persons with acquired brain injury. Brain Inj. 2007;21:913–923
  40. Gray JM, Robertson I, Pentland B, Anderson S. Microcomputer-based attentional retraining after brain damage: a randomized group controlled trial. Neuropsychol Rehabil. 1992;2:97–115
  41. Helffenstein D, Wechsler R. The use of interpersonal process recall (IPR) in the remediation of interpersonal and communication skill deficits in the newly brain injured. Clin Neuropsychol. 1982;4:139–143
  42. Hewitt J, Evans JJ, Dritschel B. Theory driven rehabilitation of executive functioning: Improving planning skills in people with traumatic brain injury through the use of an autobiographical memory cueing procedure. Neuropsychologia. 2006;44:1468–1474
  43. Huildebrandt H, Bussman-Mork B, Schwendermann G. Group therapy for memory impaired patients: a partial remediation is possible. J Neurol. 2006;253:512–519
  44. Kaschel R, Della Sala S, Cantagallo A, Fahlbock A, Laaksonen R, Kazen M. Imagery mnemonics for the rehabilitation of memory: a randomised group controlled trial. Neuropsychol Rehabil. 2002;12:127–153
  45. Kerner MJ, Acker M. Computer delivery of memory retraining with head injured patients. Cogn Rehabil. 1985;Nov/Dec:26–31
  46. Levine B, Robertson IH, Clare L, et al. Rehabilitation of executive functioning: an experimental-clinical validation of goal management training. J Int Neuropsychol Soc. 2000;6:299–312
  47. Man DW, Soong WY, Tam SF, Hui-Chan WY. A randomized clinical trail study on the effectiveness of a tele-analogy-based problem-solving programme for people with acquired brain injury. NeuroRehabilitation. 2006;21:205–217
  48. Medd J, Tate RL. Evaluation of an anger management therapy programme following ABI: a preliminary study. Neuropsychol Rehabil. 2000;10:185–201
  49. Neistadt ME. Occupational therapy treatments for constructional deficits. Am J Occup Ther. 1992;46:141–148
  50. Niemann H, Ruff RM, Baser CA. Computer assisted attention retraining in head injured individuals: a controlled efficacy study of an out-patient program. J Consult Clin Psychol. 1990;58:811–817
  51. Novack TA, Caldwell SG, Duke LW, Berquist T. Focused versus unstructured intervention for attention deficits after traumatic brain injury. J Head Trauma Rehabil. 1996;11:52–60
  52. Ownsworth TL, McFarland K. Memory remediation in long-term acquired brain injury: two approaches in diary training. Brain Inj. 1999;13:605–626
  53. Rath JF, Simon D, Langenbahn DM, Sherr RL, Diller L. Group treatment of problem-solving deficits in outpatients with traumatic brain injury: a randomized outcome study. Neuropsychol Rehabil. 2003;13:341–488
  54. Ruff RM, Baser CA, Johnston JW, Marshall LF. Neuropsychological rehabilitation: an experimental study with head-injured patients. J Head Trauma Rehabil. 1989;4:20–36
  55. Ryan TV, Ruff RM. The efficacy of structured memory retraining in a group comparison of head trauma patients. Arch Clin Neuropsychol. 1988;3:165–179
  56. Salazar AM, Warden DL, Schwab K, et al. Cognitive rehabilitation for traumatic brain injury: a randomized trial. JAMA. 2000;283:3075–3081
  57. Schmitter-Edgecombe M, Fahy J, Whelan J, Long C. Memory remediation after severe closed head injury: notebook training versus supportive therapy. J Consult Clin Psychol. 1995;63:484–489
  58. Sohlberg MM, McLaughlin KA, Pavese A, Heidrich A, Posner MI. Evaluation of attention process training and brain injury education in persons with acquired brain injury. J Clin Exp Neuropsychol. 2000;22:656–676
  59. Tam SF, Man WK. Evaluating computer-assisted memory retraining programmes for people with post-head injury amnesia. Brain Inj. 2004;18:461–470
  60. Thickpenny-Davis KL, Barker-Collow SL. Evaluation of a structured group format memory rehabilitation program for adults following brain injury. J Head Trauma Rehabil. 2007;22:303–313
  61. Tiersky LA, Anselmi V, Johnston MV, et al. A trial of neuropsychologic rehabilitation in mild-spectrum traumatic brain injury. Arch Phys Med Rehabil. 2005;86:1565–1574
  62. Thomas-Stonell N, Johnson P, Schuller R, Jutai J. Evaluation of a computer based program for cognitive-communication skills. J Head Trauma Rehabil. 1994;9:25–37
  63. von Cramen DYMathes-von Cramen, Mai N. Problem solving deficits in brain injured patients: a therapeutic approach. Neuropsychol Rehabil. 1991;1:45–64
  64. Wilson BA, Emslie H, Quirk K, Evans J, Watson P. A randomized control trial to evaluate a paging system for people with traumatic brain injury. Brain Inj. 2005;19:891–894
  65. Batchelor J, Shores E, Marosszeky J, Sandanam J, Lovarini M. Cognitive rehabilitation of severely head-injured patients using computer-assisted and noncomputerized treatment techniques. J Head Trauma Rehabil. 1988;3:78–83
  66. Chen SH, Glueckauf RL, Bracy OL. The effectiveness of computer-assisted cognitive rehabilitation for persons with traumatic brain injury. Brain Inj. 1997;2:197–209
  67. Cicerone KD. Remediation of “working attention” in mild traumatic brain injury. Brain Inj. 2002;16:185–195
  68. Cicerone KD, Mott T, Azulay J, Friel JC. Community integration and satisfaction with functioning after intensive cognitive rehabilitation for traumatic brain injury. Arch Phys Med Rehabil. 2004;85:943–950
  69. Ehlhardt LA, Sohlberg MM, Glang A, Albin R. TEACH-M: a pilot study evaluating an instructional sequence for persons with impaired memory and executive functions. Brain Inj. 2005;19:569–583
  70. Fox RM, Martella RC, Marchand-Martella NE. The acquisition, maintenance and generalization of problem-solving skills by closed head injured adults. Behav Ther. 1989;20:61–76
  71. Fryer LJ, Haffey WJ. Cognitive rehabilitation and community readaptation: outcomes of two program models. J Head Trauma Rehabil. 1987;2:51–63
  72. Freeman MR, Mittenberg W, DiCowden M, Bat-Ami M. Executive and compensatory memory retraining in traumatic brain injury. Brain Inj. 1992;6:65–70
  73. Goldstein G, Beers SR, Longmore S, McCue M. Efficacy of memory training: a technological extension and replication. Clin Neuropsychol. 1996;10:66–72
  74. Goranson TE, Graves RE, Allison D, La Feniere R. Community integration following multidisciplinary rehabilitation for traumatic brain injury. Brain Inj. 2003;17:759–774
  75. Hux K, Manasse N, Wright S, Snell J. Effect of training frequency on face-name recall by adults with traumatic brain injury. Brain Inj. 2000;14:907–920
  76. Man DW, Soong WY, Tam SF, Hui-Chan CW. Development and evaluation of a pictorial-based analogical problem-solving programme for people with traumatic brain injury. Brain Inj. 2006;20:981–990
  77. Parente R, Kolakowsky-Hayner S, Krug K, Wilk C. Retraining working memory after traumatic brain injury. NeuroRehabilitation. 1999;13:157–163
  78. Parente R, Stapleton M. Development of a cognitive strategies group for vocational training after traumatic brain injury. NeuroRehabilitation. 1999;13:13–20
  79. Prigatano GP, Fordyce DJ, Zeiner HK, Roueche JR, Pepping M, Wood BC. Neuropsychological rehabilitation after closed head injury in young adults. J Neurol Neurosurg Psychiat. 1984;47:505–513
  80. Prigatano GP, Klonoff PS, O'Brien KP, et al. Productivity after neuropsychologically oriented milieu rehabilitation. J Head Trauma Rehabil. 1994;9:91–102
  81. Rattok J, Ben-Yishay Y, Ezrachi O, et al. Outcome of different treatment mixes in a multidimensional neuropsychological rehabilitation program. Neuropsychol. 1992;6:395–415
  82. Sarajuuri JM, Kaipio ML, Koskinen SK, Neimela MR, Servo AR, Vilkki JS. Outcome of a comprehensive neurorehabilitation program for patients with traumatic brain injury. Arch Phys Med Rehabil. 2005;86:2296–2302
  83. Soong W, Tam SF, Man WK, Hui-Chan C. A pilot study on the effectiveness of tele-analogy-based problem-solving training for people with brain injuries. Int J Rehabil Res. 2005;28:341–347
  84. Stablum F, Umilta C, Mazzoldi M, Pastore N, Magon S. Rehabilitation of endogenous task shift processes in closed head injury patients. Neuropsychol Rehabil. 2007;17:1–33
  85. Svendsen HA, Teasdale TW. The influence of neuropsychological rehabilitation on symptomatology and quality of life following brain injury: a controlled long-term follow-up. Brain Injury. 2006;20:1295–1306
  86. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–175
  87. Dickinson K, Bunn R, Wentz R, Edwards P, Roberts I. Size and quality of randomized controlled trials in head injury: review of published studies. BMJ. 2000;320:1308–1311
  88. Whyte J, Hart T. It's more than a black box; it's a Russian doll: defining rehabilitation treatments. Am J Phys Med Rehabil. 2003;82:639–652
  89. Campbell M, Fitzpatrick R, Haines A, et al. Framework for design and evaluation of complex interventions to improve health. BMJ. 2000;321:694–696
  90. Hawe P, Shiell A, Riley T. Complex interventions: how “out of control” can a randomized controlled trial be?. BMJ. 2004;328:1561–1563
  91. Salter KL, Foley NC, Juai JW, Teasell RW. Assessment of participation outcomes in randomized controlled trials of stroke rehabilitation interventions. Int J Rehabil Res. 2007;30:339–342
  92. Turner-Stokes L. Evidence for the effectiveness of multi-disciplinary rehabilitation following acquired brain injury: a synthesis of two systematic approaches. J Rehabil Med. 2008;40:691–701

 Supported by the National Institute on Disability and Rehabilitation Research to JFK-Johnson Rehabilitation Institute (grant nos. H133A020518 and H133A070030).

 No commercial party having a direct financial interest in the results of the research supporting this article has or will confer a benefit on the authors or on any organization with which the authors are associated.

PII: S0003-9993(09)00472-9

doi: 10.1016/j.apmr.2009.05.019

Archives of Physical Medicine and Rehabilitation
Volume 90, Issue 11, Supplement , Pages S52-S59 , November 2009

Article Tools