Highlights
- •Results from the 8 financial management instruments reviewed should be interpreted with caution.
- •Most instruments reviewed have supporting construct validity (hypothesis-testing) evidence from studies of low risk of bias, but there is a paucity of content validity, reliability, and responsiveness evidence.
- •Systematic reviews of assessment instruments should include a critical appraisal of measurement property evidence study quality to ensure evidence has adequate methodologic quality (ie, low risk of bias).
Abstract
Objectives
To critically appraise the measurement property evidence (ie, psychometric) for 8
observation-based financial management assessment instruments.
Data sources
Seven databases were searched in May 2015.
Study selection
Two reviewers used an independent decision-agreement process to select studies of
measurement property evidence relevant to populations with adulthood acquired cognitive
impairment, appraise the quality of the evidence, and extract data. Twenty-one articles
were selected.
Data extraction
This review used the COnsensus-based Standards for the selection of health Measurement
Instruments review guidelines and 4-point tool to appraise evidence. After appraising
the methodologic quality, the adequacy of results and volume of evidence per instrument
were synthesized. Measurement property evidence with high risk of bias was excluded
from the synthesis.
Data synthesis
The volume of measurement property evidence per instrument is low; most instruments
had 1 to 3 included studies. Many included studies had poor methodologic quality per
measurement property evidence area examined. Six of the 8 instruments reviewed had
supporting construct validity/hypothesis-testing evidence of fair methodologic quality.
There is a dearth of acceptable quality content validity, reliability, and responsiveness
evidence for all 8 instruments.
Conclusions
Rehabilitation practitioners assess financial management functions in adults with
acquired cognitive impairments. However, there is limited published evidence to support
using any of the reviewed instruments. Practitioners should exercise caution when
interpreting the results of these instruments. This review highlights the importance
of appraising the quality of measurement property evidence before examining the adequacy
of the results and synthesizing the evidence.
Keywords
List of abbreviations:
CCT (Cognitive Competency Test), COSMIN (COnsensus-based Standards for the selection of health Measurement Instruments research group), EFB/FIA (Everyday Functioning Battery/Functional Impact Assessment), FCAI (Financial Competency Assessment Inventory), FCI (Financial Capacity Instrument), FM (financial management), ILS (Independent Living Scales), KELS (Kohlman Evaluation of Living Skills), MAFS (Measurement for Awareness of Financial Skills), MP (measurement property), SCIFC (Semi-structured Clinical Interview of Financial Capacity)To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to Archives of Physical Medicine and RehabilitationAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
References
- Assessment of older adults with diminished capacity: a handbook for psychologists.American Bar Association, Chicago2008 (Available at:) (Accessed May 5, 2015)
- Informing Social Security’s process for financial capability determination.National Academies Press, Washington, DC2016
- Perceived needs following traumatic brain injury.J Head Trauma Rehabil. 2004; 19: 205-216
- The disablement experienced by traumatically brain-injured adults living in the community.Brain Injury. 1995; 9: 339-353
- A profile of outcome: 2 years after traumatic brain injury.Brain Injury. 1995; 9: 1-10
- A person-centered approach to financial capacity assessment: preliminary development of a new rating scale.Clin Gerontologist. 2015; 38: 49-67
- A guide to the certificate of incapability process under the Adult Guardianship Act.British Columbia Ministry of Health, Victoria, British Columbia2016 (Available at:) (Accessed June 15, 2015)
- Financial abuse of older people.J Adult Prot. 2000; 2: 21-29
- Outcome 3 to 5 years after moderate to severe traumatic brain injury.Arch Phys Med Rehabil. 2003; 84: 1149-1157
- Activities, participation and satisfaction one-year post stroke.Disabil Rehabil. 2007; 29: 559-566
- Financial and vocational outcomes 2 years after traumatic brain injury.Disabil Rehabil. 2009; 31: 484-489
- Loss of financial management independence after brain injury: survivors’ experiences.Am J Occup Ther. 2016; 70 (7003180070p1–8)
- Assessing financial competence.Psychiatry Psychol Law. 2002; 9: 248-256
- Identifying instruments to quantify financial management skills in adults with acquired cognitive impairments.J Clin Exp Neuropsychol. 2016; 38: 76-95
- Measures of financial capacity: a review.Gerontologist. 2017; : 1-21
- Financial capacity in older adults: a review of clinical assessment approaches and considerations.Clin Gerontol. 2010; 33: 332-346
- Financial and testamentary capacity evaluations: procedures and assessment instruments underneath a functional approach.Int Psychogeriatr. 2014; 26: 217-228
- Measurement in medicine: a practical guide.Cambridge University Press, Cambridge, UK2011
- Evaluation of the methodological quality of systematic reviews of health status measurement instruments.Qual Life Res. 2009; 18: 313-333
- The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration.BMJ. 2009; 339: b2700
- Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments.Qual Life Res. 2009; 18: 1115-1123
- Clinimetrics.Yale University Press, New Haven, CT1987
- Unpublished rating scales: a major source of bias in randomised controlled trials of treatments for schizophrenia.Br J Psychiatry. 2000; 176: 249-252
- COSMIN checklist manual, version 9.COSMIN, Amsterdam, The Netherlands2012 (Available at:) (Accessed May 5, 2015)
- Quality criteria were proposed for measurement properties of health status questionnaires.J Clin Epidemiol. 2007; 60: 34-42
- Protocol for systematic review of measurement properties.COSMIN, Amsterdam, The Netherlands2011 (Available at:) (Accessed May 5, 2015)
- Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the COSMIN checklist.Qual Life Res. 2012; 21: 651-657
- Foundations of clinical research: applications to practice.2nd ed. Prentice Hall Health, Upper Saddle River, NJ2000
- A taxonomy for responsiveness.J Clinl Epidemiol. 2001; 54: 1204-1217
- Understanding the relevance of measured change through studies of responsiveness.Spine. 2000; 25: 3192-3199
- Updated method guidelines for systematic reviews in the Cochrane Collaboration Back Review Group.Spine. 2003; 28: 1290-1299
- A preliminary report on the discrepancy between clinical and test evaluations of competence.Can J Psychiatry. 1992; 37: 634-639
- Examining the construct validity of the Cognitive Competency Test for occupational therapy practice.Can J Occup Ther. 2013; 80: 171-180
- The impact of HIV-associated neuropsychological impairment on everyday functioning.J Int Neuropsychol Soc. 2004; 10: 317-331
- Performance-based everyday functioning after stroke: relationship with IADL questionnaire and neurocognitive performance.J Int Neuropsychol Soc. 2011; 17: 832-840
- Factor structure of neurocognition and functional capacity in schizophrenia: a multidimensional examination of temporal stability.J Int Neuropsychol Soc. 2013; 19: 656-663
- Assessing financial capacity in patients with Alzheimer disease.Arch Neurol. 2000; 57: 877-884
- Loss of financial competency in dementia: conceptual and empirical approaches.Aging Neuropsychol Cogn. 2001; 8: 164-181
- Declining financial capacity in mild cognitive impairment: a 1-year longitudinal study.Neurology. 2009; 73: 928-934
- Assessment of financial competence.Psychiatr Psychol Law. 2008; 15: 40-55
- Predictors of financial capacity performance in older adults using the Financial Competence Assessment Inventory.Int Psychogeriatr. 2014; 26: 921-927
- The independent living scales as a measure of functional outcome for schizophrenia.Psychiatr Serv. 2004; 55: 1052-1054
- Neurocognitive and symptom correlates of daily problem-solving skills in schizophrenia.Schizophren Res. 2006; 83: 237-245
- (2006). Fine tuning recommendations for older adults with memory complaints: using the Independent Living Scales with the Dementia Rating Scale.Clin Neuropsychol. 2006; 20: 649-661
- Evaluation of functionally meaningful measures for clinical trials of cognition enhancement in schizophrenia.Am J Psychiatry. 2011; 168: 400-407
- The cultural adaptability of intermediate measures of functional outcome in schizophrenia.Schizoph Bull. 2012; 38: 630-641
- The Independent Living Scales in civil competency evaluations: initial findings and prediction of competency adjudication.Law Hum Behav. 2013; 34: 155-162
- Influence of instrumental activities of daily living assessment method on judgments of independence.Am J Occup Ther. 1996; 50: 202-206
- The utility of the Kohlman evaluation of living skills test is associated with substantiated cases of elder self-neglect.J Am Acad Nurse Pract. 2007; 19: 137-142
- Convergent validation of the Kohlman Evaluation of Living Skills as a screening tool of older adults’ ability to live safely and independently in the community.Arch Phys Med Rehabil. 2009; 90: 1948-1952
- Measuring awareness of financial skills: reliability and validity of a new measure.Aging Ment Health. 2004; 8: 161-171
- Clinical interview assessment of financial capacity in older adults with mild cognitive impairment and Alzheimer’s disease.J Am Geriatr Soc. 2009; 57: 806-814
Heaton R, Rivera-Mindt M. Functional Impact Assessment training manual, version 1.1.
- The emerging neuroscience of financial capacity.J Am Soc Aging. 2012; 36: 46-52
- Age-associated financial vulnerability: an emerging public health issue.Ann Intern Med. 2015; 163: 877-878
- Finances in the older patient with cognitive impairment: “he didn’t want me to take over.”.JAMA. 2011; 305: 698-706
- Cognitive assessments for older adults: Which ones are used by Canadian therapists and why.Can J Occup Ther. 2007; 74: 370-381
- Reducing barriers to Patient Reported Outcome Measures for people with cognitive impairments.Arch Phys Med Rehabil. 2017; 98: 1705-1715
- Everyday impact of traumatic brain injury.in: Marcotte T. I Grant I. Neuropsychology of everyday living. Guildford Press, New York2010: 302-330
- Evidence-based rehabilitation: a guide to practice.3rd ed. Slack Inc, Thorofare, NJ2014
- Independent Living Scales.Psychological Corp, San Antonio, TX1996
- Looking for important change/differences in studies of responsiveness.J Rheumatol. 2001; 28: 400-405
- Assessment of capacity in an aging society.Am Psychol. 2013; 68: 158-171
- Exploring the factor structure of financial capacity in cognitively normal and impaired older adults.Clin Gerontol. 2018; 41: 33-41
- Measurement properties of the QuickDASH (Disabilities of the Arm, Shoulder and Hand) outcome measure and cross-cultural adaptations of the QuickDASH: a systematic review.Qual Life Res. 2013; 22: 2509-2547
- COSMIN Risk of Bias checklist for systematic review of patient-reported outcome measures.Qual Life Res. 2017 Dec 19; ([E-pub ahead of print])
- Measurement properties of performance-based measures to assess physical function in hip and knee osteoarthritis: a systematic review.Osteoarthritis Cartilage. 2012; : 1548-1562
- Checklist to operationalize measurement characteristics of patient-reported outcome measures.Syst Rev. 2016; 5: 129
- Guidelines for reporting reliability and agreement studies (GRRAS) were proposed.Int J Nurs Stud. 2011; 48: 661-671
- Content validity—establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO Good Research Practices Task Force report: part 2—assessing respondent understanding.Value Health. 2011; 14: 978-988
- Complex real-world functioning and neuropsychological test performance in older adults.Clin Neuropsychol. 2001; 15: 369-379
- Standard measures of executive function in predicting instrumental activities of daily living in older adults.Int J Geriatr Psychiatry. 2002; 17: 828-834
- Neuropsychological deficits, syndromes, and cognitive competency in schizophrenia.Cogn Neuropsychiatry. 2005; 10: 361-378
- Financial capacity following traumatic brain injury: a six-month longitudinal study.Rehabil Psychol. 2012; 57: 5-12
- Loss of financial capacity in Alzheimer’s disease: the role of working memory.Aging Neuropsychol Cogn. 2001; 8: 109-119
- Age and education corrected older adult normative data for a short form version of the Financial Capacity Instrument.Psycholog Assess. 2016; 28: 737-749
- Impaired financial abilities in mild cognitive impairment: a direct assessment approach.Neurology. 2003; 60: 449-457
- Magnetic resonance imaging volume of the angular gyri predicts financial skill deficits in people with amnestic mild cognitive impairment.J Am Geriatr Soc. 2010; 58: 265-274
- Dimensions of financial competence.Psychiatr Psychol Law. 2004; 11: 338-349
- Financial Competence Assessment Inventory: Administration and Scoring Manual.Matek Proprietary Limited, Melbourne, Victoria, Australia2008
- The Kohlman evaluation of living skills.3rd ed. American Occupational Therapy Association, Bethesda, MD1992
- Declining financial capacity in patients with mild Alzheimer disease: a one-year longitudinal study.Am J Geriatr Psychiatry. 2008; 16: 209-219
- Neurocognitive predictors of financial capacity in traumatic brain injury.J Head Trauma Rehabil. 2012; 27: E81-E90
- Impaired financial abilities in Parkinson’s disease patients with mild cognitive impairments and dementia.Parkinsonism Relat Disord. 2013; 19: 986-990
- Do people with schizophrenia who have objective cognitive impairment identify cognitive deficits on a self report measure?.Schizophr Res. 2008; 105: 156-164
- Making and Executing Decisions for Safe and Independent Living (MED-SAIL): development and validation of a brief screening tool.Am J Geriatr Psychiatry. 2014; 22: 285-293
- Awareness of functional difficulties in mild cognitive impairment: a multidomain assessment approach.J Am Geriatr Soc. 2009; 57: 978-984
- Cognitive correlates of financial abilities in mild cognitive impairment.J Am Geriatr Soc. 2006; 54: 1745-1750
- Verbal memory, problem-solving skills and community status in schizophrenia.Schizophr Res. 2004; 68: 149-158
- Neurocognitive predictors of financial capacity across the dementia spectrum: normal aging, mild cognitive impairment, and Alzheimer’s disease.J Int Neuropsychol Soc. 2009; 15: 258-267
- MRI volume of the medial frontal cortex predicts financial capacity in patients with mild Alzheimer’s disease.Brain Imaging Behav. 2013; 7: 282-292
- Financial capacity of older African Americans with amnestic mild cognitive impairment.Alzheimer Dis Assoc Disord. 2010; 24: 365-371
- The Measure of Awareness of Financial Skills (MAFS): administration and scoring manual.University of Victoria, Victoria, British Columbia, Canada2004
- Awareness of financial skills in dementia.Aging Ment Health. 2004; 8: 374-380
- Self- and informant report of financial abilities in patients with Alzheimer’s disease: reliable and valid?.J Am Geriatr Soc. 2003; 51: 1621-1626
- Cognitive Competency Test: manual.Mount Sinai Hospital Assessment & Rehabilitation, Toronto, Ontario, Canada1992
- Comparison of the test of everyday functional abilities with a direct measure of daily function.Dement Geriatr Cogn Dis. 2006; 22: 83-86
- Beyond the test manual of the Cognitive Competency Test (CCT).Occupational Therapy Now. 2007; 9: 17-19
Article info
Publication history
Published online: March 07, 2018
Footnotes
Supported by grants awarded by the Canadian Institutes of Health Research, Ontario Neurotrauama Foundation, and the Canadian Partnership Stroke Recovery, Baycrest Health Sciences, and the University of Toronto.
Disclosure statement: Dr. Engel reports scholarships and fellowships from Canadian Institutes of Health Research, Ontario Neurotrauma Foundation, Baycrest Health Sciences, and University of Toronto, during the conduct of the study; the remaining authors have nothing to disclose.
Identification
Copyright
© 2018 by the American Congress of Rehabilitation Medicine
