Advertisement
Original article| Volume 86, ISSUE 12, P2354-2360, December 2005

Intra- and Interrater Reliability of the Ergo-Kit Functional Capacity Evaluation Method in Adults Without Musculoskeletal Complaints

  • Vincent Gouttebarge
    Correspondence
    Reprint requests to Vincent Gouttebarge, MSc, Coronel Institute for Occupational and Environmental Heath, Academic Medical Center/University of Amsterdam, PO Box 22700, 1100 DE Amsterdam, the Netherlands
    Affiliations
    Coronel Institute for Occupational and Environmental Health, Academic Medical Center, AmCOGG: Amsterdam Center for Research into Health and Health Care, University of Amsterdam, Amsterdam, the Netherlands
    Search for articles by this author
  • Haije Wind
    Affiliations
    Coronel Institute for Occupational and Environmental Health, Academic Medical Center, AmCOGG: Amsterdam Center for Research into Health and Health Care, University of Amsterdam, Amsterdam, the Netherlands
    Search for articles by this author
  • P. Paul Kuijer
    Affiliations
    Coronel Institute for Occupational and Environmental Health, Academic Medical Center, AmCOGG: Amsterdam Center for Research into Health and Health Care, University of Amsterdam, Amsterdam, the Netherlands
    Search for articles by this author
  • Judith K. Sluiter
    Affiliations
    Coronel Institute for Occupational and Environmental Health, Academic Medical Center, AmCOGG: Amsterdam Center for Research into Health and Health Care, University of Amsterdam, Amsterdam, the Netherlands
    Search for articles by this author
  • Monique H. Frings-Dresen
    Affiliations
    Coronel Institute for Occupational and Environmental Health, Academic Medical Center, AmCOGG: Amsterdam Center for Research into Health and Health Care, University of Amsterdam, Amsterdam, the Netherlands
    Search for articles by this author

      Abstract

      Gouttebarge V, Wind H, Kuijer PP, Sluiter JK, Frings-Dresen MH. Intra- and interrater reliability of the Ergo-Kit functional capacity evaluation method in adults without musculoskeletal complaints

      Objective

      To evaluate the intra- and interrater reliability of tests from the Ergo-Kit (EK) functional capacity evaluation method in adults without musculoskeletal complaints.

      Design

      Within-subjects design.

      Setting

      Academic medical center in the Netherlands.

      Participants

      Twenty-seven subjects without musculoskeletal complaints (15 men, 12 women).

      Interventions

      Not applicable.

      Main Outcome Measures

      Seven EK tests (2 isometric, 3 dynamic lifting, 2 manipulation tests) were each assessed 3 times (over 4 days), twice by 1 rater (R1) and once by another rater (R2). Intrarater reliability was calculated using the EK test scores assessed by R1. Interrater reliability was calculated using the EK test scores assessed by both raters. Counterbalancing the rater order made possible the calculation of 2 interrater reliability levels (at time intervals of 4 and 8d). All reliability levels were expressed as intraclass correlation coefficients (ICCs).

      Results

      Intrarater and interrater reliability (8-d time interval) was high (ICC, >.80) for the isometric lifting tests, moderate (ICC range, .50–.80) for the dynamic lifting tests, and low (ICC, <.50) for the manipulation tests. The interrater reliability of the isometric and dynamic lifting tests (4-d time interval) was high (ICC, >.80), and it was moderate (ICC range, .50–.80) for both manipulation tests.

      Conclusions

      The isometric and dynamic lifting tests of the EK have a moderate to high level of reliability; the manipulation tests have a low level of reliability.

      Key Words

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Ferrari R.
        • Russell A.S.
        Regional musculoskeletal conditions.
        Best Pract Res Clin Rheumatol. 2003; 17: 57-70
        • Marras W.S.
        Occupational low back disorder causation and control.
        Ergonomics. 2000; 43: 880-902
        • Palmer K.T.
        Pain in the forearm, wrist and hand.
        Best Pract Res Clin Rheumatol. 2003; 17: 113-135
        • National Research Council, Institute of Medicine
        Musculoskeletal disorders and the workplace. Natl Acad Pr, Washington (DC)2001
      1. Occupational Safety and Health Administration. Prevention of work-related musculoskeletal disorders. 2004. Available at: http://www.osha.gov/pls/oshaweb/owadisp.show_document?p_table=UNIFIED_AGENDA&p_id=4530. Accessed May 11, 2005.

      2. National Statistics Publications. Health and safety statistics highlights 2002/03. 2003. Available at: http://www.hse.gov.uk/statistics/overall/hssh0203.pdf. Accessed May 10, 2005.

      3. Institute for Employee Benefit Schemes UWV. Ontwikkeling arbeidsongeschiktheid Jaaroverzicht WAO/WAZ/Wajong 2002. Amsterdam: Uitvoering Weknemersverzekeringen; 2003. Available at: http://www.uwv.nl/Images/Jaaroverzicht%20ao%202002_tcm4-2299.pdf. Accessed May 11, 2005.

        • Borghouts J.A.
        • Koes B.W.
        • Vondeling H.
        • Bouter L.M.
        Cost-of-illness of neck pain in the Netherlands in 1996.
        Pain. 1999; 80: 629-636
        • King P.M.
        Sourcebook of occupational rehabilitation. Plenum Pr, New York1998
        • Strong S.
        Functional capacity evaluation. 2002 (OT Now ;Jan/Feb:5-9.)
        • Tuckwell N.L.
        • Straker L.
        • Barrett T.E.
        Test-retest reliability on nine tasks of the physical work performance evaluation.
        Work. 2002; 19: 243-253
        • Vasudevan S.V.
        Role of functional capacity assessment in disability evaluation.
        J Back Musculoskeletal Rehabil. 1996; 6: 237-248
        • King P.M.
        • Tuckwell N.
        • Barrett T.E.
        A critical review of functional capacity evaluations.
        Phys Ther. 1998; 78: 852-866
      4. Handleiding Ergo-Kit. Ergo Control, Enschede2002
        • Matheson L.N.
        • Mooney V.
        • Grant J.E.
        • Leggett S.
        • Kenny K.
        Standardized evaluation of work capacity.
        J Back Musculoskeletal Rehabil. 1996; 6: 249-264
        • Mooney V.
        Functional capacity evaluation.
        Orthopedics. 2002; 25: 1094-1099
        • Portney L.G.
        • Watkins M.P.
        Foundations of clinical research. 2nd ed. Prentice Hall, Norwalk2000
        • Innes E.
        • Straker L.
        Validity of work-related assessments.
        Work. 1999; 13: 125-152
        • Innes E.
        • Straker L.
        Reliability of work-related assessments.
        Work. 1999; 13: 107-124
        • Gardener L.
        • McKenna K.
        Reliability of occupational therapists in determining safe, maximal lifting capacity.
        Aust Occup Ther J. 1999; 46: 110-119
        • Gouttebarge V.
        • Wind H.
        • Kuijer P.P.
        • Frings-Dresen M.H.
        Reliability and validity of functional capacity evaluation methods: a systematic review. with reference to Blankenship system, Ergos work simulator, Ergo-Kit and Isernhagen Work System.
        Int Arch Occup Environ Health. 2004; 77: 527-537
        • Hart D.L.
        • Isernhagen S.J.
        • Matheson L.N.
        Guidelines for functional capacity evaluation of people with medical conditions.
        J Orthop Sports Phys Ther. 1993; 18: 682-686
        • Numally J.C.
        Psychometric theory.3rd ed. McGraw-Hill, New York1994
        • Streiner D.L.
        • Norman G.R.
        Health measurement scales. 3rd ed. Oxford Univ Pr, New York2003
        • Carmines E.G.
        • Zeller A.R.
        Reliability and validity assessment. Sage, Thousand Oaks1979
        • Gross D.P.
        Measurements properties of performance-based assessment of functional capacity.
        J Occup Rehabil. 2004; 14: 165-174
        • Scientific Advisory Committee of the Medical Outcomes Trust
        Assessing health status and quality-of-life instruments.
        Qual Life Res. 2002; 11: 193-205
        • Stoelinga B.
        • Van Der Velden J.M.
        • Van Den Bos G.A.
        • Van Lieshout P.A.
        Chronisch Zieken en Gehandicapten. AMC/UVA, Amsterdam1996
        • Boadella J.M.
        • Sluiter J.K.
        • Frings-Dresen M.H.
        Reliability of upper extremity tests measured by the Ergos work simulator.
        J Occup Rehabil. 2003; 13: 219-232
        • Fleiss J.L.
        The design and analysis of clinical experiments. Wiley, New York1986
        • Tinsley H.E.
        Interrater reliability and agreement of subjective judgements.
        J Couns Psychol. 1975; 22: 358-376
        • Shrout P.E.
        • Fleiss J.L.
        Intraclass correlations.
        Psychol Bull. 1979; 86: 420-428
        • Dimitrov D.
        • Rumrill P.
        • Fitzgerald S.
        • Hennessey M.
        Reliability in rehabilitation measurement.
        Work. 2001; 16: 159-164
        • Hripcsak G.
        • Heitjan D.F.
        Measuring agreement in medical informatics reliability studies.
        J Biomed Inform. 2002; 35: 99-110
        • Institute for Employee Benefit Schemes UWV
        Statistische Informatie over Medische Classificatie in WAO, WAZ en Wajong 1999. Uitvoering Weknemersverzekeringen, Amsterdam2001
        • Deyo R.A.
        • Diehr P.
        • Patrick D.L.
        Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation.
        Control Clin Trials. 1991; 12: 42S-158S
        • Astrand P.
        • Rodahl K.
        • Dahl H.A.
        • Stromme S.B.
        Textbook of work physiology. 4th ed. Human Kinetics, Champaign2003
        • Wilmore J.H.
        • Costill D.L.
        Physiology of sport and exercise. Human Kinetics, Champaign1999
        • Reneman M.F.
        • Dijkstra P.U.
        • Westmaas M.
        • Goeken L.N.
        Test-retest reliability of lifting and carrying in a 2-day functional capacity evaluation.
        J Occup Rehabil. 2002; 12: 269-275
        • Horneij E.
        • Holmström E.
        • Hemborg B.
        • Isberg P.E.
        • Ekdahl C.
        Inter-rater reliability and between-days repeatability of eight physical performance tests.
        Adv Physiother. 2002; 4: 146-160
        • Essendrop M.
        • Schibye B.
        • Hansen K.
        Reliability of isometric muscle strength tests for the trunk, hands and shoulders.
        Int J Ind Ergon. 2001; 28: 379-387
        • Lechner D.E.
        • Jackson J.R.
        • Roth D.L.
        • Straaton K.V.
        Reliability and validity of a newly developed test of physical work performance.
        J Occup Med. 1994; 36: 997-1004
        • Isernhagen S.J.
        • Hart D.L.
        • Matheson L.M.
        Reliability of independent observer judgments of level of lift effort in a kinesiophysical functional capacity evaluation.
        Work. 1999; 12: 145-150
        • Reneman M.F.
        • Jaegers S.M.
        • Westmaas M.
        • Goeken L.N.
        The reliability of determining effort level of lifting and carrying in a functional capacity evaluation.
        Work. 2002; 18: 23-27
        • Saunders R.L.
        • Beissner K.L.
        • Mcmanis B.G.
        Estimates of weight that subjects can lift frequently in functional capacity evaluations.
        Phys Ther. 1997; 77: 1717-1728
        • Gross D.P.
        • Battie M.C.
        Reliability of safe maximum lifting determinations of a functional capacity evaluation.
        Phys Ther. 2002; 82: 364-371
        • Brouwer S.
        • Reneman M.F.
        • Dijkstra P.U.
        • Groothoff J.W.
        • Schellekens J.M.
        • Goeken L.N.
        Test-retest reliability of the Isernhagen Work Systems Functional Capacity Evaluation in patients with chronic low back pain.
        J Occup Rehabil. 2003; 13: 207-218