Advertisement

Measurement Properties of a 2-Dimensional Movement Analysis System: A Systematic Review and Meta-analysis

  • Ze Lu
    Correspondence
    Corresponding author Ze Lu, MSc, The School of Rehabilitation Science, McMaster University, Institute of Applied Health Sciences, Room 403, 1400 Main St. W. Hamilton, ON, Canada L8S 4L8.
    Affiliations
    School of Rehabilitation Science, McMaster University, Hamilton, Ontario

    Roth McFarlane Hand and Upper Limb Centre, St. Joseph’s Hospital, London, Ontario
    Search for articles by this author
  • Goris Nazari
    Affiliations
    School of Physical Therapy, Faculty of Health Science, Western University, London Ontario

    Collaborative Program in Musculoskeletal Health Research, Bone and Joint Institute, Western University, London, Ontario, Canada
    Search for articles by this author
  • Joy C. MacDermid
    Affiliations
    Roth McFarlane Hand and Upper Limb Centre, St. Joseph’s Hospital, London, Ontario

    School of Physical Therapy, Faculty of Health Science, Western University, London Ontario

    Collaborative Program in Musculoskeletal Health Research, Bone and Joint Institute, Western University, London, Ontario, Canada
    Search for articles by this author
  • Shirin Modarresi
    Affiliations
    School of Physical Therapy, Faculty of Health Science, Western University, London Ontario
    Search for articles by this author
  • Shannon Killip
    Affiliations
    School of Rehabilitation Science, McMaster University, Hamilton, Ontario
    Search for articles by this author
Published:March 11, 2020DOI:https://doi.org/10.1016/j.apmr.2020.02.011

      Abstract

      Objectives

      To critically appraise, compare, and summarize the quality of the measurement properties of the Dartfish software across various populations and motion tasks.

      Data Sources

      Systematic electronic searches were performed in the PsychInfo, Embase, [email protected], CINAHL, and Google Scholar databases from January 1999 to January 2020.

      Study Selection

      Prospective measurement studies published in English peer-reviewed journals that reported on at least 1 psychometric property (reliability, validity, measurement error) using Dartfish were included. An independent reviewer performed searches and identified studies.

      Data Extraction

      We followed the COnsensus-based Standards for the selection of health Measurement INstruments 2018 guideline for abstracting and assessing data quality. Independent extraction was performed by 2 individual authors. The extracted data involved the author, year, study population, setting, sample size, and measurement properties, as well as information on camera positions, analyzed movement variables, and the corresponding strategy for addressing perspective error.

      Data Synthesis

      In total, 23 studies were included in this review. Studies were pooled to examine inter-rater reliability estimates for different tasks: single-leg squat angle (2 studies, 115 participants; intra-class correlation coefficient [ICC], 0.94; 95% confidence interval [CI], 0.62-0.99), single-leg vertical drop jump angle (2 studies, 94 participants; ICC, 0.92; 95% CI, 0.20-0.99), and vertical drop jump angle (2 studies, 100 participants; ICC, 0.88; 95% CI, 0.83-0.92). Concurrent validity (2-dimensional Dartfish vs 3-dimensional Vicon) was established using the push and release task, single leg stance, and single leg stance with acutely induced dizziness in 45 healthy Parkinson patients. A correlation of 0.59 to 0.98 was reported. For tracking angles across various movements, a measurement error of approximately 10° retest variation was reported in 3 studies.

      Conclusion

      Dartfish is a reliable software for assessing a variety of tasks across multiple contexts of assessments. Evidence suggests that the estimates of motion obtained with Dartfish are valid for single plane movements.

      Keywords

      List of abbreviations:

      2D (2-dimensional), 3D (3-dimensional), CI (confidence interval), COSMIN (COnsensus-based Standards for the selection of health Measurement Instruments), ICC (intra-class correlation coefficient), MDC (minimal detectable change), SEM (standard error of the mean)
      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Archives of Physical Medicine and Rehabilitation
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Dingenen B.
        • Malfait B.
        • Vanrenterghem J.
        • Verschueren S.M.P.
        • Staes F.F.
        The reliability and validity of the measurement of lateral trunk motion in two-dimensional video analysis during unipodal functional screening tests in elite female athletes.
        Phys Ther Sport. 2014; 15: 117-123
        • Dingenen B.
        • Malfait B.
        • Vanrenterghem J.
        • Robinson M.A.
        • Verschueren S.M.P.
        • Staes F.F.
        Can two-dimensional measured peak sagittal plane excursions during drop vertical jumps help identify three-dimensional measured joint moments?.
        Knee. 2015; 22: 73-79
        • McLean S.G.
        • Walker K.
        • Ford K.R.
        • Myer G.D.
        • Hewett T.E.
        • van den Bogert A.J.
        Evaluation of a two dimensional analysis method as a screening and evaluation tool for anterior cruciate ligament injury.
        Br J Sports Med. 2005; 39: 355-362
        • Maykut J.N.
        • Taylor-Haas J.A.
        • Paterno M.V.
        • DiCesare C.A.
        • Ford K.R.
        Concurrent validity and reliability of 2d kinematic analysis of frontal plane motion during running.
        Int J Sports Phys Ther. 2015; 10: 136-146
        • Filippeschi A.
        • Schmitz N.
        • Miezal M.
        • Bleser G.
        • Ruffaldi E.
        • Stricker D.
        Survey of motion tracking methods based on inertial sensors: a focus on upper limb human motion.
        Sensors (Basel). 2017; 17: 1-40
        • Miezal M.
        • Taetz B.
        • Bleser G.
        On inertial body tracking in the presence of model calibration errors.
        Sensors (Basel). 2016; 16: 1-34
        • Piriyaprasarth P.
        • Morris M.E.
        Psychometric properties of measurement tools for quantifying knee joint position and movement: a systematic review.
        Knee. 2007; 14: 2-8
        • Khadilkar L.
        • Macdermid J.C.
        • Sinden K.E.
        • Jenkyn T.R.
        • Birmingham T.B.
        • Athwal G.S.
        An analysis of functional shoulder movements during task performance using Dartfish movement analysis software.
        Int J Shoulder Surg. 2014; 8: 1-9
        • Sinden K.E.
        • MacDermid J.C.
        Evaluating the reliability of a marker-less, digital video analysis approach to characterize fire-fighter trunk and knee postures during a lift task: a proof-of-concept study.
        J Ergon. 2016; 06: 1-10
        • Kesler R.M.
        • Bradley F.F.
        • Deetjen G.S.
        • et al.
        Impact of SCBA size and fatigue from different firefighting work cycles on firefighter gait.
        Ergonomics. 2018; 61: 1208-1215
        • Horn G.P.
        • Kesler R.M.
        • Hsiao-Wecksle E.T.
        • et al.
        Effect of SCBA design and firefighting induced fatigue on balance, gait and safety of movement.
        Urbana-Champaign: Illinois Fire Research Institute, 2015: 1-37
        • Attwells R.L.
        • Birrell S.A.
        • Hooper R.H.
        • Mansfield N.J.
        Influence of carrying heavy loads on soldiers’ posture, movements and gait.
        Ergonomics. 2006; 49: 1527-1537
        • Dempsey P.G.
        • Mathiassen S.E.
        On the evolution of task-based analysis of manual materials handling, and its applicability in contemporary ergonomics.
        Appl Ergon. 2006; 37: 33-43
        • Parsons J.L.
        • Alexander M.J.L.
        Modifying spike jump landing biomechanics in female adolescent volleyball athletes using video and verbal feedback.
        J Strength Cond Res. 2012; 26: 1076-1084
        • Melton C.
        • Mullineaux D.R.
        • Mattacola C.G.
        • Mair S.D.
        • Uhl T.L.
        Reliability of video motion-analysis systems to measure amplitude and velocity of shoulder elevation.
        J Sport Rehabil. 2011; 20: 393-405
        • Paul J.A.
        • Douwes M.
        Two-dimensional photographic posture recording and description: a validity study.
        Appl Ergon. 1993; 24: 83-90
        • Nazari G.
        • Bobos P.
        • MacDermid J.C.
        • Sinden K.E.
        • Richardson J.
        • Tang A.
        Psychometric properties of the Zephyr bioharness device: a systematic review.
        BMC Sports Sci Med Rehabil. 2018; 10: 4-11
        • Nazari G.
        • MacDermid J.C.
        • Sinden K.E.
        • Richardson J.
        • Tang A.
        Reliability of Zephyr Bioharness and Fitbit Charge measures of heart rate and activity at rest, during the modified Canadian aerobic fitness test, and recovery.
        J Strength Cond Res. 2017; 33: 559-571
        • Nazari G.
        • MacDermid J.C.
        Reliability of Zephyr BioHarness respiratory rate at rest, during the modified Canadian aerobic fitness test and recovery.
        J Strength Cond Res. 2020; 34: 264-269
        • Nazari G.
        • MacDermid J.C.
        Minimal detectable change thresholds and responsiveness of Zephyr Bioharness and Fitbit Charge devices.
        J Strength Cond Res. 2020; 34: 257-263
        • Nazari G.
        • MacDermid J.C.
        • Bain J.
        • Levis C.M.
        • Thoma A.
        Estimation of health-related-quality of life depends on which utility measure is selected for patients with carpal tunnel syndrome.
        J Hand Ther. 2017; 30: 299-306
        • Nazari G.
        • MacDermid J.C.
        • Sinden K.E.
        • Richardson J.
        • Tang A.
        Inter-instrument reliability and agreement of Fitbit Charge measurements of heart rate and activity at rest, during the modified Canadian aerobic fitness test, and in recovery.
        Physiother Canada. 2019; 71: 197-206
        • Nazari G.
        Psychometric parameters of zephyr bioharness and fitbit charge [thesis].
        McMaster University, Hamilton, ON, Canada2016 (Available at:) (Accessed August 23, 2019)
        • Norris B.S.T.
        • Olson S.L.
        Concurrent validity and reliability of two-dimensional video analysis of hip and knee joint motion during mechanical lifting.
        Physiother Theory Pract. 2011; 27: 521-530
        • Borel S.
        • Schneider P.
        • Newman C.J.
        Video analysis software increases the interrater reliability of video gait assessments in children with cerebral palsy.
        Gait Posture. 2011; 33: 727-729
        • Gregory D.E.
        • Narula S.
        • Howarth S.J.
        • Russell C.
        • Callaghan J.P.
        The effect of fatigue on trunk muscle activation patterns and spine postures during simulated firefighting tasks.
        Ergonomics. 2008; 51: 1032-1041
        • Mourcou Q.
        • Fleury A.
        • Diot B.
        • Franco C.
        • Vuillerme N.
        Mobile phone-based joint angle measurement for functional assessment and rehabilitation of proprioception.
        Biomed Res Int. 2015; 2015: 328142
        • Prinsen C.A.C.
        • Mokkink L.B.
        • Bouter L.M.
        • et al.
        COSMIN guideline for systematic reviews of patient-reported outcome measures.
        Qual Life Res. 2018; 27: 1147-1157
        • Mokkink L.B.
        • de Vet H.C.W.
        • Prinsen C.A.C.
        • et al.
        COSMIN risk of bias checklist for systematic reviews of patient-reported outcome measures.
        Qual Life Res. 2018; 27: 1171-1179
        • Tavakol M.
        • Dennick R.
        Making sense of Cronbach’s alpha.
        Int J Med Educ. 2011; 2: 53-55
        • Landis J.R.
        • Koch G.G.
        The measurement of observer agreeement for categorical data.
        Biometrics. 1997; 33: 159-174
        • Mukaka M.M.
        Statistics corner: a guide to appropriate use of correlation coefficient in medical research.
        Malawi Med J. 2012; 24: 69-71
        • Weir J.P.
        Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM.
        J Strength Cond Res. 2005; 19: 231-240
        • Bunce C.
        Correlation, agreement, and Bland-Altman analysis: statistical analysis of method comparison studies.
        Am J Ophthalmol. 2009; 148: 4-6
        • Nazari G.
        • Bobos P.
        • MacDermid J.C.
        • Birmingham T.
        The effectiveness of instrument-assisted soft tissue mobilization in athletes, participants without extremity or spinal conditions, and individuals with upper extremity, lower extremity, and spinal conditions: a systematic review.
        Arch Phys Med Rehabil. 2019; 100: 1726-1751
        • Bobos P.
        • Nazari G.
        • Szekeres M.
        • Lalone E.A.
        • Ferreira L.
        • MacDermid J.C.
        The effectiveness of joint-protection programs on pain, hand function, and grip strength levels in patients with hand arthritis: a systematic review and meta-analysis.
        J Hand Ther. 2019; 32: 194-211
        • Nazari G.
        • MacDermid J.C.
        • Bryant D.
        • Athwal G.S.
        The effectiveness of surgical vs conservative interventions on pain and function in patients with shoulder impingement syndrome. A systematic review and meta-analysis.
        PLoS One. 2019; 14: 1-22
        • Miller A.
        • Callister R.
        Reliable lower limb musculoskeletal profiling using easily operated, portable equipment.
        Phys Ther Sport. 2009; 10: 30-37
        • Paul J.C.
        • Petrizzo A.
        • Rizzo J.R.
        • et al.
        Feasibility of a cost-effective, video analysis software-based mobility protocol for objective spine kinematics and gait metrics: a proof of concept study.
        PM R. 2015; 7: 336-339
        • Redler L.H.
        • Watling J.P.
        • Dennis E.R.
        • et al.
        Reliability of a field-based drop vertical jump screening test for ACL injury risk assessment reliability of a field-based drop vertical jump screening test for ACL injury risk assessment.
        Phys Sportsmed. 2016; 44: 46-52
        • Katayanagi J.
        • Iida T.
        • Oyama Y.
        • et al.
        Sagittal plane alignment evaluation during walking in adult spinal deformity: gait analysis using DARTFISH.
        Scoliosis. 2015; 10: P21
        • Nagano Y.
        • Sakagami M.
        • Ida H.
        • Akai M.
        • Fukubayashi T.
        Statistical modelling of knee valgus during a continuous jump test.
        Sports Biomech. 2008; 7: 342-350
        • Mier C.M.
        • Shapiro B.S.
        Reliability of a computer software angle tool for measuring spine and pelvic flexibility during the sit-and-reach test.
        J Strength Cond Res. 2013; 27: 501-506
        • Milgrom R.
        • Foreman M.
        • Standeven J.
        • Engsberg J.R.
        • Morgan K.A.
        Reliability and validity of the Microsoft Kinect for assessment of manual wheelchair propulsion.
        J Rehabil Res Dev. 2016; 53: 901-918
        • Mahmoud I.
        • Othman A.A.A.
        • Abdelrasoul E.
        • Stergiou P.
        • Katz L.
        The reliability of a real time wearable sensing device to measure vertical jump.
        Procedia Eng. 2015; 112: 467-472
        • Paul S.S.
        • Lester M.E.
        • Foreman K.B.
        • Dibble L.E.
        Validity and reliability of two-dimensional motion analysis for quantifying postural deficits in adults with and without neurological impairment.
        . 2016; 1173: 1165-1173
        • Figueroa Ayala C.N.
        • Seda Díaz A.H.
        • Rodríguez Lafontaine A.
        • Rosario M.
        Concurrent validity between two-dimensional and three-dimensional motion systems for evaluation of frontal plane knee kinematics during a drop vertical jump task [thesis].
        University of Puerto Rico, San Juan, Puerto Rico2013
        • Fry K.E.
        • Pipkin A.
        • Wittman K.
        • Hetzel S.
        • Sherry M.
        Youth baseball pitching stride length: normal values and correlation with field testing.
        Sports Health. 2017; 9: 205-209
        • Christensen E.
        • Castle K.B.
        • Hussey E.
        Clinical feasibility of 2-dimensional video analysis of active cervical motion in congenital muscular torticollis.
        Pediatr Phys Ther. 2015; 27: 276-283
        • Allen T.
        • Hollingham Z.
        • Macwhirter J.
        • et al.
        Inter-rater reliability of DartfishTM movement analysis software for measuring maximum flexion and extension at the hip and knee in older adults with osteoporosis and osteopenia.
        Physiother Theory Pract. 2019; 35: 577-585
        • Souza R.B.
        • Hatamiya N.
        • Allen C.
        • et al.
        Medial and lateral heel whips: prevalence and characteristics in recreational runners.
        PM R. 2015; 7: 823-830
        • Stensrud S.
        • Myklebust G.
        • Kristianslund E.
        • Bahr R.
        • Krosshaug T.
        Correlation between two-dimensional video analysis and subjective assessment in evaluating knee control among elite female team handball players.
        Br J Sports Med. 2011; 45: 589-595
        • Fourchet F.
        • Materne O.
        • Horobeanu C.
        • Hudacek T.
        • Buchheit M.
        Reliability of a novel procedure to monitor the flexibility of lower limb muscle groups in highly-trained adolescent athletes.
        Phys Ther Sport. 2013; 14: 28-34
        • Mier C.M.
        Accuracy and feasibility of video analysis for assessing hamstring flexibility and validity of the sit-and-reach test.
        Res Q Exerc Sport. 2011; 82: 617-623
        • De Toledo J.M.
        • Loss J.F.
        • Janssen T.W.
        • et al.
        Kinematic evaluation of patients with total and reverse shoulder arthroplasty during rehabilitation exercises with different loads.
        Clin Biomech. 2012; 27: 793-800
        • Terwee C.B.
        • Bot S.D.M.
        • de Boer M.R.
        • et al.
        Quality criteria were proposed for measurement properties of health status questionnaires.
        J Clin Epidemiol. 2007; 60: 34-42