Archives of Physical Medicine and Rehabilitation
Volume 90, Issue 8 , Pages 1349-1363, August 2009

Associations Between Treatment Processes, Patient Characteristics, and Outcomes in Outpatient Physical Therapy Practice

  • Daniel Deutscher, MSc, PT

      Affiliations

    • Physical Therapy Services, Maccabi Health Care Services—HMO, Tel-Aviv, Israel
    • Corresponding Author InformationCorrespondence to Daniel Deutscher, MSc, PT, 27 Hamered St, Tel-Aviv 68125, Israel
  • ,
  • Susan D. Horn, PhD

      Affiliations

    • Institute for Clinical Outcomes Research, Salt Lake City, UT
  • ,
  • Ruth Dickstein, DSc, PT

      Affiliations

    • Department of Physical Therapy, Faculty of Social Welfare and Health Sciences, University of Haifa, Mount Carmel, Haifa, Israel
  • ,
  • Dennis L. Hart, PhD, PT

      Affiliations

    • Consulting and Research, Focus On Therapeutic Outcomes Inc, White Stone, VA
  • ,
  • Randall J. Smout, MS

      Affiliations

    • Institute for Clinical Outcomes Research, Salt Lake City, UT
  • ,
  • Moshe Gutvirtz, MHA, BPT

      Affiliations

    • Physical Therapy Services, Maccabi Health Care Services—HMO, Tel-Aviv, Israel
  • ,
  • Ilana Ariel, BPT

      Affiliations

    • Northern District Physical Therapy Services, Maccabi Health Care Services—HMO, Haifa, Israel

Article Outline

Abstract 

Deutscher D, Horn SD, Dickstein R, Hart DL, Smout RJ, Gutvirtz M, Ariel I. Associations between treatment processes, patient characteristics, and outcomes in outpatient physical therapy practice.

Objective

To identify how treatment processes are related to functional outcomes for patients seeking treatment for musculoskeletal impairments while controlling for demographic and health characteristics at intake.

Design

Prospective, observational cohort study. Treatment processes were not altered. Data were collected continuously from June 2005 to January 2008. Descriptive statistics were applied to compare patient characteristics, interventions, and outcomes between impairment categories. Ordinary least-squares multiple regressions were used to examine associations between patient characteristics at intake, treatment processes, and functional outcomes.

Setting

Fifty-four community-based outpatient physical therapy clinics of Maccabi Healthcare Services, a public health plan in Israel.

Participants

A consecutive sample of 22,019 adult patients (mean age 51.2y, standard deviation=15.7, range 18–96, 58% women) seeking treatment due to lumbar spine, knee, cervical spine, or shoulder impairments with functional measurements at intake and discharge.

Interventions

Not applicable.

Main Outcome Measure

Functional status at discharge.

Results

Explanatory power ranged from 30% to 39%. Better outcomes were associated with patient compliance with self-exercise and therapy attendance, application of therapeutic exercise and manual therapy, and completion of 3 or more functional surveys during the episode of care. Worse outcomes were associated with women, electrotherapy for pain management, and therapeutic ultrasound for shoulder impairments. Mixed results were found for group exercise programs.

Conclusions

The study of associations between treatment processes, patient characteristics, and outcomes helps to describe practice and can be used to suggest ways to improve outcomes in outpatient physical therapy practice.

Key Words: Database, Evidence-based practice, Musculoskeletal system, Rehabilitation, Therapy, physical (specialty)

List of Abbreviations: APTA, American Physical Therapy Association, BMI, body mass index, CAT, computerized adaptive testing, EHR, electronic health record, FS, functional status, ICD-9, International Classification of Diseases, 9th Revision, IRT, item response theory, PT, physical therapy

 

PHYSICAL THERAPISTS are continuously challenged to provide evidence of contribution to patients' health. Desired outcomes of PT include enhanced physical and functional abilities and restored, maintained, or promoted optimal physical function, wellness, fitness, and optimal quality of life related to movement and health.1 The World Confederation for PT promotes physical functioning as a primary goal of the profession,2 emphasizing the importance of activities and participation components as defined in the International Classification of Functioning, Disability and Health.3 Therefore, physical functioning, defined as a patient's ability to perform activities,4, 5 is an essential construct that should guide clinical reasoning when establishing treatment goals and assessing outcomes.

Improvement in PT services and outcomes depends on the therapist's ability to identify treatment processes that are related to best outcomes, controlling for large variability in patient characteristics. To date, although research in PT is increasing, reports on associations between treatment processes, patient characteristics, and outcomes are limited. These associations can be investigated through experimental or observational studies, with the purpose of enhancing the ability to choose the right treatment for the right patient on the basis of the evidence.

In observational studies, also called practice-based evidence studies,6 evidence is based on daily medical practice without establishing a specific experimental environment.7 Practice-based evidence studies are more available today as a result of computerization of medical services and formation of large clinical databases.8, 9, 10 Within these databases, data on daily practice provided to all patients are captured, enabling the study of relationships between treatments and outcomes. Patient characteristics are accounted for by multivariate statistics, in which many variables can be considered simultaneously and covariates can be identified and controlled to evaluate intervention effects. The practice-based evidence design (initially called clinical practice improvement study design)11, 12 allows nonstandardized treatment protocols to be included, so data reflect real-world clinical environments. Practice-based evidence studies have few selection criteria for participation, thus enhancing generalizability of findings (external validity).11 For example, patients with comorbidities are commonly excluded from randomized, controlled trials but are included in practice-based evidences, thus extending generalizability of findings to the targeted population.13 Practice-based evidence studies require comprehensive, complex databases including detailed patient demographic and health descriptions, characterizations of rehabilitation treatments, and recordings of valid outcomes measures.13 If the data set is large enough and if factors influencing distributions of both interventions and outcomes of interest are measured and controlled, treatment effects can be identified from observational data.7 A practice-based evidence design is not valid for identification of cause and effect but can identify associations between treatments and outcome variables, which then can be used to develop future before/after studies or randomized, controlled trials.

Of the 114,953 episodes of care provided to 101,310 patients who received PT services during 2007 in outpatient clinics of a medical service in Israel (Maccabi Healthcare Services), 93% were initiated as a result of musculoskeletal disorders, which are known to be associated with high treatment costs.8, 9, 14, 15, 16, 17 The 4 most frequently affected body parts were the lumbar spine (21%), knee (14%), cervical spine (15%), and shoulder (13%), which is similar to the incidence in outpatient clinics in the United States.15 Therefore, we included in our study patients receiving PT treatments in Maccabi for these 4 impairments groups. The current study, which is based on a practice-based evidence design of a large clinical data set, seeks to identify those treatment processes that were related to functional outcomes, controlling for patient characteristics.

Back to Article Outline

Methods 

Design 

We conducted a prospective, observational cohort study. Treatment processes were not altered. Data were collected prospectively from June 2005 to January 2008 from all patients referred to PT who met the inclusion criteria described below.

Subjects 

The study was conducted in the PT service of Maccabi, a public health maintenance organization responsible for providing health care for approximately 1.8 million people in Israel. Patients were Israeli born and new immigrants, including people whose primary language was Hebrew, Russian, Arabic, English, or Spanish. The study population included all adult patients (at least 18 years of age) who were treated with PT. Some had more than 1 episode of care. We analyzed each episode separately; therefore, we refer in the text to episodes of care as patients. This study was approved by the Institutional Review Board for the Protection of Human Subjects of Maccabi Healthcare Services—HMO, Israel.

Patients were selected for analyses if they had a musculoskeletal disorder related to 1 of the 4 impairment categories described above and had FS measurements at intake (first visit) and discharge (last visit). The study population came from a larger group of patients that had similar characteristics, including patients who either completed the treatment episode without completing a functional survey at discharge (incomplete protocol), or dropped out of treatment during the episode of care. Given the possibility for patient selection bias for patients with complete data, a comparison of patient demographic and health characteristics was made between the 2 groups of patients: those with complete and those with incomplete data for characteristics known to be related to functional outcomes, eg, age, days from onset of symptoms (acuity), and FS at intake.15, 17, 18, 19

Clinics and Therapists 

Outpatient rehabilitation clinics were defined operationally as clinics where patients with neuromusculoskeletal impairments not requiring hospitalization were treated.16 Patients were managed by 386 physical therapists (aged 36±10y, range 22–63y, 72% women) employed in 54 clinics (2–20 therapists per clinic) located in 50 cities throughout Israel. All therapists held a bachelor's degree in PT, and 10% had also earned a master's degree. The average number of years of clinical experience ± standard deviation was 10±9 years. Data were collected during routine practice where electronic outcomes were integrated into an EHR system.8

Patient Characteristics and Treatment Process Data Collection 

Patient characteristics and treatment process data were collected by the Maccabi EHR system, as described elsewhere.8 Briefly, the EHR was developed to standardize data collection related to all medical encounters for all Maccabi members, including medical data regarding treatments, patient responses, and clinical assessment. Detailed documentation of medical encounters was accomplished by using standardized data screens with each patient related to a single central medical therapy file that is accessible from any Maccabi facility throughout the country. The system provides online patient characteristics and treatment process data in real time for all clinicians. Data entered into the central data file for each therapy visit include patient personal identification number, age, sex, visit dates and time, treatment duration, clinician and clinic identification, episode identification, type of care (eg, orthopedic, neurologic), type of payer, referring doctor information, diagnosis based on ICD-9 coding,20 physical therapist's classification, treatments used, and information on falls for elderly patients. Data including reason for discharge, goal achievement, attendance and exercise compliance, and capacity to return to previous activities are entered by therapists at discharge from therapy. Data generated from the EHR system are regularly imported to the Maccabi PT database. A thorough data validation process was conducted each month during 2004 and first half of 2005 when the EHR system was implemented, and it was validated by a random electronic file selection process to compare imported and original data. Whenever inconsistencies or inaccuracies were found, EHR programming or import procedures were modified until data were validated. Data entered by clinicians to the EHR were checked for inaccuracies during monthly educational sessions conducted between each clinician and their clinic manager.

Outcomes Data Collection 

Patient-centered FS outcomes data were collected via CAT4, 5, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31 based on IRT.32, 33 The use of CATs to collect outcomes data in routine clinical work is a relatively new concept,4, 5, 23, 24, 29, 30, 31 but small-25, 26, 27, 28 and large-scale8, 15 applications have been described. Primary benefits of CAT are efficient data collection (eg, reduced respondent burden) with little loss of measurement precision4, 5, 15, 24, 25, 26, 27, 28, 29, 31, 34, 35, 36, 37 and ability to integrate data collection with an EHR in an automated manner. The FS outcomes data were integrated with the EHR data into a comprehensive database.8 Manual verifications were conducted to ensure patient EHR data and outcomes data were merged accurately.

We used 4 body part–specific CATs38 to estimate patient-specific FS measures: cervical spine,15 shoulder,4 lumbar spine,29 and knee.5, 39 FS was defined as the patient's perception of his or her ability to perform functional tasks described in the FS items4, 5, 15, 29 and represents the activity dimension of the International Classification of Functioning, Disability and Health.3 Briefly, CATs were developed by calibrating items into scales using the Andrich rating scale IRT model.40 Results from previous studies4, 5, 15, 29 suggested data fit the IRT model, items represented unidimensional scales with adequate local independence, and thus supported the FS measures were interval scaled. Measures of FS generated by IRT mathematics and applied with CAT methods38 were transformed to a range from 0 to 100 (low [0] to high [100] functioning) on a linear metric.4, 5, 15, 29 Although each CAT is transformed to a 0 to 100 FS metric, the 4 body part–specific FS scales were not equated,41 so all regressions were performed separately for the body part–specific scales. Each CAT was developed to assess FS for patients with a specific type of impairment. Therefore, the item bank for each CAT is different (different items and item calibrations). However, all CATs use a specific starting item, the same item selection routine, estimate FS with the same technique with similar 0 to 100 linear metrics, and apply the same stopping rules. Specifics of each CAT have been published.4, 5, 15, 29 Studies describing sensitivity to change,39, 42, 43 responsiveness,39, 42, 43 and clinical interpretation44 of FS measures estimated using the CATs are starting to be published, all of which support the notion that CAT FS measures have sound psychometric properties and can be interpreted in clinically meaningful ways.

We used Patient Inquiry version 5.0 software45,a to collect functional outcomes data. The software was customized by translating the original English surveys into Hebrew, Russian, and Arabic. Spanish surveys were available from the original Patient Inquiry software. Because outcomes data were collected using CATs, each clinic had at least 1 computer survey stand, including a touch screen connected to the Maccabi network for survey administration and data capture.

Electronic Database Preparation 

We integrated 2 data sets (the functional outcomes database and existing EHR database) to form a PT database.8 The PT database was integrated with a third database stored on the Maccabi central computer that contains information on comorbidities based on ICD-9 codes,20 or by attribution to disease-specific registries,46, 47, 48 chronic use of medication (based on prescribed pharmaceutical purchasing database), and appointment scheduling.

Data Analysis 

Descriptive statistics were used to examine frequencies of categorical patient and treatment variables, and average and amount of variation with standard deviation for continuous measures. We compared patients with complete or incomplete outcomes collection protocol, as well as patient characteristics, therapy interventions, and outcomes between patients with lumbar spine, cervical spine, shoulder, and knee impairments. Chi-square tests were used for analysis of categorical data, and t tests or analyses of variance were used for continuous data. The α was set at .05.

We used ordinary least-squares multiple regression to examine associations between variables describing demographic and health characteristics at intake and treatment process variables with each patient's functional outcome at discharge. Use of CAT estimated measures of functional outcomes are not common in regression models of health data, but we thought that the interval nature of the FS measures based on a rating scale IRT model was appropriate for regression techniques that assume linearity of continuous data.49 Only variables with frequencies of 2% or more of the sample were allowed to enter regression models. Stepwise R2 selection procedure for ordinary least-squares regressions allowed independent variables to enter and leave each model. We created the most parsimonious model for each outcome by allowing only significant variables to remain in the model.50 Variables were entered if the significance level of its T value was less than .05 (entry value) and removed if significance was greater than 0.1 (removal value). The importance of each predictor was determined by its T value. Variables entering regression models were checked for multicollinearity; no correlations were greater than 0.6. All analyses were performed with SPSS statistical software, version 15.b

Data on age, intake FS, number of comorbidities, number of disease specific registries, number of visits per treatment episode, duration in days of treatment episode, and number of procedural interventions throughout the episode of care were allowed to enter the regression models as continuous measures. For categorical data, we created a dummy variable for each category to be used as independent variables in the regression models. Each category was represented as a binary predictor coded 1 if present and 0 if absent. All categories that were allowed to enter as dummy variables into the regression models are described in Table 1, Table 2, Table 3, Table 4. For example, we used dummy variables to represent the attribution of each specific comorbidity, each disease specific registry, and each specific chronic medication use.

Table 1. Patient Characteristics
VariablesTotal (N=22,019)Lumbar Spine (n=7216)Knee (n=4394)Cervical Spine (n=5157)Shoulder (n=5252)P
Patient Demographic Characteristics
Age51±1650±1653±1648±1556±15<.001
Age groups (%) <.001
18–4535.641.430.745.022.5
45–6542.838.243.341.549.8
65–7515.214.218.110.318.9
Over 756.46.27.93.28.8
Sex (%) .003
Male42.042.841.140.243.4
Female58.057.258.959.856.6
Payer (%) <.001
Maccabi78.079.590.755.587.3
MVA19.217.86.141.410.2
Work2.72.73.03.02.3
Others0.10.00.20.10.2
Daily activity (%) <.001
Office29.330.125.633.926.9
Physical11.812.910.711.411.6
Combined58.957.063.754.761.5
Language (%) <.001
Hebrew67.866.568.770.066.7
Russian26.628.225.424.827.1
English3.22.83.92.44.1
Arabic1.41.70.81.91.0
Spanish1.00.81.20.91.1
Health and Functional Status Data at Intake
Intake FS48.3±11.846.2±13.845.3±12.851.8±13.4<.001
Acuity (%) <.001
Acute18.218.313.225.415.4
Sub acute34.832.434.435.038.1
Chronic47.049.352.439.646.5
Medication use at intake (%) <.001
Yes43.245.336.949.839.0
No56.854.763.150.261.0
No. of related surgeries (%) <.001
None92.594.483.696.393.7
15.13.512.32.23.9
21.41.22.60.81.3
30.60.51.00.20.6
4 or more0.40.40.50.50.5
Physical activity (%) <.001
None51.354.450.950.648.4
1–2/wk18.618.716.919.918.4
3 or more30.127.032.229.533.2

NOTE. Values are mean ± SD unless otherwise noted.

Refer to Appendix 1 for variable operational definitions.

Age is described both as continuous data and in categories but is allowed to enter the regression models only as continuous data.

Table 2. Patient Comorbidities or Attribution to Disease Registries
Comorbidity/Medical RegistryTotal (N=22,019)Lumbar Spine (n=7216)Knee (n=4394)Cervical Spine (n=5157)Shoulder (n=5252)P
Comorbidities0.84±1.140.81±1.140.89±1.140.69±1.040.98±1.23<.001
Comorbidities groups (%) <.001
None53.655.650.558.848.3
124.023.324.623.525.0
212.511.314.310.814.2
3 or more9.99.810.66.912.5
Registry count0.66±0.860.63±0.850.71±0.860.53±0.770.78±0.91<.001
Registry count groups (%) <.001
None54.856.652.060.949.0
128.627.929.227.530.1
212.711.615.29.115.5
3 or more3.93.93.62.55.4
Asthma or other lung disease (%)4.03.84.14.14.2.737
Cardiovascular registry (%)10.31010.48.212.8<.001
CVA/TIA (%)NANANANA2.0
Depressive disorder (%)2.22.22.22.22.2.984
Diabetes registry (%)10.59.911.17.414.1<.001
Fertility registry (%)4.14.62.65.93.0<.001
Heart disease (%)3.94.23.62.85.0<.001
Hyper cholesterol (%)17.216.318.813.920.5<.001
Hyper tension registry (%)35.934.440.528.041.9<.001
Hypothyroidism (%)4.14.04.63.74.4.119
Oncology registry (%)4.94.45.83.85.9<.001
Osteoporosis (%)4.24.34.43.05.0<.001
Overweight or obesity (%)3.83.74.62.94.1<.001
Tobacco use disorder (%)8.28.66.59.87.7<.001

NOTE. Values are mean ± SD unless otherwise noted.

Abbreviations: CVA, cerebral vascular accident; NA, not applicable; TIA, transient ischemic attack.

Comorbidities and registry count are described both as continuous data and in categories but are allowed to enter the regression models only as continuous data.

Frequencies <2%.

Table 3. Chronic Use of Medication
Condition Treated/Medication GroupTotal (N=22,019)Lumbar Spine (n=7216)Knee (n=4394)Cervical Spine (n=5157)Shoulder (n=5252)P
Anticonvulsant4.34.33.54.54.7.021
Antidepressant12.712.511.913.712.7.044
AntineoplasticNANANANA2.0
Antipsychotic2.12.2NA2.4NA.195
Antithrombotic21.019.823.515.725.8<.001
Asthma8.38.19.07.98.5.186
Cardiovascular32.230.736.624.738.1<.001
Corticosteroids3.63.73.33.14.0.044
Diabetes9.18.49.76.412.5<.001
Hormonereplacementtherapy6.66.56.96.27.1.258
Hyperlipidemic32.129.335.325.539.7<.001
Hypothyroidism7.26.87.96.47.8.004
Migraine2.72.82.33.62.2<.001
Osteoporosis7.97.88.95.59.4<.001
Prostate6.05.66.64.97.3<.001
Sedatives10.610.410.810.510.9.811

NOTE. Values are percentage of N.

Abbreviation: NA, not applicable.

Frequencies <2%.

Table 4. Treatment-Related Variables
VariablesTotal (N=22,019)Lumbar Spine (n=7216)Knee (n=4394)Cervical Spine (n=5157)Shoulder (n=5252)P
No. of visits7.6±4.47.1±3.67.7±4.87.5±3.78.5±5.5<.001
Duration (d)52.8±38.050.8±37.149.6±35.355.4±39.055.5±40.1<.001
Referring doctor specialty (%) <.001
General practitioner17.017.49.824.315.2
Orthopedic75.075.184.464.577.5
Other8.07.55.811.27.3
Waiting days from referral30.7±34.931.5±32.330.4±34.129.9±35.030.5±38.7.105
Waiting days from referral categories (%) <.001
0 to 720.418.423.220.421.0
7.1 to 1412.912.712.113.912.9
14.1 to 3024.424.622.325.724.6
Over 3042.344.342.440.041.5
Mean appointment time (min)27.3±8.928.2±9.125.4±8.128.8±9.926.0±7.6<.001
Mean appointment time categories (%) <.001
0 to 19.913.011.317.011.014.0
20 to 24.927.824.931.325.131.6
25 to 29.924.424.424.423.625.2
30 or more34.839.427.340.329.2
Attendance compliance (%) <.001
Good87.587.187.886.288.9
Moderate6.56.65.68.25.7
Not good0.70.80.90.70.6
Irrelevant5.35.55.74.94.8
Home exercise compliance (%) <.001
Good66.764.469.564.469.8
Moderate15.416.513.017.114.1
Not good5.66.45.35.84.7
Irrelevant§12.312.712.212.711.4
No. of surveys during episode of care (%) .001
278.278.880.277.376.8
3 or more21.821.219.822.723.2

NOTE. Values are mean ± SD unless otherwise noted.

Refer to Appendix 1 for variable operational definitions.

Continuous variables of waiting days from referral to start of therapy and mean appointment time were allowed to enter regression models as categorical variables for ease of clinical interpretation, but they are also described as continuous data.

Irrelevant attendance compliance refers to cases with a very small number of visits.

§Irrelevant home exercise compliance refers to cases where no self-exercises were prescribed.

Back to Article Outline

Results 

Subjects 

Intake surveys were administered for 57,008 patients. There were 17,485 patients (31%) who completed treatment but who did not complete a functional survey at discharge (incomplete protocol), and 17,504 patients (31%) who dropped out of treatment during the episode of care. That left 22,019 patients with intake and discharge measures, a 39% completion rate.8 Descriptive data of these patients are provided in Table 1, Table 2, Table 3, Table 4, Table 5. The definitions of variables and categories described in tables are in appendix 1. Comparison of patient's age, acuity, and FS at intake between patients with complete versus incomplete outcomes collection protocols suggested no difference in age (51.2±15.7y and 51.2±16.2y, respectively, P=.97), slight differences in sex frequency (58.0% and 59.5%, respectively, P=.02), and a statistically significant but clinically identical difference in FS at intake (48.0±13.1 and 48.3±14.1, respectively, P=.02). However, the percentage of patients with a chronic condition at intake (conditions existing for >90 days as perceived by the patient) was higher in the incomplete protocol group than in the complete protocol group (51% and 47%, respectively, P<.001), as was the average number of comorbidities (.88±1.2 and .84±1.1, respectively, P<.001).

Table 5. Physical Therapy Procedural Interventions and Outcome Measure
VariablesTotal (N=22,019)Lumbar Spine (n=7216)Knee (n=4394)Cervical Spine (n=5157)Shoulder (n=5252)P
Physical Therapy Procedural Interventions As Recorded in the EHR
Actsit_mob0.1±0.6NANA0.1±0.40.2±1.0<.001
Assit_exNANANANA0.1±0.9
Assupron_exNANANANA0.1±1.2
Bike_exNANA0.4±1.7NANA
Back_sch0.2±0.80.4±1.2NANANA
Clinic_ex1.4±2.91.0±1.91.9±3.50.8±1.82.2±3.8<.001
Cold_packNANA0.1±0.9NANA
Consult0.1±0.40.1±0.40.1±0.30.1±0.40.1±0.3.079
DFM0.5±1.50.3±1.20.4±1.50.4±1.50.8±2.0<.001
Electro_pain2.3±3.12.7±3.12.3±3.21.9±2.82.3±3.3<.001
Ergonomic0.1±0.30.1±0.3NA0.1±0.30.04±0.3<.001
Function_exNANA0.1±0.5NANA
Gait_exNANA0.1±0.6NANA
Group_ex0.9±2.50.7±2.20.7±2.41.5±2.90.8±2.5<.001
Hot_pack2.1±2.92.3±2.91.0±2.32.9±3.01.9±3.1<.001
Joint_mob2.2±3.22.2±2.91.6±2.92.7±3.32.3±3.7<.001
MET0.2±1.3NA0.3±1.7NA0.4±2.1<.001
Neural_mob0.1±0.70.1±0.8NA0.1±0.70.1±0.8<.001
Passup_mob0.2±1.10.1±0.60.1±0.60.1±0.60.4±1.9<.001
Proprio_exNANA0.3±1.2NANA
Reassess0.7±1.50.7±1.30.8±1.50.7±1.30.8±1.7<.001
Self_ex1.9±2.31.8±2.12.1±2.31.6±2.02.1±2.6<.001
Shortwave0.8±2.10.5±1.61.5±2.80.3±1.11.0±2.4<.001
Softis_mob1.4±2.61.3±2.30.9±2.21.8±2.71.6±2.9<.001
Stabil_ex0.1±0.80.1±0.6NA0.1±0.40.2±1.3<.001
Stretch_ex0.1±0.70.1±0.70.1±0.50.1±0.60.2±1.0<.001
Strength_ex0.1±0.9NA0.3±1.3NA0.2±1.1<.001
Supron_ex0.1±0.70.1±0.70.1±0.90.1±0.50.1±0.8<.001
ThermasNANANANA0.1±1.0
Ultrasound1.3±2.60.7±1.91.9±3.00.6±1.72.1±3.2<.001
Physical Therapy Procedural Interventions as Defined in the Guide to PT Practice1
ElectroAPTA3.1±3.73.2±3.53.9±4.12.2±3.03.3±4.1<.001
Man_therAPTA4.3±5.14.0±4.53.0±4.55.1±5.15.0±5.8<.001
PammAPTA3.8±4.43.6±4.13.2±4.34.1±4.34.4±4.9<.001
Therap_exAPTA5.6±6.24.7±4.16.6±7.24.5±3.97.3±8.6<.001
Outcome Measure
FS at discharge59.4±14.058.9±15.855.9±15.964.8±14.6<.001
FS change11.1±12.912.8±14.610.6±13.713.0±14.5<.001

NOTE. Values are mean ± SD of average number of times each code was used during the episode of care.

Abbreviation: NA, not applicable.

Refer to Appendix 1 for variable operational definitions.

Frequencies <2%.

Patient Demographic and Health Data 

Patient demographic and general health characteristics at intake are described in table 1. Patients with lumbar and cervical spine impairments were younger than patients treated for knee and shoulder impairments. Nearly half of all patients were referred to treatment for chronic conditions existing at least 3 months, and 51% were not involved in any weekly physical activity before onset of the condition being treated. Most patients answered the surveys in Hebrew, and 27% of patients answered in Russian. For 19% of patients, the payer was motor vehicle insurance due to a motor vehicle accident. The rate of motor vehicle accident payer among cervical spine impairments was more than double that for the full sample.

Patient comorbid conditions or attribution to disease registries are described in table 2. The highest number of comorbidities was usually found in patients with shoulder impairments, followed by knee impairments. Patients with cervical spine impairments had the largest frequency of tobacco use or women registered in the fertility registry, and patients with knee impairments had the highest rate of overweight or obesity. No significant differences between impairment groups were found for frequencies of hypothyroidism, asthma or other lung diseases, and depressive disorders.

Data on chronic use of medication are described in table 3. Patients treated for shoulder impairments usually used more medications than patients in the other groups. Yet patients with spinal impairments (mainly cervical spine) used more antipsychotic and antimigraine medication than patients with shoulder and knee problems. No substantial differences among impairment groups were found for frequencies of chronic use of sedatives, antidepressants, asthma medications, corticosteroid drugs, and hormone replacement therapy.

Treatment Process 

Variables related to treatment process are described in table 4. Number of visits per treatment episode, attendance compliance, and home exercise compliance were higher in patients with knee and shoulder compared with patients with lumber and cervical spine impairments. In all categories, most referrals were from orthopedic surgeons, with the highest rate for patients with knee impairments. The longest appointment length of time was scheduled for patients with spinal impairments. The lowest rate of patients completing at least 1 survey during the treatment episode in addition to the surveys completed at intake and discharge was in the knee impairment group. There were no differences between impairment groups in waiting days from referral to first visit.

PT procedural interventions, intervention groups as defined in the guide to PT practice,1 and FS outcome measures are described in table 5. The data in the table represent the average number of times each intervention was used during the overall episode of care. Exercises performed in the clinic were recorded more than twice as much for knee and shoulder than for lumbar and cervical spine impairments. Self-exercise education also was recorded more frequently in patients with knee and shoulder impairments than in spinal impairments, as was the case for the aggregated therapeutic exercise code. Group exercise was most frequent in patients with cervical spine impairments, and joint mobilization was least frequent for patients with knee impairments. Shortwave therapy was applied most frequently for knee impairments, and therapeutic ultrasound was applied most frequently for shoulder impairments.

Associations Between Patient Characteristics, Process of Care, and Outcomes 

Multiple regression analyses for the 4 impairment categories are presented in Table 6A, Table 6B. The table has 2 sections. The first section (6A) includes significant associations between patient demographic and health characteristics at intake and FS at discharge (outcome). The second section (6B) includes significant associations between treatment process variables and functional outcome at discharge, controlling for patient characteristics. The explanatory power of the 4 regression models (1 model per patient group), described by R2 values, ranged from 30% to 39%. The R2 value did not change when allowing 4 aggregated procedural intervention variables (ElectroAPTA, Man_therAPTA, PammAPTA, Therap_exAPTA)1 to enter models, compared with allowing specific process variables. Therefore, we selected specific process variables for the 4 regression models because they are more informative than aggregated intervention variables from a clinical perspective. B coefficients indicated the amount of expected change in discharge FS given a 1-unit change in the value of the respective predictor variable, given that all other variables in the model are held constant. T values indicated the importance of each independent variable on predicting discharge FS (dependent variable).

Table 6A. Multiple Regression Analyses by Impairment Categories: Patient Characteristics
Dependent VariableLumbar Spine ImpairmentKnee ImpairmentCervical Spine ImpairmentShoulder Impairment
Discharge FS(n=7216; R2=0.35)(n=4394; R2=0.36)(n=5157; R2=0.39)(n=5252; R2=0.30)
PredictorsBTPBTPBTPBTP
Constant34.035.4<.00136.025.1<.00133.427.5<.00140.631.9<.001
Demographic
Age−0.1−5.3<.001−0.1−4.6<.001−0.1−7.4<.001−0.1−8.0<.001
Daily activity=office0.62.0.041
Female −1.5−3.7<.001−1.9−5.1<.001−2.2−6.1<.001
Language=Hebrew 0.92.5.013
Language=Russian1.85.7<.0012.34.7<.001
Payer=Maccabi3.28.8<.0013.13.8<.0013.78.6<.0014.07.2<.001
Payer=Work −3.4−2.5.013
Health
Acuity=acute3.07.4<.0012.03.0.0021.53.1.0022.24.2<.001
Acuity=chronic−2.8−9.2<.001−3.4−8.1<.001−3.5−8.3<.001−2.2−5.9<.001
Intake functional status0.545.5<.0010.533.9<.0010.640.8<.0010.533.4<.001
Medication use at intake −1.3−3.0.003−1.3−3.5<.001
No. of related surgeries=1 or more−3.8−6.4<.001
Physical activity=1–2/week 1.12.5.012
Physical activity=none−1.4−5.2<.001−1.6−4.0<.001−1.1−3.1.002
Comorbidities
No. of comorbidities−0.5−3.5.001
No. of medical condition registries −0.7−2.7.006
Cardiovascular registry −1.1−2.0.042
Tobacco use disorder −1.4−2.4.015−1.4−2.1.035
Chronic medication use
Antidepressant−1.5−3.7<.001−1.5−2.4.016−1.2−2.4.018−1.8−3.5<.001
Asthma−1.5−3.0.003
Migraine −3.0−3.2.001
Osteoporosis−1.3−2.4.015−1.5−2.1.035

B indicates the coefficient that represents the amount of expected change in discharge FS given a 1-unit change in the value of the variable, given that all other variables in the model are held constant.

T indicates values representing the importance of each independent variable on predicting discharge FS (dependent variable).

Table 6B. Multiple Regression Analyses by Impairment Categories: Treatment Process
Dependent VariableLumbar Spine ImpairmentKnee ImpairmentCervical Spine ImpairmentShoulder Impairment
Discharge FS(N=7216; R2=0.35)(N=4394; R2=0.36)(N=5157; R2=0.39)(N=5252; R2=0.30)
PredictorsBTPBTPBTPBTP
Constant34.035.4<.00136.025.1<.00133.427.5<.00140.631.9<.001
Process related
Attendance compliance=good2.14.7<.0011.72.5.0132.95.0<.0012.54.1<.001
Referring doctor's specialty=general practitioner1.33.3.001
Referring doctor's specialty=orthopedic −1.1−3.1.002
Duration0.0−2.0.049
Home exercise compliance=good3.08.9<.0013.46.6<.0013.17.2<.0014.29.6<.001
Home exercise compliance=not good−2.4−4.1<.001−2.1−2.3.021−2.6−3.2.001−2.0−2.4.017
Mean appointment time=30min or more 1.32.7.008
No. of surveys=3 or more1.02.6.008 1.83.9<.0011.22.8.005
No. of visits−0.2−4.0<.001 −0.6−8.3<.001
Waiting days from referral=0–7 1.83.5<.001
Waiting days from referral=7.1–14−1.3−3.2.002
Waiting days from referral=14.1 to 30−0.7−2.0.041
Interventions
Assupron_ex NA NA NA 0.42.7.006
Cold_pack NA −0.5−2.4.017 NA NA
Consult−0.8−2.3.019
Electro_pain−0.2−3.7<.001−0.2−3.2.001 −0.2−3.3.001
Group_ex −0.2−2.7.0060.22.6.008−0.2−3.3.001
Joint_mob 0.12.0.0450.23.4.001
Neural_mob NA −0.5−2.5.014
Passupro_mob 0.22.3.024
Proprio_ex NA 0.42.2.025 NA NA
Reassess−0.3−2.7.007
Shortwave −0.3−4.3<.001 −0.3−4.5<.001
Stabil_ex0.62.9.004 NA
Stretch_ex 0.42.4.014
Ultrasound −0.2−3.5<.001

B indicates the coefficient that represents the amount of expected change in discharge FS given a 1-unit change in the value of the variable, given that all other variables in the model are held constant.

T indicates values representing the importance of each independent variable on predicting discharge FS (dependent variable).

NA (frequencies <2%).

For all models, patient variables explained most of the variation in outcomes (ie, in discharge functional score), with intake FS score being positively associated with outcomes and the strongest predictor. For clarity, we note that variables associated with poorer or better outcomes refer to poorer or better than their reference group—for example, acute compared with not acute, or women compared with not women. Older age, chronic conditions, and greater use of antidepressant medications were associated with poorer outcomes, whereas acute conditions and regular Maccabi payer (ie, regular health insurance as opposed to workers' compensation or car insurance coverage) were associated with better outcomes. In all models except for the lumbar spine impairment group, women were associated with poorer outcomes, and in all models except for patients with shoulder impairments, no physical activity before onset of the condition was associated with poorer outcomes.

Across all models, good home exercise compliance (reference is moderate or poor compliance) was the strongest process variable associated with better outcomes and was 1 of 3 second most predictive variables overall, along with symptom acuity and age. In addition, poor home exercise compliance was associated with poorer outcomes, and good visit attendance compliance was associated with better outcomes. In all models except for knee impairments, completion of at least 1 functional survey during the episode of care in addition to intake and discharge surveys (labeled 3 surveys or more with reference being 2 surveys only at intake and discharge) was associated with better outcomes. In models for spinal impairments (lumbar and cervical spine), a high number of visits per episode of care was associated with poorer outcomes. Patients with lumbar or cervical spine impairments who were referred by general practitioners were associated with better outcomes compared with referral by an orthopedic surgeon. For lumbar spine and knee impairments, longer waiting days from referral to admission were associated with poorer outcomes.

Greater use of electrotherapeutic modalities for pain management was associated with poorer outcomes in all models except for a cervical spine impairments model. In models for patients with knee and cervical spine impairments, manual joint mobilization was associated with better outcomes. Additionally, in all models, higher frequencies of personal active exercise interventions were associated with better outcomes. The only active intervention that had mixed associations with outcomes was group exercise, with negative associations for knee and shoulder impairments and positive associations for cervical spine impairments.

Back to Article Outline

Discussion 

Our purpose was to identify associations between FS outcomes during PT, patient characteristics, and treatment processes for patients with lumbar spine, knee, cervical spine, or shoulder musculoskeletal impairments. Many associations were identified. For brevity, we discuss only some of these associations, which characterize our findings and emphasize benefits of practice-based evidence studies to outpatient therapy clinical practice.

Patient Demographic and General Health 

Demographic variables and health characteristics are considered outcome confounders.7, 11, 51, 52, 53, 54, 55 Intake FS, age, acuity level, payer, the existence of various comorbidities, chronic use of antidepressant medication, and exercise history were associated with functional outcomes across all 4 regression models. The 4 strongest predictors of outcomes were intake FS, age, acuity levels, and payer. These have been reported by others,15, 39, 42, 54 a finding that emphasizes the importance of controlling for these factors when studying associations between treatment processes and outcomes in PT.

The presence of comorbid conditions was associated with poorer outcomes across all 4 regression models (see Table 6A, Table 6B). This supports use of comorbidity indices known to be predictive of functional outcomes.39, 42, 43, 56 However, although the highest rate of comorbidities usually found in patients with shoulder impairments, this group had the weakest associations between comorbidities and outcomes. This result has been reported previously,57 suggesting that comorbidities may not have important negative effects on shoulder functional outcomes.

Additionally, overweight, with highest frequency in patients with knee impairments, was not associated with functional outcomes in any model. Evidence exists supporting a BMI effect on incidence of knee osteoarthritis, particularly in women, although several studies failed to detect an effect of BMI on knee osteoarthritis progression.58 Future analyses should perhaps identify smaller and more homogeneous subsets of patients with knee impairments that might show associations that are masked when all knee impairments are analyzed together. For example, if women with knee impairments were analyzed separately from men, or patients with knee osteoarthritis were analyzed separately from patients with knee internal derangements, associations between BMI and functional outcomes might emerge. Furthermore, we noted that rates of overweight and obesity in our study were much lower than rates reported in a recent survey in Israel.59 This suggests possible underreporting of BMI measures in Maccabi records, which might have influenced our results.

Chronic use of medication had a stronger association with poorer outcomes than comorbidities. This stronger association could result from the fact that the medication data being extracted from a database of purchased prescriptions are not affected by the comprehensiveness of doctors' registration in the EHR. For example, for the total sample, only 2% of patients were labeled as experiencing a depressive disorder, but 13% purchased antidepression medication, which was the most predictive chronic medication use of poorer outcomes in all groups. This finding is supported by previous publications60, 61 and emphasizes the need to control for use of medications as well as to identify patients with depression when studying associations between treatments and outcomes in PT. From a clinical perspective, it is important to find ways to improve outcomes of patients with depression when seeking PT treatment. Previous studies have suggested integrating cognitive behavioral treatments to improve functional and mental status, including depression in patients with low back pain.62 Additional studies are required to study the contribution of these approaches.

Lack of physical activity (defined as at least once a week for a duration of 20min or more) before the onset of the condition being treated was associated with poorer outcomes in lumbar spine, knee, and cervical spine impairments. Moderate physical activity (once to twice a week) was associated with better outcomes in shoulder impairments. Exercise history has been previously reported to be associated with functional outcomes,39, 42, 43, 54, 63 which suggests that health promotion measures targeted to improve participation in routine physical activity could benefit patients attending PT.

Sex was associated with outcomes in 3 of the 4 regression models. Women were associated with poorer outcomes for patients with knee, cervical spine and shoulder impairments. English-speaking men and women in the United States responded to FS items in similar ways,5, 29, 64 suggesting that sex plays a role in how a person responds to PT. Previous evidence indicates that women are more likely to respond positively to multidisciplinary65 and cognitive-behavioral treatments for chronic pain.66, 67 A recent study on sex differences for work-disabled people with chronic musculoskeletal pain found sex differences in the influence of sociodemographic and psychosocial factors on rehabilitation outcomes of functional health status.68 Future studies are needed to identify ways to adapt treatment procedures to sex. Subset analyses by sex could help discover whether different treatment plans should be designed for women and men.

Process-Related and Intervention Variables 

Compliance with self-exercise programs was one of the strongest predictors overall and the strongest predictor among process variables (see table 6B). Better outcomes were achieved when patients were more compliant with their exercise program. This result has important implications for clinicians. Ability to improve patient compliance is probably more of an educational skill than a clinical skill. One could perceive this as a marketing skill. Physical therapists need to know how to educate and persuade patients that what they are “selling” actually works. These persuasive skills are especially important because self-exercise programs are time-consuming and demand self-discipline and persistence. It is only when the patient is convinced that it is worth the time and effort that good compliance with exercise programs can be achieved. Another patient compliance issue is compliance with attending therapy. Again, better compliance was associated with better outcomes. These results suggest clinicians should strengthen their educating skills. Although similar recommendations were published recently,69 the best ways to achieve this goal are yet to be determined.

Interestingly, patients with spinal impairments had a lower rate of good home exercise compliance than patients with peripheral impairments. The same trend was observed for good attendance compliance. These differences may result from therapists' clinical skills, which seem to be more persuasive when educating their patients to do exercises targeted to peripheral joint structures. Also, exercises for peripheral joints may be easier to understand and perform, and therefore they are related to higher compliance than exercises addressing spinal structures. Support for this claim is seen in the frequencies of therapeutic exercise use by impairment categories (see table 5, Therap_exAPTA); therapeutic exercises were used more frequently per treatment episodes for peripheral compared with spinal impairments. We conjecture that physical therapists consider exercises for peripheral joints to be more effective and easier to perform than exercises for spinal joints, and therefore they are prescribed more often. Physical therapists may need more education regarding evidence-based knowledge on effectiveness of exercises for spinal impairments. An enhanced postgraduate educational program on methods that are supported scientifically can help therapists to better adjust exercises to their patients, be more persuasive, and improve patient compliance. Our data strongly suggest that if this happens, outcomes could be improved.

For patients to comply with exercise programs, they first must be prescribed by their therapists. Active exercise variables that entered the regression models were associated with better outcomes. An exception was group exercise, which was associated with poorer outcomes for knee and shoulder impairments. For lumbar spine impairments, group exercise was not associated with outcomes, a result reported previously.70 Only patients with cervical spine impairments, who had the highest frequency for use of group exercises, seemed to benefit from them. This result calls for further investigation of the specific contents of group exercise programs and their appropriateness for different musculoskeletal conditions.

Joint mobilization was positively related to outcomes in cervical spine impairments and had borderline significance for knee impairments. Thus, in spite of little support in the literature for passive interventions,71, 72 the use of manual therapy (a passive intervention) is important. Further analyses are needed to identify more specific groups of patients that do or do not benefit from manual therapy techniques, as reported previously for spinal manipulation techniques.73, 74, 75 However, electrotherapy, including shortwave therapy and therapeutic ultrasound, were always associated with poorer outcomes. Similar results have been reported in the past.71, 76, 77, 78, 79, 80 Nonetheless, there is some evidence to support that with knee osteoarthritis, transcutaneous electrical nerve stimulation was more effective than placebo81 and that combined exercise therapy with physical agents increases the effectiveness of exercise.82 This suggests the need for further investigation to detect groups of patients that might benefit from these interventions, and for reevaluation of electrotherapeutic modalities and therapeutic ultrasound, which in many cases may have little benefit in promoting functional outcomes.

Interestingly, in all but knee impairments (where 3 or more surveys were least frequent), patients who took only the intake and discharge surveys had poorer outcomes than those who took 3 or more surveys. Three or more surveys indicate that a functional survey was completed at least once during the episode of care. This could have encouraged therapists to adjust treatment strategies when realizing that patients were not improving as expected. This suggests that therapists ought to initiate a wider use of functional measures during therapy in order for the process of care to be continuously based on outcomes.

For treated patients with spinal impairments, poorer outcomes were associated with more visits per treatment episode. This finding needs careful interpretation. Because of the public nature of the Maccabi system, therapists' reimbursement is not dependent on number of visits. Therefore, the main reason to prolong therapy is when a patient does not get better. Our data suggest that when outcomes improve during treatment of spinal impairments, the episode of care is usually shorter. When outcomes do not improve, the tendency of therapists might be to add visits, hoping that this will help improve outcomes, but simply doing more might not be beneficial. Further testing is needed to study whether this explains the association found between number of visits and outcomes. Because overall costs of PT service are closely related to number of visits per treatment episode, we suggest that a reasonable way to improve the cost-effectiveness ratio in PT is to focus on improving outcomes rather than on lowering costs. When outcomes improve, it is likely that cost will eventually decrease, a view that has been acknowledged previously for medical care in general83 and is supported by pay-for-performance simulations in outpatient therapy.15

Study Limitations 

Patient selection bias is a possible limitation attributed to observational studies. In our data, all patients referred to therapy were assessed, but not all patients who had intake data also had discharge data, which produces the potential for patient selection bias. We chose to include patients treated in all clinics participating in the outcomes collection system, regardless of how long the clinic was using the system. Consequently, inclusion of clinics that just recently implemented the outcomes measurement system resulted in a relatively low overall completion rate (39%).8 With large data sets, which minimizes the possibility of a consistent selection bias,15 the only potential for selection bias related to low completion rates would be if therapists would consistently collect both intake and discharge functional surveys from specific groups of patients thought to have achieved better outcomes. If that were to occur, higher frequencies for characteristics known to be related to better outcomes would be found in the complete protocol group. Thus, we would expect patients from the complete protocol group to be younger, more acutely injured, and with lower intake scores compared with the incomplete protocol group, because all of these variables were found to be strongly associated with better FS outcomes.35, 53, 54, 84, 85, 86, 87 Given our findings, we could also expect these patients to have a higher rate of men and in some cases more comorbidities. However, in our sample, both groups of patients (with or without functional measures at discharge) were similar in age, sex, and intake FS measures. Still, there was a difference between the 2 groups regarding symptom acuity, with a larger percentage of patients with chronic symptoms and a slightly higher average number of comorbidities in the incomplete protocol group compared with the complete protocol group. Although previous findings have been equivocal related to differences between complete and incomplete data related to symptom acuity,39, 42 our current finding suggests possible patient selection bias. Therefore, we recommend that all clinics achieve high completion rates in order to minimize the potential for patient selection bias.

Possible missing or underreporting of patient characteristics could limit our ability to control for baseline patient characteristics. Therefore, we should encourage addition of other patient descriptors such as educational and socioeconomic levels, known to be related to outcomes in general health care88, 89 and in musculoskeletal rehabilitation.90, 91 Furthermore, we need improvements in registrations of patients characteristics thought to be underreported—for example, BMI values. We conducted additional cross-checks for possible underreporting of comorbidities and identified possible underreporting of tobacco use disorders. One of the ways that the Maccabi health care system works to improve the comprehensiveness of patient specific comorbidities data is the formation of condition-specific registries that are based on several inclusion criteria from several different data sources.46, 47, 48 This not only can improve the ability to control for these characteristics, but also can help identify health promotion and prevention activities directed to decrease risk factors that inhibit the achievement of high physical function in PT.

Another possible limitation results from unstudied reliability and validity of treatment process coding among therapists. Reliability verification of data registration coding has been acknowledged as an important step of practice-based evidence studies.6, 11, 12, 13 We assume that improved reliability and validity of the treatment coding process will enable us to discover additional relationships between treatment process and outcome, and will raise the explanatory power (R2) by treatment processes in regression models. Therefore, the Maccabi PT management team has initiated an educational program for all physical therapists to improve representation of treatment processes within the electronic database.

Finally, the clinical interpretability of the regression models described in our study is limited as a result of the heterogeneity of patients in the 4 subsets we analyzed. For example, patients with lumbar spine or cervical spine symptoms are known to include many different subgroups of patients that can be reliably and validly classified.73, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107 When analyzing all subgroups together, some important clinical associations might be masked. To overcome this limitation, therapists must learn to classify their patients in a reliable and valid way and record these classifications accordingly. Only then will we be able to identify clinically valid subgroups of patients that, when analyzed separately, could reveal additional and more specific relationships between process of care and outcomes, helping therapists to improve the outcomes of care.

Back to Article Outline

Conclusions 

This study offers an introductory examination of a large integrated database to investigate associations between patient characteristics, treatments, and outcomes in outpatient PT practice. We found that better functional outcomes were associated with the following: high patient compliance with self-exercises; use of active exercises; number of completed functional assessments during therapy; high participation in routine physical activity; and use of manual therapy. Further studies are needed to identify ways to improve outcomes for women. The wide use of electrotherapeutic modalities in all impairment categories, and therapeutic ultrasound for shoulder impairments, was not supported and therefore should be reevaluated. Finally, we conclude that practice-based evidence studies work well with integrated outcomes and EHR databases to help clinicians identify ways to improve care.

Suppliers

Back to Article Outline

Acknowledgments 

We thank Rafi Rolnik, BSc, Department of Medical Information System, Avi Hosit and his team, Information Technology Department, and Shlomo Oz, David Amital, MSc, Eyal Kedem, MBA, Orly Shpigel, BA Econ, and Hillel Alapi, BBSc, System Development Department, who all played key roles in the data collection process from the various computerized registries of Maccabi Healthcare Services. We thank the PT research and development coordinators and PT district directors of Maccabi who managed the process of implementing a continuous data collection strategy. A special acknowledgment is dedicated to the physical therapists and their clinic managers of Maccabi who participated in the ongoing data collection process.

Back to Article Outline

Appendix 1 

Appendix 1. VARIABLE DESCRIPTIONS
NameDescription
Patient Demographic Characteristics
Daily activityType of regular daily activity (office; physical; combined)
LanguageLanguage used to answer the functional survey (Hebrew; Russian; English; Arabic; Spanish)
PayerPayer of medical insurance: Maccabi—regular public health plan; MVA—car insurance; Work—social security; Others—sport, terror activities
Health and Functional Status Data at Intake
AcuityDays from onset of the condition being treated: acute, 0–21d; subacute, 22–90d; chronic, >90d
Co-morbiditiesNumber of attributed comorbidities as registered by at least one physician during the previous year, based on ICD-918 codes
Registry-countNumber of attributed Maccabi Healthcare Services medical registries41, 42
Registry-count groupsGroups of attributed medical registries (none; 1; 2; 3 or more)
Intake FSFunctional status measure at intake
Medication use at intakeUse of medication related to the condition being treated, at the beginning of treatment episode (yes; no)
Number of survey during episodeNumber of functional surveys during the episode of care including the intake survey (2; 3 or more)
Physical activityWeekly physical activity of at least 20min, before onset of the condition being treated (none; 1–2/wk; 3 or more)
Number of related surgeriesPrevious surgery related to the condition being treated (none; 1; 2; 3; 4 or more)
Treatment-Related Variables
Attendance complianceAttendance compliance as described by the therapist at episode closure (good; moderate; not good; irrelevant)
Referring doctor specialtySpecialization of referring physician (general practitioner; orthopedic; other)
DurationDuration of treatment episode in days from intake to discharge
Home exercise complianceHome exercise compliance as described by the therapist at episode closure (good; moderate; not good; irrelevant)
Mean appointment timeMean appointment time as scheduled in minutes for each visit at the PT clinic
Number of visitsNumber of treatment visits during the episode of care
Waiting days from referralWaiting days from date of referral to episode start
Physical Therapy Procedural Interventions as Recorded in the EHR (recorded as yes/no for each visit)
Actsit_mobActive movements in sitting
Assit_exAssisted active exercise in sitting
Assupron_exAssisted active exercise in supine/prone position
Back_schMaccabi Healthcare Services Back school
Bike_exUse of exercise bike
Clinic_exExercise at the clinic
Cold_packApplication of cold pack
ConsultConsultation with patient
DFMDeep friction massage
Electro_painElectrical stimulation for pain management
ErgonomicErgonomic consultation
Function_exFunctional exercise
Gait_exGait exercise
Group_exGroup exercise
Hot_packApplication of hot pack
Joint_mobJoint mobilization
METExercise with the medical exercise therapy device
Neural_mobNeural tension/neurodynamic mobilization techniques
Passupro_mobPassive movements in supine or prone
Proprio_exProprioceptive exercise
ReassessReassessment
Self_exSelf-exercise education
ShortwaveShortwave therapy
Softis_mobSoft tissue mobilization
Stabil_exStabilization exercise (shoulder or spine)
Strength_exStrengthening exercise
Stretch_exStretching exercise
Supron_exSupine or prone active movements
ThermasSling exercise with the Therapy Master device
UltrasoundApplication of therapeutic ultrasound
Procedural Interventions as Defined in the Guide to PT Practice1
ElectroAPTAElectrotherapeutic modalities—APTA group code
Man_therAPTAManual therapy—APTA group code
PammAPTAPhysical agents and mechanical modalities—APTA group code
Therap_exAPTATherapeutic exercise—APTA group code

Back to Article Outline

References 

  1. Guide to physical therapist practice. 2nd ed. American Physical Therapy Association. Phys Ther 2001;81:9-746.
  2. World Confederation for Physical Therapy. Declarations of principle and position statements. 1999. http://wcpt.org/node/29602Accessed July 1, 2009
  3. International Classification of Functioning, Disability and Health (ICF). Geneva: World Health Organization; 2001;
  4. Hart DL, Cook KF, Mioduski JE, Teal CR, Crane PK. Simulated computerized adaptive test for patients with shoulder impairments was efficient and produced valid measures of function. J Clin Epidemiol. 2006;59(3):290–298
  5. Hart DL, Mioduski JE, Stratford PW. Simulated computerized adaptive tests for measuring functional status were efficient with good discriminant validity in patients with hip, knee, or foot/ankle impairments. J Clin Epidemiol. 2005;58(6):629–638
  6. Horn SD, Gassaway J. Practice-based evidence study design for comparative effectiveness research. Med Care. 2007;45(10 Suppl 2):S50–S57
  7. Horn SD, DeJong G, Ryser DK, Veazie PJ, Teraoka J. Another look at observational studies in rehabilitation research: going beyond the holy grail of the randomized controlled trial. Arch Phys Med Rehabil. 2005;86(12 Suppl 2):S8–S15
  8. Deutscher D, Hart DL, Dickstein R, Horn SD, Gutvirtz M. Implementing an integrated electronic outcomes and electronic health record process to create a foundation for clinical practice improvement. Phys Ther. 2008;88:270–285
  9. Swinkels IC, Ende CH, de Bakker D, et al. Clinical databases in physical therapy. Physiother Theory Pract. 2007;23:153–167
  10. Swinkels IC, Hart DL, Deutscher D, et al. Comparing patient characteristics and treatment processes in patients receiving physical therapy in the United States, Israel and the Netherlands (Cross sectional analyses of data from three clinical databases). BMC Health Serv Res. 2008;8:163
  11. Horn SD. Clinical practice improvement methodology: implementation and evaluation. New York: Faulkner & Gray; 1997;
  12. Horn SD, Hopkins DSP. Clinical practice improvement: a new technology for developing cost-effective quality care. New York: Faulkner & Gray; 1994;
  13. Gassaway J, Horn SD, DeJong G, Smout RJ, Clark C, James R. Applying the clinical practice improvement approach to stroke rehabilitation: methods used and baseline results. Arch Phys Med Rehabil. 2005;86(12 Suppl 2):S16–S33
  14. Deutscher D. Quality assurance in physical therapy [thesis]. Tel-Aviv: Tel-Aviv Univ; 2002;
  15. Hart DL, Connolly JB. Pay-for-performance for physical therapy and occupational therapy: Medicare Part B Services (Final report). Grant 18-P-93066/9-01 Health & Human Services/Centers for Medicare & Medicaid Services; 2006;http://www.cms.hhs.gov/TherapyServices/downloads/P4PFinalReport06-01-06.pdfAccessed July 1, 2009
  16. Hart DL, Wright BD. Development of an index of physical functional health status in rehabilitation. Arch Phys Med Rehabil. 2002;83:655–665
  17. Khoudri I, Ali Zeggwagh A, Abidi K, Madani N, Abouqal R. Measurement properties of the short form 36 and health-related quality of life after intensive care in Morocco. Acta Anaesthesiol Scand. 2007;51:189–197
  18. Badke MB, Boissonnault WG. Changes in disability following physical therapy intervention for patients with low back pain: dependence on symptom duration. Arch Phys Med Rehabil. 2006;87:749–756
  19. Boissonnault WG, Badke MB. Influence of acuity on physical therapy outcomes for patients with cervical disorders. Arch Phys Med Rehabil. 2008;89:81–86
  20. In:  Hart AC,  Schmidt KM,  Aaron WS editor. ICD-9-CM code book. Reston: St Anthony's; 1999;
  21. Ader D. Developing the Patient-Reported Outcomes Measurement Information System (PROMIS). Med Care. 2007;45(5 Suppl 1):S1–S2
  22. Cella D, Yount S, Rothrock N, et al. The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years. Med Care. 2007;45(5 Suppl 1):S3–S11
  23. Fliege H, Becker J, Walter OB, Bjorner JB, Klapp BF, Rose M. Development of a computer-adaptive test for depression (D-CAT). Qual Life Res. 2005;14:2277–2291
  24. Haley SM, Coster WJ, Andres PL, Kosinski M, Ni P. Score comparability of short forms and computerized adaptive testing: simulation study with the activity measure for post-acute care. Arch Phys Med Rehabil. 2004;85:661–666
  25. Haley SM, Fragala-Pinkham M, Ni P. Sensitivity of a computer adaptive assessment for measuring functional mobility changes in children enrolled in a community fitness programme. Clin Rehabil. 2006;20:616–622
  26. Haley SM, Ni P, Fragala-Pinkham MA, Skrinar AM, Corzo D. A computer adaptive testing approach for assessing physical functioning in children and adolescents. Dev Med Child Neurol. 2005;47:113–120
  27. Haley SM, Raczek AE, Coster WJ, Dumas HM, Fragala-Pinkham MA. Assessing mobility in children using a computer adaptive testing version of the pediatric evaluation of disability inventory. Arch Phys Med Rehabil. 2005;86:932–939
  28. Haley SM, Siebens H, Coster WJ, et al. Computerized adaptive testing for follow-up after discharge from inpatient rehabilitation: I (Activity outcomes). Arch Phys Med Rehabil. 2006;87:1033–1042
  29. Hart DL, Mioduski JE, Werneke MW, Stratford PW. Simulated computerized adaptive test for patients with lumbar spine impairments was efficient and produced valid measures of function. J Clin Epidemiol. 2006;59(9):947–956
  30. Ware JE. Conceptualization and measurement of health-related quality of life: comments on an evolving field. Arch Phys Med Rehabil. 2003;84(4 Suppl 2):S43–S51
  31. Ware JE, Kosinski M, Bjorner JB, et al. Applications of computerized adaptive testing (CAT) to the assessment of headache impact. Qual Life Res. 2003;12:935–952
  32. Hambleton RK, Swaminathan H. Item response theory: principles and applications. Boston: Kluwar; 1985;
  33. Hambleton RK, Swaminathan H, Rogers HJ. Fundamentals of item response theory. Newbury Park: Sage Publications; 1991;
  34. Jette AM, Haley SM. Contemporary measurement techniques for rehabilitation outcomes assessment. J Rehabil Med. 2005;37:339–345
  35. Jette AM, Haley SM, Tao W, et al. Prospective evaluation of the AM-PAC-CAT in outpatient rehabilitation settings. Phys Ther. 2007;87:385–398
  36. In:  Sands WA,  Waters BK,  McBride JR editor. Computerized adaptive testing: from inquiry to operation. Washington: American Psychological Association; 1997;
  37. Wainer H. Introduction and history. In:  Wainer H editors. Computerized adaptive testing: a primer. 2nd ed.. Mahwah: Lawrence Erlbaum; 2000;p. 1–21
  38. Mills CN. Computer-based testing: building the foundation for future assessments. Mahwah: Lawrence Erlbaum; 2002;
  39. Hart DL, Wang YC, Stratford PW, Mioduski JE. Computerized adaptive test for patients with knee impairments produced valid and responsive measures of function. J Clin Epidemiol. 2008;61(11):1113–1124
  40. Andrich D. A rating formulation for ordered response categories. Psychometrika. 1978;43:561–573
  41. In:  Lord FM editors. Applications of item response theory to practical testing problems. Hillsdale: Lawrence Erlbaum; 1980;
  42. Hart DL, Wang YC, Stratford PW, Mioduski JE. A computerized adaptive test for patients with hip impairments produced valid and responsive measures of function. Arch Phys Med Rehabil. 2008;89:2129–2139
  43. Hart DL, Wang YC, Stratford PW, Mioduski JE. Computerized adaptive test for patients with foot or ankle impairments produced valid and responsive measures of function. Qual Life Res. 2008;17:1081–1091
  44. Wang YC, Hart DL, Stratford PW, Mioduski JE. Clinical interpretation of computerized adaptive test–generated outcome measures in patients with knee impairments. Arch Phys Med Rehabil. 2009;90:1340–1348
  45. Patient Inquiry. Version 5. Knoxville: Focus on Therapeutic Outcomes. 2008. http://www.fotoinc.com/demoinstructions.htmAccessed July 1, 2009
  46. Chodick G, Heymann AD, Shalev V, Kookia E. The epidemiology of diabetes in a large Israeli HMO. Eur J Epidemiol. 2003;18:1143–1146
  47. Heymann AD, Chodick G, Halkin H, Kokia E, Shalev V. [Description of a diabetes disease register extracted from a central database]. Harefuah. 2007;146:15–1779
  48. Shapiro J, Cohen AD, David M, et al. The association between psoriasis, diabetes mellitus, and atherosclerosis in Israel: a case-control study. J Am Acad Dermatol. 2007;56:629–634
  49. Wright BD, Linacre JM. Observations are always ordinal; measurements, however, must be interval. Arch Phys Med Rehabil. 1989;70:857–860
  50. Horn SD, DeJong G, Smout RJ, Gassaway J, James R, Conroy B. Stroke rehabilitation patients, practice, and outcomes: is earlier and more aggressive therapy better?. Arch Phys Med Rehabil. 2005;86(12 Suppl 2):S101–S114
  51. Iezzoni LI. Using risk-adjusted outcomes to assess clinical practice: an overview of issues pertaining to risk adjustment. Ann Thorac Surg. 1994;58:1822–1826
  52. Iezzoni LI, Shwartz M, Ash AS, Mackiernan Y, Hotchkin EK. Risk adjustment methods can affect perceptions of outcomes. Am J Med Qual. 1994;9:43–48
  53. Resnik L, Feng Z, Hart DL. State regulation and the delivery of physical therapy services. Health Serv Res. 2006;41(4 Pt 1):1296–1316
  54. Resnik L, Hart DL. Using clinical outcomes to identify expert physical therapists. Phys Ther. 2003;83:990–1002
  55. Resnik L, Liu D, Mor V, Hart DL. Predictors of physical therapy clinic performance in the treatment of patients with low back pain syndromes. Phys Ther. 2008;88:989–1004
  56. Groll DL, To T, Bombardier C, Wright JG. The development of a comorbidity index with physical function as the outcome. J Clin Epidemiol. 2005;58:595–602
  57. Boissonnault WG, Badke MB, Wooden MJ, Ekedahl S, Fly K. Patient outcome following rehabilitation for rotator cuff repair surgery: the impact of selected medical comorbidities. J Orthop Sports Phys Ther. 2007;37:312–319
  58. Reijman M, Pols HA, Bergink AP, et al. Body mass index associated with onset and progression of osteoarthritis of the knee but not of the hip: the Rotterdam Study. Ann Rheum Dis. 2007;66:158–162
  59. Keinan-Boker L, Noyman N, Chinich A, Green MS, Nitzan-Kaluski D. Overweight and obesity prevalence in Israel: findings of the first national health and nutrition survey (MABAT). Isr Med Assoc J. 2005;7:219–223
  60. Kim JM, Stewart R, Glozier N, et al. Physical health, depression and cognitive function as correlates of disability in an older Korean population. Int J Geriatr Psychiatry. 2005;20:160–167
  61. Russo A, Cesari M, Onder G, et al. Depression and physical function: results from the aging and longevity study in the Sirente geographic area (ilSIRENTE Study). J Geriatr Psychiatry Neurol. 2007;20:131–137
  62. Guzman J, Esmail R, Karjalainen K, Malmivaara A, Irvin E, Bombardier C. WITHDRAWN: multidisciplinary bio-psycho-social rehabilitation for chronic low-back pain. Cochrane Database Syst Rev. 2006;18:CD000963
  63. Hart DL, Dobrzykowski EA. Impact of exercise history on health status outcomes in patients with musculoskeletal impairments. Orthop Phys Ther Clin North Am. 2000;9:1–16
  64. Crane PK, Hart DL, Gibbons LE, Cook KF. A 37-item shoulder functional status item pool had negligible differential item functioning. J Clin Epidemiol. 2006;59:478–484
  65. Jensen IB, Bodin L. Multimodal cognitive-behavioural treatment for workers with chronic spinal pain: a matched cohort study with an 18-month follow-up. Pain. 1998;76:35–44
  66. Jensen IB, Bergstrom G, Ljungquist T, Bodin L, Nygren AL. A randomized controlled component analysis of a behavioral medicine rehabilitation program for chronic spinal pain: are the effects dependent on gender?. Pain. 2001;91:65–78
  67. Jensen IB, Nygren A, Lundin A. Cognitive-behavioural treatment for workers with chronic spinal pain: a matched and controlled cohort study in Sweden. Occup Environ Med. 1994;51:145–151
  68. Lillefjell M. Gender differences in psychosocial influence and rehabilitation outcomes for work-disabled individuals with chronic musculoskeletal pain. J Occup Rehabil. 2006;16:659–674
  69. Moore A, Jull G. Educator skills for musculoskeletal therapy practice: do we use these skills effectively and how and when are they used?. Man Ther. 2008;13:91–92
  70. Carr JL, Klaber Moffett JA, Howarth E, et al. A randomized trial comparing a group exercise programme for back pain patients with individual physiotherapy in a severely deprived area. Disabil Rehabil. 2005;27:929–937
  71. Hurley MV, Bearne LM. Non-exercise physical therapies for musculoskeletal conditions. Best Pract Res Clin Rheumatol. 2008;22:419–433
  72. Jette AM, Delitto A. Physical therapy treatment choices for musculoskeletal impairments. Phys Ther. 1997;77:145–154
  73. Childs JD, Fritz JM, Flynn TW, et al. A clinical prediction rule to identify patients with low back pain most likely to benefit from spinal manipulation: a validation study. Ann Intern Med. 2004;141:920–928
  74. Fritz JM, Brennan GP, Leaman H. Does the evidence for spinal manipulation translate into better outcomes in routine clinical care for patients with occupational low back pain? (A case-control study). Spine J. 2006;6:289–295
  75. Fritz JM, Whitman JM, Flynn TW, Wainner RS, Childs JD. Factors related to the inability of individuals with low back pain to improve with a spinal manipulation. Phys Ther. 2004;84:173–190
  76. Gross AR, Aker PD, Goldsmith CH, Peloso P. Physical medicine modalities for mechanical neck disorders. Cochrane Database Syst Rev. 2000;CD000961
  77. Kroeling P, Gross A, Houghton PE. Electrotherapy for neck disorders. Cochrane Database Syst Rev. 2005;CD004251
  78. Kroeling P, Gross AR, Goldsmith CH. A Cochrane review of electrotherapy for mechanical neck disorders. Spine. 2005;30:E641–E648
  79. McCarthy CJ, Callaghan MJ, Oldham JA. Pulsed electromagnetic energy treatment offers no clinical benefit in reducing the pain of knee osteoarthritis: a systematic review. BMC Musculoskelet Disord. 2006;7:51
  80. Michener LA, Walsworth MK, Burnet EN. Effectiveness of rehabilitation for patients with subacromial impingement syndrome: a systematic review. J Hand Ther. 2004;17:152–164
  81. Osiri M, Welch V, Brosseau L, et al. Transcutaneous electrical nerve stimulation for knee osteoarthritis. Cochrane Database Syst Rev. 2000;CD002823
  82. Cetin N, Aytar A, Atalay A, Akman MN. Comparing hot pack, short-wave diathermy, ultrasound, and TENS on isokinetic strength, pain, and functional status of women with osteoarthritic knees: a single-blind, randomized, controlled trial. Am J Phys Med Rehabil. 2008;87:443–451
  83. Porter M, Teisberg E. Redefining health care (Creating value-based competition on results). Boston (MA): Harvard Business School Press; 2006;
  84. Hart DL. The power of outcomes: FOTO Industrial Outcomes Tool—initial assessment. Work. 2001;16:39–51
  85. Hart DL, Dobrzykowski EA. Influence of orthopaedic clinical specialist certification on clinical outcomes. J Orthop Sports Phys Ther. 2000;30:183–193
  86. Jette DU, Jette AM. Physical therapy and health outcomes in patients with knee impairments. Phys Ther. 1996;76:1178–1187
  87. Jette DU, Jette AM. Physical therapy and health outcomes in patients with spinal impairments. Phys Ther. 1996;76:930–941discussion 942-5
  88. Huisman M, Kunst A, Deeg D, Grigoletto F, Nusselder W, Mackenbach J. Educational inequalities in the prevalence and incidence of disability in Italy and the Netherlands were observed. J Clin Epidemiol. 2005;58:1058–1065
  89. Lubetkin EI, Jia H, Franks P, Gold MR. Relationship among sociodemographic factors, clinical conditions, and health-related quality of life: examining the EQ-5D in the US general population. Qual Life Res. 2005;14:2187–2196
  90. Atlas SJ, Tosteson TD, Hanscom B, et al. What is different about workers' compensation patients? (Socioeconomic predictors of baseline disability status among patients with lumbar radiculopathy). Spine. 2007;32:2019–2026
  91. Davis ET, Lingard EA, Schemitsch EH, Waddell JP. Effects of socioeconomic status on patients' outcome after total knee arthroplasty. Int J Qual Health Care. 2008;20:40–46
  92. Childs JD, Fritz JM, Piva SR, Erhard RE. Clinical decision making in the identification of patients likely to benefit from spinal manipulation: a traditional versus an evidence-based approach. J Orthop Sports Phys Ther. 2003;33:259–272
  93. Childs JD, Fritz JM, Piva SR, Whitman JM. Proposal of a classification system for patients with neck pain. J Orthop Sports Phys Ther. 2004;34:686–696discussion 697-700
  94. Delitto A, Cibulka MT, Erhard RE, Bowling RW, Tenhula JA. Evidence for use of an extension-mobilization category in acute low back syndrome: a prescriptive validation pilot study. Phys Ther. 1993;73:216–222discussion 223-8
  95. Delitto A, Erhard RE, Bowling RW. A treatment-based classification approach to low back syndrome: identifying and staging patients for conservative treatment. Phys Ther. 1995;75:470–485discussion 485-9
  96. Donelson R. Evidence-based low back pain classification (Improving care at its foundation). Europa medicophysica. 2004;40:37–44
  97. Donelson R. Rapidly reversible low back pain: an evidence-based pathway to widespread recoveries and savings. Hanover: Self Care First; 2007;
  98. Flynn T, Fritz J, Whitman J, et al. A clinical prediction rule for classifying patients with low back pain who demonstrate short-term improvement with spinal manipulation. Spine. 2002;27:2835–2843
  99. Fritz JM, Brennan GP. Preliminary examination of a proposed treatment-based classification system for patients receiving physical therapy interventions for neck pain. Phys Ther. 2007;87:513–524
  100. Fritz JM, Cleland JA, Childs JD. Subgrouping patients with low back pain: evolution of a classification approach to physical therapy. J Orthop Sports Phys Ther. 2007;37:290–302
  101. Fritz JM, Lindsay W, Matheson JW, et al. Is there a subgroup of patients with low back pain likely to benefit from mechanical traction? (Results of a randomized clinical trial and subgrouping analysis). Spine. 2007;32:E793–E800
  102. Werneke M, Hart DL. Centralization phenomenon as a prognostic factor for chronic low back pain and disability. Spine. 2001;26:758–764discussion 765
  103. Werneke M, Hart DL. Discriminant validity and relative precision for classifying patients with nonspecific neck and back pain by anatomic pain patterns. Spine. 2003;28:161–166
  104. Werneke M, May S. The centralization phenomenon and fear-avoidance beliefs as prognostic factors for acute low back pain. J Orthop Sports Phys Ther. 2005;35:844–845author reply 845-7
  105. Werneke MW, Harris DE, Lichter RL. Clinical effectiveness of behavioral signs for screening chronic low-back pain patients in a work-oriented physical rehabilitation program. Spine. 1993;18:2412–2418
  106. Werneke MW, Hart DL. Categorizing patients with occupational low back pain by use of the Quebec Task Force Classification system versus pain pattern classification procedures: discriminant and predictive validity. Phys Ther. 2004;84:243–254
  107. Werneke MW, Hart DL, Resnik L, Stratford PW, Reyes A. Centralization: prevalence and effect on treatment outcomes using a standardized operational definition and measurement method. J Orthop Sports Phys Ther. 2008;38:116–125
  • a Focus On Therapeutic Outcomes Inc, PO Box 11444, Knoxville, TN 37919.
  • b SPSS Inc, 233 S Wacker Dr, Chicago, IL 60606.

 Supported by Maccabi Healthcare Services—HMO, Israel; and by the Maccabi Institute for Health Services Research, Israel.

 A commercial party having a direct financial interest in the results of the research supporting this article has conferred or will confer a financial benefit on the author or one or more of the authors. Hart is an employee of, and investor in, Focus On Therapeutic Outcomes Inc, a database management company, owner of the outcomes collection software used to collect function outcome for the study.

 Reprints are not available from the author.

PII: S0003-9993(09)00280-9

doi:10.1016/j.apmr.2009.02.005

Archives of Physical Medicine and Rehabilitation
Volume 90, Issue 8 , Pages 1349-1363, August 2009