Published on in Vol 26 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/52964, first published .
Investigating the Use of Telemedicine by Health Care Providers to Diagnose and Manage Patients With Musculoskeletal Disorders: Systematic Review and Meta-Analysis

Investigating the Use of Telemedicine by Health Care Providers to Diagnose and Manage Patients With Musculoskeletal Disorders: Systematic Review and Meta-Analysis

Investigating the Use of Telemedicine by Health Care Providers to Diagnose and Manage Patients With Musculoskeletal Disorders: Systematic Review and Meta-Analysis

Review

1School of Rehabilitation, Faculty of Medicine, Université de Montréal, Montréal, QC, Canada

2Hôpital Maisonneuve-Rosemont Research Center, Université de Montréal Affiliated Research Center, Montréal, QC, Canada

3Centre for Interdisciplinary Research in Rehabilitation of Greater Montreal, Institut Universitaire sur la Réadaptation en Déficience Physique de Montréal, Montréal, QC, Canada

Corresponding Author:

François Desmeules, PT, PhD

School of Rehabilitation

Faculty of Medicine

Université de Montréal

7077 Avenue du Parc

Montréal, QC, H3N 1X7

Canada

Phone: 1 514 343 6791

Email: f.desmeules@umontreal.ca


Background: Access to care is a major challenge for patients with musculoskeletal disorders (MSKDs). Telemedicine is one of the solutions to improve access to care. However, initial remote diagnosis of MSKDs involves some challenges, such as the impossibility of touching the patient during the physical examination, which makes it more complex to obtain a valid diagnosis. No meta-analysis has been performed to date to synthesize evidence regarding the initial assessment including a physical evaluation using telemedicine to diagnose patients with MSKDs.

Objective: This study aims to appraise the evidence on diagnostic and treatment plan concordance between remote assessment using synchronous or asynchronous forms of telemedicine and usual in-person assessment for the initial evaluation of various MSKDs.

Methods: An electronic search was conducted up to August 2023 using terms related to telemedicine and assessment of MSKDs. Methodological quality of studies was assessed with the Quality Assessment of Diagnostic Accuracy Studies 2 tool. Random-effect model meta-analyses were performed. The Grading of Recommendations, Assessment, Development, and Evaluations framework was used to synthesize the quality and certainty of the evidence.

Results: A total of 23 concordance studies were eligible and included adult participants (N=1493) with various MSKDs. On the basis of high certainty, pooled κ and prevalence-adjusted and bias-adjusted κ for the diagnostic concordance between remote and in-person assessments of MSKDs were 0.80 (95% CI 0.72-0.89; 7 studies, 353 patients) and 0.83 (95% CI 0.76-0.89; 6 studies, 306 patients). On the basis of moderate certainty, pooled Gwet AC1 for treatment plan concordance between remote and in-person assessments of MSKDs was 0.90 (95% CI 0.80-0.99; 2 studies, 142 patients).

Conclusions: The diagnostic concordance for MSKDs is good to very good. Treatment plan concordance is probably good to excellent. Studies evaluating the accuracy to detect red and yellow flags as well as the potential increase in associated health care resources use, such as imaging tests, are needed.

J Med Internet Res 2024;26:e52964

doi:10.2196/52964

Keywords



Background

Almost 1.7 billion people have a musculoskeletal disorder (MSKD) in the world [1]. MSKDs refer to disorders affecting muscles, bones, and joints, such as low back pain, osteoarthritis, or tendinopathy [2]. MSKDs can lead to pain, disability, and poor health-related quality of life, resulting in a significant burden to health care systems as well as to society [2-6]. Evidence shows that a valid diagnosis through a careful initial evaluation and prompt treatment are essential for MSKDs [2,7]. Recommendations for various MSKDs emphasize the importance of screening for signs and symptoms of underlying serious pathologies (red flags) and for psychological factors associated with a poorer prognosis (yellow flags) during the initial evaluation as well as conducting a physical examination that includes measurements of mobility, strength, and use of orthopedic tests [2,8].

Significant health inequalities exist between urban and low-density population areas in several countries, with rural populations having a higher rate of injury and a higher risk of chronic MSKDs [9-11]. These inequalities can partially be explained by difficulties in accessing primary and secondary care [12-14]. The COVID-19 pandemic exacerbated these difficulties, with nearly 1 in 5 individuals unable to access health care during the first year of the COVID-19 pandemic, and patients with MSKDs were more affected by these delays than other patient populations [6,15-17]. Access to care is a major challenge for patients with MSKDs as delays can negatively impact clinical outcomes, such as pain, disability, or quality of life, while also potentially exacerbating psychological distress [18].

Telemedicine has been shown to have many benefits for patients, health care systems, and society [19]. It is an interesting option for optimizing health care access by removing unnecessary hurdles, such as geographical location or for patients with impaired mobility [19-21]. Telemedicine first appeared under asynchronous forms where communication between parties was not happening in real time [22]. Asynchronous forms are still used today for communication between patients and health care providers via messaging systems (emails and instant SMS text messaging) or smartphone apps for follow-up or counselling [23]. Synchronous forms of telemedicine with phone calls and videoconferencing allow real-time interaction between parties [22]. The use of videoconferencing in telemedicine has been a major progress by allowing visual evaluation of movement, edema, or scars, for example, or to observe patient physical performance and function [24]. The use of telemedicine in high-income countries now mainly focuses on patient remote management or follow-ups of patients who have already been assessed in person [25]. Telemedicine is well implanted in medical specialties, such as radiology, dermatology, or psychiatry, but is not widely used in the MSKDs care pathways, particularly for the initial assessment of new patients where a diagnosis is required [25,26]. The use of telemedicine for MSKDs brings many challenges related to the geographical distancing of the patient and the health care provider [27-31]. The loss of physical contact during the physical examination and treatments raises questions among patients and clinicians about the relevance, safety, and effectiveness of remote care [27,30,31]. Patients and health care providers also express concerns about the quality of the therapeutic relationship when consultations are not conducted in person [27,28]. However, telemedicine offers advantages to patients and health care providers, such as better accessibility, greater flexibility, and the possibility to offer interventions that are adapted to a patient’s environment as the remote consultation will likely be in a person’s home [27].

Previous systematic reviews and meta-analyses have reported that remote patient follow-up management after an in-person initial evaluation is a valid alternative to usual in-person management and leads to similar benefits in clinical outcomes for various MSKDs, such as low back pain, neck pain, shoulder pain, or neurological conditions [32-35]. Previous systematic reviews focusing on synchronous remote initial assessment highlighted that most clinical measures remotely evaluated have a good concurrent validity and an excellent reliability [24,36]. Remote diagnoses were highly concordant with in-person diagnoses, but no meta-analysis was performed on these results, and these systematic reviews only included studies with physiotherapists as evaluators, excluding other health care providers who usually assess patients with MSKDs, such as orthopedic surgeons or primary care physicians [36]. As the diagnosis as well as the treatment plan are key elements of an initial assessment, it is crucial to undertake a comprehensive appraisal, including a meta-analysis of the concordance between remote and in-person assessment for new patients with MSKDs.

Objective

This systematic review with meta-analysis aimed to appraise the available evidence on diagnosis and care concordance after an initial assessment between a remote evaluation and an in-person evaluation for the evaluation of various MSKDs.

Therefore, the research question for this systematic review was as follows: Can a complete, valid, and safe assessment be carried out using asynchronous, synchronous or both forms of telehealth to diagnose various MSKDs?


Protocol, Registration, and Deviation

The protocol of this systematic review has been registered on PROSPERO (CRD42022335606) [37]. A total of 2 deviations from the protocol have occurred and are as follows: (1) We now only present results for the first specific objective (concordance of diagnosis and management) in this publication, as there were too much data concerning the second objective (concordance of clinical measures) to be presented in 1 publication (data concerning the second objective will be presented in a second publication); (2) We have now added the calculation of prediction intervals to further assess the heterogeneity of the pooled estimates in addition to the I2 and τ² statistics.

Literature Search

An electronic search was conducted in 4 databases (MEDLINE, Embase, Cochrane Central, and CINAHL) from January 2000 to August 2023 using terms related to telemedicine by any type of health care providers (physicians, orthopedic surgeons, physiotherapists, or other providers), MSKDs, and the assessment or the clinical examination of these conditions. A trained librarian was consulted during the development of our research strategy. We chose to limit our search to the last 2 decades to identify technologies still in use and readily available to clinicians. The full search strategy is available in the Multimedia Appendix 1. Reference lists of identified published studies and previous systematic reviews were checked for any additional studies.

Study Selection

A pair of reviewers (RV and MC or AAC) independently reviewed titles and abstracts to identify studies of interest. Consensus from reviewers was required to include studies. A third reviewer (SL) was available if a consensus was not achieved by the 2 initial reviewers. Textbox 1 shows the inclusion criteria for articles.

Textbox 1. Inclusion criteria for eligible studies.

Inclusion criteria

  • Participants with symptoms related to suspected musculoskeletal disorders.
  • Participants assessed during a remote evaluation (synchronous or asynchronous) and compared with an in-person evaluation by any health care provider.
  • Any type of diagnostic, care or treatment plan concordance outcomes (such as raw agreement, κ, prevalence-adjusted and bias-adjusted κ, or other concordance coefficients).
  • Technologies used for the remote assessment had to be accessible for routine clinical use (no experimental setup and no use of sensors to be placed on the participants).
  • Full-article or conference abstracts written in French or English.

Data Extraction

Data of included studies were extracted using a predefined standardized form documenting the following: authors’ names, year of publication, study design, country, care settings, characteristics of the remote assessment (modality and technology used as well as the presence of a third party to help with patient evaluation), body region or regions affected, number of participants, participant characteristics, health care provider characteristics, and outcome measures. Data extraction was performed by 1 evaluator (RV), and the extracted data were reviewed and verified by a second evaluator (MC or AAC). When data were missing or incomplete, attempts to contact original authors were made to obtain complete data and results.

Methodological Quality Assessment

Methodological quality of included studies was assessed with the valid and reliable Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool [38]. This tool appraises patient selection, index tests, reference standard, flow, and timing. QUADAS-2 also assesses the presence of applicability concerns that would decrease the external validity of the study results. Assessment of methodological quality and applicability concerns was performed by a pair of independent evaluators (RV and MC or SL or AAC or Claudia Cosculluela); the final score was obtained through consensus. In case of disagreement, a third evaluator was available to facilitate consensus (MC or SL). Studies were considered at risk of bias if at least 1 item of the QUADAS-2 was evaluated at high risk of bias.

Data Synthesis

κ, prevalence-adjusted and bias-adjusted κ (PABAK), and Gwet AC1 coefficients were pooled into separate meta-analyses. Weighted means were calculated for raw agreement. Random-effect model meta-analyses were performed using the metafor package in RStudio Team (2020, Rstudio: Integrated Development for R. Rstudio) [39,40]. Secondary analyses for different modalities of delivery (asynchronous or synchronous) and for affected body regions were performed. Sensitivity analyses were also performed, including only studies with a low risk of bias (with no item ranked as high risk of bias on the QUADAS-2). Pooled concordance estimates were interpreted as follows: 0.00-0.20=weak, 0.21-0.40=slight, 0.41-0.60=moderate, 0.61-0.80=good, 0.81-0.90=very good, and 0.91-1.00=excellent agreement [41,42]. Coding scripts are available in Multimedia Appendix 2. For all meta-analyses, α levels were set at .05, and 95% CIs were calculated. Statistical heterogeneity was quantified and reported using the I2 and τ² statistics and interpreted according to the Cochrane methodology [43]. Prediction intervals were also calculated using the Comprehensive Meta-Analysis software (version 4.0; H.Biostat) to further assess the heterogeneity of the pooled estimates [44,45]. A narrative synthesis was performed for studies and outcomes not pooled in meta-analyses or for conference abstracts included in this review.

The Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) framework was used for grading the quality and certainty of evidence and for formulating recommendations [46]. Level of evidence was interpreted as follows: very low certainty: the true effect is probably markedly different from the pooled estimated effect, low certainty: the true effect might be markedly different from the pooled estimated effect, moderate certainty: we believe that the true effect is probably close to the pooled estimated effect, and high certainty: we are very confident that the true effect is similar to the pooled estimated effect.


Overview

After full-text review, 11 studies on in-person remote diagnostic concordance [42,47-56], 7 studies on in-person remote diagnostic and treatment plan concordance [41,57-62], and 3 studies on in-person remote treatment plan concordance [63-65] were included (Figure 1). No studies presented results on triage concordance of surgical candidates. A total of 2 conference abstracts were also included on in-person remote diagnostic concordance [66,67]. Reasons for exclusions are available in Multimedia Appendix 3. Full characteristics of the included studies are presented in Tables 1 and 2 and Table S1 in Multimedia Appendix 4.

Figure 1. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flowchart for concordance studies selection.
Table 1. Characteristics of the included studies (study settings).
Author and yearDesignCountryCare settingModality of assessmentTechnology
Abboud et al [57], 2005Prospective cohortUnited StatesOrthopedicAsynchronousRecorded photographs and data
Bovonratwet et al [58], 2022Retrospective cohortUnited StatesOrthopedicSynchronousVideoconferencing
Bradley et al [47], 2021Case controlUnited StatesOrthopedicSynchronousVideoconferencing
Demaerschalk et al [48], 2022Retrospective cohortUnited StatesClinicSynchronousVideoconferencing
Dias et al [56], 2023Prospective cohortBrazilOrthopedicSynchronousVideoconferencing
Exposto et al [42], 2022Prospective cohortDenmarkDentistrySynchronousVideoconferencing
Melnick et al [65], 2023Retrospective cohortUnited StatesOrthopedicSynchronousVideoconferencing
Michaelson et al [62], 2023Retrospective cohortUnited StatesOrthopedicSynchronousVideoconferencing with the presence of the patient’s caregiver
Rabin et al [61], 2022Prospective cohortIsraelOrthopedicSynchronousVideoconferencing with presence of a research assistant or the patient’s caregiver
Tachakra et al [54], 2000Prospective cohortUnited KingdomEmergency DepartmentSynchronousVideoconferencing with presence of a nurse
Wang et al [55], 2022Prospective cohortUnited StatesOrthopedicAsynchronousRecorded video of a standardized clinical examination with presence of a research assistant
Cottrell et al [59], 2018Prospective cohortAustraliaPhysiotherapySynchronousVideoconferencing
Lade et al [49], 2012Prospective cohortAustraliaPhysiotherapySynchronousVideoconferencing
Lovo et al [41], 2022Prospective cohortCanadaRural clinicSynchronousVideoconferencing with presence of a nurse
Peterson et al [63], 2019Prospective cohortUnited StatesPhysiotherapySynchronousVideoconferencing
Richardson et al [50], 2017Prospective cohortAustraliaPhysiotherapySynchronousVideoconferencing
Russell et al [52], 2010Prospective cohortAustraliaPhysiotherapySynchronousVideoconferencing
Russell et al [51], 2010Prospective cohortAustraliaPhysiotherapySynchronousVideoconferencing
Steele et al [53], 2012Prospective cohortAustraliaPhysiotherapySynchronousVideoconferencing
Turner et al [60], 2019Prospective cohortUnited KingdomPhysiotherapySynchronousTelephone
Worboys et al [64], 2018Prospective cohortAustraliaOccupational therapySynchronousVideoconferencing with presence of an assistant
Table 2. Characteristics of the included studies (patient and evaluator characteristics).
Author and yearPatientsEvaluatorsAccess to imaging tests to make diagnosis

Musculoskeletal disorders (MSKDsa)Values, nAge (y), mean (SD)Female (%)Profession (number of evaluators)Training
Abboud et al [57], 2005Upper extremity MSKDs10043 (NRb)50Orthopedic surgeons (n=3)NRYes
Bovonratwet et al [58], 2022Spine MSKDs6557.5 (14.8)46Orthopedic surgeons (n=5)NRYes
Bradley et al [47], 2021Shoulder MSKDs5058.253Orthopedic surgeons (n=9)NRNo
Demaerschalk et al [48], 2022MSKDs300NRNRPhysicians, nurses, and physician assistantsNRNR
Dias et al [56], 2023Low back pain12247.8 (13.1)66Orthopedic surgeons (n=17)NRNR
Exposto et al [42], 2022Temporomandibular joint disorders1531 (12)75Dentists (n=5)10 hours of trainingNR
Melnick et al [65], 2023Spine MSKDs15261.4 (15.4)43Orthopedic surgeons (n=7)NRNR
Michaelson et al [62], 2023Shoulder MSKDs8252.6 (NR)NROrthopedic surgeons (n=5)NRYes
Rabin et al [61], 2022Shoulder MSKDs4744.6 (22)36Orthopedic surgeons (n=2)4 hours of meeting and training with 5 pilot test participantsYes
Tachakra et al [54], 2000Minor trauma injuries200NR31Emergency physicianNRYes
Wang et al [55], 2022Shoulder MSKDs3250.2 (16.2)47Orthopedic surgeon (n=1)NRYes
Cottrell et al [59], 2018Chronic MSKDs4252.7 (14.5)57Advanced practice physiotherapists (n=6)Training with 4 pilot test participantsYes
Lade et al [49], 2012Elbow MSKDs1038 (13)10Physiotherapy students (n=3)Support by an experienced physiotherapistNR
Lovo et al [41], 2022Chronic back pain2753.7 (18.1)70Physiotherapists (n=2) and nurses (n=2)Interprofessional training before the studyNR
Peterson et al [63], 2019Low back pain4748.6 (15)70Physiotherapists (n=2)NRNR
Richardson et al [50], 2017Knee MSKDs1823 (7)55Physiotherapists (n=3)Training with 2 pilot test participantsNR
Russell et al [52], 2010Ankle MSKDs1524.5 (10.8)67Physiotherapy students (n=3)Training with 2 pilot test participantsNR
Russell et al [51], 2010Lower limb MSKDs (nonarticular)1926 (13)74Physiotherapists (n=3)Training with 2 pilot test participantsNR
Steele et al [53], 2012Shoulder MSKDs2230.7 (14.2)27Physiotherapy students (n=3)Support by an experienced physiotherapistNR
Turner et al [60], 2019MSKDs55NRNRPhysiotherapists (n=22)NRNR
Worboys et al [64], 2018Hand injuries18NR45Occupational therapists (n=4)NRNR

aMSKD: musculoskeletal disorder.

bNR: not reported.

Countries and Clinical Settings

Studies were conducted in Australia (7/23, 30%), the United States (8/23, 35%), the United Kingdom (4/23, 17%), Denmark (1/23, 4%), Canada (1/23, 4%), Brazil (1/23, 4%), and Israel (1/23, 4%). In terms of care settings, studies were conducted in physiotherapy primary care clinics (8/23, 35%) [49-53,59,60,63], in orthopedic specialized care (8/23, 35%) [47,55-58,61,62,65], and in primary medical care (4/23, 17%) [41,48,66,67]; one study was conducted in an emergency department [54]. One study was concerning temporomandibular disorders in dentistry [42], and 1 study was conducted in an occupational therapy clinic [64]. Synchronous modalities were the most frequent way of contacting patients (21/23, 91%), with 18 (78%) of the 23 studies using a videoconferencing interface [41,42,47-56,58,59,61-63,65] and 3 (13%) using telephone calls [60,66,67]. Support staff was present to help with patient assessment and mobilization during the remote evaluation in 5 (22%) of the 23 studies [41,54,55,61,65]. Asynchronous modalities were used in 2 (8%) of the 23 studies, 1 using photographs of the patients [57] and 1 using video recordings of a self-performed clinical examination under the supervision of an assistant [55].

Participants

A total of 1849 participants were included. Mean age of participants was 49.6 (SD 14.9) years. Female gender accounted for 48% (887/1849) of the participants. Included participants had spinal disorders (703/1849, 38.02%), upper limb disorders (375/1849, 20.3%), lower limb disorders (201/1849, 10.9%), temporomandibular disorders (15/1849, 0.8%), and unspecified various MSKDs (555/1849, 30%). Of the 23 studies, 5 (22%) were conducted in university physiotherapy and dentistry clinics, which included a younger sample of patients and more acute or traumatic pathologies [42,50-53]. Other studies were conducted essentially in usual orthopedic and physiotherapy clinics and included broader samples with various MSKDs clinical representations.

Evaluators and Training

Evaluators were physiotherapists in 35% (8/23) of the studies, physiotherapy students in 13% (3/23) of the studies, or orthopedic surgeons in 35% (8/23) of the studies. Other health care providers involved were nurses, dentists, occupational therapists, and emergency and primary care physicians. In 7 (30%) of the 23 studies, evaluators received specific training on how to perform and adapt their remote assessment [41,42,50-52,59,61]. No information regarding specific training was available for the remaining studies [47,48,54-58,60,62-67]. Of the 23 studies, 3 (13%) involving physiotherapy students allowed them to be advised by a senior physiotherapist if they felt the need [49,52,53]. In 7 (30%) of the 23 studies, evaluators had access to participants’ imaging test results [54,55,57-59,61,62] while in 3 (13%) studies they did not [47,66,67]. No information regarding access to imaging results was available for the remaining studies.

Methodological Quality of Included Studies

Of the 21 studies, 3 (14%) had a perfect QUADAS-2 score [55-57]. A total Of the 21 studies, 11 (52%) had at least 1 item of the QUADAS-2 scored as a high a risk of bias [42,47,49,52-54,58,59,62,63,65] and 9 (43%) had at least 1 item of the QUADAS-2 score scored with an unclear risk of bias [41,48,49,51-54,58,61]. The main shortcomings concerned recruitment method or patient selection [50-52,58,59,61,63,64], the use of case-control study design [42,47], and the lack of blinding or validity of the evaluators’ diagnosis (diagnoses made by physiotherapy students with inconsistent supervision) [49,52-54,62,65]. Of the 9 (43%) had an applicability concern related to the representativeness of the sample of patients recruited [50-53,58,60,61,63,64]. A study had applicability concerns due to the choice of the index test and of the reference standard for the remote and in-person assessments because the remote and in-person assessments were conducted simultaneously [64]. Details are presented in Table 3.

Table 3. Quality of the included concordance studies based on the Quality Assessment of Diagnostic Accuracy Studies 2 Tool.
Author and yearRisk of biasApplicability concerns

Patient selectionIndex testReference standardFlow and timingPatient selectionIndex testReference standard
Abboud et al [57], 2005LowLowLowLowLowLowLow
Dias et al [56], 2023LowLowLowLowLowLowLow
Wang et al [55], 2022LowLowLowLowLowLowLow
Bovonratwet et al [58], 2022HighaLowUnclearLowHighaLowLow
Bradley et al [47], 2021HighbLowLowLowLowLowLow
Cottrell et al [59], 2018HighcLowLowLowLowLowLow
Demaerschalk et al [48], 2022LowLowUnclearLowLowLowLow
Exposto et al [42], 2022HighbLowLowLowLowLowLow
Lade et al [49], 2012UnclearLowHighdLowLowLowLow
Lovo et al [41], 2022UnclearLowLowLowLowLowLow
Melnick et al [65], 2023LowLowHigheLowLowLowLow
Michaelson et al [62], 2023LowLowHigheUnclearLowUnclearLow
Peterson et al [63], 2019Highf,gLowLowLowHighgLowLow
Rabin et al [61], 2022LowUnclearUnclearLowHighhLowLow
Richardson et al [50], 2017LowLowLowLowHighiLowLow
Russell et al [52], 2010UnclearLowHighdLowHighiLowLow
Russell et al [51], 2010UnclearLowLowLowHighiLowLow
Steele et al [53], 2012UnclearLowHighdLowHighiLowLow
Tachakra et al [54], 2022UnclearLowHighjLowLowLowLow
Turner et al [60], 2019LowLowLowLowUnclearLowLow
Worboys et al [64], 2018LowLowLowLowHighkHighkHighk

aPatients who did not have a specific diagnosis and treatment plan during the remote assessment were excluded, which could increase agreement by including only patients who could be easily assessed remotely.

bCase-control design was used in the study.

cOnly a convenience sampling was used for recruitment.

dAssessments were conducted by physiotherapy students, which could reduce the validity of the diagnoses made by evaluators.

eDuring the in-person assessment, evaluators had access to the treatment plan proposed after the remote assessment.

fOnly a convenience sampling was used for recruitment.

gPatients with surgical history of the lumbosacral spine, visible deformity, or no reproduction of symptoms with certain orthopedic tests were excluded.

hAlmost half of the patients (22/47, 47%) were evaluated during a postoperative or nonoperative follow-up consultation, which could increase agreement on diagnosis and treatment plan.

iThis cohort was composed of younger patients recruited in the university clinic with only acute or subacute injuries, without degenerative pathologies.

jThe same evaluator conducted the remote and in-person assessments.

kInitial assessments were excluded, and a third party was present with the patient to assist with data collection, which could have increased the agreement.

Diagnostic Concordance Between Remote and In-Person Assessments

Of the 23 studies, 17 (74%) reported diagnostic concordance results between in-person and remote assessments, and a study [62] reported diagnostic changes between in-person and remote assessments; the overall raw agreement was 85.9% (1352/1574 patients). Of the 23 studies, diagnostic concordance between in-person and remote assessments pooled estimations were possible for 7 (30%) studies for κ and 6 (26%) for PABAK estimates. The pooled estimates are presented in Figure 2. The pooled κ was 0.80 (95% CI 0.72-0.89; 7 studies, 353 patients), and the pooled PABAK was 0.83 (95% CI 0.76-0.89; 6 studies, 306 patients), corresponding to very good agreement between both types of assessments. Statistical heterogeneity measured with the I2 statistic were 65% and 38%, respectively, and considered potentially moderate for these meta-analyses. Prediction intervals for the pooled κ and PABAK were (0.52-0.92) and (0.68-0.91), which were very similar to the calculated CIs for the PABAK but not for the κ, and that difference could be attributed to the κ estimate in the study by Dias et al [56].

Figure 2. Diagnostic concordance (Cohen κs and prevalence-adjusted and bias-adjusted κs [PABAK]) between in-person and remote assessment in patients with musculoskeletal disorders. Meta-analysis with pooled Cohen κs included studies with physiotherapists (6/32, 19%), orthopedic surgeons (23/32, 72%), and physiotherapy students (3/32, 9%) as evaluators. Meta-analysis with pooled PABAKs included studies with physiotherapists (6/30, 33%), orthopedic surgeons (21/30, 50%) and physiotherapy students (3/30, 17%) as evaluators. 95% PI: 95% prediction interval; RE: random-effect model; τ2/I2/P: test for heterogeneity [50-52,55-57,61].

Another study could not be pooled in previous analyses as Fleiss κs were used to evaluate the agreement between in-person and remote assessments [42]. Diagnostic concordance between in-person and remote assessments for the study by Exposto et al [42] for patients with temporomandibular disorders reported Fleiss κs between 0.52 and 1.0, depending on the specific temporomandibular disorders (myalgia of the masseter or the temporalis muscles, temporomandibular arthralgia, or disk displacement with reduction).

Subgroup analyses were performed according to the presence or not of a third party to evaluate the participant during the remote evaluation (Figure S1 in Multimedia Appendix 4), profession of the health care providers (Figures S2 and S3 in Multimedia Appendix 4), body regions (Figures S2 and S4 in Multimedia Appendix 4), and asynchronous or synchronous evaluation forms of telemedicine used (Figures S5 and S6 in Multimedia Appendix 4). Similar results for diagnostic concordance were reported for all these subgroup analyses. For body regions, subgroup analyses were performed specific to upper and lower limb MSKDs. Analyses excluding high risk-of-bias studies (studies with a QUADAS-2 without items evaluated at high risk of bias) reported similar results for diagnostic concordance (Figure S7 in Multimedia Appendix 4).

Treatment Plan Concordance Between Remote and In-Person Assessments

Of the 23 studies, 8 (35%) reported treatment plan concordance outcomes between in-person and remote assessments and 2 (9%) [62,65] reported treatment plan changes between in-person and remote assessments. Overall raw agreement was 84% (406/483 patients). Treatment plan concordance between in-person and remote assessments pooled estimations were only possible for 2 (9%) of the 23 studies for Gwet AC1 coefficient estimates. The pooled estimates are presented in Figure 3. The pooled Gwet AC1 coefficient was 0.90 (95% CI 0.80-0.99; 2 studies, 142 patients), corresponding to a good to excellent agreement between both types of assessments. Statistical heterogeneity (I2=50%) was potentially moderate for this meta-analysis. Prediction intervals could not be calculated as this meta-analysis is based on only 2 studies.

Figure 3. Treatment plan concordance (Gwet AC1 coefficients) between in-person and remote assessment in patients with musculoskeletal disorders. Meta-analysis with pooled Gwet AC1 coefficients included studies with advanced practice physiotherapists (6/9, 67%) and orthopedic surgeons (3/9, 33%). Gwet: Gwet AC1 coefficient; RE: random-effect model; τ2/I2/P: test for heterogeneity [57,59].

Of the 23 studies, 2 (9%) reporting κ estimates (2 studies, n=147) were not pooled together because of statistical heterogeneity (I2=94.79%). The first study by Abboud et al [57] compared the treatment plan concordance among 3 orthopedic surgeons for patients with upper limb MSKDs and reported an excellent agreement with a κ of 0.91 (95% CI 0.85-0.97; 100 patients). The other study by Rabin et al [61] compared the treatment plan concordance between 2 orthopedic surgeons for patients with shoulder pathologies. The authors reported only moderate agreement between remote and in-person proposed treatment plans with a κ of 0.43 (95% CI 0.22-0.64; 47 patients).

Another study was not pooled in these analyses as the evaluators were physiotherapists and had to choose among 3 physiotherapy treatments for low back pain patients (manipulation, specific exercises, or stabilization exercises). In the study by Peterson et al [63], the treatment plan concordance between in-person and remote assessments evaluated was only moderate with a κ of 0.52 (95% CI 0.32-0.72) and a PABAK of 0.52 (95% CI 0.31-0.72).

GRADE Analysis

Pooled results for diagnostic concordance were of high certainty, highlighting a good to very good concordance between remote and in-person assessments (Figure 4).

Figure 4. Summary of the findings and Grading of Recommendations, Assessment, Development, and Evaluations analysis for diagnostic and treatment plan concordance.

Pooled results for treatment plan concordance were of moderate certainty, highlighting a good to excellent concordance between remote and in-person assessments (Figure 4). The I2 was at 50%, and prediction intervals could not be calculated; therefore, certainty of the results was downgraded.


Principal Findings

The aim of this systematic review and meta-analysis was to appraise the available evidence on diagnosis and care concordance after an initial assessment between a remote evaluation and an in-person evaluation for the initial evaluation of various MSKDs. On the basis of our results, health care providers can remotely make a diagnosis that is concordant with a usual in-person assessment. These results are robust and among various populations with acute or chronic MSKDs; we conducted several secondary analyses to assess the impact of various factors that may affect the validity and the feasibility of a remote assessment. Presence of assistance with the patient, body region being assessed, technologies used, and different health care providers’ profession did not appear to influence the accuracy of the remote assessment, but these findings need to be confirmed due to the limited number of studies in certain analyses. Sensitivity analyses, including only studies without high risk of bias and results from the study by Exposto et al [42], not pooled in the meta-analysis, yielded similar results. The study by Dias et al [56] reported a lower κ than the rest of the pooled studies but a similar raw agreement and PABAK (not calculated in the original paper but extracted and calculated by our team). The distribution of diagnoses in the study by Dias et al [56] shows a very high prevalence of some diagnostic categories and a very low prevalence of others. This imbalance may have biased and lowered the κ statistical value [68,69]. Overall concordance was found to be high in our review, but it may still vary across certain MSKDs, and our secondary analyses with fewer study and participants may not have been able to capture this issue. Moreover, studies on various spinal disorders, such as neck pain, or on degenerative pathologies, such as osteoarthritis, which were only marginally represented in the included studies, but very prevalent, are also needed.

Treatment plans proposed remotely had a good to excellent concordance with the treatment plans proposed in person. It may seem logical that if the remote diagnosis is correct, the treatment plan would be similar. However, there is uncertainty about these results because overall less data were available on the treatment plan in the literature; only 2 studies could be pooled and showed potentially moderate heterogeneity. Raw agreement between remote and in-person treatment plan was 84% (406/483 patients; 9 studies), which can be considered high. Again, these results are promising but need to be confirmed by more studies using statistical estimates to conclude on treatment plan concordance.

However, it should be kept in mind that an initial assessment is not only a diagnosis and a treatment plan. Some other key elements were not or could not have been properly evaluated with a remote assessment in several of the included studies. No data are available on the detection of serious pathologies (red flags) or the evaluation psychosocial risk factors (yellow flags) using a remote assessment [24]. Most red or yellow flags are identified during the subjective examination by elements of the patient’s history, specific questions, or questionnaires [8,70]. They may also be identifiable during a remote assessment by using the same screening procedure as during an in-person assessment. However, some tests used to rule out the presence of serious pathologies cannot be performed remotely, such as certain tests of the neurological examination, and patients may be less likely to talk about the psychosocial problems they are experiencing during a remote video or phone encounter. Among the studies we included, none reported having identified serious pathologies. However, given the small sample sizes of the studies and the low prevalence of serious conditions, it is unlikely that several patients with a serious condition were in the included samples [8]. Caution is therefore warranted when concluding that a remote assessment is as safe as traditional in-person assessment and that patients with important psychosocial risk factors are accurately identified. This is the first systematic review with meta-analyses addressing the agreement between remote and in-person diagnoses and treatment plan for MSKDs. Our results are consistent with previous reviews investigating the validity and reliability of different parts of a remote physical examination for MSKDs. Previous reviews have highlighted that most clinical measures assessed by videoconferencing applications, such as pain (visual analog scale) or range of motion assessment in patients with MSKDs, have good concurrent validity and excellent reliability [24,36]. Nevertheless, some measures, such as orthopedic tests, which are usually hands on, have lower concurrent validity and reliability when assessed remotely or simply cannot be performed [47]. Adaptations to the usual in-person physical examination in the musculoskeletal field still need to be developed to achieve validity and reliability comparable to in-person physical examination or to establish that the accuracy of a remote assessment is not as high [24,36,71]. Our results are complementary to other reviews with meta-analyses conducted on remote management of patients with MSKDs that show that remote care after an in-person assessment leads to similar improvements in clinical outcomes as the usual fully in-person approach [32-35]. Guidelines for MSKDs management now emphasize the importance of patient education and self-management as well as physical activity and exercise prescription [2]; all these interventions can be performed remotely [72,73]. In conjunction with our conclusions, the actual body of evidence on remote patient follow-up and clinical measures as well as recommended interventions for MSKDs potentially support the benefits of full remote care pathways for patients with MSKDs.

As stated earlier, more evidence is still needed on the impact of remote assessment for MSKDs. Future studies should also focus on the potential impacts of an initial remote evaluation on health care resources use, such as the use of imaging and other paraclinical investigations, as telemedicine could increase their use. Clinicians and patients express doubts on the validity and safety of a complete remote evaluation because of the impossibility of a hands-on assessment [29,74-76]. This uncertainty induced by the use of telemedicine could increase their use to confirm their diagnosis. There could also be an impact on follow-up visits and referrals to other health care providers and on modification of the relationship between the health care provider and the patient (therapeutic alliance) due to a first video or phone encounter. Telemedicine being an evolution in professional practices, quality standards and proper training of health care providers as well as the integration into the curriculum for trainees must also be anticipated to ensure the quality of remote care and promote the integration of telehealth [28,77,78]. Moreover, digital innovations, such as tools for clinical decision-making aids and improvements in information communication technologies, could compensate for the loss of hands-on assessment and could promote the acceptability of telemedicine by providing additional tools to help clinicians with evaluations and treatments [79-81].

Particular attention should as well be focused on the implementation of telemedicine that does not exclude populations, particularly in rural areas and low-income populations that may be affected by inequalities in access to information and communication technologies, such as access to reliable high-speed internet connections [82]. It is important to develop remote assessment methods using devices available to the public (smartphone and tablet) in contexts similar to clinical reality and not to neglect research of alternatives for populations without access to a high-speed internet connection, such as assessment by phone [60,66,67].

Strengths and Limitations

Strengths of this review include the use of 4 major bibliographical databases, a comprehensive search strategy, the use of the validated QUADAS-2 score to assess methodological quality of included studies, and the use of the Grading of Recommendations, Assessment, Development and Evaluations approach to rate the certainty of the evidence. Prediction intervals were used to assess the impact of the heterogeneity on the results [45]. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were followed to ensure a robust review methodology [83]. Furthermore, this study is one of the first meta-analyses to pool concordance outcomes using novel validated statistical approaches [40,84].

However, some limitations should be highlighted. The presence of publication bias could not be assessed because there were <10 studies to conduct a funnel plot [85]. Our results highlighted that the accuracy of remote diagnoses was not influenced by the type of health care provider or the body region involved. However, the studies pooled in the meta-analyses included only orthopedic surgeons or physiotherapists to evaluate mostly adults with peripheral MSKDs. The accuracy of remote diagnoses made by other health care providers or in different clinical settings, such as rheumatology, or for spinal disorders, such as neck pain, could be different. Moreover, the included studies were carried out in experimental settings, which could overestimate the accuracy of the diagnoses compared to real-life conditions when participants are at home and not in a medical environment. Most of the studies (3/6, 50%) included in the meta-analyses used technologies developed specifically for telemedicine, ensuring an optimal quality of exchange between the evaluator and the participant. The limited number of studies included for treatment plans should also be highlighted. Therefore, more methodologically sound studies with larger sample size are needed.

Conclusions

Health care providers can remotely make a diagnosis that is concordant with a usual in-person assessment for various MSKDs. Diagnostic concordance between remote and in-person assessments is good to very good, and future studies are unlikely to modify this conclusion. Type of health care provider, body region, technology used, and the presence of assistance with the patient do not seem to influence the accuracy of remote diagnoses, but more studies are needed to confirm the impact of such factors. Health care providers offer treatment plans that are consistent with those usually proposed in person. Treatment plan concordance between remote and in-person assessments is probably good to excellent, but future studies may modify these conclusions. There are still some considerations, such as the economic impact, modification of therapeutic alliance between health care provider and patient, or detection of serious pathologies and psychosocial risk factors, to investigate to fully appraise the challenges and benefits of the initial remote evaluation for patients with MSKDs. This systematic review with meta-analysis adds support for further development of hybrid or fully remote care pathways for patients with MSKDs to facilitate access to musculoskeletal care.

Acknowledgments

The authors would like to express their gratitude to James M Gregory, Yuri Martins Costa, and Seth Peterson for sharing their data to perform the required analyses and to Claudia Cosculluela for her participation in the risk-of-bias analysis. FD is an Fonds de Recherche du Québéc-Santé FRQ-S Senior Scholar, DK is an Fonds de Recherche du Québéc-Santé Junior-2 Scholar and RV is supported by PhD scholarships from the Faculté de médecine de l’Université de Montréal, the École de réadaptation de l’Université de Montréal, and the Réseau provincial de recherche en adaptation-réadaptation.

Data Availability

All analyses are available in Multimedia Appendix 4. The data sets generated during and analyzed during this study are available from the corresponding author on reasonable request.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Search strategy.

DOCX File , 33 KB

Multimedia Appendix 2

Codes used in RStudio.

DOCX File , 13 KB

Multimedia Appendix 3

Manuscripts excluded with reasons.

DOCX File , 19 KB

Multimedia Appendix 4

Supplementary materials (characteristics of conference abstracts and subgroup analyses).

DOCX File , 2694 KB

Multimedia Appendix 5

PRISMA 2020 checklist.

PDF File (Adobe PDF File), 68 KB

  1. Cieza A, Causey K, Kamenov K, Hanson SW, Chatterji S, Vos T. Global estimates of the need for rehabilitation based on the Global Burden of Disease study 2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet. Dec 19, 2021;396(10267):2006-2017. [FREE Full text] [CrossRef] [Medline]
  2. Lin I, Wiles L, Waller R, Goucke R, Nagree Y, Gibberd M, et al. What does best practice care for musculoskeletal pain look like? Eleven consistent recommendations from high-quality clinical practice guidelines: systematic review. Br J Sports Med. Jan 02, 2020;54(2):79-86. [CrossRef] [Medline]
  3. Safiri S, Kolahi AA, Cross M, Hill C, Smith E, Carson-Chahhoud K, et al. Prevalence, deaths, and disability-adjusted life years due to musculoskeletal disorders for 195 countries and territories 1990-2017. Arthritis Rheumatol. Apr 2021;73(4):702-714. [FREE Full text] [CrossRef] [Medline]
  4. Briggs AM, Cross MJ, Hoy DG, Sànchez-Riera L, Blyth FM, Woolf AD, et al. Musculoskeletal health conditions represent a global threat to healthy aging: a report for the 2015 World Health Organization world report on ageing and health. Gerontologist. Apr 18, 2016;56 Suppl 2(Suppl 2):S243-S255. [CrossRef] [Medline]
  5. Bevan S. Economic impact of musculoskeletal disorders (MSDs) on work in Europe. Best Pract Res Clin Rheumatol. Jun 2015;29(3):356-373. [CrossRef] [Medline]
  6. Moir M, Barua B. Waiting your turn: wait times for health care in Canada, 2021 report. Fraser Institute. Dec 15, 2021. URL: https://www.fraserinstitute.org/studies/waiting-your-turn-wait-times-for-health-care-in-canada-2021 [accessed 2023-08-23]
  7. Ojha HA, Wyrsta NJ, Davenport TE, Egan WE, Gellhorn AC. Timing of physical therapy initiation for nonsurgical management of musculoskeletal disorders and effects on patient outcomes: a systematic review. J Orthop Sports Phys Ther. Feb 2016;46(2):56-70. [CrossRef] [Medline]
  8. Finucane LM, Downie A, Mercer C, Greenhalgh SM, Boissonnault WG, Pool-Goudzwaard AL, et al. International framework for red flags for potential serious spinal pathologies. J Orthop Sports Phys Ther. Jul 2020;50(7):350-372. [CrossRef] [Medline]
  9. Grimmer K, Bowman P. Differences between metropolitan and country public hospital allied health services. Aust J Rural Health. Nov 1998;6(4):181-188. [CrossRef] [Medline]
  10. Bath B, Trask C, McCrosky J, Lawson J. A biopsychosocial profile of adult Canadians with and without chronic back disorders: a population-based analysis of the 2009-2010 Canadian Community Health Surveys. Biomed Res Int. 2014;2014:919621. [FREE Full text] [CrossRef] [Medline]
  11. How healthy are rural Canadians? : an assessment of their health status and health determinants. Canadian Institute for Health Information. 2006. URL: https://secure.cihi.ca/free_products/rural_canadians_2006_report_e.pdf [accessed 2023-08-23]
  12. Ono T, Schoenstein M, Buchan J. Geographic imbalances in doctor supply and policy responses. Organisation for Economic Cooperation and Development. Apr 3, 2014. URL: https:/​/www.​oecd-ilibrary.org/​social-issues-migration-health/​geographic-imbalances-in-doctor-supply-and-policy-responses_5jz5sq5ls1wl-en [accessed 2023-08-23]
  13. Huguet M. Centralization of care in high volume hospitals and inequalities in access to care. Soc Sci Med. Sep 2020;260:113177. [FREE Full text] [CrossRef] [Medline]
  14. Eberhardt MS, Pamuk ER. The importance of place of residence: examining health in rural and nonrural areas. Am J Public Health. Oct 2004;94(10):1682-1686. [CrossRef] [Medline]
  15. Health at a glance: Europe 2022. Organisation for Economic Co-operation and Development. Dec 5, 2022. URL: https://www.oecd.org/en/publications/health-at-a-glance-europe-2022_507433b0-en.html [accessed 2023-08-23]
  16. Enquête sur l'accès aux soins de santé et aux produits pharmaceutiques pendant la pandémie (EASSPPP). Statistics Canada. Jun 2, 2021. URL: https://www.statcan.gc.ca/fr/enquete/menages/5346 [accessed 2023-08-23]
  17. Pujolar G, Oliver-Anglès A, Vargas I, Vázquez ML. Changes in access to health services during the COVID-19 pandemic: a scoping review. Int J Environ Res Public Health. Feb 03, 2022;19(3):1749. [FREE Full text] [CrossRef] [Medline]
  18. Deslauriers S, Déry J, Proulx K, Laliberté M, Desmeules F, Feldman DE, et al. Effects of waiting for outpatient physiotherapy services in persons with musculoskeletal disorders: a systematic review. Disabil Rehabil. Mar 14, 2021;43(5):611-620. [CrossRef] [Medline]
  19. Report of the WCPT/INPTRA digital physical therapy practice task force. International Network of Physiotherapy Regulatory Authorities. May 15, 2019. URL: https:/​/www.​med.unc.edu/​healthsciences/​physical/​schoolbasedpt/​wp-content/​uploads/​sites/​662/​2020/​04/​WCPTINPTRA_DigitalPTPractice.​pdf [accessed 2023-08-23]
  20. Marcin JP, Shaikh U, Steinhorn RH. Addressing health disparities in rural communities using telehealth. Pediatr Res. Jan 14, 2016;79(1-2):169-176. [FREE Full text] [CrossRef] [Medline]
  21. Moffatt JD, Eley DS. The reported benefits of telehealth for rural Australians. Aust Health Rev. Aug 25, 2010;34(3):276-281. [FREE Full text] [CrossRef]
  22. Jagarapu JR, Savani RC. A brief history of telemedicine and the evolution of teleneonatology. Semin Perinatol. Aug 2021;45(5):151416. [FREE Full text] [CrossRef] [Medline]
  23. Ganjali R, Jajroudi M, Kheirdoust A, Darroudi A, Alnattah A. Telemedicine solutions for clinical care delivery during COVID-19 pandemic: a scoping review. Front Public Health. Jul 22, 2022;10:937207. [FREE Full text] [CrossRef] [Medline]
  24. Mani S, Sharma S, Omar B, Paungmali A, Joseph L. Validity and reliability of internet-based physiotherapy assessment for musculoskeletal disorders: a systematic review. J Telemed Telecare. Mar 31, 2016;23(3):379-391. [CrossRef]
  25. WHO Global Observatory for eHealth. Telemedicine: opportunities and developments in Member States: report on the second global survey on eHealth. World Health Organization. 2010. URL: https://iris.who.int/handle/10665/44497 [accessed 2023-08-23]
  26. El Aoufy K, Melis MR, Bellando Randone S, Blagojevic J, Bartoli F, Fiori G, et al. The positive side of the coin: Sars-Cov-2 pandemic has taught us how much telemedicine is useful as standard of care procedure in real life. Clin Rheumatol. Feb 05, 2022;41(2):573-579. [FREE Full text] [CrossRef] [Medline]
  27. Farzad M, MacDermid J, Ferreira L, Szekeres M, Cuypers S, Shafiee E. A description of the barriers, facilitators, and experiences of hand therapists in providing remote (tele) rehabilitation: an interpretive description approach. J Hand Ther. Oct 2023;36(4):805-816. [CrossRef] [Medline]
  28. Rethorn ZD, Lee AC, Rethorn TJ. Connecting at the webside: rapid telehealth implementation for musculoskeletal clinicians. J Orthop Sports Phys Ther. Jan 2021;51(1):8-11. [CrossRef] [Medline]
  29. Renard M, Gaboury I, Michaud F, Tousignant M. The acceptability of two remote monitoring modalities for patients waiting for services in a physiotherapy outpatient clinic. Musculoskeletal Care. Sep 2022;20(3):616-624. [FREE Full text] [CrossRef] [Medline]
  30. Malliaras P, Merolli M, Williams CM, Caneiro JP, Haines T, Barton C. 'It's not hands-on therapy, so it's very limited': telehealth use and views among allied health clinicians during the coronavirus pandemic. Musculoskelet Sci Pract. Apr 2021;52:102340. [FREE Full text] [CrossRef] [Medline]
  31. Rabanifar N, Hoseini MA, Abdi K. Exploring barriers to implementing telerehabilitation from experiences of managers, policymakers, and providers of rehabilitation services in Iran: a qualitative study. Med J Islam Repub Iran. Dec 22, 2022;36:157. [FREE Full text] [CrossRef] [Medline]
  32. Cottrell MA, Galea OA, O'Leary SP, Hill AJ, Russell TG. Real-time telerehabilitation for the treatment of musculoskeletal conditions is effective and comparable to standard practice: a systematic review and meta-analysis. Clin Rehabil. May 02, 2017;31(5):625-638. [CrossRef] [Medline]
  33. Suso-Martí L, La Touche R, Herranz-Gómez A, Angulo-Díaz-Parreño S, Paris-Alemany A, Cuenca-Martínez F. Effectiveness of telerehabilitation in physical therapist practice: an umbrella and mapping review with meta-meta-analysis. Phys Ther. May 04, 2021;101(5):101. [FREE Full text] [CrossRef] [Medline]
  34. Gava V, Ribeiro LP, Barreto RP, Camargo PR. Effectiveness of physical therapy given by telerehabilitation on pain and disability of individuals with shoulder pain: a systematic review. Clin Rehabil. Jun 01, 2022;36(6):715-725. [CrossRef] [Medline]
  35. Krzyzaniak N, Cardona M, Peiris R, Michaleff ZA, Greenwood H, Clark J, et al. Telerehabilitation versus face-to-face rehabilitation in the management of musculoskeletal conditions: a systematic review and meta-analysis. Phys Ther Rev. Apr 12, 2023;28(2):71-87. [CrossRef]
  36. Zischke C, Simas V, Hing W, Milne N, Spittle A, Pope R. The utility of physiotherapy assessments delivered by telehealth: a systematic review. J Glob Health. Dec 18, 2021;11:04072. [FREE Full text] [CrossRef] [Medline]
  37. Vincent C, Lafrance S, Charron M, Kairy D, Desmeules F. Remote assessment and management of patients with musculoskeletal disorders: a systematic review with meta-analyses. PROSPERO. 2022. URL: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=335606 [accessed 2024-09-08]
  38. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. Oct 18, 2011;155(8):529-536. [FREE Full text] [CrossRef] [Medline]
  39. Viechtbauer W. Conducting meta-analyses in R with the metafor package. J Stat Softw. 2010;36(3):1-48. [CrossRef]
  40. Sun S. Meta-analysis of Cohen’s kappa. Health Serv Outcomes Res Method. 2011;11:145-163. [CrossRef]
  41. Lovo S, Harrison L, O’Connell ME, Rotter T, Bath B. A physical therapist and nurse practitioner model of care for chronic back pain using telehealth: diagnostic and management concordance. J Telemed Telecare. May 12, 2022;30(5):842-850. [CrossRef]
  42. Exposto FG, Castrillon EE, Exposto CR, Costa DM, Gøkhan MA, Svensson P, et al. Remote physical examination for temporomandibular disorders. Pain. May 01, 2022;163(5):936-942. [CrossRef] [Medline]
  43. Higgins JP, Chandler J, Cumpston M, Li T, Page MJ, Welch VA. Cochrane handbook for systematic reviews of interventions version 6.4. The Cochrane Collaboration. URL: https://training.cochrane.org/handbook [accessed 2023-08-23]
  44. Borenstein M, Higgins JP, Hedges LV, Rothstein HR. Basics of meta-analysis: I² is not an absolute measure of heterogeneity. Res Synth Methods. Mar 2017;8(1):5-18. [CrossRef] [Medline]
  45. IntHout J, Ioannidis JP, Rovers MM, Goeman JJ. Plea for routinely presenting prediction intervals in meta-analysis. BMJ Open. Jul 12, 2016;6(7):e010247. [FREE Full text] [CrossRef] [Medline]
  46. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. Apr 26, 2008;336(7650):924-926. [FREE Full text] [CrossRef] [Medline]
  47. Bradley KE, Cook C, Reinke EK, Vinson EN, Mather RC3, Riboh J, et al. Comparison of the accuracy of telehealth examination versus clinical examination in the detection of shoulder pathology. J Shoulder Elbow Surg. May 2021;30(5):1042-1052. [FREE Full text] [CrossRef] [Medline]
  48. Demaerschalk BM, Pines A, Butterfield R, Haglin JM, Haddad TC, Yiannias J, et al. Assessment of clinician diagnostic concordance with video telemedicine in the integrated multispecialty practice at mayo clinic during the beginning of COVID-19 pandemic from March to June 2020. JAMA Netw Open. Sep 01, 2022;5(9):e2229958. [FREE Full text] [CrossRef] [Medline]
  49. Lade H, McKenzie S, Steele L, Russell TG. Validity and reliability of the assessment and diagnosis of musculoskeletal elbow disorders using telerehabilitation. J Telemed Telecare. Oct 19, 2012;18(7):413-418. [CrossRef] [Medline]
  50. Richardson BR, Truter P, Blumke R, Russell TG. Physiotherapy assessment and diagnosis of musculoskeletal disorders of the knee via telerehabilitation. J Telemed Telecare. Jul 08, 2016;23(1):88-95. [CrossRef]
  51. Russell T, Truter P, Blumke R, Richardson B. The diagnostic accuracy of telerehabilitation for nonarticular lower-limb musculoskeletal disorders. Telemed J E Health. Jun 2010;16(5):585-594. [CrossRef] [Medline]
  52. Russell TG, Blumke R, Richardson B, Truter P. Telerehabilitation mediated physiotherapy assessment of ankle disorders. Physiother Res Int. Sep 17, 2010;15(3):167-175. [CrossRef] [Medline]
  53. Steele L, Lade H, McKenzie S, Russell TG. Assessment and diagnosis of musculoskeletal shoulder disorders over the internet. Int J Telemed Appl. 2012;2012:945745. [FREE Full text] [CrossRef] [Medline]
  54. Tachakra S, Lynch M, Newson R, Stinson A, Sivakumar A, Hayes J, et al. A comparison of telemedicine with face-to-face consultations for trauma management. J Telemed Telecare. Dec 02, 2000;6 Suppl 1(1_suppl):S178-S181. [CrossRef] [Medline]
  55. Wang G, Fiedler AK, Warth RJ, Bailey L, Shupe PG, Gregory JM. Reliability and accuracy of telemedicine-based shoulder examinations. J Shoulder Elbow Surg. Aug 2022;31(8):e369-e375. [CrossRef] [Medline]
  56. Dias JMJ, Mendes AFJ, Pestana de Aguiar E, Silveira LC, Noel Dias MF, Barbosa Raposo NR. Interobserver agreement and satisfaction with the use of telemedicine for evaluating low back pain: a primary, observational, cross-sectional, analytical study. Global Spine J. Aug 16, 2023:21925682231194453. [FREE Full text] [CrossRef] [Medline]
  57. Abboud JA, Bozentka DJ, Beredjiklian PK. Telemedicine consultation for patients with upper extremity disorders is reliable. Clin Orthop Relat Res. Jun 2005;435(435):250-257. [CrossRef] [Medline]
  58. Bovonratwet P, Song J, Kim YE, Shinn D, Morse KW, Dowdell JE, et al. Telemedicine visits can generate highly accurate diagnoses and surgical plans for spine patients. Spine (Phila Pa 1976). Sep 01, 2022;47(17):1194-1202. [CrossRef] [Medline]
  59. Cottrell MA, O'Leary SP, Swete-Kelly P, Elwell B, Hess S, Litchfield MA, et al. Agreement between telehealth and in-person assessment of patients with chronic musculoskeletal conditions presenting to an advanced-practice physiotherapy screening clinic. Musculoskelet Sci Pract. Dec 2018;38:99-105. [CrossRef] [Medline]
  60. Turner D. An exploratory study of physiotherapy telephone assessment. Int J Therapy Rehab. Feb 2009;16(2):97-105. [CrossRef]
  61. Rabin A, Dolkart O, Kazum E, Wengier R, Goldstein Y, Maman E, et al. Shoulder assessment by smartphone: a valid alternative for times of social distancing. Arch Orthop Trauma Surg. Jun 13, 2022;142(6):979-985. [FREE Full text] [CrossRef] [Medline]
  62. Michaelson EM, Wiesel BB, Siedlarz B, Murthi AM, Sethi PM, Lutton DM, et al. Accuracy of telemedicine for the diagnosis and treatment of patients with shoulder complaints. Curr Orthop Pract. 2023;34(3):112-116. [CrossRef]
  63. Peterson S, Kuntz C, Roush J. Use of a modified treatment-based classification system for subgrouping patients with low back pain: agreement between telerehabilitation and face-to-face assessments. Physiother Theory Pract. Nov 03, 2019;35(11):1078-1086. [CrossRef] [Medline]
  64. Worboys T, Brassington M, Ward EC, Cornwell PL. Delivering occupational therapy hand assessment and treatment sessions via telehealth. J Telemed Telecare. Feb 13, 2017;24(3):185-192. [CrossRef]
  65. Melnick K, Porche K, Sriram S, Goutnik M, Cuneo M, Murad G, et al. Evaluation of patients referred to the spine clinic via telemedicine and the impact on diagnosis and surgical decision-making. J Neurosurg Spine. Oct 01, 2023;39(4):600-606. [CrossRef] [Medline]
  66. Higginson R, Hutchinson C. Diagnostic accuracy of knee pathologies by a telephone based Advanced Level Physiotherapy service. Physiotherapy. Dec 2017;103(Supplement 1):e104. [CrossRef]
  67. Hutchinson C, Higginson R. The diagnostic accuracy of spinal pathologies referred for by a telephone based advanced level physiotherapy triage service. Physiotherapy. Dec 2017;103(Supplement 1):e99. [CrossRef]
  68. Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. May 1993;46(5):423-429. [FREE Full text] [CrossRef] [Medline]
  69. Flight L, Julious SA. The disagreeable behaviour of the kappa statistic. Pharm Stat. 2015;14(1):74-78. [FREE Full text] [CrossRef] [Medline]
  70. Stearns ZR, Carvalho ML, Beneciuk JM, Lentz TA. Screening for yellow flags in orthopaedic physical therapy: a clinical framework. J Orthop Sports Phys Ther. Sep 2021;51(9):459-469. [CrossRef] [Medline]
  71. Lu AD, Veet CA, Aljundi O, Whitaker E, Smith WB2, Smith JE. A systematic review of physical examination components adapted for telemedicine. Telemed J E Health. Dec 01, 2022;28(12):1764-1785. [CrossRef] [Medline]
  72. Kennedy CA, Warmington K, Flewelling C, Shupak R, Papachristos A, Jones C, et al. A prospective comparison of telemedicine versus in-person delivery of an interprofessional education program for adults with inflammatory arthritis. J Telemed Telecare. Jul 09, 2016;23(2):197-206. [CrossRef]
  73. van der Kolk NM, de Vries NM, Kessels RP, Joosten H, Zwinderman AH, Post B, et al. Effectiveness of home-based and remotely supervised aerobic exercise in Parkinson's disease: a double-blind, randomised controlled trial. Lancet Neurol. Nov 2019;18(11):998-1008. [CrossRef] [Medline]
  74. Cottrell MA, Hill AJ, O'Leary SP, Raymer ME, Russell TG. Patients are willing to use telehealth for the multidisciplinary management of chronic musculoskeletal conditions: a cross-sectional survey. J Telemed Telecare. Aug 2018;24(7):445-452. [CrossRef] [Medline]
  75. Kairy D, Tousignant M, Leclerc N, Côté AM, Levasseur M, The Telage Researchers. The patient's perspective of in-home telerehabilitation physiotherapy services following total knee arthroplasty. Int J Environ Res Public Health. Aug 30, 2013;10(9):3998-4011. [FREE Full text] [CrossRef] [Medline]
  76. Lawford BJ, Bennell KL, Kasza J, Hinman RS. Physical therapists' perceptions of telephone- and internet video-mediated service models for exercise management of people with osteoarthritis. Arthritis Care Res (Hoboken). Mar 29, 2018;70(3):398-408. [CrossRef] [Medline]
  77. Davies L, Hinman RS, Russell T, Lawford B, Bennell K, International Videoconferencing Steering Group. An international core capability framework for physiotherapists to deliver quality care via videoconferencing: a Delphi study. J Physiother. Oct 2021;67(4):291-297. [FREE Full text] [CrossRef] [Medline]
  78. Munce S, Andreoli A, Bayley M, Guo M, Inness EL, Kua A, et al. Clinicians' experiences of implementing a telerehabilitation toolkit during the COVID-19 pandemic: qualitative descriptive study. JMIR Rehabil Assist Technol. Mar 10, 2023;10:e44591. [FREE Full text] [CrossRef] [Medline]
  79. Lowe C, Browne M, Marsh W, Morrissey D. Usability testing of a digital assessment routing tool for musculoskeletal disorders: iterative, convergent mixed methods study. J Med Internet Res. Aug 30, 2022;24(8):e38352. [FREE Full text] [CrossRef] [Medline]
  80. Lervik LC, Vasseljen O, Austad B, Bach K, Bones AF, Granviken F, et al. SupportPrim-a computerized clinical decision support system for stratified care for patients with musculoskeletal pain complaints in general practice: study protocol for a randomized controlled trial. Trials. Apr 11, 2023;24(1):267. [FREE Full text] [CrossRef] [Medline]
  81. Létourneau D, Brière S, Maheux MA, Godin C, Warren P, Lauzier G, et al. OpenTera: a framework for telehealth applications. J Open Source Softw. Nov 2023;8(91):5497. [CrossRef]
  82. The state of broadband 2020: tackling digital inequalities. International Telecommunication Union and United Nations Educational, Scientific and Cultural Organization. Sep 2020. URL: https://www.itu.int/dms_pub/itu-s/opb/pol/S-POL-BROADBAND.21-2020-PDF-E.pdf [accessed 2023-08-23]
  83. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. Mar 29, 2021;372:n71. [FREE Full text] [CrossRef] [Medline]
  84. Lafrance S, Vincent R, Demont A, Charron M, Desmeules F. Advanced practice physiotherapists can diagnose and triage patients with musculoskeletal disorders while providing effective care: a systematic review. J Physiother. Oct 2023;69(4):220-231. [FREE Full text] [CrossRef] [Medline]
  85. Page MJ, Higgins JP, Sterne JA. Assessing risk of bias due to missing results in a synthesis. In: Higgins JP, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al, editors. Cochrane Handbook for Systematic Reviews of Interventions. London, UK. The Cochrane Collaboration; 2019.


GRADE: Grading of Recommendations, Assessment, Development, and Evaluations
MSKD: musculoskeletal disorder
PABAK: prevalence-adjusted and bias-adjusted κ
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
QUADAS-2: Quality Assessment of Diagnostic Accuracy Studies 2


Edited by N Cahill; submitted 20.09.23; peer-reviewed by C Zhang, D Singh, R Theiler; comments to author 16.04.24; accepted 24.07.24; published 23.09.24.

Copyright

©Raphaël Vincent, Maxime Charron, Simon Lafrance, Audrey-Anne Cormier, Dahlia Kairy, François Desmeules. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 23.09.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.