Review
Abstract
Background: In recent years, the effectiveness and cost-effectiveness of digital health services for people with musculoskeletal conditions have increasingly been studied and show potential. Despite the potential of digital health services, their use in primary care is lagging. A thorough implementation is needed, including the development of implementation strategies that potentially improve the use of digital health services in primary care. The first step in designing implementation strategies that fit the local context is to gain insight into determinants that influence implementation for patients and health care professionals. Until now, no systematic overview has existed of barriers and facilitators influencing the implementation of digital health services for people with musculoskeletal conditions in the primary health care setting.
Objective: This systematic literature review aims to identify barriers and facilitators to the implementation of digital health services for people with musculoskeletal conditions in the primary health care setting.
Methods: PubMed, Embase, and CINAHL were searched for eligible qualitative and mixed methods studies up to March 2024. Methodological quality of the qualitative component of the included studies was assessed with the Mixed Methods Appraisal Tool. A framework synthesis of barriers and facilitators to implementation was conducted using the Consolidated Framework for Implementation Research (CFIR). All identified CFIR constructs were given a reliability rating (high, medium, or low) to assess the consistency of reporting across each construct.
Results: Overall, 35 studies were included in the qualitative synthesis. Methodological quality was high in 34 studies and medium in 1 study. Barriers (–) of and facilitators (+) to implementation were identified in all 5 CFIR domains: “digital health characteristics” (ie, commercial neutral [+], privacy and safety [–], specificity [+], and good usability [+]), “outer setting” (ie, acceptance by stakeholders [+], lack of health care guidelines [–], and external financial incentives [–]), “inner setting” (ie, change of treatment routines [+ and –], information incongruence (–), and support from colleagues [+]), “characteristics of the healthcare professionals” (ie, health care professionals’ acceptance [+ and –] and job satisfaction [+ and –]), and the “implementation process” (involvement [+] and justification and delegation [–]). All identified constructs and subconstructs of the CFIR had a high reliability rating. Some identified determinants that influence implementation may be facilitators in certain cases, whereas in others, they may be barriers.
Conclusions: Barriers and facilitators were identified across all 5 CFIR domains, suggesting that the implementation process can be complex and requires implementation strategies across all CFIR domains. Stakeholders, including digital health intervention developers, health care professionals, health care organizations, health policy makers, health care funders, and researchers, can consider the identified barriers and facilitators to design tailored implementation strategies after prioritization has been carried out in their local context.
doi:10.2196/49868
Keywords
Introduction
Background
Approximately 1.71 billion people experience musculoskeletal conditions, which are a major contributor to health care problems worldwide [
]. Worldwide population growth and aging will increase the burden of musculoskeletal conditions on health care in the upcoming decades [ , ]. Therefore, prevention, early detection, and optimal treatment of musculoskeletal conditions, which comprise one of the largest patient groups in primary care, become increasingly important [ - ]. However, patients experience barriers that decrease access to primary care services, such as geographic and transport-related barriers, lack of health insurance, no after-hours access, and a shortage of primary health care professionals [ , ]. A potential solution to optimize prevention and treatment of musculoskeletal conditions, reduce the burden of musculoskeletal conditions on health care, and improve accessibility in primary care is the use of digital health services.Digital health is an umbrella term encompassing eHealth and mobile health, which are defined as the use of information and communications technology in support of health and health-related fields and the use of mobile wireless technologies for health [
]. Examples are video consultations between a health care professional and patient and the integration of apps within primary care treatment. There are several potential benefits to digital health services, such as improved cost-effectiveness, more information about the health status of the patient, better communication between patients and health care professionals, and more accessibility for patients [ , ]. Previous research supports the effectiveness of digital health services in reducing pain and improving functional disability, catastrophizing, coping ability, and self-efficacy [ , ].Despite the benefits of digital health services, their use for musculoskeletal conditions in primary care is lagging. Therefore, a thorough implementation is needed, including the development of implementation strategies that potentially improve the use of digital health services for patients with musculoskeletal conditions in primary care. Important stakeholders for designing these implementation strategies are eHealth developers, health care professionals, health care organizations, health policy makers, health care funders, and researchers. The first step to design implementation strategies for local contexts is to perform a determinant analysis in a more specific context to gain insight into determinants that influence implementation from the perspective of patients and health care professionals. Several studies have identified barriers and facilitators to the implementation of digital health services in other settings and populations [
- ]. Some of these barriers for patients or health care professionals in these settings are workflow, resistance to change, costs, reimbursement, intervention design, and digital literacy. However, it remains unclear which barriers and facilitators are applicable for patients with musculoskeletal conditions in the primary health care setting and what the overarching narrative is for this patient population and setting. A generic overview of barriers and facilitators within this more specific context, which is the aim of this systematic review, is useful as a first step for a thorough implementation. A prioritization of these barriers and facilitators for various local contexts, that is, a specific primary care physiotherapy practice, would be the next step to design fitting implementation strategies for the local context [ ].A practical theory-based framework to guide for systematical assessment of barriers and facilitators that influence implementation is the Consolidated Framework for Implementation Research (CFIR) [
]. The CFIR consolidates implementation determinants from a broad array of implementation theories and is composed of 5 domains (intervention [digital health service] characteristics, outer setting, inner setting, characteristics of individuals [health care professionals], and the implementation process), and it provides a systematic way of identifying constructs that have been associated with effective implementation. The use of a framework such as CFIR to structure the overview of barriers and facilitators allows stakeholders undertaking implementation activities to focus on barriers and facilitators that are of most interest to them more easily and design implementation strategies that are specific to their local context [ ].Objectives
No systematic overview of barriers and facilitators influencing the implementation of digital health services for people with musculoskeletal conditions in the primary health care setting exists to support these stakeholders in designing fitting implementation strategies. Therefore, the aim of this systematic literature review was to identify barriers and facilitators to the implementation of digital health for people with musculoskeletal conditions in the primary health care setting.
Methods
This systematic literature review of qualitative data from qualitative and mixed methods articles is reported following the enhancing transparency in reporting the synthesis of qualitative research statement [
]. Exclusively incorporating qualitative evidence in this systematic review enables a nuanced exploration of the multifaceted factors influencing implementation, providing diverse perspectives and in-depth insights from both patients and health care providers.Search Strategy
The electronic databases PubMed, Embase, and CINAHL were searched to seek all available studies up to March 2024. The complete search strategy can be found in
. Inclusion and exclusion criteria are presented in .Inclusion criteria
- Domain: adults (aged ≥18 years); musculoskeletal conditions (eg, low back pain, osteoarthritis, and total knee replacement); primary health care setting (eg, general practice and physiotherapy practice)
- Determinant: the health care professional (eg, general practitioners, physiotherapists, and occupational therapists) has provided digital health (eg, synchronous patient-therapist interactions through telephone or video consultations and asynchronous physical exercise training, coaching, and monitoring using web applications, wearables, and platforms) more than once during an intervention
- Outcome: data on barriers or facilitators to the implementation of digital health services that fit into one of the Consolidated Framework for Implementation Research domains; data of patients or health care professionals
- Article type: qualitative and mixed methods designs; full text in English is available
Exclusion criteria
- Determinant: web-based training programs for health care professionals
- Article type: articles with no qualitative component, such as a quantitative survey only
Selection of Studies
The web-based screening tool Rayyan was used for the selection of studies [
]. A total of 3 reviewers (MLvT, IS, and MvdV) conducted the inclusion of eligible articles. Articles were screened independently by 2 reviewers for eligibility based on title and abstract. When an article was potentially eligible for inclusion, a full paper copy of the report was obtained and screened independently by 2 reviewers. Disagreements between the reviewers regarding an article’s eligibility were resolved by discussion until consensus was reached. In case of disagreement, a fourth reviewer (CJJK) was consulted. In addition, reference tracking was performed in all included articles. The reasons for exclusion were recorded ( ) [ ].Data Extraction and Management
The reviewers extracted the following data using a standardized extraction form: first author, country, year of publication, aim, design and method of data collection and methods of analysis, sample, description of digital health service, and data on barriers or facilitators to the implementation of digital health services reported in the Results section.
Assessment of Methodological Quality
In total, 3 reviewers (MLvT, IS, and MvdV) independently assessed the methodological quality of the qualitative component of the included articles. The Mixed Methods Appraisal Tool (MMAT) was used to appraise studies for this review [
]. It is a 5-item tool designed to appraise the methodological quality of 5 categories of studies, including qualitative and mixed methods studies. The MMAT has established content validity and has been piloted across the mentioned methodologies [ ]. The MMAT encompasses 2 initial screening questions: “Are there clear research questions?” and “Do the collected data allow to address the research questions?” Methodological quality assessment was only performed if “yes” could be answered for both screening questions. A detailed presentation of the individual ratings of each MMAT criterion was provided to inform the quality of the included studies. Overall sum scores were calculated based on the quality of the qualitative component only and presented as number of stars (*), with 0 and 1 star indicating low quality, 2 and 3 stars indicating medium quality, and 4 and 5 stars indicating high quality [ ]. These cutoff values were determined by 2 reviewers (MLvT and IS), as the MMAT subscribes, and are arbitrary but useful for transparent data syntheses. Disagreements were resolved in a consensus meeting between the raters. When there was any disagreement, a fourth reviewer (CJJK) could be consulted but was not necessary. As the aim was to describe and synthesize a body of qualitative literature and not determine an effect size, the quality assessment was only included to inform the overall quality of the included articles and to determine the reliability rating.Data Synthesis
A framework synthesis was performed, with secondary thematic analysis of the results section of the included articles. To synthesize the findings, the CFIR was used, using the 2009 version because the analysis began before the 2022 update [
]. Initially, MLvT and IS used an open coding process to identify barriers and facilitators to implementation and allocated them to the most fitting CFIR construct or subconstruct using a coding manual from the CFIR [ ]. During the axial coding process, these open codes were organized into thematic categories representing barriers and facilitators to implementation. MLvT conducted the axial coding, which was reviewed by IS and CJJK on an iterative basis. As the thematic analysis progressed, recurring themes identified across the included studies informed the development of a comprehensive narrative for the generic overview of barriers and facilitators to implementation.Next, all identified CFIR constructs or subconstructs were given (MLvT, IS, and MvdV) a reliability rating to review the consistency of reporting across each construct and the quality of the studies that identified them, which was also reported in another systematic review on barriers and facilitators in another context and aims to indicate confidence in the findings [
]. All disagreements were resolved through discussion until consensus was reached. Three levels of reliability were distinguished: (1) high reliability (the construct is consistently supported by >1 study of medium quality and 1 study of high quality or the construct is supported by at least 2 studies of high quality based on the MMAT); (2) medium reliability (the construct is supported by >1 study of medium quality or the construct is identified on the basis of at least 1 high-quality study based on the MMAT); and (3) low reliability (the construct is supported only by studies of low quality or single studies of medium quality based on the MMAT).Results
Study Selection
The literature search resulted in a total of 1516 articles found in the Embase, PubMed, and CINAHL databases. After removing duplicates, 1425 articles were screened based on title and abstract. This resulted in 95 studies that were screened full text, after which studies were excluded on outcome (n=27, 28%), article type (n=21, 22%), determinant (n=7, 7%), and domain (n=5, 5%). In 2 cases of initial disagreement between reviewers, a fourth reviewer (CJJK) was consulted. Finally, 35 studies were included in the qualitative synthesis [
- ]. No additional studies were found through reference checking. The study selection procedure is presented in .Study Characteristics
Characteristics of the included studies are presented in
. Individual articles are ordered alphabetically within all presented tables. All included articles were published between 2011 and 2024. A total of 10 articles originated from Australia [ , , , , , , , , , ]; 9 articles originated from the Netherlands [ - , , , , , , ]; 4 articles originated from Canada [ , , , ]; 3 articles originated from the United Kingdom [ , , ]; 2 articles originated from Brazil [ , ], Sweden [ , ], and France [ , ]; and 1 article originated from Denmark [ ]. The digital health services mentioned in the included articles aimed to facilitate synchronous patient-therapist interactions through telephone or video consultations and to support asynchronous physical exercise training, coaching, and monitoring using web applications and platforms. The participants in the included articles primarily consisted of patients, physiotherapists, and general practitioners but also encompassed occupational therapists, dietitians, psychologists, and a pharmacist. Patients presented with a variety of musculoskeletal conditions, including knee and hip osteoarthritis, knee conditions, chronic nonspecific low back pain, Achilles tendinopathy, traumatic hand injury, anterior cruciate ligament reconstruction, shoulder joint replacement, and total knee replacement.Information about methodological quality of the studies is presented in
. Almost all qualitative components of the included studies, assessed with the MMAT, were of high methodological quality. In total, 31 articles scored 5 stars, and 3 articles scored 4 stars. Qualitative component of 1 article was of medium methodological quality and scored 3 stars.Author, year, country | Aims of the study | Methodsa | Participantsa | Digital health service |
Aily et al [ | ], 2020; Brazil
|
|
| In-person exercise therapy instructions along with a booklet and DVD to take home. Participants also received 6 motivational phone calls throughout the 12-week treatment |
Arensman et al [ | ], 2022; the Netherlands
|
|
| The Physitrack app that allows physiotherapists to create and share personalized exercise programs with patients. The app allows patients to set reminders to perform their exercises, track their adherence, rate pain scores during the exercises, and send direct messages to their physiotherapists |
Barton et al [ | ], 2022; Australia
|
|
| Telehealth care from physiotherapists throughout Australia |
Bossen et al [ | ], 2016; the Netherlands
|
|
| E-Exercise is a 12-week intervention, which combines visits with a physiotherapist and a web-based physical activity intervention. Patients receive 4 face-to-face sessions and are supposed to complete 12 web-based assignments. The website has a portal for both patients and physiotherapists and contains text- and video-based information |
Button et al [ | ], 2018; the United Kingdom
|
|
| TRAK is a web-based intervention for supporting rehabilitation of knee conditions, with a potential to enhance the quality of treatment components, such as health information provision, rehabilitation monitoring, remote support, and personalized exercise progression |
Martínez de la Cal et al [ | ], 2021; Spain
|
|
| McKenzie Exercise Therapy and electroanalgesia based on telerehabilitation with the help of 10.1 “Quad Core” tablets |
Cottrell et al [ | ], 2017; Australia
|
|
| Telerehabilitation: delivery of rehabilitation service at a distance using telecommunications technology |
Dehainault et al [ | ], 2024; France
|
|
| Participants were presented with screenshots from the “Mon Coach Dos” and “Activ’Dos” mobile apps, with a standardized explanatory presentation framework. An information sheet about the apps was integrated into the slideshow presenting their description, creator, funding, and data use |
Dunphy et al [ | ], 2017; the United Kingdom
|
|
| TRAK is a digital intervention developed to support self-management of knee conditions. TRAK provides a platform for individually tailored exercise programs with videos, detailed instructions and progress logs for individual exercises, a health information section, and a contact option that allows a patient to email a physiotherapist for additional support |
Egerton et al [ | ], 2017; Australia
|
|
| The new model for primary care management of knee osteoarthritis includes a multidisciplinary team of health professionals using remote delivery options (primarily telephone) to provide ongoing “care support.” The GP refers the patient to the “care support team” following a brief initial consultation. The “care support team” staff will have skills in health behavior change plus expertise in current best practice for knee osteoarthritis management |
Eriksson et al [ | ], 2011; Sweden
|
|
| A 2-month home-based video physiotherapy program, supervised by an experienced physiotherapist specializing in shoulder problems. |
Ezzat et al [ | ], 2022; Australia
|
|
| GLA:Dh is a physiotherapist-led 8-week program, which includes 2 group education sessions, followed by 12 supervised, neuromuscular exercise therapy sessions. The program is delivered via telehealth or in person |
Ezzat et al [ | ], 2023; Australia
|
|
| GLA:D is a physiotherapist-led 6- to 8-week program, which includes 2 to 3 group education sessions, followed by 12 supervised, neuromuscular exercise therapy sessions. The program is delivered via telehealth or in person |
Farzad et al [ | ], 2023; Canada
|
|
| Web-based hand therapy interventions |
Geraghty et al [ | ], 2020; the United Kingdom
|
|
| SupportBack is a web-based platform to support patients through a self-tailored, 6-week self-management program. Contents include exercises or a walking program with weekly goals, feedback, and advice. Patients also received 3 telephone calls from an musculoskeletal physiotherapist to provide reassurance, address concerns, problem-solve, and encourage continued engagement with the intervention and physical activity goals |
Hasani et al [ | ], 2021; Australia
|
|
| Gym-based exercise program where the participants performed 4 sets of unilateral isotonic standing and seated calf raise exercises in a Smith machine (both sides, one leg at a time) 3 times per week, over 12 weeks Physiotherapists supervised 1 session per week via videoconference software (Zoom) that was downloaded to the participants’ smartphone |
Hinman et al [ | ], 2017; Australia
|
|
| Participants were provided 7 internet-based Skype-delivered physical therapy sessions for 3 months, with the main purpose being to prescribe an individualized home-based strengthening program to be undertaken 3 times per week |
Hjelmager et al [ | ], 2019; Denmark
|
|
| Distribution of health-related information via the internet |
Kairy et al [ | ], 2013; Canada
|
|
| An in-home telerehabilitation program consisting of twice-a-week physiotherapy sessions for 8 weeks (total 16 sessions) by a videoconferencing system located in the participant’s home |
Kelly et al [ | ], 2022; Ireland
|
|
| The use of technological platforms (eg, mobile, computer and tablet) in physiotherapy |
Kingston et al [ | ], 2015; Australia
|
|
| The use of technology, namely, telehealth and the use of the internet |
Kloek et al [ | ], 2020; the Netherlands
|
|
| The intervention consists of about 5 physiotherapy sessions in combination with a web-based application (E-Exercise). The web-based application contains a tailored 12-week behavioral graded activity program, videos with strength and mobility exercises, and videos and texts with information about osteoarthritis-related topics. |
Lamper et al [ | ], 2021; the Netherlands
|
|
| The eCoach Pain is an electronic coach to facilitate pain rehabilitation. It supports the provision of integrated rehabilitation care with a shared biopsychosocial vision on health. Both patients and primary health care professionals use the eCoach Pain. It comprises a measurement tool for assessing complexity of the pain problem, diaries, pain education sessions, monitoring options, and a chat function |
Lawford et al [ | ], 2019; Australia
|
|
| The patients received 5 to 10 telephone consultations over a 6-month period. Physiotherapists devised goals and an action plan for each patient that involved both a structured home exercise program and a physical activity plan. Patients also had access to a study website containing video demonstrations of each exercise |
Van der Meer et al [ | ], 2022; the Netherlands
|
|
| eHealth included in the health care process of people with TMD |
Östlind et al [ | ], 2022; Sweden
|
|
| A wearable activity tracker (Fitbit Flex 2) in combination with the Fitbit app for 12 weeks. The participants were asked to monitor their activity daily, and they received automatic feedback from the app |
Palazzo et al [ | ], 2016; France
|
|
| The use of new technologies to decrease the burden of home-based exercise programs in chronic LBP |
Passalent et al [ | ], 2022; Canada
|
|
| Technology for encouraging physical activity |
Pereira et al [ | ], 2023; Brazil
|
|
| Physical therapy by telerehabilitation |
Petrozzi et al [ | ], 2021; Australia
|
|
| Physical treatments combined with an internet-delivered psychosocial program called MoodGYM |
Poolman et al [ | ], 2024; the Netherlands
|
|
| Back2Action is a newly developed biopsychosocial-blended intervention consisting of in-person physiotherapy sessions blended with psychologically informed digital health. The digital part of the intervention incorporates pain education and behavioral activation |
Renard et al [ | ], 2022; Canada
|
|
| Teleconsultation follow‐ups |
Van Tilburg et al [ | ], 2022; the Netherlands
|
|
| The patients received a stratified blended intervention, whereby a prognostic stratification tool, a web-based application (e-Exercise), and face-to-face physiotherapy sessions are integrated within physiotherapy treatment to create an optimal combination |
Van Tilburg et al [ | ], 2023; the Netherlands
|
|
| A blended physiotherapy treatment (e-Exercise) for people with neck and shoulder conditions in which a smartphone app with personalized information, exercises, and physical activity modules was an integral part of physiotherapy treatment |
De Vries et al [ | ], 2017; the Netherlands
|
|
| The web-based component of e-Exercise consists of a 12-week incremental physical activity program based on graded activity, strength and stability exercises, and information on osteoarthritis-related themes. The offline component consists of up to 5 face-to-face physiotherapy sessions |
aFor mixed methods designs, only the data collection, data analysis, and participants from the qualitative component are described.
bLBP: low back pain.
cTRAK: Taxonomy for the Rehabilitation of Knee Conditions.
dN/OPSC: Neurosurgical and Orthopaedic Physiotherapy Screening Clinic.
eMDS: multidisciplinary service.
fACL: anterior cruciate ligament.
gGP: general practitioner.
hGLA:D: Good Life with Osteoarthritis in Denmark.
iRE-AIM QuEST: Reach, Effectiveness, Adoption, Implementation, and Maintenance Qualitative Evaluation for Systematic Translation.
jTMD: temporomandibular disorder.
Study | Criteria from the Mixed Methods Appraisal Tool: qualitative studies | Total number of stars (based on the qualitative component) | |||||
1.1a | 1.2b | 1.3c | 1.4d | 1.5e | |||
Aily et al [ | ], 20200f | 1g | 1 | 1 | 1 | *** | |
Arensman et al [ | ], 20221 | 1 | 1 | 1 | 1 | ***** | |
Barton et al [ | ], 20221 | 1 | 1 | 1 | 1 | ***** | |
Bossen et al [ | ], 20161 | 1 | 1 | 0 | 1 | **** | |
Button et al [ | ], 20181 | 1 | 1 | 1 | 1 | ***** | |
Martínez de la Cal et al [ | ], 20211 | 1 | 1 | 1 | 1 | ***** | |
Cottrell et al [ | ], 20171 | 1 | 1 | 1 | 1 | ***** | |
Dehainault et al [ | ], 20241 | 1 | 1 | 1 | 1 | ***** | |
Dunphy et al [ | ], 20171 | 1 | 1 | 1 | 1 | ***** | |
Egerton et al [ | ]1 | 1 | 1 | 1 | 1 | ***** | |
Eriksson et al [ | ], 20111 | 1 | 1 | 0 | 1 | **** | |
Ezzat et al [ | ], 20221 | 1 | 1 | 1 | 1 | ***** | |
Ezzat et al [ | ], 20231 | 1 | 1 | 1 | 1 | ***** | |
Farzad et al [ | ], 20231 | 1 | 1 | 1 | 1 | ***** | |
Geraghty et al [ | ], 20201 | 1 | 1 | 1 | 1 | ***** | |
Hasani et al [ | ], 20211 | 1 | 1 | 1 | 1 | ***** | |
Hinman et al [ | ], 20171 | 1 | 1 | 1 | 1 | ***** | |
Hjelmager et al [ | ], 20191 | 1 | 1 | 1 | 1 | ***** | |
Kairy et al [ | ], 20131 | 1 | 1 | 1 | 1 | ***** | |
Kelly et al [ | ], 20221 | 1 | 1 | 1 | 1 | ***** | |
Kingston et al [ | ], 20151 | 1 | 1 | 1 | 1 | ***** | |
Kloek et al [ | ], 20201 | 1 | 1 | 1 | 1 | ***** | |
Lamper et al [ | ], 20211 | 1 | 1 | 1 | 1 | ***** | |
Lawford et al [ | ], 20191 | 1 | 1 | 1 | 1 | ***** | |
van der Meer et al [ | ], 20221 | 1 | 1 | 1 | 1 | ***** | |
Östlind et al [ | ], 20221 | 1 | 1 | 1 | 1 | ***** | |
Palazzo et al [ | ], 20161 | 1 | 1 | 1 | 1 | ***** | |
Passalent et al [ | ], 20221 | 1 | 1 | 1 | 1 | ***** | |
Pereira et al [ | ], 20231 | 1 | 1 | 1 | 1 | ***** | |
Petrozzi et al [ | ], 20211 | 1 | 1 | 1 | 1 | ***** | |
Poolman et al [ | ], 20241 | 1 | 1 | 1 | 1 | ***** | |
Renard et al [ | ], 20221 | 1 | 1 | 1 | 1 | ***** | |
van Tilburg et al [ | ], 20221 | 1 | 1 | 1 | 1 | ***** | |
van Tilburg et al [ | ], 20231 | 1 | 1 | 1 | 1 | ***** | |
De Vries et al [ | ], 20171 | 1 | 1 | 0 | 1 | **** |
a1.1=Is the qualitative approach appropriate to answer the research question?
b1.2=Are the qualitative data collection methods adequate to address the research question?
c1.3=Are the findings adequately derived from the data?
d1.4=Is the interpretation of results sufficiently substantiated by data?
e1.5=Is there coherence between qualitative data sources, collection, analysis, and interpretation?
f0=no.
g1=yes.
Barriers and Facilitators by CFIR
Overview
An overview of CFIR constructs or subconstructs influencing implementation of digital health services for patients with musculoskeletal conditions in the primary health care setting, with the sources and reliability rating, is presented in
. An overview of the data synthesis supported by illustrative quotes, is presented in .CFIRa domain, construct, and subconstruct | Studies | Reliability | ||||
Innovation characteristics | ||||||
Innovation source | [ | , , ]High | ||||
Relative advantage | [ | - , - , - , - ]High | ||||
Adaptability | [ | - , , - , , , - , , , , , ]High | ||||
Complexity | [ | - , , , - , , , , , , , , ]High | ||||
Design quality and packaging | [ | , , , , , , , , , , , , ]High | ||||
Cost | [ | , , , , , , , , , ]High | ||||
Outer setting | ||||||
Patient needs and resources | [ | , , - , , , , - , - , , - ]High | ||||
External policy and incentives | [ | , , , , , , ]High | ||||
Inner setting | ||||||
Networks and communications | [ | , , ]High | ||||
Implementation climate | ||||||
Tension for change | [ | , , , , , , ]High | ||||
Compatibility | [ | , , , , - , , , ]High | ||||
Learning climate | [ | , ]High | ||||
Readiness for implementation | ||||||
Available resources | [ | , , , , , , , , - , , , - , , , ]High | ||||
Access to knowledge and information | [ | - , , , ]High | ||||
Characteristics of individuals | ||||||
Knowledge and beliefs about the intervention | [ | , , , - , - , , , ]High | ||||
Process | ||||||
Engaging | ||||||
Opinion leaders | [ | ]Medium | ||||
Key stakeholders (health care professional) | [ | , , , ]High | ||||
Executing | [ | ]Medium |
aCFIR: Consolidated Framework for Implementation Research.
CFIRa domain, construct, and subconstruct | Barriers (–) and facilitators (+) with illustrative quotes | ||||
Digital health service characteristics | |||||
Innovation source |
| ||||
Relative advantage |
| ||||
Adaptability |
| ||||
Complexity |
| ||||
Design quality and packaging |
| ||||
Cost |
| ||||
Outer setting | |||||
Patient needs and resources |
| ||||
External policy and incentives |
| ||||
Inner setting | |||||
Networks and communications |
| ||||
Implementation climate | |||||
Tension for change |
| ||||
Readiness for implementation | |||||
Compatibility |
| ||||
Learning climate |
| ||||
Knowledge and beliefs about the intervention | |||||
Available resources |
| ||||
Access to knowledge and information |
| ||||
Characteristics of individuals | |||||
Knowledge and beliefs about the intervention |
| ||||
Process | |||||
Engaging | |||||
Opinion leaders |
| ||||
Executing | |||||
Key stakeholders (health care professional) |
| ||||
|
aCFIR: Consolidated Framework for Implementation Research.
Domain 1: Digital Health Service Characteristics
Innovation Source (High Reliability)
Commercially neutral digital health services may facilitate implementation according to health care professionals because logos of, for example, pharmaceutical companies could indicate economic instead of public health interests [
, ]. A link with an institution with a good image, such as a specialized hospital, may also be a facilitator to implementation, according to health care professionals, because it promotes trust [ ].Relative Advantage (High Reliability)
When patients or health care professionals experience a relative advantage of digital health services over usual care, this may facilitate implementation. Mentioned relative advantages were promoting adherence [
- , , , , , , ], self-management [ - , , , , , - , , , , ], empowerment [ , , , , , ], motivation through support [ , - , , , , , - ], access to health care [ , , , , , , , , - , - , , , ], creating societal awareness [ ] for specific health problems, and a continuous care chain [ , , , , , , ]. The integration of digital health and therapy sessions (blended care) is described by patients and health care professionals as a facilitator because the digital health service can then be tailored to patient’s needs, complementary therapy can be offered, and self-efficacy can be enhanced [ - , , , - , , , , , ]. However, there were also some concerns among health care professionals that quality of care may be reduced because, for example, physical examination may not be as thorough compared to usual face-to-face care [ , - , , - , , , ]. On the contrary, some health care professionals believed that extra time and encouragement for the patient through a digital health service may result in better treatment outcomes. Advantages and disadvantages related to the patient–health care professional relationship were also experienced as both barriers and facilitators to implementation by patients and health care professionals [ - , , , , , , , , , , ]. Patients reported, for example, that when having health concerns, they prefer face-to-face reassurance over reassurance through a digital health service. Physiotherapists also had some concerns about creating a professional relationship if there are none or less face-to-face sessions. In contrast, they experienced that consulting via telephone forced them to focus on effective conversations, which allowed them to talk at a more personal level with patients. In addition, privacy and safety concerns may be barriers to implementation [ , , - , ]. During the COVID-19 pandemic, safely providing health care from home was reported as a facilitator for implementation.Adaptability (High Reliability)
Both health care professionals and patients agreed that adaptability of digital health services to fit the local context may be an important facilitator to implementation. Digital health services that are flexible to tailor to specific patient needs and suitable for various groups or subgroups of patients facilitate implementation [
- , , , , - , , , - , , , , , ]. Another facilitating determinant was an evolving intervention [ , , ]. Use of a digital health service may increase if its content changes and information and features are continuously updated.Complexity (High Reliability)
Complexity of digital health services that affect implementation is mostly linked to usability. Facilitating determinants concerning usability may be easy installation; easy to use; simple design and interface; simple navigation; visual support of text; and a not too wordy, manageable content [
- , , , - , , , , , , , ]. Barriers concerning usability may be functional limitations of digital health services used in health care compared to those available on the commercial market. Another facilitating determinant to implementation was sufficient health care professional management for patients, such as updating relevant links and personal plans or the provision of technical aid by health care professionals to reduce complexity [ , , ].Design Quality and Packaging (High Reliability)
Experienced excellence in design quality and packaging of digital health services, such as variety and range of content and functionalities [
, , , , , , , , , ], persuasive design [ , , ], and modality [ , , , , , ], may facilitate implementation according to both patients and health care professionals. Some mentioned functionalities are personal plans, exercise logs with speech notes as an alternative to text input, information modules with educational videos alongside written information, a progress dashboard with milestones, email or chat support, reminder tools, and feedback functions. An app was preferred over a website as modality, in particular, because of offline functionalities of an app.Cost (High Reliability)
Costs associated with digital health services may be a barrier to implementation. Next to direct costs, a potential reducednumber of treatment sessions [
, , , , ] may both be a barrier and facilitator to implementation. Potential loss of income because of substitution of treatment sessions was experienced as a barrier by health care professionals. However, reducing treatment sessions may be a facilitator to some health care professionals because of efficiency, and offering innovative interventions attracts new patients, which is a financial incentive. Some health care professionals mentioned that patient expenses for digital health services may be a barrier to implementation [ , , , , , ]. In addition, digital health services may improve access to care for patients living in remote areas and may save them travel expenses, which was experienced as a facilitator to implementation.Domain 2: Outer Setting
Patient Needs and Resources (High Reliability)
Needs of patients may influence the participation in digital health. Personal traits of patients, such as poor digital literacy [
, , , , , , , ], poor communication skills [ , , ], higher age [ , , , , , ], lack of motivation [ , , , , , , , , , , ], maladaptive illness perceptions [ , ], and feeling depressed [ ], may be barriers to adherence or participation and therefore to implementation of digital health in primary care. Moreover, entertaining strategies for performing exercises, such as exercises in a video game, might improve engagement according to patients, which facilitates implementation [ ].External Policy and Incentives (High Reliability)
Broad acceptance of digital health by patients, health care professionals, and health service funders creates trust for health care professionals that implementation is worthwhile. Therefore, acceptance by thesestakeholders, or even the demand by stakeholders such as patients, may be an important facilitator to implementation [
, , , , ]. The absence of health care guidelines [ , ], standards, or protocols in using digital health and strict privacy regulations [ ] may be barriers to implementation. Another barrier to health care professionals may be a lack of external financial incentive if the digital health intervention aims to substitute treatment sessions [ ].Domain 3: Inner Setting
Networks and Communications (High Reliability)
Effective, useful, and timely channels of communication between health care professionals involved in the use of a digital health intervention may be facilitators to implementation [
, , ]. An example is the quality and quantity of communication between a general practitioner and a care support team that provided remotely delivered interventions in a multidisciplinary intervention. Another facilitator is some sort of personal relationship between health care professionals that are involved in using a digital health service [ ].Implementation Climate—Tension for Change (High Reliability)
Health care professionals and patients agreed that there is a need for change, which was a facilitator to implementation of digital health. Problems that create a tension for change are poor accessibility to health care [
, , ] because of for example medical comorbidities, poor health literacy or inconvenient appointment times, large distance to health care service, high burden of health care on health care professionals, no availability of a (specialized) health care professional, and the need for trustworthy information [ ].Implementation Climate—Compatibility (High Reliability)
Integrating digital health services into usual care requires change of treatment routines, which may be a barrier to implementation, specifically because of lack of knowledge and practice to adapt routines, lack of confidence, and resistance to change of health care professionals [
, , , , - , , , ]. Positive experiences with integrating digital health services into usual care may lead to more acceptability and may overcome this barrier. Moreover, incompatibility with other initiatives and guidelines may be barriers to implementation [ ]. There are many initiatives and guidelines for management of musculoskeletal conditions, and whenever these are incompatible with a digital health service, treatment routines may become complicated and confusing. In addition, incompatibility with existing payment structures may lead to inequity of care and was a barrier to implementation according to health care professionals [ ]. Health care professionals mentioned that information incongruence could be another barrier to implementation [ ]. Safety may be affected when patient advice and information, provided by health care professionals and via digital health services, are incongruent and as a consequence cause the health care professional to spend extra time and effort to deal with conflicting messages.Implementation Climate—Learning Climate (High Reliability)
The extent to which health care professionals feel as essential, valued, and knowledgeable partners in the implementation process creates a better climate for implementation. Facilitators to implementation of digital health services may be support from colleagues and that the professional autonomy of health care professionals was maintained [
, ].Readiness for Implementation—Available Resources (High Reliability)
Available resources, including the availability of suitable infrastructure, may facilitate the implementation of digital health. Technology-related issues may be a barrier to implementation [
, , , , , , - , , , ]. Both patients and health care professionals mentioned several technology-related issues, including troubles with initially setting up or operating the technology, insufficient battery life, poor or no internet connection, poor video quality, and audio problems. Moreover, time may both be a barrier as well as a facilitator to implementation [ , , , , , , , , ]. Some health care professionals perceived digital health services as time saving, whereas others perceived it as an additional burden. This issue involves the lack of time to familiarize with, set up, personalize, and use the technology as well as the time investment required from health care professionals to assist patients. In addition, the lack of a quiet physical space for health care professionals as well as patients specifically for telerehabilitation may be a barrier to implementation [ , , , ]. Moreover, the lack of electronic health records may be a barrier to implementation [ ].Readiness for Implementation—Access to Knowledge and Information (High Reliability)
Access of health care professionals and patients to knowledge and information about the use of digital health services may be an important determinant that influences implementation. A health care professionals’ training before using the digital health intervention may be a facilitator to implementation [
, - , , ]. Access for patients to explore the digital health intervention before a consultation and clear instructions in the form of a manual, webinar, videos, or face-to-face support were facilitators to implementation [ , , , , , , ].Domain 4: Characteristics of Health Care Professionals (Knowledge and Beliefs About the Intervention: High Reliability)
Health care professionals’ acceptance of a digital health intervention may both be a facilitator and barrier [
, , , - , , , , ]. Resistance to change of health care professionals may be a barrier to implementation, but if health care professionals trust that their efforts to embrace change will be worthwhile, this may facilitate implementation. Most health care professionals are open to digital health services, as long as they have appropriate training and time to familiarize with the intervention and its content. If experiences with a digital health intervention exceeds health care professionals’ expectations, this results in intrinsic motivation for the digital health intervention, which promotes implementation. The feeling of maintaining professional autonomy and confidence of health care professionals in being able to deliver the digital health intervention may also facilitate implementation. Concerns about patient information confidentiality, the belief that a digital health intervention will not be as good as face-to-face care, and providing digital health for conditions perceived as low priority may be barriers to implementation related to health care professional acceptance. Moreover, concerns that health care professionals’ job satisfaction may diminish may be a barrier to implementation [ , , ]. However, if digital health services enable more contact with patients, this is experienced as a promotion of health care professionals’ satisfaction. Another contribution to satisfaction was that digital health services may lead to less physically demanding care compared to usual care, which all may facilitate implementation.Domain 5: Process
Engaging—Opinion Leaders (Medium Reliability)
Peer opinion leaders exert influence through their representativeness and credibility. When new digital health services are presented to a health care professional by a coworker who vouches for it (peer opinion leader), this may facilitate implementation [
].Engaging—Key Stakeholders (Health Care Professional; High Reliability)
Involvement of health care professionals in the implementation of digital health services is a facilitating determinant to implementation that promotes confidence in digital health services [
]. Furthermore, the willingness of health care professionals to try digital health services may facilitate implementation [ ]. Organizational uncertainties among key stakeholders, such as questions like “Who does it?” and “Who pays for it?” may be barriers to implementation [ ]. In addition, setting up a technical support team may lead to feelings of support by the health care professional, which may facilitate implementation [ ].Executing (Medium Reliability)
Executing the implementation of digital health services might require some justification and delegation to key involved stakeholders, such as gym staff [
]. This may be a barrier to implementation as, for example, content of the digital health intervention (eg, specific gym exercises) may not always be conventional.Discussion
Principal Findings
In this systematic review, barriers and facilitators to the implementation of digital health services for people with musculoskeletal conditions in the primary health care setting were identified and synthesized according to the CFIR. Barriers and facilitators were identified within all 5 CFIR domains, and almost all constructs or subconstructs of the CFIR with synthesized barriers or facilitators had high reliability. Various stakeholders are involved in the implementation of digital health services for patients with musculoskeletal conditions in the primary care setting. The current determinant analysis provides a generic overview of barriers and facilitators that may be considered by stakeholders, such as digital health intervention developers, health care professionals, health care organizations, health policy makers, health care funders, and researchers, to design fitting implementation strategies [
]. As stakeholders mainly have influence on barriers and facilitators in specific CFIR domains, main results for stakeholders will be presented and discussed accordingly.Identified barriers and facilitators that may especially be important for developers are from the domain “digital health service characteristics.” Facilitators within this domain include the flexibility of digital health services to tailor to specific patient needs, suitability for various subgroups, and high usability. Digital health service developers can consider these facilitators when developing and evaluating their product by using, for example, an eHealth framework, such as the Center for eHealth Research Roadmap [
]. An example of an existing digital health service that uses some of these facilitators is eHealth platform Physitrack, which was experienced by physiotherapists as user friendly, accessible, and helpful in providing personalized care [ , ]. Intervention design with nonoptimal usability was also identified as a barrier to implementation in other contexts, just as costs [ - ]. In this study, financial aspects, such as loss of income for health care providers because of potential substitution or patient expenses, were also shown to be important barriers to implementation for this specific context. Financial strategies to overcome these barriers when implementing digital health services for the context of patients with chronic illnesses living at home, such as changing the (patient) billing systems and fee structures, were suggested in previous research and may be relevant for developers to consider [ ].Identified barriers and facilitators that are especially important to health care professionals are from the domain “digital health service characteristics” and “outer setting.” A facilitator within the domain “digital health service characteristics” is the relative advantage of digital health over usual care, such as promoting adherence, self-management, empowerment, and access to health care. Important barriers are the concern that digital health services might negatively affect patient–health care professional relationship and quality of care, experienced additional burden of digital health services, and change of treatment routines. Existing workflow was also shown to be an important barrier in other contexts [
]. To use these facilitators and overcome these barriers, health care professionals might consider using previously developed implementation strategies used in another context, such as conducting educational meetings to train and educate colleague health professionals or conducting cyclical small tests of change [ ]. Personal traits of patients, such as digital literacy, maladaptive illness perceptions, poor communication skills, and lack of confidence in the patient’s own physical ability, are barriers from the “outer setting.” An example of a previously developed tool for physiotherapists is the use of the Checklist Blended Physiotherapy [ ]. This clinical decision aid to support the physiotherapist in the decision of whether a digital health service should be an integral part of physiotherapy treatment for an individual patient might be a strategy, which has yet to be evaluated.Identified barriers and facilitators that are especially important to health policy makers are mostly from the domain “outer setting.” The lack of health care guidelines and lack of an external financial incentive were identified as barriers. The World Health Organization developed guideline recommendations on digital health services that can be used to develop guidelines for local contexts [
]. Changing reimbursement policies and clinician incentives are financial strategies that may are recommended to health policy makers [ ]. Moreover, broad acceptance of digital health services by patients, health care professionals, and health service funders creates trust for health care professionals that implementation is worthwhile, which may facilitate implementation.Identified barriers and facilitators that are especially relevant to health care organizations are mostly from the domain “inner setting.” Providing access to knowledge and information about the digital health intervention was found to be an important facilitator. In addition, an opinion leader and involvement of health care professionals facilitates implementation. Therefore, it is suggested that health care organizations consider implementation strategies, such as developing and distributing educational material as well as identifying and preparing champions, and inform local opinion leaders to develop stakeholder interrelationships [
]. Important barriers to overcome are technology-related issues and incompatibility with other initiatives, guidelines, and existing payment structures. Organizational uncertainties, such as questions like “Who does it?” and “Who pays for it?” are barriers to implementation that health care organizations must mainly overcome. To overcome these barriers, health care organizations are suggested to consider new sources of funding, involve executive boards, and try to form or join an innovation network [ ].Researchers can use the generic overview of barriers and facilitators of all domains to prioritize them for a local context, develop implementation strategies, test them, and systematically evaluate implementation outcomes. This is important because determinants are specific to the local context, and local contexts are ever changing [
].Although several studies have identified barriers and facilitators to the implementation of digital health services in other settings than primary care or complex interventions in the primary care setting, this is the first systematic review of studies identifying and analyzing the facilitators and barriers of digital health services for people with musculoskeletal conditions in the primary health care setting. The results of this study are consistent with findings in other settings or the general health care setting [
]. Although the findings on the level of CFIR domains or subdomains are comparable to other contexts, the nuance in the description of the identified barriers and facilitators are mostly specific to primary care for patients with musculoskeletal conditions.A strength of this systematic review is that all included articles had a mixed methods or qualitative design, and end-user perspectives of both patients and health care professionals were included, which led to a rich description of barriers and facilitators. However, it is important to note that many of the included studies did not follow a structured implementation process, and it was not possible to discuss whether implementation duration influenced the participants’ perspectives. Another strength is the use of the CFIR. Synthesizing according to the CFIR makes our findings easier comparable to other implementation studies and supports the use of common terminology in this field. Despite the careful execution of this study, there are some methodological considerations. The quality of the qualitative component was assessed by presenting stars. Cutoff values were determined by the authors; however, these cutoff values are arbitrary, which may have influenced the interpretation of the quality of included articles. In addition, a reliability rating was used to indicate confidence in the findings. While this approach took consistency and quality of the studies into account, we acknowledge that tools such as GRADE-CERQual were not used, which assesses confidence in findings from a more comprehensive perspective, considering factors such as coherence and adequacy. Incorporating GRADE-CERQual or similar methods in future research could enhance confidence in findings of a qualitative data synthesis [
]. The context of this review was digital health services, the primary care setting, and musculoskeletal conditions. People with musculoskeletal conditions are one of the largest patient groups in the primary health care setting. Although this patient group is very heterogenous, there are some transcendent key recommendations for patients with musculoskeletal conditions in primary health care, which makes the context sufficiently specific to inform relevant stakeholders [ ]. Specific types of digital health services researched in the included articles were also very heterogenous. Therefore, it was not possible to specify barriers and facilitators to implementation for different types of digital health services. This should be considered when developing implementation strategies for specific digital health services. This systematic review provides a generic overview, and reliability was presented on the level of subconstructs and not on the level of individual determinants. Therefore, a prioritization of determinants should be carried out for the local context, as a first step in designing implementation strategies [ ].Conclusions
This systematic review provides an extensive description of the barriers and facilitators to the implementation of digital health services for people with musculoskeletal conditions in the primary health care setting. The findings are based on the synthesis of 35 qualitative and mixed methods articles through the CFIR. Barriers and facilitators were identified across all 5 CFIR domains, and nearly all constructs or subconstructs of the CFIR with synthesized barriers or facilitators had high reliability. This suggests that the implementation process can be complex and requires implementation strategies across all CFIR domains. Stakeholders, such as digital health intervention developers, health care professionals, health care organizations, health policy makers, health care funders, and researchers, can consider the identified barriers and facilitators to design tailored implementation strategies after a prioritization has been carried out in their local context.
Acknowledgments
The authors would like to thank the authors of all data used in the review.
Data Availability
The data sets generated and analyzed during this study are available from the corresponding author on reasonable request.
Conflicts of Interest
None declared.
Search strategy.
DOCX File , 17 KBPreferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) checklist.
DOCX File , 32 KBReferences
- Cieza A, Causey K, Kamenov K, Hanson SW, Chatterji S, Vos T. Global estimates of the need for rehabilitation based on the Global Burden of Disease study 2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet. Dec 19, 2021;396(10267):2006-2017. [FREE Full text] [CrossRef] [Medline]
- World report on ageing and health. World Health Organization. 2015. URL: https://www.who.int/publications/i/item/9789241565042#:~:text=The%20World%20report%20on%20ageing,new%20concept%20of%20functional%20ability [accessed 2024-04-29]
- GBD 2019 DiseasesInjuries Collaborators. Global burden of 369 diseases and injuries in 204 countries and territories, 1990-2019: a systematic analysis for the Global Burden of Disease Study 2019. Lancet. Oct 17, 2020;396(10258):1204-1222. [FREE Full text] [CrossRef] [Medline]
- Friedberg MW, Hussey PS, Schneider EC. Primary care: a critical review of the evidence on quality and costs of health care. Health Aff (Millwood). May 2010;29(5):766-772. [CrossRef] [Medline]
- Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q. Oct 03, 2005;83(3):457-502. [FREE Full text] [CrossRef] [Medline]
- Shi L. The impact of primary care: a focused review. Scientifica (Cairo). 2012;2012:432892. [FREE Full text] [CrossRef] [Medline]
- Douthit N, Kiv S, Dwolatzky T, Biswas S. Exposing some important barriers to health care access in the rural USA. Public Health. Jun 2015;129(6):611-620. [CrossRef] [Medline]
- Bodenheimer T, Pham HH. Primary care: current problems and proposed solutions. Health Aff (Millwood). May 2010;29(5):799-805. [CrossRef] [Medline]
- WHO guideline recommendations on digital interventions for health system strengthening. World Health Organization. URL: https://www.ncbi.nlm.nih.gov/books/NBK541902/ [accessed 2024-04-29]
- Catwell L, Sheikh A. Evaluating eHealth interventions: the need for continuous systemic evaluation. PLoS Med. Aug 18, 2009;6(8):e1000126. [FREE Full text] [CrossRef] [Medline]
- Elbert NJ, van Os-Medendorp H, van Renselaar W, Ekeland AG, Hakkaart-van Roijen L, Raat H, et al. Effectiveness and cost-effectiveness of ehealth interventions in somatic diseases: a systematic review of systematic reviews and meta-analyses. J Med Internet Res. Apr 16, 2014;16(4):e110. [FREE Full text] [CrossRef] [Medline]
- Hewitt S, Sephton R, Yeowell G. The effectiveness of digital health interventions in the management of musculoskeletal conditions: systematic literature review. J Med Internet Res. Jun 05, 2020;22(6):e15617. [FREE Full text] [CrossRef] [Medline]
- Kloek CJ, Bossen D, Spreeuwenberg PM, Dekker J, de Bakker DH, Veenhof C. Effectiveness of a blended physical therapist intervention in people with hip osteoarthritis, knee osteoarthritis, or both: a cluster-randomized controlled trial. Phys Ther. Jul 01, 2018;98(7):560-570. [FREE Full text] [CrossRef] [Medline]
- Mishuris RG, Stewart M, Fix GM, Marcello T, McInnes DK, Hogan TP, et al. Barriers to patient portal access among veterans receiving home-based primary care: a qualitative study. Health Expect. Dec 12, 2015;18(6):2296-2305. [FREE Full text] [CrossRef] [Medline]
- Kruse CS, Atkins JM, Baker TD, Gonzales EN, Paul JL, Brooks M. Factors influencing the adoption of telemedicine for treatment of military veterans with post-traumatic stress disorder. J Rehabil Med. May 08, 2018;50(5):385-392. [FREE Full text] [CrossRef] [Medline]
- Hadjistavropoulos HD, Nugent MM, Dirkse D, Pugh N. Implementation of internet-delivered cognitive behavior therapy within community mental health clinics: a process evaluation using the consolidated framework for implementation research. BMC Psychiatry. Sep 12, 2017;17(1):331. [FREE Full text] [CrossRef] [Medline]
- Batterham PJ, Sunderland M, Calear AL, Davey CG, Christensen H, Teesson M, et al. Developing a roadmap for the translation of e-mental health services for depression. Aust N Z J Psychiatry. Sep 23, 2015;49(9):776-784. [CrossRef] [Medline]
- Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. Aug 07, 2009;4(1):50. [FREE Full text] [CrossRef] [Medline]
- Nilsen P, Bernhardsson S. Context matters in implementation science: a scoping review of determinant frameworks that describe contextual determinants for implementation outcomes. BMC Health Serv Res. Mar 25, 2019;19(1):189. [FREE Full text] [CrossRef] [Medline]
- Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. Nov 27, 2012;12(1):181. [FREE Full text] [CrossRef] [Medline]
- Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. Dec 05, 2016;5(1):210. [FREE Full text] [CrossRef] [Medline]
- Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. Jul 21, 2009;339:b2700. [FREE Full text] [CrossRef] [Medline]
- Pluye P, Gagnon M, Griffiths F, Johnson-Lafleur J. A scoring system for appraising mixed methods research, and concomitantly appraising qualitative, quantitative and mixed methods primary studies in Mixed Studies Reviews. Int J Nurs Stud. Apr 2009;46(4):529-546. [CrossRef] [Medline]
- Souto RQ, Khanassov V, Hong QN, Bush PL, Vedel I, Pluye P. Systematic mixed studies reviews: updating results on the reliability and efficiency of the Mixed Methods Appraisal Tool. Int J Nurs Stud. Jan 2015;52(1):500-501. [CrossRef] [Medline]
- Hong QN. Reporting the results of the MMAT. Mixed Methods Appraisal Tool. URL: http://mixedmethodsappraisaltoolpublic.pbworks.com/ [accessed 2024-04-29]
- CFIR codebook. Consolidated Framework for Implementation Research. 2014. URL: https://cfirguide.org/wp-content/uploads/2019/08/cfircodebooktemplate10-27-2014.docx [accessed 2024-04-29]
- Bach-Mortensen AM, Lange BC, Montgomery P. Barriers and facilitators to implementing evidence-based interventions among third sector organisations: a systematic review. Implement Sci. Jul 30, 2018;13(1):103. [FREE Full text] [CrossRef] [Medline]
- de Vries HJ, Kloek CJ, de Bakker DH, Dekker J, Bossen D, Veenhof C. Determinants of adherence to the online component of a blended intervention for patients with hip and/or knee osteoarthritis: a mixed methods study embedded in the e-Exercise trial. Telemed J E Health. Dec 2017;23(12):1002-1010. [CrossRef] [Medline]
- van der Meer HA, de Pijper L, van Bruxvoort T, Visscher CM, Nijhuis-van der Sanden MW, Engelbert RH, et al. Using e-Health in the physical therapeutic care process for patients with temporomandibular disorders: a qualitative study on the perspective of physical therapists and patients. Disabil Rehabil. Feb 16, 2022;44(4):617-624. [CrossRef] [Medline]
- van Tilburg ML, Kloek CJ, Foster NE, Ostelo RW, Veenhof C, Staal JB, et al. Development and feasibility of stratified primary care physiotherapy integrated with eHealth in patients with neck and/or shoulder complaints: results of a mixed methods study. BMC Musculoskelet Disord. Mar 09, 2023;24(1):176. [FREE Full text] [CrossRef] [Medline]
- Petrozzi MJ, Spencer G, Mackey MG. A process evaluation of the Mind Your Back trial examining psychologically informed physical treatments for chronic low back pain. Chiropr Man Therap. Aug 17, 2021;29(1):32. [FREE Full text] [CrossRef] [Medline]
- Östlind E, Ekvall Hansson E, Eek F, Stigmar K. Experiences of activity monitoring and perceptions of digital support among working individuals with hip and knee osteoarthritis - a focus group study. BMC Public Health. Aug 30, 2022;22(1):1641. [FREE Full text] [CrossRef] [Medline]
- Kelly M, Fullen BM, Martin D, Bradley C, McVeigh JG. eHealth interventions to support self-management: perceptions and experiences of people with musculoskeletal disorders and physiotherapists - 'eHealth: It's TIME': a qualitative study. Physiother Theory Pract. May 25, 2024;40(5):1011-1021. [CrossRef] [Medline]
- Renard M, Gaboury I, Michaud F, Tousignant M. The acceptability of two remote monitoring modalities for patients waiting for services in a physiotherapy outpatient clinic. Musculoskeletal Care. Sep 10, 2022;20(3):616-624. [CrossRef] [Medline]
- Poolman EY, Vorstermans L, Donker MH, Bijker L, Coppieters MW, Cuijpers P, et al. How people with persistent pain experience in-person physiotherapy blended with biopsychosocial digital health - a qualitative study on participants' experiences with Back2Action. Internet Interv. Jun 2024;36:100731. [FREE Full text] [CrossRef] [Medline]
- Pereira TA, Santos IB, Mota RF, Fukusawa L, Azevedo-Santos IF, DeSantana JM. Beliefs and expectations of patients with fibromyalgia about telerehabilitation during COVID-19 pandemic: a qualitative study. Musculoskelet Sci Pract. Oct 2023;67:102852. [CrossRef] [Medline]
- Passalent L, Cyr A, Jurisica I, Mathur S, Inman RD, Haroon N. Motivators, barriers, and opportunity for e-Health to encourage physical activity in axial Spondyloarthritis: a qualitative descriptive study. Arthritis Care Res (Hoboken). Jan 20, 2022;74(1):50-58. [CrossRef] [Medline]
- Ezzat AM, Bell E, Kemp J, O'Halloran P, Russell T, Wallis J, et al. "Much better than I thought it was going to be": telehealth delivered group-based education and exercise was perceived as acceptable among people with knee osteoarthritis. Osteoarthr Cartil Open. Sep 2022;4(3):100271. [FREE Full text] [CrossRef] [Medline]
- Lamper C, Huijnen I, de Mooij M, Köke A, Verbunt J, Kroese M. An eCoach-pain for patients with chronic musculoskeletal pain in interdisciplinary primary care: a feasibility study. Int J Environ Res Public Health. Nov 06, 2021;18(21):11661. [FREE Full text] [CrossRef] [Medline]
- Barton CJ, Ezzat AM, Merolli M, Williams CM, Haines T, Mehta N, et al. "It's second best": a mixed-methods evaluation of the experiences and attitudes of people with musculoskeletal pain towards physiotherapist delivered telehealth during the COVID-19 pandemic. Musculoskelet Sci Pract. Apr 2022;58:102500. [FREE Full text] [CrossRef] [Medline]
- Farzad M, MacDermid J, Ferreira L, Szekeres M, Cuypers S, Shafiee E. A description of the barriers, facilitators, and experiences of hand therapists in providing remote (tele) rehabilitation: an interpretive description approach. J Hand Ther. Oct 2023;36(4):805-816. [CrossRef] [Medline]
- Dehainault M, Gaillard O, Ouattara B, Peurois M, Begue C. Physical activity advice given by French general practitioners for low back pain and the role of digital e-health applications: a qualitative study. BMC Prim Care. Jan 29, 2024;25(1):44. [FREE Full text] [CrossRef] [Medline]
- Arensman R, Kloek C, Pisters M, Koppenaal T, Ostelo R, Veenhof C. Patient perspectives on using a smartphone app to support home-based exercise during physical therapy treatment: qualitative study. JMIR Hum Factors. Sep 13, 2022;9(3):e35316. [FREE Full text] [CrossRef] [Medline]
- M Ezzat A, Kemp JL, J Heerey J, F Pazzinatto M, De Oliveira Silva D, Dundules K, et al. Implementation of the good life with osteoArthritis in Denmark (GLA:D) program via telehealth in Australia: a mixed-methods program evaluation. J Telemed Telecare. Apr 20, 2023:1357633X231167620. [CrossRef] [Medline]
- van Tilburg ML, Kloek CJ, Staal JB, Bossen D, Veenhof C. Feasibility of a stratified blended physiotherapy intervention for patients with non-specific low back pain: a mixed methods study. Physiother Theory Pract. Feb 20, 2022;38(2):286-298. [CrossRef] [Medline]
- Kloek CJ, Bossen D, de Vries HJ, de Bakker DH, Veenhof C, Dekker J. Physiotherapists' experiences with a blended osteoarthritis intervention: a mixed methods study. Physiother Theory Pract. May 28, 2020;36(5):572-579. [CrossRef] [Medline]
- Lawford BJ, Delany C, Bennell KL, Hinman RS. "I was really pleasantly surprised": firsthand experience and shifts in physical therapist perceptions of telephone-delivered exercise therapy for knee osteoarthritis-a qualitative study. Arthritis Care Res (Hoboken). Apr 28, 2019;71(4):545-557. [CrossRef] [Medline]
- Hinman RS, Nelligan RK, Bennell KL, Delany C. "Sounds a bit crazy, but it was almost more personal:" a qualitative study of patient and clinician experiences of physical therapist-prescribed exercise for knee osteoarthritis via skype. Arthritis Care Res (Hoboken). Dec 02, 2017;69(12):1834-1844. [CrossRef] [Medline]
- Martínez de la Cal J, Fernández-Sánchez M, Matarán-Peñarrocha GA, Hurley DA, Castro-Sánchez AM, Lara-Palomo IC. Physical therapists' opinion of e-Health treatment of chronic low back pain. Int J Environ Res Public Health. Feb 16, 2021;18(4):1889. [FREE Full text] [CrossRef] [Medline]
- Kairy D, Tousignant M, Leclerc N, Côté AM, Levasseur M, Researchers T. The patient's perspective of in-home telerehabilitation physiotherapy services following total knee arthroplasty. Int J Environ Res Public Health. Aug 30, 2013;10(9):3998-4011. [FREE Full text] [CrossRef] [Medline]
- Button K, Nicholas K, Busse M, Collins M, Spasić I. Integrating self-management support for knee injuries into routine clinical practice: TRAK intervention design and delivery. Musculoskelet Sci Pract. Feb 2018;33:53-60. [FREE Full text] [CrossRef] [Medline]
- Cottrell MA, Hill AJ, O'Leary SP, Raymer ME, Russell TG. Service provider perceptions of telerehabilitation as an additional service delivery option within an Australian neurosurgical and orthopaedic physiotherapy screening clinic: a qualitative study. Musculoskelet Sci Pract. Dec 2017;32:7-16. [CrossRef] [Medline]
- Dunphy E, Hamilton FL, Spasić I, Button K. Acceptability of a digital health intervention alongside physiotherapy to support patients following anterior cruciate ligament reconstruction. BMC Musculoskelet Disord. Nov 21, 2017;18(1):471. [FREE Full text] [CrossRef] [Medline]
- Egerton T, Nelligan R, Setchell J, Atkins L, Bennell KL. General practitioners' perspectives on a proposed new model of service delivery for primary care management of knee osteoarthritis: a qualitative study. BMC Fam Pract. Sep 07, 2017;18(1):85. [FREE Full text] [CrossRef] [Medline]
- Eriksson L, Lindström B, Ekenberg L. Patients' experiences of telerehabilitation at home after shoulder joint replacement. J Telemed Telecare. Jan 01, 2011;17(1):25-30. [CrossRef] [Medline]
- Hjelmager DM, Vinther LD, Poulsen SH, Petersen LS, Jensen MB, Riis A. Requirements for implementing online information material for patients with low back pain in general practice: an interview study. Scand J Prim Health Care. Mar 31, 2019;37(1):60-68. [FREE Full text] [CrossRef] [Medline]
- Kingston GA, Judd J, Gray MA. The experience of medical and rehabilitation intervention for traumatic hand injuries in rural and remote North Queensland: a qualitative study. Disabil Rehabil. May 26, 2015;37(5):423-429. [CrossRef] [Medline]
- Aily JB, Barton CJ, Mattiello SM, De Oliveira Silva D, De Noronha M. Telerehabilitation for knee osteoarthritis in Brazil: a feasibility study. Int J Telerehabil. Dec 08, 2020;12(2):137-148. [FREE Full text] [CrossRef] [Medline]
- Geraghty AW, Roberts LC, Stanford R, Hill JC, Yoganantham D, Little P, et al. Exploring patients' experiences of internet-based self-management support for low back pain in primary care. Pain Med. Sep 01, 2020;21(9):1806-1817. [FREE Full text] [CrossRef] [Medline]
- Hasani F, Malliaras P, Haines T, Munteanu SE, White J, Ridgway J, et al. Telehealth sounds a bit challenging, but it has potential: participant and physiotherapist experiences of gym-based exercise intervention for Achilles tendinopathy monitored via telehealth. BMC Musculoskelet Disord. Feb 04, 2021;22(1):138. [FREE Full text] [CrossRef] [Medline]
- Palazzo C, Klinger E, Dorner V, Kadri A, Thierry O, Boumenir Y, et al. Barriers to home-based exercise program adherence with chronic low back pain: patient expectations regarding new technologies. Ann Phys Rehabil Med. Apr 2016;59(2):107-113. [FREE Full text] [CrossRef] [Medline]
- Bossen D, Kloek C, Snippe HW, Dekker J, de Bakker D, Veenhof C. A blended intervention for patients with knee and hip osteoarthritis in the physical therapy practice: development and a pilot study. JMIR Res Protoc. Feb 24, 2016;5(1):e32. [FREE Full text] [CrossRef] [Medline]
- Lau R, Stevenson F, Ong BN, Dziedzic K, Treweek S, Eldridge S, et al. Achieving change in primary care--causes of the evidence to practice gap: systematic reviews of reviews. Implement Sci. Mar 22, 2016;11(1):40. [FREE Full text] [CrossRef] [Medline]
- van Gemert-Pijnen JE, Nijland N, van Limburg M, Ossebaard HC, Kelders SM, Eysenbach G, et al. A holistic framework to improve the uptake and impact of eHealth technologies. J Med Internet Res. Dec 05, 2011;13(4):e111. [FREE Full text] [CrossRef] [Medline]
- van der Meer HA, Doomen A, Visscher CM, Engelbert RH, Nijhuis-van der Sanden MW, Speksnijder CM. The additional value of e-Health for patients with a temporomandibular disorder: a mixed methods study on the perspectives of orofacial physical therapists and patients. Disabil Rehabil Assist Technol. Feb 12, 2024;19(2):433-445. [CrossRef] [Medline]
- Be the hero in your client's health journey. Physitrack®. URL: https://www.physitrack.com/ [accessed 2024-04-29]
- Varsi C, Solberg Nes L, Kristjansdottir OB, Kelders SM, Stenberg U, Zangi HA, et al. Implementation strategies to enhance the implementation of eHealth programs for patients with chronic illnesses: realist systematic review. J Med Internet Res. Sep 27, 2019;21(9):e14255. [FREE Full text] [CrossRef] [Medline]
- Waltz TJ, Powell BJ, Matthieu MM, Damschroder LJ, Chinman MJ, Smith JL, et al. Use of concept mapping to characterize relationships among implementation strategies and assess their feasibility and importance: results from the Expert Recommendations for Implementing Change (ERIC) study. Implement Sci. Aug 07, 2015;10(1):109. [FREE Full text] [CrossRef] [Medline]
- Kloek CJ, Janssen J, Veenhof C. Development of a checklist to assist physiotherapists in determination of patients' suitability for a blended treatment. Telemed J E Health. Aug 01, 2020;26(8):1051-1065. [CrossRef] [Medline]
- Schreiweis B, Pobiruchin M, Strotbaum V, Suleder J, Wiesner M, Bergh B. Barriers and facilitators to the implementation of eHealth services: systematic literature analysis. J Med Internet Res. Nov 22, 2019;21(11):e14197. [FREE Full text] [CrossRef] [Medline]
- Lewin S, Booth A, Glenton C, Munthe-Kaas H, Rashidian A, Wainwright M, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series. Implement Sci. Jan 25, 2018;13(Suppl 1):2. [FREE Full text] [CrossRef] [Medline]
- Lin I, Wiles L, Waller R, Goucke R, Nagree Y, Gibberd M, et al. What does best practice care for musculoskeletal pain look like? Eleven consistent recommendations from high-quality clinical practice guidelines: systematic review. Br J Sports Med. Jan 2020;54(2):79-86. [CrossRef] [Medline]
Abbreviations
CFIR: Consolidated Framework for Implementation Research |
MMAT: Mixed Methods Appraisal Tool |
Edited by A Mavragani; submitted 13.06.23; peer-reviewed by J Ross, LA Gomes; comments to author 07.10.23; revised version received 01.12.23; accepted 10.04.24; published 27.08.24.
Copyright©Mark Leendert van Tilburg, Ivar Spin, Martijn F Pisters, J Bart Staal, Raymond WJG Ostelo, Miriam van der Velde, Cindy Veenhof, Corelien JJ Kloek. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 27.08.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.