Published on in Vol 25 (2023)

This is a member publication of Imperial College London (Jisc)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/48000, first published .
Mapping Factors That Affect the Uptake of Digital Therapeutics Within Health Systems: Scoping Review

Mapping Factors That Affect the Uptake of Digital Therapeutics Within Health Systems: Scoping Review

Mapping Factors That Affect the Uptake of Digital Therapeutics Within Health Systems: Scoping Review

Review

1LSE Health, Department of Health Policy, London School of Economics and Political Science, London, United Kingdom

2Department of International Health, Care and Public Health Research Institute, Faculty of Health, Medicine and Life Sciences, Maastricht University, Maastricht, Netherlands

3Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom

4Department of Psychiatry and Behavioral Sciences, Stanford University, Stanford, CA, United States

5Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, United Kingdom

6Duke Clinical Research Institute, Duke University School of Medicine, Durham, NC, United States

7Department of Health Services Research, Care and Public Health Research Institute, Faculty of Health Medicine and Life Science, Maastricht University, Maastricht, Netherlands

8Institute of Global Health Innovation, Imperial College London, London, United Kingdom

*these authors contributed equally

Corresponding Author:

Elias Mossialos, PhD

LSE Health

Department of Health Policy

London School of Economics and Political Science

London, WC2A 2AE

United Kingdom

Phone: 44 7772 707841

Email: e.a.mossialos@lse.ac.uk


Background: Digital therapeutics are patient-facing digital health interventions that can significantly alter the health care landscape. Despite digital therapeutics being used to successfully treat a range of conditions, their uptake in health systems remains limited. Understanding the full spectrum of uptake factors is essential to identify ways in which policy makers and providers can facilitate the adoption of effective digital therapeutics within a health system, as well as the steps developers can take to assist in the deployment of products.

Objective: In this review, we aimed to map the most frequently discussed factors that determine the integration of digital therapeutics into health systems and practical use of digital therapeutics by patients and professionals.

Methods: A scoping review was conducted in MEDLINE, Web of Science, Cochrane Database of Systematic Reviews, and Google Scholar. Relevant data were extracted and synthesized using a thematic analysis.

Results: We identified 35,541 academic and 221 gray literature reports, with 244 (0.69%) included in the review, covering 35 countries. Overall, 85 factors that can impact the uptake of digital therapeutics were extracted and pooled into 5 categories: policy and system, patient characteristics, properties of digital therapeutics, characteristics of health professionals, and outcomes. The need for a regulatory framework for digital therapeutics was the most stated factor at the policy level. Demographic characteristics formed the most iterated patient-related factor, whereas digital literacy was considered the most important factor for health professionals. Among the properties of digital therapeutics, their interoperability across the broader health system was most emphasized. Finally, the ability to expand access to health care was the most frequently stated outcome measure.

Conclusions: The map of factors developed in this review offers a multistakeholder approach to recognizing the uptake factors of digital therapeutics in the health care pathway and provides an analytical tool for policy makers to assess their health system’s readiness for digital therapeutics.

J Med Internet Res 2023;25:e48000

doi:10.2196/48000

Keywords



Background

The digital health landscape encompasses a broad range of technologies that promote, improve, or support health system functioning and the delivery of health care, including electronic health records, telemedicine, mobile health apps, and health data analytics [1]. Digital therapeutics are a specific subset of the overarching digital health landscape that generate and deliver clinically validated medical interventions and are used as part of a clinical treatment pathway for various health conditions [2,3]. As a result, they can be regulated and prescribed as therapeutics or medical devices, which distinguishes them from more generic digital health applications in the well-being and lifestyle space [4].

Despite digital therapeutics being used to successfully treat a range of conditions, including insomnia, attention-deficit/hyperactivity disorder in children, and substance use disorder [5-9], as well as showing cost-reducing properties [8,10], there are several barriers that reduce their uptake. These include issues around reimbursing them [11,12] and a lack of standardization in evaluating the technologies and their outcome measures. This makes it difficult to use standard approaches to compare different interventions using traditional clinical and cost-effectiveness evaluations [1,11,13,14]. The resulting lack of data on the comparative effectiveness and cost-effectiveness of digital therapeutics can limit market access for innovative technologies [13,15] and present challenges for policy makers and providers when establishing reimbursement mechanisms. There are also factors that influence uptake at the patient level, including digital infrastructure and literacy [2,15-18], and at the health professional level, including lack of training, uncertainties surrounding accountability, and shifts in professional workflow [13,19]. Although the COVID-19 pandemic boosted the implementation of digital health across the health ecosystem [17,18,20], the uptake was not sustainable, as patients reverted back to traditional health services over time [21].

Objective

A number of studies have identified a range of barriers to the uptake of digital health products at different levels [15,19,22,23]. Understanding the full spectrum of uptake factors is essential to identify ways in which policy makers and providers can facilitate the adoption of effective digital therapeutics within a health system, as well as the steps developers can take to assist in the deployment of products [24,25]. In this review, we aimed to map the most frequently discussed uptake factors of digital therapeutics using a scoping review of the digital health literature.


Overview

We performed a scoping review with thematic synthesis in accordance with the scoping review framework developed by Arksey and O’Malley [26] and Levac [27]. This method allows for the rapid mapping of the key concepts underpinning a broad research area, which is particularly valuable for complex issues that have not been reviewed comprehensively to date [26-28]. In this specific context, our scoping review sought to identify articles with characteristics relevant to the uptake factors of digital therapeutics until additional articles no longer expand the argumentation and thematic saturation is reached instead of providing an exhaustive list of published literature [29]. As such, a representative sample of the digital health literature is sufficient in this context [29]. We followed Joanna Briggs Institute Manual for Evidence Synthesis for Scoping Reviews and reported the findings according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines (Table S1 in Multimedia Appendix 1) [30,31]. As is the case with most scoping reviews, no review protocol was published.

Eligibility Criteria

To be eligible for inclusion, publications had to discuss factors determining digital therapeutic uptake in the health care sector. Uptake, in this context, refers to both the integration of digital therapeutics into the health system and the acceptability and practical use of digital therapeutics by patients and health professionals. Publications from 2000 onward were considered, as this year marks the start of digitalization in health [1,17,21]. Only publications in English were considered. In terms of study designs, research protocols, conference abstracts, theses, preprints, news articles, and workshop proceedings were excluded. Publications that explicitly focused on electronic health records were also excluded. Given the nature of a scoping review, the inclusion criteria were kept broad to ensure that all aspects and dimensions of the uptake factors of digital therapeutics were covered.

Search Strategy and Data Collection

Scientific articles were systematically identified through 3 scientific databases (MEDLINE, Cochrane Database of Systematic Reviews, and Web of Science). These databases were chosen to cover both health-specific and interdisciplinary academic fields. The scientific search was supplemented with a nonsystematic search for gray literature using Google Scholar (first 200 hits) [32]. The full query for the scientific databases is shown in Table S2 in Multimedia Appendix 1. An information specialist at the London School of Economics and Political Science Library further validated the search strategy.

The initial search was conducted on December 12, 2022, and an updated search was conducted on March 9, 2023. The complete screening process (title or abstract and full-text screening) was performed by 1 reviewer in counterchronological order to ensure that recent evidence that might capture novel developments in the uptake of digital therapeutics is not overlooked. To further improve the robustness of the methodology, a subset (828/35,541, 2.33%) of the articles was also assessed by a second reviewer for verification, and interrater agreement scores were computed. Disagreements between the reviewers were resolved by consensus, and no third person was involved. The interrater agreement between the 2 reviewers was calculated using Cohen κ in R (version 4.1.2; R Foundation for Statistical Computing) [33,34]. Deduplication was performed using Endnote (version 22; Clarivate Plc), and screening was performed using Covidence (Veritas Health Innovation) [35]. Reference lists of the included articles were also screened for relevant articles.

Data Synthesis

A thematic analysis was used to extract data relevant to the uptake of digital therapeutics [36]. Salient factors were extracted by 1 author (RvK) and clustered post hoc into relevant domains of the Consolidated Framework for Implementation Research (CFIR) [37]: (1) outer and inner settings, (2) individuals, and (3) innovation. In this review, we decided to pool the outer and inner settings into 1 domain, seeing as their contents are entangled and not mutually exclusive in the context of digital therapeutics [38]. The clustering was reviewed and verified by other authors (AR-U, MA, IK, and EM). We also applied frequency categories to the salient factors to indicate how often a particular factor was reported in the included documents: very frequent was applied when >15% of the included documents mention a factor, frequent was applied when between 5% and 15% of the included documents reported a factor, and regular was applied when <5% of the included documents reported a factor that can affect the uptake of digital therapeutics. It is important to note that these frequency labels do not communicate the relative importance of the uptake factors. They only capture how often a factor was mentioned in the included documents. These frequency categories were translated into color codes in the development of the map of uptake factors, with red indicating the factors very frequently cited, yellow indicating the factors frequently cited, and blue indicating the factors infrequently cited.

The results were further clustered according to Donabedian quality framework, which makes a distinction among structure, process, and outcome measures [39]. In this review, structure measures refer to the uptake factors that describe the physical, institutional, or organizational context in which care is delivered (eg, policy context or demographic characteristics). Process measures capture the transactional uptake factors of digital therapeutics (eg, the preferences, perceptions, or attitudes of patients and professionals). Outcome measures capture all the direct and indirect effects of digital therapeutics on the health care ecosystem. The policy category exclusively includes structure factors. For the patient and health professional characteristics, as well as the properties of digital therapeutics, a subclassification between structure and process measures was made. The outcome category exclusively covers outcome measures, which were divided into 4 subcategories: patient-level, health system, public health, and data science outcomes.

Ethical Considerations

The results presented in this manuscript have no inherent ethical implications or considerations. No animals or human participants were involved in this research. No personal data were used in this research. Thus, we did not seek a review of our study design from an institutional review board.


Search Results

Our search strategy yielded 49,192 results from academic database searches (n=35,541, 72.24% after deduplication) and 221 results from supplementary searches, amassing 35,762 unique records. Ultimately, out of 35,541 documents, we included 244 (0.69%) documents (n=234, 95.9% scientific articles; n=6, 2.5% organizational reports; n=2, 0.8% health technology assessment frameworks [although the included literature covered additional frameworks]; and n=2, 0.8% web pages) in this review (Figure 1). Out of 244 documents, our final sample comprised 60 (24.6%) literature reviews [19,40-98]; 49 (20.1%) viewpoints, commentaries, and editorials [11,13,17,99-144]; 43 (17.6%) cross-sectional studies [83,145-186]; 39 (16%) qualitative research articles [1,15,187-223]; 13 (5.3%) case reports [4,5,12,224-233]; 11 (4.5%) longitudinal studies [234-244]; 9 (3.7%) mixed methods studies [245-253]; 5 (2%) economic evaluations [254-258]; 5 (2%) randomized controlled trials [259-263]; 4 (1.6%) policy documents [264-267]; 3 (1.2%) preference studies [268-270]; 2 (0.8%) websites [271,272]; and 1 (0.4%) book chapter [273]. Of the 244 included studies, 23 (9.4%) were published before 2014 [41,66,71,96,98,116,122,124-126,129,130,132,158,163, 167,171,192,211,227,237,238,268]. The included articles covered 35 distinct countries from all continents. Articles representing the United States (67/244, 27.5%) constituted the largest share of the included articles, followed by those with no specific country focus (62/244, 25.4%) and those focusing on Germany (21/244, 8.6%). Figures S1 and S2 in Multimedia Appendix 1 show an overview of the article types published per geographic region. In the subset screening of the total sample by the second reviewer (828/35,541, 2.33%), we found a crude interrater agreement score of 88.6% (734/828 observations) between the 2 reviewers. We also accounted for the possibility of reaching interrater agreement by chance by computing Cohen κ (0.589), which indicated a moderate agreement between the observers.

Figure 1. A PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flowchart outlining the data collection process. HTA: health technology assessment.

Outer and Inner Setting Domains

An important uptake factor of digital therapeutics was the presence of a legal framework to (1) distinguish digital therapeutics from commercial lifestyle and well-being apps, accrediting the former as a reimbursable form of health care, and (2) protect patients’ privacy, confidentiality, and (health) data security [1,4,5,13,15,47,52,54-56,59,66,77,80,87,96, 99,108,109,112,116,120,123,133,139,148,149,157,161,166,167, 169,186,190,208,209,212,231]. A clear example of such a legal framework is the mHealthBelgium validation pyramid in Belgium, which consists of 3 levels: the first level determines the basic requirements, such as the need for Conformité Européene marking, which indicates that a product adheres to the European Union health, safety, and environmental protection standards; the second level is designed to ensure interoperability and connectivity with the broader health informatics system; and the third level regulates the funding of digital health apps by the National Institute of Health and Disability Insurance, which is acquired after a digital health app has passed the clinical review process [224]. In terms of evidence requirements, establishing different evidence tiers to distinguish digital therapeutics from other types of digital health applications (eg, those aimed at communication or administrative functions) was considered vital [5,12,93,123,157,161,203,212,224,231,265]. In practice, this is already observed in the United Kingdom, where the National Institute of Health and Care Excellence (NICE) has devised a 3-level evidence framework that distinguishes (1) digital tools with no patient-relevant outcomes, (2) digital tools that aid in communication and education, and (3) digital therapeutics that are designed to generate and deliver medical interventions [5,224,265]. These 3 evidence tiers also each have their respective evidence requirements (Table S3 in Multimedia Appendix 1), with the highest level requiring evidence of effectiveness for the claimed benefits of the digital therapeutic on top of the requirements for the second evidence tier. The establishment of a formal body to transparently assess and certify digital therapeutics also influenced uptake [15,121,166,174,213]. Practical examples include the NICE in the United Kingdom, the Federal Institute for Drugs and Medical Devices (Bundesinstitut für Arzneimittel und Medizinprodukte) in Germany, and the Finnish Coordinating Center for Health Technology Assessment [75,224,229,265]. The NICE has also established an early value assessment process for digital therapeutics, which can provide preliminary insights into how digital therapeutics can benefit the health system (particularly surrounding their ability to address unmet health needs) while also assessing what types of evidence are available and what types of evidence are missing [272].

The financing model for digital therapeutics was considered highly influential with respect to their uptake in the health care system [12,65,81,87,127,139,162,170,203,205,212,229, 230,232]. In the included literature, eleven distinct financing models for digital therapeutics were identified: (1) periodical subscription (Germany and the United Kingdom), (2) 1-time license fee (Germany), (3) part of bundle packages with other (nondigital) therapeutics (the United States), (4) financing through (innovation) grants, subsidies, or fundraisers (the Netherlands and Germany), (5) sponsor-based agreements in which the digital therapeutic is sponsored by a large platform or institution (eg, Alzheimer Netherlands sponsors a digital health intervention for Dutch patients with dementia at no charge to caregivers), (6) public-private partnerships (eg, a private actor helps develop the local digital health infrastructure on the condition that their digital therapeutic is added in the local health care inventory), (7) inclusion in data plans, (8) performance-based contracts (the United States), (9) risk-benefit sharing contracts (the United States), (10) part of employment benefit plans, and (11) pay-as-you-go arrangements [12,65,86,87,127,143,162,170,203,205,212,229,230,232,239]. In addition, some form of reimbursement parity (eg, service or payment parity) with traditional biomedical therapeutics was considered important [68,70,119,123,153,169,206,238]. Incentives for the uptake of digital therapeutics were also identified as an important means of bolstering the development of a reimbursement pathway for digital therapeutics (eg, dedicated funding or financial compensation for offsetting the high fixed costs of implementing digital therapeutics in practice) [1,19,62,87,122,126,133,140,143,145,169,174,187,188,200,218,225, 227,231]. An important aspect of these incentives is the development of reimbursement codes for digital therapeutics [2,53,99,148,153,169,170,212]. The United States created reimbursement codes for Medicare and Medicaid to be able to better reimburse digital health, but these payment codes are used for digital health as a whole and not specifically for digital therapeutics [53,160]. After certification, the uptake of digital therapeutics is facilitated by the ability of health care professionals or health insurers to identify accredited digital therapeutics through an openly accessible register or inventory [4,59,224,226,229,231,232]. These registers have already been established in Germany, Belgium, and France [15,224], whereas the National Health Service (NHS) App Library in England was decommissioned in December 2021 during a restructuring of the NHS website [271].

Another vital element is the development of funding options for digital therapeutics during and after the research phase (eg, innovation and research grants, pay-for-performance constructs, or payment/completed digital therapeutic use cycle). For the latter, it is important that the financial responsibility is not placed on patients to protect them from disproportionate out-of-pocket payments and ensure that digital therapeutics do not become an exclusive domain of higher socioeconomic groups [12,15,46,58,61,72,86,99,100,105,106,114,116,146,149,154, 164,172,190,192,197,200,202,226-228,249]. It was emphasized that there were benefits to allowing the procurement of digital therapeutics as locally as possible, as health purchasers (eg, Integrated Care Boards in the United Kingdom, insurance companies in the Netherlands, and employer groups in the United States) are best placed to assess the needs and preferences of their covered population, although this could translate into longer adoption times and higher uptake costs, as each individual insurer needs to invest in the digital infrastructure. There was a stated need to adjust or redesign the existing protocols and professional guidelines, commonly created for the provision of face-to-face health care, to create opportunities for digital therapeutics and address the liability and risk-sharing concerns with using digital therapeutics [19,51,52,57,63-66,81,87,106,110,112,114,118,121,126, 139,149,158,192,205,207,225,233]. The presence or development of a high-quality digital infrastructure that can be accessed by all population groups [1,5, 13,40,45,47,63,66,74,87,100,106,119,122,124, 134,135,137,140,153,162,199,201,209,218,238,270,273], the availability of testing environments so that health professionals can gain experience with digital therapeutics [129,201], and the inclusion of digital therapeutic modules in medical curricula were identified as facilitators of the uptake of digital therapeutics [52,58,61,62,70,78,80,81,87,105,110,115,134,149,190,197, 207,208]. A good practice example of this can be found in the United Kingdom with the establishment of the NHS Digital Academy, which trains health professionals according to a comprehensive framework on digital health competencies (Figure S3 in Multimedia Appendix 1) [97,267]. Finally, the included articles emphasized the importance of developing a formal license for health professionals to allow them to prescribe digital therapeutics [13,64,68,70,87,123,124,131].

Individuals Domain

Patients

In terms of the Donabedian framework structure measures, the characteristics of the population group targeted by a digital therapeutic are important uptake determinants, as they influence the impact that any digital therapeutic might have on different clinical pathways and different diseases. Demographic characteristics are associated with patients’ uptake of digital therapeutics. Younger age [5,19,40,43,49,52-54,63, 83,100,101,126,135,139,175,177,181,182,196,203,206,235,236,256,259], sex (male or female depending on the circumstances) [17,53,62,63,101,181,182,235,256], higher language skills [19,53,126], higher education level [5,17, 43,49,54,62,63,83,100,101,107,135,175,177,181,182], higher health literacy [40,47], being employed [5,17,62,100,101], higher income level [17,40,52,54,62,100,101,107, 152,153,171,175,269,270], and living in an urban environment (compared with living in a rural environment or being homeless) [17,40,53,54,62,100,101,139,156,170,171,181,258,269] were associated with increased uptake of digital therapeutics. Furthermore, cultural and social environments [49,62,71,82,86,115,135,142,159,193,195,235]; ethnic background [40,101,102,107,142,175,193,195,235]; being unhealthy or living with a disability [11,17,40,52,62,80,100-103,107,181,190,206,236,259,270]; patient-specific needs, attitudes, and habits [1,80,102,109,110,193,195]; distance to health services [152,171,185,236], risk of contracting a disease [165]; insurance status [175,270]; time since diagnosis [177]; and past health care experiences [217] can influence the uptake of digital therapeutics. The extent to which the target group can access the internet is an additional determinant of the uptake of digital therapeutics [17,19,52,53,62,63,76,77,80,88,100-102,115,137, 139,182,206,269], as well as the target group’s (perceived) digital skills and capabilities and ability to understand the risks associated with using digital tools [1,5, 13,17,40,45,49,50,52,62,63,80-82,100-102,105,107,115,135,139,147,175,177, 188,191,192,194,199-201,210,224,225,237,245,252].

For process measures, it was considered vital to understand how patients perceive the need to use the digital therapeutic (on its own as well as compared with in-person visits); their views, doubts, and comfort regarding the use of the digital therapeutic and its potential benefits; resilience to setbacks; waiting times for the health care in question; and the ease of using the digital therapeutic [13,15,19,42-44,48,50,52,62,82,83,88,107,133,141, 150,159,170,177,178,186,188,189,193,201-203,208,216, 220,221,245,247,251,252,254,269,270]. Articles from the United States and Germany indicate that individuals who rate their health status as being lower favor the use of digital tools to aid them in their health care [43,50,195], although none of these articles focused on digital therapeutics specifically. Nevertheless, patients’ preferences for using digital therapeutics instead or alongside of traditional care form a core part of whether digital therapeutics are used in practice [42,50,62,73,82,165,199,209,246,247].

Health Professionals

As with the target patient group, health professionals’ perceptions are also key factors of the uptake of digital therapeutics. Relevant factors include how easy the digital therapeutic is to use [13,42,44,202,218], how health professionals perceive the digital capabilities and risk profile of the patient and the quality of the digital therapeutic [90,145,172,184,211,218], how the technology will affect organizational workflow, and professional responsibilities and autonomy [13,42,54,62,110,116,133,155,189,197,198, 202,207,211,221,273]. Barriers to implementation (eg, financial, human resource, or time- and workload-related barriers) were also frequently cited [42,43,62, 63,90,104,115,139,145,155,156,199,200,202,218].

With respect to structure measures, the demographic characteristics of health professionals play a role. Female and younger health professionals were reported to favor the prescription of digital therapeutics in Germany and the Netherlands [147,196], as did health professionals located in rural environments in Australia, the United States, and Taiwan [62,151,155,236]. The digital connectivity and literacy of health professionals were widely recognized as key components in determining their willingness toward and likelihood of prescribing digital therapeutics across countries [1,5,17,42-46,62,70,76,80,81,90,100,101,104,106,116,117,135, 145,146,162,174,183,184,187,189,191,192,194,196,197,199-201,203, 210,224,225,228,231], as were their personal attitudes toward, familiarity with, and trust in digital therapeutics [1,42,43,62,70,104,105,116,139,145-147,183,184, 187,189,192,196,198-200,203,209,210,230,231,236,248].

With respect to process measures, professionals reported rigidity in their work process [146,187,192,196], as well as a tendency to be risk averse and to resist change unless a digital therapeutic had been nationally accredited or endorsed [63,104,139,147,231,248], reemphasizing the need for policy mechanisms aimed at the accreditation of digital therapeutics. Approval from the institutional or social environment was also reported as an important indicator of the uptake and use of digital therapeutics by health professionals [19,42,62,104,112,115,139,156,159,174,200,202,203]. Finally, certain medical specialties (eg, psychology, psychiatry, and neurology) may be more amenable to adopting digital therapeutics than other specialties (eg, ophthalmology, dermatology, and surgery) [140,145,146, 162,167,183,196,213,235,236,247], which may be explained by the varying degrees of availability or applicability of digital therapeutics for different medical specialties [183,196].

Innovation Domain

Characteristics of Digital Therapeutics and Manufacturer Provisions

On the basis of the mapped literature, the nature, content, and structure of digital therapeutics are major determinants of their uptake and effectiveness across countries [1,4,13,19,40,63,100,102,189,191-194,200,205,230,246,265,266]. The design of digital therapeutics needs to be driven by the needs and expectations of patients [56,61,66, 68,84,100,102,117,118,122,132,136,140,141,168,177,189, 191-194,200,202,208,214-216,221,230,233,250,266,273,274] while acknowledging that patient needs may shift with time and disease progression [140]. They need to have clear aims and a position in the health care pathway that is understood by patients and professionals, with comprehensive and trusted information provided about the qualities and services of the devices and targeted health condition [56,57,93,118,142, 174,177,178,186,190,214,221,228,250,252,259, 265,266,273]. They should also be easy and straightforward to understand and use [1,4,13,19,40,42,117,135,141,150,193,194,203,208,217,250, 252,265,266,273], as well as have the ability to be personalized according to patient needs and preferences [4,13,62,117,208,216,217,220,246]. Finally, a key property and enabler of the reimbursement of digital therapeutics is their interaction with the target population: they should be co-designed and coimplemented with patients and health professionals to maximize the likelihood of their uptake by the relevant stakeholders, with the recognition of the fact that engagement might differ across population groups in different countries [4,13,19,40,47,56,57,89,129,166,174,189, 190,200,214,215,220,230,250].

With respect to structure measures, the interoperability of digital therapeutics (ie, the ability to communicate with local health informatics systems, such as electronic health records) was the most often emphasized requirement from a design viewpoint [1,4,13,15,17,19,44,45,54,57,61,66,80,82,103,106,107, 110,111,124,147,189-192,197,199,200,202,222,224, 230,231,246,264-266,270,273]. However, it is important that digital therapeutics remain compliant with local privacy and security legislation and prevent direct-to-consumer advertisements through the application [4,47-49,51,57,93,115,125,138,187,211,219,220,224], as well as identification through secondary data sharing [79,91,93,138,217]. The hardware and software requirements [63,91,163,194,233], implementation and upkeep costs [41,63,65,133,146,198,211,231,237,238,254], required input and oversight from health professionals [11,107,254,265], ability to work without a constant internet connection [91,135,217,233], price [165,222], and scalability were also deemed important factors, as they dictate the investment threshold for adopting digital therapeutics and how widely and cost-effectively digital therapeutics can be deployed, including the potential to realize economies of scale [164,199,231,265].

With respect to process measures, certain additional provisions from the developer broaden the potential uptake of digital therapeutics in addition to enhancing the digital therapeutics themselves. These additional provisions include dedicated training courses for the digital therapeutic aimed at patients and health professionals, and user support during and after implementation were noted as critical uptake factors [13,19,61-63,66,73,115,118,145,148,159,184,199,203,206,252].

Finally, a key property of digital therapeutics was the existence of a strong evidence base that matches the corresponding evidence tier of the national regulatory framework. This should contain data on the positive health effects of using the digital therapeutic compared with the status quo or preexisting treatment options (eg, pragmatic randomized controlled trials using a real-world data arm), the context in which the digital therapeutic is to be implemented, how it affects the clinical workflow in the target setting, economic evaluations (cost-effectiveness, cost utility, and cost benefit), economic risk to the payer, budget impact, qualitative evidence on patients’ and health professionals’ experiences with using the tool, health system needs assessment, the safety of the patient and their data (eg, reports of regular penetration testing), and transferability and generalizability across population groups [1,4, 13,15,44,46,49,54,61,65,85,86,91,98,105,106,108-112,117, 118,133,144,188,196,197,200,210,228,229,232,266]. In this context, positive health effects include not only medical benefits, such as improved health status, shortening of the duration of disease, prolongation of survival, and improvement of the quality of life, but also broader elements, such as treatment adherence, patient safety and sovereignty, coping capabilities, and the reduction of therapy-related efforts [108,109,229].

Relative Advantages of Digital Therapeutics

The mapped literature highlighted the multidimensionality and versatility of digital therapeutics by showcasing their relative advantages compared with their competitors. At the patient level, the most reported relative advantages were improvements in health outcomes and shortened disease duration through novel health care options, faster diagnoses, decrease in adverse medical events, and improved monitoring of clinical and patient-reported outcome measures [11,17,41,43, 45,47-49,53,60,61,69,71,74,80,81,88,92,94,95,100,102,105,124,128,130, 132,133,135,137,138,146,153,163,172,173,179,189,202,207,218,224,226,228, 229,231,232,234,239-242,244,246,248,257,260,262,263,265,266,270,275], as well as changes in the quality of life, well-being, and life expectancy [13,47,48,58,88,92,120,128,153,224,226, 229,244,246,257]. Digital therapeutics can also induce changes in the quality of care, patient satisfaction, and diagnostic accuracy [48,52,53,55,60,69,76,88,89,92,102,128,137, 147,165,168,179,189,203,219,242,243,270,273] while empowering the patient to have a more active role in their health care and further enabling shared decision-making [4,56,82,92,102,105,134,139,175,189,191,201, 216,225,226,229,231,241,246,248,258,266,273]. At the behavioral level, digital therapeutics have been shown to positively affect treatment adherence [41,48,69,137,196,226,229,231,246,266,273], patients’ coping and health management abilities [4,13,76,82,126,134,137,145,175,226,229,244,254,257,263,266,270,273], and general behavioral and lifestyle aspects [13,43,56,246,254]. Furthermore, digital therapeutics could improve access to health care, reduce waiting times, and lower thresholds for seeking out health services [1,41,43,45,48,49,53,55,61,62,67,70,71, 74,76,80,88,90,91,95,99,102,111,113,120,124,130-133,137-139,142,150, 151,162,171,173,181,183,185,193,196,203,216,217,224-226,229,232,234, 239,240,242,247,249,253,256,261,262,269,273,275]. They can also aid in the development of (digital) health literacy [4,13,41,43,47,76,82,83,89,92,139,147,165,196,202,208, 219,226,229,242,250,251,257,266,270,274].

At the health system level, digital therapeutics can influence health care costs and resource use [41,47,48, 53,69,71,72,80,81,94,95,105,107,111,113,121,124,128,131,133,147, 153,154,160,164,171,172,180,189,207,211,212,228,231,232,237,238,255-258, 261,262,265,269,273] and affect the workload and workflow of the health workforce, potentially bringing about significant improvements [19,47,60,62,78,80,90,105,116,124,126,128, 134,146,147,176,188,194,196,221,231]. They can also improve coordination among health professionals [60,90,92,225,226,229,232,273]. Furthermore, as they require less health professional input, digital therapeutics can help address clinical workforce shortages [47,72,80,124,128,173,176,228,243,270].

Digital therapeutics have secondary relative advantages at the public health and data science levels. The data generated through their use can allow for the tracking of disease burden [1,100,151,253], resulting in the ability to monitor and model the spread patterns of infectious diseases and inform national priorities for health care procurement and resource allocation [1,17,41,45,151]. As they reduce the need for patients to travel to health care facilities, they are both environmentally friendly and can reduce the risk of hospital-borne infections [120,139,165,171,180,185]. When designed and deployed adequately, digital therapeutics can also contribute to the reduction of health inequalities; however, when designed poorly or without the consideration of the potential for the digital exclusion of groups with lower levels of digital literacy, they have the potential to exacerbate health inequalities [47,53,68,70,81,95,99,100,102,107,120,127,132,139,140, 142,143,173,182,210,218,221,242]. Finally, digital therapeutics can aid in the generation and analysis of meaningful real-world (health) data through their integration with electronic health records [5,136,231,273], enable the use of cloud-based diagnostics and (big data) analyses [48,72,223], and be continuously developed and improved through iterative user feedback [201]. However, privacy-conscious data-sharing platforms (eg, PhysioNet and the US National Institute of Health All of Us research program) are vital for minimizing the risk of reidentification [79].

Comprehensive Map of Uptake Factors

From the 244 included documents, we extracted 85 factors that determine the uptake of digital therapeutics within a health system. At the policy level, the need to develop a legal framework for digital therapeutics was very frequently iterated (37/244, 15.2%). As for patients, their demographics (57/244, 23.4%), perceptions of digital therapeutics (39/244, 16%), and digital skills and risk perceptions (38/244, 15.6%) were very frequently reported to influence the potential uptake of digital therapeutics. The interoperability of digital therapeutics was also very frequently reported to influence their uptake (39/244, 16%). As for health professionals, their digital connectivity and literacy were the most stated factors affecting their uptake of digital therapeutics (43/244, 17.6%). In terms of the relative advantages of digital therapeutics, improved access to health services (65/244, 26.6%), improved health outcomes (63/244, 25.8%), and changes in health care costs and resource use (46/244, 18.9%) were very frequently reported. Further details on the frequency with which uptake factors were reported in the included studies are shown in Table 1. Finally, a visual map that outlines all the extracted factors color coded by frequency is shown in Figure 2.

Table 1. Frequency table of the most reported uptake factors in the included documents (n=244).
Domain and factorsFrequency, n (%)
Policy

Very frequently reported factors (≥15%)


Developing a legal framework37 (15.2)

Frequently reported factors (5%-15%)


Implementing a high-quality digital infrastructure28 (11.5)


Developing funding options27 (11.1)


Redesigning protocols and professional guidelines25 (10.2)


Inclusion of digital health modules in medical education18 (7.4)


Financing model for digital therapeutics17 (7)
Patient characteristics

Very frequently reported factors (≥15%)


Demographic characteristics57 (23.4)


Patient perceptions of digital therapeutics39 (16)


Digital skills and risk perceptions38 (15.6)
Digital therapeutic

Very frequently reported factors (≥15%)


Interoperability39 (16)

Frequently reported factors (5%-15%)


Need-driven and patient-centered design34 (13.9)


Evidence base33 (13.5)


Simple and straightforward to use20 (8.2)


Clear aim that is understood by patients and professionals19 (7.8)


Accounting for different needs across populations and disease stages19 (7.8)


Provision of training courses for patients and professionals17 (7)


Remaining compliant with local privacy and security legislation15 (6.1)
Health professional

Very frequently reported factors (≥15%)


Digital literacy43 (17.6)

Frequently reported factors (5%-15%)


Professional preference28 (11.5)


Effect on clinical workflow and professional autonomy16 (6.6)


Financial, human resource, or time- and workload-related barriers15 (6.1)


Approval from the institutional or social environment13 (5.3)
Outcome

Very frequently reported factors (≥15%)


Improved access to health services65 (26.6)


Improved health outcomes63 (25.8)


Change in health care costs and resource use46 (18.9)

Frequently reported factors (5%-15%)


Improving digital literacy, health literacy, or digital health literacy in patients26 (10.7)


Improving the quality of care, patient satisfaction, and diagnostic accuracy24 (9.8)


Enabling shared decision-making23 (9.4)


Affecting health inequalities23 (9.4)


Affecting the workload and workflow of the health workforce21 (8.6)
Figure 2. Map of the factors that can affect the uptake of digital therapeutics. The items in red are reported in 15% or more of the included articles. Items in yellow are reported in 5% to 15% of included articles. Items in blue are reported in less than 5% of the included articles.

Principal Findings

This review aimed to create the first map of the most frequently discussed uptake factors of digital therapeutics that will aid their implementation across different health systems. Our map contains 85 factors that can affect the uptake of digital therapeutics within a health system. This map offers a novel and comprehensive overview of the known uptake factors from both technological and human perspectives. This bridges the dichotomy of the digital health literature in which articles either focus on the technological or patient and professional perspectives, which inadvertently highlights the novelty of this review. The map is intended to be scaled and adopted by countries looking to introduce digital therapeutics in their health service portfolio, expand the proportion of their population that benefits from digital therapeutics, or extend access to digital therapeutics to excluded communities. As this map was based on a standardized set of constructs in the CFIR, it can support future research on and implementation endeavors of digital therapeutics. It offers policy makers, health insurers, and other change agents specific digital health–related action points to focus on in their pursuit of implementing digital therapeutics in the health care system. In doing so, it can help address the existing barriers to the uptake of digital therapeutics, harmonize digital therapeutic infrastructure across health systems, and aid researchers in analyzing health system readiness for using digital therapeutics.

This map of factors aims to guide the integration of digital therapeutics into clinical practice by helping stakeholders identify, assess, and address key uptake barriers unique to digital therapeutics, including issues related to policy readiness, regulatory approval, reimbursement, engagement, data privacy and security, adoption, and clinical effectiveness. It highlights the finding that the innovation and individuals domains of the CFIR contain the most frequently cited uptake factors of digital therapeutics. The relative focus on these factors is unsurprising, seeing how digital therapeutics are unprecedented in terms of the required user input. It also signals these uptake factors as action points for policy makers, health insurers, and health promotion experts. Patient groups may need to be sensitized to the concept of digital therapeutics before they are ready and willing to use these novel tools in their health care pathways [22]. Simultaneously, it points to an opportunity for investors to update funding requirements to better enfranchise future users of digital therapeutics, especially if they are designed to combat the existing health inequalities.

Users of this map should consider the unique characteristics and needs of different health care settings and digital therapeutics on a per-case basis. Consequently, health care organizations can ensure that they are able to effectively leverage the potential of digital therapeutics to improve patient outcomes and address pressing health care challenges [1,71,128,194]. The map is not solely reliant on clinical health outcomes but allows room for a broader interpretation of positive health effects, such as treatment adherence, patient safety and sovereignty, coping capabilities, and reduction of therapy-related efforts [109,229]. This interpretation allows for a more versatile and holistic assessment of digital therapeutics, which could contribute to the value-based pricing of digital therapeutics [12,229].

The focus on the United States in the digital health literature included in this review is likely related to the current health system challenges worldwide. In particular, the United States is experiencing stark rises in health care costs, inequitable access to health care, and labor shortages in the health workforce [276], for which digital therapeutics can be seen as a potential (partial) solution. Although these issues exist worldwide, the United States has a favorable environment for developing and adopting innovations, as it hosts the largest technology companies and venture capital investors [277]. By contrast, the focus on Germany, for example, is attributable to the recent adoption of the Digital Healthcare Act, which only now formally enabled digital therapeutics to be prescribed by general practitioners [266].

In this review, we also found that countries with multipayer reimbursement systems (the United States, Germany, and the Netherlands) form the predominant countries of interest in the literature on reimbursing digital therapeutics. These health systems are built on the basis of (managed) competition and a mix of supplementary and substitutive private health insurance markets [278]. Stereotypically, these types of systems are more conducive to adopting health care innovations, as insurers are actively incentivized to look for a competitive advantage and potential cost-saving solutions [279]. This reasoning also suggests a partial explanation for why countries with a single-payer system (eg, Australia, Canada, or the European Nordic countries) are poorly represented in the current digital health literature. The outlier here is the United Kingdom, where there has been a broad policy discussion around this topic with a strong impetus from national bodies (eg, NHS England) [280]. A downside of introducing digital therapeutics in multipayer countries is the high investment cost of setting up the digital infrastructure in a health system. The Netherlands offers a partial solution to this problem by allowing health insurers to pool their resources and collectively buy the digital infrastructure required to run digital therapeutics [281].

Limitations and Future Research

Some limitations of this review need to be considered. First, the findings of this review should be interpreted as scoping, meaning it provides a high-level overview of the literature and may not capture more intricate and field-specific factors that can affect the uptake of digital therapeutics in health care. Second, the quality of the included sources was not assessed, which should be considered when interpreting the results. Third, we acknowledge the presence of evidence selection bias, as only 3 academic databases and Google Scholar were used, and the search strategy was not exhaustive. That said, an exhaustive search was not required to reach the aim of this review, namely the development of a map of uptake factors. In fact, we reached data saturation during the extraction of the current sample of articles. Fourth, we acknowledge that this review only captures the uptake factors that are considered important within the current digital health literature. Fifth, the high representation of the United States in the included articles might skew our results to be geared toward the US health ecosystem, although we believe that this is counterbalanced by the articles that focused on countries other than the United States. Sixth, these results cannot be directly transferred to the context of artificial intelligence, even though it overlaps to some degree with digital therapeutics, as the latter are often powered by some form of artificial intelligence. Finally, we acknowledge that this review makes broad conclusions about digital therapeutics holistically and may not be applicable to individual applications.

Various avenues for further research were also identified in this review. A comprehensive evidence synthesis for each domain within the map of factors could further improve its quality and robustness. An assessment of the relative importance of the uptake factors within each domain can provide more actionable guidance for policy makers, health professionals, and patients. Patient engagement and empowerment lie at the core of digital therapeutics, yet these concepts remain unquantified. Future research should investigate conceptualizing key performance indicators for patient activity and engagement with digital therapeutics. Even though qualitative studies comprised a decent proportion of the included studies (39/244, 16%), these studies focused predominantly on the experiences of implementing digital health applications in finalized or near-finalized development stages into practical situations. However, research on the process by which a digital therapeutic is developed and how patients can be enfranchised within that process is lacking. Future research should also investigate the possibility, risks, and benefits of migrating the necessary health data infrastructure for digital therapeutics to cloud-based environments compared with local storage. Finally, future research should explore how different financing models for digital therapeutics interact with different types of health systems to identify best practices and further streamline the integration of digital therapeutics in health care pathways.

Conclusions

Ultimately, digital therapeutics are set to disrupt the delivery of health care by challenging the fundamental assumption that health care needs to be location bound and episodic in nature [130]. Understanding the array of factors that determine the uptake of digital therapeutics in the health care landscape is a vital step in progressing the development of digitally augmented health systems. The map of factors developed in this review offers a multistakeholder approach to recognizing the uptake factors of digital therapeutics in the health care pathway and provides an analytical tool for policy makers to assess their health system’s readiness for digital therapeutics.

Acknowledgments

The authors would like to thank Ms Andra Fry at the London School of Economics and Political Science Library for her input on the methodology.

The authors declare that no funding was acquired for this research.

Authors' Contributions

RvK contributed to conceptualization, the methodology, visualization, software use, validation, formal analysis, writing (original draft, as well as review and editing), data curation, supervision, and project administration. AR-U contributed to conceptualization, the methodology, validation, visualization, formal analysis, and writing (original draft, as well as review and editing). MA contributed to the methodology, validation, and writing (review and editing). IK contributed to the methodology, validation, and writing (review and editing). SF contributed to validation and writing (review and editing). GM contributed to validation and writing (review and editing). SDR contributed to validation and writing (review and editing). MP contributed to validation and writing (review and editing). GW contributed to validation and writing (review and editing). EM contributed to conceptualization, the methodology, validation, writing (original draft, as well as review and editing), supervision, and project administration.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Additional figures, tables, and the search strategy per database.

DOCX File , 641 KB

  1. Fahy N, Williams GA, Habicht T, Köhler K, Jormanainen V, Satokangas M, et al. Use of Digital Health Tools in Europe: Before, During and After COVID-19. Copenhagen (Denmark). European Observatory on Health Systems and Policies; 2021. URL: https://www.ncbi.nlm.nih.gov/books/NBK576970/ [accessed 2022-11-01]
  2. Patel NA, Butte AJ. Characteristics and challenges of the clinical pipeline of digital therapeutics. NPJ Digit Med. Dec 11, 2020;3(1):159. [FREE Full text] [CrossRef] [Medline]
  3. Rowland SP, Fitzgerald JE, Holme T, Powell J, McGregor A. What is the clinical value of mHealth for patients? NPJ Digit Med. Jan 13, 2020;3:4. [FREE Full text] [CrossRef] [Medline]
  4. Essén A, Stern AD, Haase CB, Car J, Greaves F, Paparova D, et al. Health app policy: international comparison of nine countries' approaches. NPJ Digit Med. Mar 18, 2022;5(1):31. [FREE Full text] [CrossRef] [Medline]
  5. Brassel S, Radu P, Bell E, Garau M. Navigating the landscape of digital health. Office of Health Economics. 2022. URL: https://www.ohe.org/publications/navigating-the-landscape-of-digital-health/ [accessed 2023-01-11]
  6. Kollins SH, DeLoss DJ, Cañadas E, Lutz J, Findling RL, Keefe RS, et al. A novel digital intervention for actively reducing severity of paediatric ADHD (STARS-ADHD): a randomised controlled trial. Lancet Digit Health. Apr 2020;2(4):e168-e178. [FREE Full text] [CrossRef] [Medline]
  7. Kollins SH, Childress A, Heusser AC, Lutz J. Effectiveness of a digital therapeutic as adjunct to treatment with medication in pediatric ADHD. NPJ Digit Med. Mar 26, 2021;4(1):58. [FREE Full text] [CrossRef] [Medline]
  8. Brezing CA, Brixner DI. The rise of prescription digital therapeutics in behavioral health. Adv Ther. Dec 2022;39(12):5301-5306. [FREE Full text] [CrossRef] [Medline]
  9. Fast N, van Kessel R, Humphreys K, Ward NF, Roman-Urrestarazu A. The evolution of telepsychiatry for substance use disorders during COVID-19: a narrative review. Curr Addict Rep. 2023;10(2):187-197. [FREE Full text] [CrossRef] [Medline]
  10. Shah N, Velez FF, Colman S, Kauffman L, Ruetsch C, Anastassopoulos K, et al. Real-world reductions in healthcare resource utilization over 6 months in patients with substance use disorders treated with a prescription digital therapeutic. Adv Ther. Sep 2022;39(9):4146-4156. [FREE Full text] [CrossRef] [Medline]
  11. Lantzsch H, Panteli D, Martino F, Stephani V, Seißler D, Püschel C, et al. Benefit assessment and reimbursement of digital health applications: concepts for setting up a new system for public coverage. Front Public Health. Apr 21, 2022;10:832870. [FREE Full text] [CrossRef] [Medline]
  12. Ju JH, Sim B, Lee J, Lee JY. Reimbursement of digital therapeutics: future perspectives in Korea. Korean Circ J. Apr 2022;52(4):265-279. [FREE Full text] [CrossRef] [Medline]
  13. Tromp J, Jindal D, Redfern J, Bhatt A, Séverin T, Banerjee A, et al. World heart federation roadmap for digital health in cardiology. Glob Heart. Aug 26, 2022;17(1):61. [FREE Full text] [CrossRef] [Medline]
  14. von Huben A, Howell M, Howard K, Carrello J, Norris S. Health technology assessment for digital technologies that manage chronic disease: a systematic review. Int J Technol Assess Health Care. May 26, 2021;37(1):e66. [CrossRef] [Medline]
  15. Prodan A, Deimel L, Ahlqvist J, Birov S, Thiel R, Toivanen M, et al. Success factors for scaling up the adoption of digital therapeutics towards the realization of P5 medicine. Front Med (Lausanne). Apr 12, 2022;9:854665. [FREE Full text] [CrossRef] [Medline]
  16. van Kessel R, Wong BL, Rubinić I, O'Nuallain E, Czabanowska K. Is Europe prepared to go digital? Making the case for developing digital capacity: an exploratory analysis of Eurostat survey data. PLOS Digit Health. Feb 17, 2022;1(2):e0000013. [FREE Full text] [CrossRef] [Medline]
  17. Wong BL, Maaß L, Vodden A, van Kessel R, Sorbello S, Buttigieg S, et al. European Public Health Association (EUPHA) Digital Health Section. The dawn of digital public health in Europe: implications for public health policy and practice. Lancet Reg Health Eur. Mar 2022;14:100316. [FREE Full text] [CrossRef] [Medline]
  18. Holly L, Wong BL, van Kessel R, Awah I, Agrawal A, Ndili N. Optimising adolescent wellbeing in a digital age. BMJ. Mar 20, 2023;380:e068279. [FREE Full text] [CrossRef] [Medline]
  19. Whitelaw S, Pellegrini DM, Mamas MA, Cowie M, Van Spall HG. Barriers and facilitators of the uptake of digital health technology in cardiovascular care: a systematic scoping review. Eur Heart J Digit Health. Feb 04, 2021;2(1):62-74. [FREE Full text] [CrossRef] [Medline]
  20. van Kessel R, Kyriopoulos I, Mastylak A, Mossialos E. Changes in digital healthcare search behavior during the early months of the COVID-19 pandemic: a study of six English-speaking countries. PLOS Digit Health. May 01, 2023;2(5):e0000241. [FREE Full text] [CrossRef] [Medline]
  21. van Kessel R, Kyriopoulos I, Wong BL, Mossialos E. The effect of the COVID-19 pandemic on digital health-seeking behavior: big data interrupted time-series analysis of Google trends. J Med Internet Res. Jan 16, 2023;25:e42401. [FREE Full text] [CrossRef] [Medline]
  22. Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, et al. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. Nov 01, 2017;19(11):e367. [FREE Full text] [CrossRef] [Medline]
  23. Gordon WJ, Landman A, Zhang H, Bates DW. Beyond validation: getting health apps into clinical practice. NPJ Digit Med. Feb 03, 2020;3:14. [FREE Full text] [CrossRef] [Medline]
  24. Chawla V. Where is the money in digital health? The roadmap to digital health app reimbursement in Europe. Research 2 Guidance. 2022. URL: https:/​/research2guidance.​com/​where-is-the-money-in-digital-health-the-roadmap-to-digital-health-app-reimbursement-in-europe/​ [accessed 2022-11-11]
  25. Wharton GA, Sood HS, Sissons A, Mossialos E. Virtual primary care: fragmentation or integration? Lancet Digit Health. Nov 2019;1(7):e330-e331. [FREE Full text] [CrossRef] [Medline]
  26. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. Feb 2005;8(1):19-32. [FREE Full text] [CrossRef]
  27. Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci. Sep 20, 2010;5:69. [FREE Full text] [CrossRef] [Medline]
  28. Sutton A, Clowes M, Preston L, Booth A. Meeting the review family: exploring review types and associated information retrieval requirements. Health Info Libr J. Sep 2019;36(3):202-222. [FREE Full text] [CrossRef] [Medline]
  29. Booth A. Searching for qualitative research for inclusion in systematic reviews: a structured methodological review. Syst Rev. May 04, 2016;5:74. [FREE Full text] [CrossRef] [Medline]
  30. Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. Oct 02, 2018;169(7):467-473. [FREE Full text] [CrossRef] [Medline]
  31. Peters MD, Godfrey C, McInerney P, Munn Z, Tricco AC, Khalil H. Scoping reviews. In: Aromataris E, Munn Z, editors. JBI Manual for Evidence Synthesis. Adelaide, Australia. JBI; 2020.
  32. Haddaway NR, Collins AM, Coughlin D, Kirk S. The role of Google scholar in evidence reviews and its applicability to grey literature searching. PLoS One. Sep 17, 2015;10(9):e0138237. [FREE Full text] [CrossRef] [Medline]
  33. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. Apr 1960;20(1):37-46. [FREE Full text]
  34. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. Mar 1977;33(1):159-174. [Medline]
  35. Better systematic review management. Covidence. URL: https://www.covidence.org/ [accessed 2023-03-14]
  36. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77-101. [FREE Full text] [CrossRef]
  37. Damschroder LJ, Reardon CM, Widerquist MA, Lowery J. The updated consolidated framework for implementation research based on user feedback. Implement Sci. Oct 29, 2022;17(1):75. [FREE Full text] [CrossRef] [Medline]
  38. Wienert J, Zeeb H. Implementing health apps for digital public health - an implementation science approach adopting the consolidated framework for implementation research. Front Public Health. May 07, 2021;9:610237. [FREE Full text] [CrossRef] [Medline]
  39. Donabedian A. Evaluating the quality of medical care. 1966. Milbank Q. 2005;83(4):691-729. [FREE Full text] [CrossRef] [Medline]
  40. Honeyman M, Maguire D, Evans H, Davies A. Digital Technology and Health Inequalities: A Scoping Review. Cardiff, Wales. Public Health Wales NHS Trust; 2020.
  41. Dávalos ME, French MT, Burdick AE, Simmons SC. Economic evaluation of telemedicine: review of the literature and research guidelines for benefit-cost analysis. Telemed J E Health. Dec 2009;15(10):933-948. [CrossRef] [Medline]
  42. Gagnon MP, Ngangue P, Payne-Gagnon J, Desmartis M. m-Health adoption by healthcare professionals: a systematic review. J Am Med Inform Assoc. Jan 2016;23(1):212-220. [FREE Full text] [CrossRef] [Medline]
  43. van den Heuvel JF, Groenhof TK, Veerbeek JH, van Solinge WW, Lely AT, Franx A, et al. eHealth as the next-generation perinatal care: an overview of the literature. J Med Internet Res. Jun 05, 2018;20(6):e202. [FREE Full text] [CrossRef] [Medline]
  44. Kolasa K, Kozinski G. How to value digital health interventions? A systematic literature review. Int J Environ Res Public Health. Mar 23, 2020;17(6):2119. [FREE Full text] [CrossRef] [Medline]
  45. Omboni S, Padwal RS, Alessa T, Benczúr B, Green BB, Hubbard I, et al. The worldwide impact of telemedicine during COVID-19: current evidence and recommendations for the future. Connect Health. Jan 04, 2022;1:7-35. [FREE Full text] [CrossRef] [Medline]
  46. Yan K, Balijepalli C, Druyts E. The impact of digital therapeutics on current health technology assessment frameworks. Front Digit Health. Jun 09, 2021;3:667016. [FREE Full text] [CrossRef] [Medline]
  47. Song Y, Bernard L, Jorgensen C, Dusfour G, Pers YM. The challenges of telemedicine in rheumatology. Front Med (Lausanne). Oct 13, 2021;8:746219. [FREE Full text] [CrossRef] [Medline]
  48. Nilius G, Schroeder M, Schoebel C. Telehealth and its implementation in respiratory sleep medicine. Curr Opin Pulm Med. Nov 01, 2021;27(6):523-528. [CrossRef] [Medline]
  49. Ambrosino N, Fracchia C. The role of tele-medicine in patients with respiratory diseases. Expert Rev Respir Med. Nov 2017;11(11):893-900. [CrossRef] [Medline]
  50. Zaman SB, Khan RK, Evans RG, Thrift AG, Maddison R, Islam SM. Exploring barriers to and enablers of the adoption of information and communication technology for the care of older adults with chronic diseases: scoping review. JMIR Aging. Jan 07, 2022;5(1):e25251. [FREE Full text] [CrossRef] [Medline]
  51. Briggs LG, Labban M, Alkhatib K, Nguyen DD, Cole AP, Trinh QD. Digital technologies in cancer care: a review from the clinician's perspective. J Comp Eff Res. May 2022;11(7):533-544. [FREE Full text] [CrossRef] [Medline]
  52. Butz B, Kloep L, Kriegesmann B. User experience reevaluation and diffusion of technology in the context of compulsory usage illustrated by the example of telepsychotherapy-a literature review. Digit Health. Nov 13, 2022;8:20552076221134448. [FREE Full text] [CrossRef] [Medline]
  53. Patel P, Dhindsa D, Eapen DJ, Khera A, Gulati M, Stone NJ, et al. Optimizing the potential for telehealth in cardiovascular care (in the era of COVID-19): time will tell. Am J Med. Aug 2021;134(8):945-951. [FREE Full text] [CrossRef] [Medline]
  54. Kozik M, Isakadze N, Martin SS. Mobile health in preventive cardiology: current status and future perspective. Curr Opin Cardiol. Sep 01, 2021;36(5):580-588. [FREE Full text] [CrossRef] [Medline]
  55. Kompala T, Neinstein AB. Telehealth in type 1 diabetes. Curr Opin Endocrinol Diabetes Obes. Feb 01, 2021;28(1):21-29. [CrossRef] [Medline]
  56. Almalki M, Giannicchi A. Health apps for combating COVID-19: descriptive review and taxonomy. JMIR Mhealth Uhealth. Mar 02, 2021;9(3):e24322. [FREE Full text] [CrossRef] [Medline]
  57. Koumpouros Y, Georgoulas A. A systematic review of mHealth funded R and D activities in EU: trends, technologies and obstacles. Inform Health Soc Care. 2020;45(2):168-187. [CrossRef] [Medline]
  58. Neubeck L, Hansen T, Jaarsma T, Klompstra L, Gallagher R. Delivering healthcare remotely to cardiovascular patients during COVID-19: a rapid review of the evidence. Eur J Cardiovasc Nurs. Aug 2020;19(6):486-494. [FREE Full text] [CrossRef] [Medline]
  59. Sauermann S, Herzberg J, Burkert S, Habetha S. DiGA - a chance for the German healthcare system. J Eur CME. Dec 23, 2022;11(1):2014047. [FREE Full text] [CrossRef] [Medline]
  60. Parikh RB, Basen-Enquist KM, Bradley C, Estrin D, Levy M, Lichtenfeld JL, et al. Digital health applications in oncology: an opportunity to seize. J Natl Cancer Inst. Oct 06, 2022;114(10):1338-1339. [FREE Full text] [CrossRef] [Medline]
  61. Raney L, Bergman D, Torous J, Hasselberg M. Digitally driven integrated primary care and behavioral health: how technology can expand access to effective treatment. Curr Psychiatry Rep. Sep 30, 2017;19(11):86. [CrossRef] [Medline]
  62. Meurk C, Leung J, Hall W, Head BW, Whiteford H. Establishing and governing e-Mental health care in Australia: a systematic review of challenges and a call for policy-focussed research. J Med Internet Res. Jan 13, 2016;18(1):e10. [FREE Full text] [CrossRef] [Medline]
  63. Scott Kruse C, Karem P, Shifflett K, Vegi L, Ravi K, Brooks M. Evaluating barriers to adopting telemedicine worldwide: a systematic review. J Telemed Telecare. Jan 2018;24(1):4-12. [FREE Full text] [CrossRef] [Medline]
  64. Goodspeed TA, Page RE, Koman LE, Hollenbeck AT, Gilroy AS. Legal and regulatory issues with teledermatology. Curr Derm Rep. May 3, 2019;8(2):46-51. [FREE Full text] [CrossRef]
  65. Boriani G, Vitolo M, Svennberg E, Casado-Arroyo R, Merino JL, Leclercq C. Performance-based risk-sharing arrangements for devices and procedures in cardiac electrophysiology: an innovative perspective. Europace. Oct 13, 2022;24(10):1541-1547. [FREE Full text] [CrossRef] [Medline]
  66. Jennett PA, Scott RE, Affleck Hall L, Hailey D, Ohinmaa A, Anderson C, et al. Policy implications associated with the socioeconomic and health system impact of telehealth: a case study from Canada. Telemed J E Health. 2004;10(1):77-83. [CrossRef] [Medline]
  67. Lopéz DM, Blobel B. mHealth in low- and middle-income countries: status, requirements and strategies. Stud Health Technol Inform. 2015;211:79-87. [Medline]
  68. Weinstein RS, Lopez AM, Joseph BA, Erps KA, Holcomb M, Barker GP, et al. Telemedicine, telehealth, and mobile health applications that work: opportunities and barriers. Am J Med. Mar 2014;127(3):183-187. [CrossRef] [Medline]
  69. Kario K, Harada N, Okura A. The first software as medical device of evidence-based hypertension digital therapeutics for clinical practice. Hypertens Res. Dec 2022;45(12):1899-1905. [FREE Full text] [CrossRef] [Medline]
  70. Hasselberg MJ. The digital revolution in behavioral health. J Am Psychiatr Nurses Assoc. Jan 2020;26(1):102-111. [CrossRef] [Medline]
  71. Alvarez RC. The promise of e-Health - a Canadian perspective. eHealth Int. Sep 17, 2002;1(1):4. [FREE Full text] [CrossRef] [Medline]
  72. Meessen B. The role of digital strategies in financing health care for universal health coverage in low- and middle-income countries. Glob Health Sci Pract. Oct 10, 2018;6(Suppl 1):S29-S40. [FREE Full text] [CrossRef] [Medline]
  73. Chua V, Koh JH, Koh CH, Tyagi S. The willingness to pay for telemedicine among patients with chronic diseases: systematic review. J Med Internet Res. Apr 13, 2022;24(4):e33372. [FREE Full text] [CrossRef] [Medline]
  74. Leon N, Balakrishna Y, Hohlfeld A, Odendaal WA, Schmidt BM, Zweigenthal V, et al. Routine Health Information System (RHIS) improvements for strengthened health system management. Cochrane Database Syst Rev. Aug 13, 2020;8(8):CD012012. [FREE Full text] [CrossRef] [Medline]
  75. Haverinen J, Keränen N, Falkenbach P, Maijala A, Kolehmainen T, Reponen J. Digi-HTA: health technology assessment framework for digital healthcare services. FinJeHeW. Nov 02, 2019;11(4):326-341. [FREE Full text] [CrossRef]
  76. Nanda M, Sharma R. A review of patient satisfaction and experience with telemedicine: a virtual solution during and beyond COVID-19 pandemic. Telemed J E Health. Dec 2021;27(12):1325-1331. [CrossRef] [Medline]
  77. Abbadessa G, Brigo F, Clerico M, De Mercanti S, Trojsi F, Tedeschi G, et al. Digital therapeutics in neurology. J Neurol. Mar 2022;269(3):1209-1224. [FREE Full text] [CrossRef] [Medline]
  78. Ali S, Kleib M, Paul P, Petrovskaya O, Kennedy M. Compassionate nursing care and the use of digital health technologies: a scoping review. Int J Nurs Stud. Mar 2022;127:104161. [CrossRef] [Medline]
  79. Chikwetu L, Miao Y, Woldetensae MK, Bell D, Goldenholz DM, Dunn J. Does deidentification of data from wearable devices give us a false sense of security? A systematic review. Lancet Digit Health. Apr 2023;5(4):e239-e247. [FREE Full text] [CrossRef] [Medline]
  80. Barrios V, Cinza-Sanjurjo S, García-Alegría J, Freixa-Pamias R, Llordachs-Marques F, Molina CA, et al. Role of telemedicine in the management of oral anticoagulation in atrial fibrillation: a practical clinical approach. Future Cardiol. Sep 2022;18(9):743-754. [FREE Full text] [CrossRef] [Medline]
  81. Burg F, Pscherer A, Opitz OG. Digital communication in visceral medicine: regulatory framework for digital communication. Visc Med. Oct 20, 2021;96(6):1-7. [FREE Full text] [CrossRef] [Medline]
  82. Cheng L, Liu F, Mao X, Peng W, Wang Y, Huang H, et al. The pediatric cancer survivors' user experiences with digital health interventions: a systematic review of qualitative data. Cancer Nurs. Jan 2022;45(1):E68-E82. [CrossRef] [Medline]
  83. Chuang TY, Cheng W, Chiu YC, Fan YH, Chi CC, Chang CC, et al. Free interactive counselling program in a mobile communication application for improving health education on indwelling ureteric stents after ureterorenoscopic lithotripsy: an observational study. Digit Health. Aug 04, 2022;8:20552076221117754. [FREE Full text] [CrossRef] [Medline]
  84. Edwards KJ, Maslin K, Andrade J, Jones RB, Shawe J. Mobile health as a primary mode of intervention for women at risk of or diagnosed with gestational diabetes mellitus: a scoping review. JBI Evid Synth. Sep 01, 2022;20(9):2195-2243. [CrossRef] [Medline]
  85. Feldman N, Back D, Boland R, Torous J. A systematic review of mHealth application interventions for peripartum mood disorders: trends and evidence in academia and industry. Arch Womens Ment Health. Dec 2021;24(6):881-892. [FREE Full text] [CrossRef] [Medline]
  86. Hilty DM, Serhal E, Crawford A. A telehealth and telepsychiatry economic cost analysis framework: scoping review. Telemed J E Health. Jan 2023;29(1):23-37. [CrossRef] [Medline]
  87. Intan Sabrina M, Defi IR. Telemedicine guidelines in South East Asia-a scoping review. Front Neurol. Jan 13, 2020;11:581649. [FREE Full text] [CrossRef] [Medline]
  88. Jones C, Miguel-Cruz A, Smith-MacDonald L, Cruikshank E, Baghoori D, Kaur Chohan A, et al. Virtual trauma-focused therapy for military members, veterans, and public safety personnel with posttraumatic stress injury: systematic scoping review. JMIR Mhealth Uhealth. Sep 21, 2020;8(9):e22079. [FREE Full text] [CrossRef] [Medline]
  89. Kvedarienė V, Burzdikaitė P, Česnavičiūtė I. mHealth and telemedicine utility in the monitoring of allergic diseases. Front Allergy. Sep 02, 2022;3:919746. [FREE Full text] [CrossRef] [Medline]
  90. Odendaal WA, Anstey Watkins J, Leon N, Goudge J, Griffiths F, Tomlinson M, et al. Health workers' perceptions and experiences of using mHealth technologies to deliver primary healthcare services: a qualitative evidence synthesis. Cochrane Database Syst Rev. Mar 26, 2020;3(3):CD011942. [FREE Full text] [CrossRef] [Medline]
  91. Skeen SJ, Cain D, Gamarel KE, Hightow-Weidman L, Reback CJ. mHealth for transgender and gender-expansive youth: harnessing gender-affirmative cross-disciplinary innovations to advance HIV prevention and care interventions. Mhealth. Apr 20, 2021;7:37. [FREE Full text] [CrossRef] [Medline]
  92. Tripepi M, Pizzocaro E, Giardino A, Frigerio I, Guglielmi A, Butturini G. Telemedicine and pancreatic cancer: a systematic review. Telemed J E Health. Mar 2023;29(3):352-360. [CrossRef] [Medline]
  93. Wong CA, Madanay F, Ozer EM, Harris SK, Moore M, Master SO, et al. Digital health technology to enhance adolescent and young adult clinical preventive services: affordances and challenges. J Adolesc Health. Aug 2020;67(2S):S24-S33. [FREE Full text] [CrossRef] [Medline]
  94. Yang Y, Chen H, Qazi H, Morita PP. Intervention and evaluation of mobile health technologies in management of patients undergoing chronic dialysis: scoping review. JMIR Mhealth Uhealth. Apr 03, 2020;8(4):e15549. [FREE Full text] [CrossRef] [Medline]
  95. Grogan J, Simmons Z. Telemedicine for the care of neuromuscular disorders. Curr Treat Options Neurol. May 11, 2020;22(6):17. [FREE Full text] [CrossRef]
  96. Mossialos E, Thomson S, Ter Linden A. Information technology law and health systems in the European Union. Int J Technol Assess Health Care. 2004;20(4):498-508. [CrossRef] [Medline]
  97. Sheikh A, Anderson M, Albala S, Casadei B, Franklin BD, Richards M, et al. Health information technology and digital innovation for national learning health and care systems. Lancet Digit Health. Jun 2021;3(6):e383-e396. [FREE Full text] [CrossRef] [Medline]
  98. Oliver A, Mossialos E, Robinson R. Health technology assessment and its influence on health-care priority setting. Int J Technol Assess Health Care. 2004;20(1):1-10. [CrossRef] [Medline]
  99. Mehrotra A, Bhatia RS, Snoswell CL. Paying for telemedicine after the pandemic. JAMA. Feb 02, 2021;325(5):431-432. [FREE Full text] [CrossRef] [Medline]
  100. van Kessel R, Hrzic R, O'Nuallain E, Weir E, Wong BL, Anderson M, et al. Digital health paradox: international policy perspectives to address increased health inequalities for people living with disabilities. J Med Internet Res. Feb 22, 2022;24(2):e33819. [FREE Full text] [CrossRef] [Medline]
  101. van Kessel R, Wong BL, Clemens T, Brand H. Digital health literacy as a super determinant of health: more than simply the sum of its parts. Internet Interv. Feb 07, 2022;27:100500. [FREE Full text] [CrossRef] [Medline]
  102. van Kessel R, Wong BL, Forman R, Gabrani J, Mossialos E. The European health data space fails to bridge digital divides. BMJ. Jul 08, 2022;378:e071913. [CrossRef] [Medline]
  103. Vallespin B, Cornet J, Kotzeva A. Ensuring evidence-based safe and effective mHealth applications. Stud Health Technol Inform. 2016;222:248-261. [Medline]
  104. Asthana S, Jones R, Sheaff R. Why does the NHS struggle to adopt eHealth innovations? A review of macro, meso and micro factors. BMC Health Serv Res. Dec 21, 2019;19(1):984. [FREE Full text] [CrossRef] [Medline]
  105. van Hattem NE, Silven AV, Bonten TN, Chavannes NH. COVID-19's impact on the future of digital health technology in primary care. Fam Pract. Nov 24, 2021;38(6):845-847. [FREE Full text] [CrossRef] [Medline]
  106. Williams G, Fahy N, Aissat D, Lenormand M, Stüwe L, Zablit-Schmidt I, et al. COVID-19 and the use of digital health tools: opportunity amid crisis that could transform health care delivery. Eurohealth. 2022;28(1):29-34. [FREE Full text]
  107. Podlewska AM, van Wamelen DJ. Parkinson's disease and COVID-19: the effect and use of telemedicine. Int Rev Neurobiol. 2022;165:263-281. [FREE Full text] [CrossRef] [Medline]
  108. Gerke S, Stern AD, Minssen T. Germany's digital health reforms in the COVID-19 era: lessons and opportunities for other countries. NPJ Digit Med. Jul 10, 2020;3:94. [FREE Full text] [CrossRef] [Medline]
  109. Stern AD, Brönneke J, Debatin JF, Hagen J, Matthies H, Patel S, et al. Advancing digital health applications: priorities for innovation in real-world evidence generation. Lancet Digit Health. Mar 2022;4(3):e200-e206. [FREE Full text] [CrossRef] [Medline]
  110. Genovese S, Bengoa R, Bowis J, Harney M, Hauck B, Pinget M, et al. The European health data space: a step towards digital and integrated care systems. J Integr Care. Oct 12, 2022;30(4):363-372. [FREE Full text] [CrossRef]
  111. Peek N, Sujan M, Scott P. Digital health and care in pandemic times: impact of COVID-19. BMJ Health Care Inform. Jun 2020;27(1):e100166. [FREE Full text] [CrossRef] [Medline]
  112. Ruwaard J, Kok R. View of wild west eHealth: time to hold our horses? Eur Health Psychol. 2015;17(1):45-49. [FREE Full text]
  113. Aremu EO, Heffernan JL, Kvedar JC. The difference in practice expense costs between telehealth and in-office care could serve as the basis for differential reimbursement structures. Telemed J E Health. Jun 2022;28(6):912-916. [CrossRef] [Medline]
  114. Bashshur RL, Doarn CR, Frenk JM, Kvedar JC, Shannon GW, Woolliscroft JO. Beyond the COVID pandemic, telemedicine, and health care. Telemed J E Health. Nov 2020;26(11):1310-1313. [CrossRef] [Medline]
  115. Bediang G, Perrin C, Ruiz de Castañeda R, Kamga Y, Sawadogo A, Bagayoko CO, et al. The RAFT telemedicine network: lessons learnt and perspectives from a decade of educational and clinical services in low- and middle-incomes countries. Front Public Health. Oct 07, 2014;2:180. [FREE Full text] [CrossRef] [Medline]
  116. Brooks E, Turvey C, Augusterfer EF. Provider barriers to telemental health: obstacles overcome, obstacles remaining. Telemed J E Health. Jun 2013;19(6):433-437. [CrossRef] [Medline]
  117. Cohen AB, Stump L, Krumholz HM, Cartiera M, Jain S, Scott Sussman L, et al. Aligning mission to digital health strategy in academic medical centers. NPJ Digit Med. Jun 02, 2022;5(1):67. [FREE Full text] [CrossRef] [Medline]
  118. Smuck M, Odonkor CA, Wilt JK, Schmidt N, Swiernik MA. The emerging clinical role of wearables: factors for successful implementation in healthcare. NPJ Digit Med. Mar 10, 2021;4(1):45. [FREE Full text] [CrossRef] [Medline]
  119. Haque SN. Telehealth beyond COVID-19. Psychiatr Serv. Jan 01, 2021;72(1):100-103. [CrossRef] [Medline]
  120. Tenderich A. Virtual nation: telemedicine's breakout moment. J Diabetes Sci Technol. Jul 2020;14(4):799-800. [FREE Full text] [CrossRef] [Medline]
  121. Alami H, Lehoux P, Auclair Y, de Guise M, Gagnon MP, Shaw J, et al. Artificial intelligence and health technology assessment: anticipating a new level of complexity. J Med Internet Res. Jul 07, 2020;22(7):e17707. [FREE Full text] [CrossRef] [Medline]
  122. Stroetmann KA. Achieving the integrated and smart health and wellbeing paradigm: a call for policy research and action on governance and business models. Int J Med Inform. Apr 2013;82(4):e29-e37. [CrossRef] [Medline]
  123. Flannery D, Jarrin R. Building a regulatory and payment framework flexible enough to withstand technological progress. Health Aff (Millwood). Dec 2018;37(12):2052-2059. [CrossRef] [Medline]
  124. Tracy J, Rheuban K, Waters RJ, DeVany M, Whitten P. Critical steps to scaling telehealth for national reform. Telemed J E Health. Nov 2008;14(9):990-994. [CrossRef] [Medline]
  125. Fried BM, Weinreich G, Cavalier GM, Lester KJ. e-Health: technologic revolution meets regulatory constraint. Health Aff (Millwood). Nov 2000;19(6):124-131. [CrossRef] [Medline]
  126. Jenkins M, Levy J, Cohen E, Yoon S, Singer J, Mostashari F. Integration of self-management tools in personal and provider e-health records. Stud Health Technol Inform. 2009;146:179-184. [Medline]
  127. Ben-Zeev D. Mobile health for all: public-private partnerships can create a new mental health landscape. JMIR Ment Health. Jun 06, 2016;3(2):e26. [FREE Full text] [CrossRef] [Medline]
  128. Woods L, Eden R, Canfell OJ, Nguyen KH, Comans T, Sullivan C. Show me the money: how do we justify spending health care dollars on digital health? Med J Aust. Feb 06, 2023;218(2):53-57. [FREE Full text] [CrossRef] [Medline]
  129. Alverson DC, Edison K, Flournoy L, Korte B, Magruder C, Miller C. Telehealth tools for public health, emergency, or disaster preparedness and response: a summary report. Telemed J E Health. Jan 2010;16(1):112-114. [CrossRef] [Medline]
  130. Speedie SM, Ferguson AS, Sanders J, Doarn CR. Telehealth: the promise of new care delivery models. Telemed J E Health. Nov 2008;14(9):964-967. [CrossRef] [Medline]
  131. North F, Crane SJ, Takahashi PY, Ward WJ, Tulledge-Scheitel SM, Ytterberg K, et al. Telemedicine barriers associated with regional quality measures. Telemed J E Health. Feb 2014;20(2):179-181. [CrossRef] [Medline]
  132. Myers KM, Lieberman D. Telemental health: responding to mandates for reform in primary healthcare. Telemed J E Health. Jun 2013;19(6):438-443. [CrossRef] [Medline]
  133. Rajda J, Paz HL. The future of virtual care services: a payor's perspective. Telemed J E Health. Mar 2020;26(3):267-269. [CrossRef] [Medline]
  134. Amorim P, Brito D, Castelo-Branco M, Fàbrega C, Gomes da Costa F, Martins H, et al. Telehealth opportunities in the COVID-19 pandemic early days: what happened, did not happen, should have happened, and must happen in the near future? Telemed J E Health. Oct 2021;27(10):1194-1199. [CrossRef] [Medline]
  135. Bonnechère B, Kossi O, Mapinduzi J, Panda J, Rintala A, Guidetti S, et al. Mobile health solutions: an opportunity for rehabilitation in low- and middle income countries? Front Public Health. Jan 24, 2022;10:1072322. [FREE Full text] [CrossRef] [Medline]
  136. Canfell OJ, Littlewood R, Burton-Jones A, Sullivan C. Digital health and precision prevention: shifting from disease-centred care to consumer-centred health. Aust Health Rev. Jun 2022;46(3):279-283. [CrossRef] [Medline]
  137. D'Anza B, Pronovost PJ. Digital health: unlocking value in a post-pandemic world. Popul Health Manag. Feb 2022;25(1):11-22. [CrossRef] [Medline]
  138. van Eijk RP, Beelen A, Kruitwagen ET, Murray D, Radakovic R, Hobson E, et al. A road map for remote digital health technology for motor neuron disease. J Med Internet Res. Sep 22, 2021;23(9):e28766. [FREE Full text] [CrossRef] [Medline]
  139. Jagannath S, Mikhael J, Nadeem O, Raje N. Digital health for patients with multiple myeloma: an unmet need. JCO Clin Cancer Inform. Oct 2021;5:1096-1105. [FREE Full text] [CrossRef] [Medline]
  140. Patel S, Goldsack JC, Cordovano G, Downing A, Fields KK, Geoghegan C, et al. Advancing digital health innovation in Oncology: priorities for high-value digital transformation in cancer care. J Med Internet Res. Jan 04, 2023;25:e43404. [FREE Full text] [CrossRef] [Medline]
  141. Strauss G, Flannery JE, Vierra E, Koepsell X, Berglund E, Miller I, et al. Meaningful engagement: a crossfunctional framework for digital therapeutics. Front Digit Health. Aug 11, 2022;4:890081. [FREE Full text] [CrossRef] [Medline]
  142. Willis HA, Gonzalez JC, Call CC, Quezada D, Scholars For Elevating Equity And Diversity Seed; Galán CA. Scholars for Elevating Equity and Diversity (SEED), Galán CA. Culturally responsive telepsychology and mHealth interventions for racial-ethnic minoritized youth: research gaps and future directions. J Clin Child Adolesc Psychol. Nov 2022;51(6):1053-1069. [CrossRef] [Medline]
  143. Zhang Y, Chandra S, Peña MT, Lal L, Summers RL, Swint JM. Framework for evaluating and developing sustainable telehealth programs. Telemed J E Health (Forthcoming). Jan 30, 2023 [CrossRef] [Medline]
  144. Jayawardana S, Mossialos E. How should economic evaluation be used to measure value and set priorities in health care? AMA J Ethics. Aug 01, 2021;23(8):E613-E618. [FREE Full text] [CrossRef] [Medline]
  145. Della Vecchia C, Leroy T, Bauquier C, Pannard M, Sarradon-Eck A, Darmon D, et al. Willingness of French general practitioners to prescribe mHealth apps and devices: quantitative study. JMIR Mhealth Uhealth. Feb 11, 2022;10(2):e28372. [FREE Full text] [CrossRef] [Medline]
  146. Muehlensiepen F, Knitza J, Marquardt W, Engler J, Hueber A, Welcker M. Acceptance of telerheumatology by rheumatologists and general practitioners in Germany: nationwide cross-sectional survey study. J Med Internet Res. Mar 29, 2021;23(3):e23742. [FREE Full text] [CrossRef] [Medline]
  147. Treskes RW, Wildbergh TX, Schalij MJ, Scherptong RW. Expectations and perceived barriers to widespread implementation of eHealth in cardiology practice: results from a national survey in the Netherlands. Neth Heart J. Jan 2019;27(1):18-23. [FREE Full text] [CrossRef] [Medline]
  148. Antoniotti NM, Drude KP, Rowe N. Private payer telehealth reimbursement in the United States. Telemed J E Health. Jun 2014;20(6):539-543. [CrossRef] [Medline]
  149. Avanesova AA, Shamliyan TA. Worldwide implementation of telemedicine programs in association with research performance and health policy. Health Policy Technol. Jun 2019;8(2):179-191. [FREE Full text] [CrossRef]
  150. Bos WH, van Tubergen A, Vonkeman HE. Telemedicine for patients with rheumatic and musculoskeletal diseases during the COVID-19 pandemic; a positive experience in the Netherlands. Rheumatol Int. Mar 2021;41(3):565-573. [FREE Full text] [CrossRef] [Medline]
  151. Brady CJ, D'Amico S, Withers N, Kim BY. Using public datasets to identify priority areas for ocular telehealth. Telemed J E Health. Nov 2021;27(11):1293-1298. [FREE Full text] [CrossRef] [Medline]
  152. Yu Q, Zhu C, Feng S, Xu L, Hu S, Chen H, et al. Economic burden and health care access for patients with inflammatory bowel diseases in China: web-based survey study. J Med Internet Res. Jan 05, 2021;23(1):e20629. [FREE Full text] [CrossRef] [Medline]
  153. Harju A, Neufeld J. The impact of the Medicaid expansion on telemental health utilization in four midwestern states. Telemed J E Health. Nov 2021;27(11):1260-1267. [CrossRef] [Medline]
  154. Zhao M, Hamadi H, Haley DR, Xu J, White-Williams C, Park S. Telehealth: advances in alternative payment models. Telemed J E Health. Dec 2020;26(12):1492-1499. [CrossRef] [Medline]
  155. Ranganathan C, Balaji S. Key factors affecting the adoption of telemedicine by ambulatory clinics: insights from a statewide survey. Telemed J E Health. Feb 2020;26(2):218-225. [CrossRef] [Medline]
  156. Alishahi Tabriz A, Turner K, Williams Jr D, Babu N, North S, Shea CM. Association of financial factors and telemedicine adoption for heart attack and stroke care among rural and urban hospitals: a longitudinal study. Telemed J E Health. Jun 2022;28(6):781-788. [FREE Full text] [CrossRef] [Medline]
  157. Ágh T, Hadžiabdić MO, Garuoliene K, Granas AG, Aarnio E, Menditto E, et al. European Network to Advance Best Practices and Technology on Medication Adherence (ENABLE). Reimbursed medication adherence enhancing interventions in European countries: results of the EUREcA study. Front Pharmacol. Jun 17, 2022;13:892240. [FREE Full text] [CrossRef] [Medline]
  158. Smith AC, Armfield NR, Croll J, Gray LC. A review of Medicare expenditure in Australia for psychiatric consultations delivered in person and via videoconference. J Telemed Telecare. Apr 2012;18(3):169-171. [CrossRef] [Medline]
  159. Philippi P, Baumeister H, Apolinário-Hagen J, Ebert DD, Hennemann S, Kott L, et al. Acceptance towards digital health interventions - model validation and further development of the unified theory of acceptance and use of technology. Internet Interv. Sep 20, 2021;26:100459. [FREE Full text] [CrossRef] [Medline]
  160. Powers B, Bucher A. An economic impact model for estimating the value to health systems of a digital intervention for diabetes primary care: development and usefulness study. JMIR Form Res. Sep 26, 2022;6(9):e37745. [FREE Full text] [CrossRef] [Medline]
  161. Borowiack E, Marzec M, Nowotarska A, Jarosz J, Orkisz A, Prząda-Machno P. Chance of reimbursement for ADD-ON therapies in Poland and in the world - review of the reimbursement recommendations. Przegl Epidemiol. 2018;72(1):99-109. [FREE Full text] [Medline]
  162. Ganapathy K, Das S, Reddy S, Thaploo V, Nazneen A, Kosuru A, et al. Digital health care in public private partnership mode. Telemed J E Health. Dec 2021;27(12):1363-1371. [CrossRef] [Medline]
  163. Lewis T, Synowiec C, Lagomarsino G, Schweitzer J. E-health in low- and middle-income countries: findings from the center for health market innovations. Bull World Health Organ. May 01, 2012;90(5):332-340. [FREE Full text] [CrossRef] [Medline]
  164. Moro Visconti R, Morea D. Healthcare digitalization and pay-for-performance incentives in smart hospital project financing. Int J Environ Res Public Health. Mar 30, 2020;17(7):2318. [FREE Full text] [CrossRef] [Medline]
  165. Wu H, Deng Z, Wang B, Gupta S. How does service price influence patients’ decisions? An examination of the free-market pricing mechanism in online health communities. Electron Mark. Mar 12, 2021;31:877-893. [FREE Full text] [CrossRef]
  166. Jamaladin H, van de Belt TH, Luijpers LC, de Graaff FR, Bredie SJ, Roeleveld N, et al. Mobile apps for blood pressure monitoring: systematic search in app stores and content analysis. JMIR Mhealth Uhealth. Nov 14, 2018;6(11):e187. [FREE Full text] [CrossRef] [Medline]
  167. Whitten P, Buis L. Private payer reimbursement for telemedicine services in the United States. Telemed J E Health. Feb 2007;13(1):15-23. [CrossRef] [Medline]
  168. Wu H, Lu N. Service provision, pricing, and patient satisfaction in online health communities. Int J Med Inform. Feb 2018;110:77-89. [CrossRef] [Medline]
  169. Neufeld JD, Doarn CR, Aly R. State policies influence Medicare telemedicine utilization. Telemed J E Health. Jan 2016;22(1):70-74. [CrossRef] [Medline]
  170. Neufeld JD, Doarn CR. Telemedicine spending by Medicare: a snapshot from 2012. Telemed J E Health. Aug 2015;21(8):686-693. [CrossRef] [Medline]
  171. Bynum AB, Irwin CA, Cranford CO, Denny GS. The impact of telemedicine on patients' cost savings: some preliminary findings. Telemed J E Health. 2003;9(4):361-367. [CrossRef] [Medline]
  172. Rajan B, Sainathan A, Agnihothri S, Cui L. The promise of mHealth for chronic disease management under different payment systems. Manuf Serv Oper Manag. 2022;24(6):3158-3176. [FREE Full text] [CrossRef]
  173. Qin X, Hsieh CR. Understanding and addressing the treatment gap in mental healthcare: economic perspectives and evidence from China. Inquiry. Jan 2020;57:46958020950566. [FREE Full text] [CrossRef] [Medline]
  174. Nuño-Solinís R, Urizar E, Merino M, Del Barrio J, Errea Rodríguez M. Validation study of a value-based digital health questionnaire. Int J Environ Res Public Health. Jun 08, 2022;19(12):7034. [FREE Full text] [CrossRef] [Medline]
  175. Ajayi KV, Wachira E, Onyeaka HK, Montour T, Olowolaju S, Garney W. The use of digital health tools for health promotion among women with and without chronic diseases: insights from the 2017-2020 health information national trends survey. JMIR Mhealth Uhealth. Aug 19, 2022;10(8):e39520. [FREE Full text] [CrossRef] [Medline]
  176. Bärlund M, Takala L, Tianen L, Kellokumpu-Lehtinen PL. Real-world evidence of implementing eHealth enables fluent symptom-based follow-up of a growing number of patients with breast cancer with the same healthcare resources. Clin Breast Cancer. Apr 2022;22(3):261-268. [FREE Full text] [CrossRef] [Medline]
  177. Ector GI, Verweij L, Hermens RP, Blijlevens NM. Filling the gaps of patient information needs and information perception in chronic myeloid leukemia with the patient-physician co-produced web-based platform CMyLife. Patient Educ Couns. Mar 2022;105(3):686-694. [FREE Full text] [CrossRef] [Medline]
  178. Khairat S, Wallace E, Bohlmann A, Zebrowski A, Stabile K, Yao Y, et al. Digital health experiences of incarcerated populations using telemedicine in North Carolina prisons. J Patient Exp. Apr 19, 2022;9:23743735221092611. [FREE Full text] [CrossRef] [Medline]
  179. Liou H, Lane C, Huang C, Mookadam M, Joseph M, Hecker DuVal J. Eye movement desensitization and reprocessing in a primary care setting: assessing utility and comparing efficacy of virtual versus in-person methods. Telemed J E Health. Sep 2022;28(9):1359-1366. [CrossRef] [Medline]
  180. Papavero S, Fracasso A, Ramaglia P, Cicchetti A, de Belvis AG, Ferrara FM. Telemedicine has a social impact: an Italian national study for the evaluation of the cost-opportunity for patients and caregivers and the measurement of carbon emission savings. Telemed J E Health (Forthcoming). Jan 13, 2023 [CrossRef] [Medline]
  181. Radó N, Girasek E, Békási S, Győrffy Z. Digital technology access and health-related internet use among people experiencing homelessness in Hungary: quantitative survey. J Med Internet Res. Oct 19, 2022;24(10):e38729. [FREE Full text] [CrossRef] [Medline]
  182. Ratcliff CL, Krakow M, Greenberg-Worisek A, Hesse BW. Digital health engagement in the us population: insights from the 2018 health information national trends survey. Am J Public Health. Jul 2021;111(7):1348-1351. [CrossRef] [Medline]
  183. Rossano A, Crijns T, Ring D, Reichenberg J. Clinician preferences for current and planned future use of telemedicine. Telemed J E Health. Sep 2022;28(9):1293-1299. [CrossRef] [Medline]
  184. Teferi GH, Tilahun BC, Guadie HA, Amare AT. Smartphone medical app use and associated factors among physicians at referral hospitals in Amhara region, North Ethiopia, in 2019: cross-sectional study. JMIR Mhealth Uhealth. Mar 26, 2021;9(3):e19310. [FREE Full text] [CrossRef] [Medline]
  185. Tilahun BB, Thompson NR, Bautista JF, Sankary LR, Stanton S, Punia V. Telepsychology may improve treatment adherence in patients with psychogenic nonepileptic seizures. Telemed J E Health. Aug 2022;28(8):1159-1165. [CrossRef] [Medline]
  186. Uncovska M, Freitag B, Meister S, Fehring L. Patient acceptance of prescribed and fully reimbursed mHealth apps in Germany: an UTAUT2-based online survey study. J Med Syst. Jan 27, 2023;47(1):14. [FREE Full text] [CrossRef] [Medline]
  187. Bouvet R, Desmarais P, Minvielle E. Legal and organizational barriers to the development of eHealth in France. Med Law. Sep 2015;34(1):361-379. [Medline]
  188. Peeters JM, Krijgsman JW, Brabers AE, Jong JD, Friele RD. Use and uptake of eHealth in general practice: a cross-sectional survey and focus group study among health care users and general practitioners. JMIR Med Inform. Apr 06, 2016;4(2):e11. [FREE Full text] [CrossRef] [Medline]
  189. Swinkels IC, Huygens MW, Schoenmakers TM, Oude Nijeweme-D'Hollosy W, van Velsen L, Vermeulen J, et al. Lessons learned from a living lab on the broad adoption of eHealth in primary health care. J Med Internet Res. Mar 29, 2018;20(3):e83. [FREE Full text] [CrossRef] [Medline]
  190. Silven AV, Petrus AH, Villalobos-Quesada M, Dirikgil E, Oerlemans CR, Landstra CP, et al. Telemonitoring for patients with COVID-19: recommendations for design and implementation. J Med Internet Res. Sep 02, 2020;22(9):e20953. [FREE Full text] [CrossRef] [Medline]
  191. Dritsakis G, Trenkova L, Śliwińska-Kowalska M, Brdarić D, Pontoppidan NH, Katrakazas P, et al. Public health policy-making for hearing loss: stakeholders' evaluation of a novel eHealth tool. Health Res Policy Syst. Oct 29, 2020;18(1):125. [FREE Full text] [CrossRef] [Medline]
  192. Brebner JA, Brebner EM, Ruddick-Bracken H. Experience-based guidelines for the implementation of telemedicine services. J Telemed Telecare. 2005;11 Suppl 1:3-5. [CrossRef] [Medline]
  193. Freund J, Buntrock C, Braun L, Thielecke J, Baumeister H, Berking M, et al. Digital prevention of depression for farmers? A qualitative study on participants' experiences regarding determinants of acceptance and satisfaction with a tailored guided internet intervention program. Internet Interv. Aug 09, 2022;29:100566. [FREE Full text] [CrossRef] [Medline]
  194. Yagiz JI, Goderis G. The impact of the COVID-19 pandemic on eHealth use in the daily practice and life of Dutch-speaking general practitioners in Belgium: qualitative study with semistructured interviews. JMIR Form Res. Nov 28, 2022;6(11):e41847. [FREE Full text] [CrossRef] [Medline]
  195. Spanhel K, Schweizer JS, Wirsching D, Lehr D, Baumeister H, Bengel J, et al. Cultural adaptation of internet interventions for refugees: results from a user experience study in Germany. Internet Interv. May 21, 2019;18:100252. [FREE Full text] [CrossRef] [Medline]
  196. Dahlhausen F, Zinner M, Bieske L, Ehlers JP, Boehme P, Fehring L. Physicians' attitudes toward prescribable mHealth apps and implications for adoption in Germany: mixed methods study. JMIR Mhealth Uhealth. Nov 23, 2021;9(11):e33012. [FREE Full text] [CrossRef] [Medline]
  197. Dahlhausen F, Zinner M, Bieske L, Ehlers JP, Boehme P, Fehring L. There's an app for that, but nobody's using it: insights on improving patient access and adherence to digital therapeutics in Germany. Digit Health. Jul 03, 2022;8:20552076221104672. [FREE Full text] [CrossRef] [Medline]
  198. Voogt MP, Opmeer BC, Kastelein AW, Jaspers M, Peute L. Obstacles to Successful Implementation of eHealth Applications into Clinical Practice. Stud Health Technol Inform. 2018;247:521-525. [Medline]
  199. Cremers HP, Theunissen L, Hiddink J, Kemps H, Dekker L, van de Ven R, et al. Successful implementation of eHealth interventions in healthcare: development of an eHealth implementation guideline. Health Serv Manage Res. Nov 2021;34(4):269-278. [CrossRef] [Medline]
  200. Bally EL, Cesuroglu T. Toward integration of mHealth in primary care in the Netherlands: a qualitative analysis of stakeholder perspectives. Front Public Health. Jan 15, 2020;7:407. [FREE Full text] [CrossRef] [Medline]
  201. Agbakoba R, McGee-Lennon M, Bouamrane MM, Watson N, Mair F. Implementing a national Scottish digital health and wellbeing service at scale: a qualitative study of stakeholders' views. Stud Health Technol Inform. 2015;216:487-491. [Medline]
  202. Webers C, Beckers E, Boonen A, van Eijk-Hustings Y, Vonkeman H, van de Laar M, et al. Development, usability and acceptability of an integrated eHealth system for spondyloarthritis in the Netherlands (SpA-Net). RMD Open. Apr 11, 2019;5(1):e000860. [FREE Full text] [CrossRef] [Medline]
  203. Christie HL, Boots LM, Peetoom K, Tange HJ, Verhey FR, de Vugt ME. Developing a plan for the sustainable implementation of an electronic health intervention (partner in balance) to support caregivers of people with dementia: case study. JMIR Aging. Jun 25, 2020;3(1):e18624. [FREE Full text] [CrossRef] [Medline]
  204. Bae YS, Kim KH, Choi SW, Ko T, Lim JS, Piao M. Satisfaction and usability of an information and communications technology-based system by clinically healthy patients with COVID-19 and medical professionals: cross-sectional survey and focus group interview study. JMIR Form Res. Aug 26, 2021;5(8):e26227. [FREE Full text] [CrossRef] [Medline]
  205. Velayati F, Ayatollahi H, Hemmat M, Dehghan R. Key components and critical factors for developing a telehealth business framework: a qualitative study. BMC Med Inform Decis Mak. Dec 04, 2021;21(1):339. [FREE Full text] [CrossRef] [Medline]
  206. Schoebel V, Wayment C, Gaiser M, Page C, Buche J, Beck AJ. Telebehavioral health during the COVID-19 pandemic: a qualitative analysis of provider experiences and perspectives. Telemed J E Health. Aug 2021;27(8):947-954. [CrossRef] [Medline]
  207. Lin JC, Humphries MD, Shutze WP, Aalami OO, Fischer UM, Hodgson KJ. Telemedicine platforms and their use in the coronavirus disease-19 era to deliver comprehensive vascular care. J Vasc Surg. Feb 2021;73(2):392-398. [FREE Full text] [CrossRef] [Medline]
  208. Hermaszewska S, Sin J. End-user perspectives on the development of an online intervention for parents of children on the autism spectrum. Autism. Jul 2021;25(5):1234-1245. [FREE Full text] [CrossRef] [Medline]
  209. Faes L, Rosenblatt A, Schwartz R, Touhami S, Ventura CV, Chatziralli IP, et al. International Retinal Collaborative. Overcoming barriers of retinal care delivery during a pandemic-attitudes and drivers for the implementation of digital health: a global expert survey. Br J Ophthalmol. Dec 2021;105(12):1738-1743. [CrossRef] [Medline]
  210. Moshi MR, Tooher R, Merlin T. Development of a health technology assessment module for evaluating mobile medical applications. Int J Technol Assess Health Care. Jun 2020;36(3):252-261. [CrossRef] [Medline]
  211. Thielscher C, Doarn CR. Long-term future of telemedicine in Germany: the patient's, physician's, and payer's perspective. Telemed J E Health. Sep 2008;14(7):701-706. [CrossRef] [Medline]
  212. Powell AC, Bowman MB, Harbin HT. Reimbursement of apps for mental health: findings from interviews. JMIR Ment Health. Aug 06, 2019;6(8):e14724. [FREE Full text] [CrossRef] [Medline]
  213. Belghiti J, Oget-Gendre C, Berthon AF, Fagon JY. Supporting innovation in health care: a short experience in a dedicated unit of the French ministry of public health. J Visc Surg. Jun 2021;158(3S):S6-11. [CrossRef] [Medline]
  214. Al-Mondhiry J, D'Ambruoso S, Pietras C, Strouse T, Benzeevi D, Arevian AC, et al. Co-created mobile apps for palliative care using community-partnered participatory research: development and usability study. JMIR Form Res. Jun 23, 2022;6(6):e33849. [FREE Full text] [CrossRef] [Medline]
  215. Eaves ER, Doerry E, Lanzetta SA, Kruithoff KM, Negron K, Dykman K, et al. Applying user-centered design in the development of a supportive mHealth app for women in substance use recovery. Am J Health Promot. Jan 2023;37(1):56-64. [FREE Full text] [CrossRef] [Medline]
  216. Lackie ME, Parrilla JS, Lavery BM, Kennedy AL, Ryan D, Shulman B, et al. Digital health needs of women with postpartum depression: focus group study. J Med Internet Res. Jan 06, 2021;23(1):e18934. [FREE Full text] [CrossRef] [Medline]
  217. Meyer CL, Surmeli A, Hoeflin Hana C, Narla NP. Perceptions on a mobile health intervention to improve maternal child health for Syrian refugees in Turkey: opportunities and challenges for end-user acceptability. Front Public Health. Nov 22, 2022;10:1025675. [FREE Full text] [CrossRef] [Medline]
  218. Panda N, Sinyard R, Margo J, Henrich N, Cauley CE, Onnela JP, et al. Perceptions of mobile health technology in elective surgery: a qualitative study of north American surgeons. Ann Surg. Mar 01, 2023;277(3):423-428. [CrossRef] [Medline]
  219. Shih P, Prokopovich K, Degeling C, Street J, Carter SM. Direct-to-consumer detection of atrial fibrillation in a smartwatch electrocardiogram: medical overuse, medicalisation and the experience of consumers. Soc Sci Med. Jun 2022;303:114954. [CrossRef] [Medline]
  220. Smits M, Nacar M, D S Ludden G, van Goor H. Stepwise design and evaluation of a values-oriented ambient intelligence healthcare monitoring platform. Value Health. Jun 2022;25(6):914-923. [FREE Full text] [CrossRef] [Medline]
  221. Van Grootven B, Irusta LA, Christiaens W, Mistiaen P, De Meester C, Cornelis J, et al. Experiences with the implementation of remote monitoring in patients with COVID-19: a qualitative study with patients and healthcare professionals. J Nurs Scholarsh. Jan 2023;55(1):67-78. [FREE Full text] [CrossRef] [Medline]
  222. van Velthoven MH, Cordon C, Challagalla G. Digitization of healthcare organizations: the digital health landscape and information theory. Int J Med Inform. Apr 2019;124:49-57. [CrossRef] [Medline]
  223. Salas-Vega S, Haimann A, Mossialos E. Big data and health care: challenges and opportunities for coordinated policy development in the EU. Health Syst Reform. May 19, 2015;1(4):285-300. [CrossRef] [Medline]
  224. Recognising the value of digital health apps: an assessment of five European healthcare systems. MedTech Europe. Nov 16, 2021. URL: https:/​/www.​medtecheurope.org/​wp-content/​uploads/​2021/​11/​2111_v4.​8_mte_dht_reimbursement16.​11.​2021-2.​pdf [accessed 2022-11-11]
  225. From innovation to implementation: eHealth in the WHO European region. World Health Organization. 2016. URL: https://apps.who.int/iris/bitstream/handle/10665/326317/9789289051378-eng.pdf [accessed 2022-12-15]
  226. Schliess F, Affini Dicenzo T, Gaus N, Bourez JM, Stegbauer C, Szecsenyi J, et al. The German fast track toward reimbursement of Digital Health Applications (DiGA): opportunities and challenges for manufacturers, healthcare providers, and people with diabetes. J Diabetes Sci Technol (Forthcoming). Sep 03, 2022:19322968221121660. [FREE Full text] [CrossRef] [Medline]
  227. Lluch M. Incentives for telehealthcare deployment that support integrated care: a comparative analysis across eight European countries. Int J Integr Care. Nov 04, 2013;13:e042. [FREE Full text] [CrossRef] [Medline]
  228. Holterman S, Hettinga M, Buskens E, Lahr M. Factors influencing procurement of digital healthcare: a case study in Dutch district nursing. Int J Health Policy Manag. Aug 29, 2021;11(9):1883-1893. [FREE Full text] [CrossRef] [Medline]
  229. Gensorowsky D, Witte J, Batram M, Greiner W. Market access and value-based pricing of digital health applications in Germany. Cost Eff Resour Alloc. Jun 13, 2022;20(1):25. [FREE Full text] [CrossRef] [Medline]
  230. Christie HL, Boots LM, Hermans I, Govers M, Tange HJ, Verhey FR, et al. Business models of eHealth interventions to support informal caregivers of people with dementia in the Netherlands: analysis of case studies. JMIR Aging. Jun 03, 2021;4(2):e24724. [FREE Full text] [CrossRef] [Medline]
  231. Ahlqvist J, Kalliola M. How can digital therapeutics help Europe? Sitra. 2021. URL: https://www.sitra.fi/app/uploads/2021/11/sitra-how-can-digital-therapeutics-help-europe.pdf [accessed 2022-12-30]
  232. Powell AC, Torous JB, Firth J, Kaufman KR. Generating value with mental health apps. BJPsych Open. Feb 05, 2020;6(2):e16. [FREE Full text] [CrossRef] [Medline]
  233. Reid HW, Proeschold-Bell RJ, Makarushka C, Melgar Vega KD, Huchko M, Jeronimo J, et al. Using the consolidated framework for implementation research to inform the design of the mobile Inspección Visual con Ácido Acético system: mixed methods case study. JMIR Form Res. Jun 23, 2022;6(6):e32577. [FREE Full text] [CrossRef] [Medline]
  234. Bush J, Barlow DE, Echols J, Wilkerson J, Bellevin K. Impact of a mobile health application on user engagement and pregnancy outcomes among Wyoming Medicaid members. Telemed J E Health. Nov 2017;23(11):891-898. [FREE Full text] [CrossRef] [Medline]
  235. Drake C, Lian T, Cameron B, Medynskaya K, Bosworth HB, Shah K. Understanding telemedicine's "new normal": variations in telemedicine use by specialty line and patient demographics. Telemed J E Health. Jan 2022;28(1):51-59. [FREE Full text] [CrossRef] [Medline]
  236. Tzeng YH, Yin WH, Lin KC, Wei J, Liou HR, Sung HJ, et al. Factors associated with the utilization of outpatient virtual clinics: retrospective observational study using multilevel analysis. J Med Internet Res. Aug 12, 2022;24(8):e40288. [FREE Full text] [CrossRef] [Medline]
  237. Dansky KH, Palmer L, Shea D, Bowles KH. Cost analysis of telehomecare. Telemed J E Health. 2001;7(3):225-232. [CrossRef] [Medline]
  238. Armstrong AW, Dorer DJ, Lugn NE, Kvedar JC. Economic evaluation of interactive teledermatology compared with conventional care. Telemed J E Health. Apr 2007;13(2):91-99. [CrossRef] [Medline]
  239. Das S, Wang J, Chen SY, Chen CE. Telemental health collaborative care medication management: implementation and outcomes. Telemed J E Health. Jul 2022;28(7):1035-1043. [FREE Full text] [CrossRef] [Medline]
  240. Owusu JT, Wang P, Wickham RE, Varra AA, Chen C, Lungu A. Real-world evaluation of a large-scale blended care-cognitive behavioral therapy program for symptoms of anxiety and depression. Telemed J E Health. Oct 2022;28(10):1412-1420. [FREE Full text] [CrossRef] [Medline]
  241. Ritterband LM, Thorndike FP, Morin CM, Gerwien R, Enman NM, Xiong R, et al. Real-world evidence from users of a behavioral digital therapeutic for chronic insomnia. Behav Res Ther. Jun 2022;153:104084. [FREE Full text] [CrossRef] [Medline]
  242. Scheer J, Areias AC, Molinos M, Janela D, Moulder R, Lains J, et al. Engagement and utilization of a complete remote digital care program for musculoskeletal pain management in urban and rural areas across the United States: longitudinal cohort study. JMIR Mhealth Uhealth. Mar 16, 2023;11:e44316. [FREE Full text] [CrossRef] [Medline]
  243. Tan LF, Chan YH, Tay A, Jayasundram J, Low NA, Merchant RA. Practicality and reliability of self vs administered rapid geriatric assessment mobile app. J Nutr Health Aging. 2021;25(9):1064-1069. [FREE Full text] [CrossRef] [Medline]
  244. Tumeh IB, Bergerot CD, Lee D, Philip EJ, Freitas-Júnior R. mHealth program for patients with advanced cancer receiving treatment in a public health hospital in Brazil. Psychooncology. Jan 2023;32(1):125-132. [CrossRef] [Medline]
  245. Melchiorre MG, Papa R, Quattrini S, Lamura G, Barbabella F, on behalf of ICARE4EU Consortium. Integrated care programs for people with multimorbidity in European countries: eHealth adoption in health systems. Biomed Res Int. Apr 08, 2020;2020:9025326. [FREE Full text] [CrossRef] [Medline]
  246. Voncken-Brewster V, Tange H, Moser A, Nagykaldi Z, de Vries H, van der Weijden T. Integrating a tailored e-health self-management application for chronic obstructive pulmonary disease patients into primary care: a pilot study. BMC Fam Pract. Jan 08, 2014;15:4. [FREE Full text] [CrossRef] [Medline]
  247. Balchander D, Cabrera CI, Zack B, Porter S, Sunshine J, D'Anza B. Assessing telehealth through the lens of the provider: considerations for the post-COVID-19 era. Telemed J E Health. Dec 2022;28(12):1806-1816. [CrossRef] [Medline]
  248. Romm KL, Nilsen L, Gjermundsen K, Holter M, Fjell A, Melle I, et al. Remote care for caregivers of people with psychosis: mixed methods pilot study. JMIR Ment Health. Jul 28, 2020;7(7):e19497. [FREE Full text] [CrossRef] [Medline]
  249. Chukwu E, Garg L, Eze G. Mobile health insurance system and associated costs: a cross-sectional survey of primary health centers in Abuja, Nigeria. JMIR Mhealth Uhealth. May 17, 2016;4(2):e37. [FREE Full text] [CrossRef] [Medline]
  250. Ayyoubzadeh SM, Shirkhoda M, R Niakan Kalhori S, Mohammadzadeh N, Zakerabasali S. A smartphone remote monitoring app to follow up colorectal cancer survivors: requirement analysis. JMIR Cancer. Jan 05, 2022;8(1):e18083. [FREE Full text] [CrossRef] [Medline]
  251. Becker ER, Shegog R, Savas LS, Frost EL, Coan SP, Healy CM, et al. Parents' experience with a mobile health intervention to influence human papillomavirus vaccination decision making: mixed methods study. JMIR Pediatr Parent. Feb 21, 2022;5(1):e30340. [FREE Full text] [CrossRef] [Medline]
  252. LoBuono DL, Shea KS, Tovar A, Leedahl SN, Mahler L, Xu F, et al. Acceptance and perception of digital health for managing nutrition in people with Parkinson's disease and their caregivers and their digital competence in the United States: a mixed-methods study. Health Sci Rep. Nov 11, 2021;4(4):e412. [FREE Full text] [CrossRef] [Medline]
  253. Saha S, Quazi ZS. Does digitally enabling frontline health workers improve coverage and quality of maternal and child health services? Findings from a mixed methods evaluation of TECHO+ in Gujarat. Front Public Health. Jul 22, 2022;10:856561. [FREE Full text] [CrossRef] [Medline]
  254. Lewkowicz D, Wohlbrandt AM, Bottinger E. Digital therapeutic care apps with decision-support interventions for people with low back pain in Germany: cost-effectiveness analysis. JMIR Mhealth Uhealth. Feb 07, 2022;10(2):e35042. [FREE Full text] [CrossRef] [Medline]
  255. Aardoom JJ, Dingemans AE, van Ginkel JR, Spinhoven P, Van Furth EF, Van den Akker-van Marle ME. Cost-utility of an internet-based intervention with or without therapist support in comparison with a waiting list for individuals with eating disorder symptoms: a randomized controlled trial. Int J Eat Disord. Dec 2016;49(12):1068-1076. [CrossRef] [Medline]
  256. Ambrens M, van Schooten KS, Lung T, Clemson L, Close JC, Howard K, et al. Economic evaluation of the e-Health StandingTall balance exercise programme for fall prevention in people aged 70 years and over. Age Ageing. Jun 01, 2022;51(6):afac130. [CrossRef] [Medline]
  257. Li J, Sun L, Hou Y, Chen L. Cost-effectiveness analysis of a mobile-based intervention for patients with type 2 diabetes mellitus. Int J Endocrinol. Jul 01, 2021;2021:8827629. [FREE Full text] [CrossRef] [Medline]
  258. Luo X, Xu W, Ming WK, Jiang X, Yuan Q, Lai H, et al. Cost-effectiveness of mobile health-based integrated care for atrial fibrillation: model development and data analysis. J Med Internet Res. Apr 19, 2022;24(4):e29408. [FREE Full text] [CrossRef] [Medline]
  259. McManus RJ, Little P, Stuart B, Morton K, Raftery J, Kelly J, et al. HOME BP investigators. Home and Online Management and Evaluation of Blood Pressure (HOME BP) using a digital intervention in poorly controlled hypertension: randomised controlled trial. BMJ. Jan 19, 2021;372:m4858. [FREE Full text] [CrossRef] [Medline]
  260. Allen AR, Smith J, Hobbs MJ, Loughnan SA, Sharrock M, Newby JM, et al. Internet-delivered cognitive behaviour therapy for post-traumatic stress disorder: a randomised controlled trial and outcomes in routine care. Behav Cogn Psychother. Nov 2022;50(6):649-655. [CrossRef] [Medline]
  261. Loohuis AM, Van Der Worp H, Wessels NJ, Dekker JH, Slieker-Ten Hove MC, Berger MY, et al. Cost-effectiveness of an app-based treatment for urinary incontinence in comparison with care-as-usual in Dutch general practice: a pragmatic randomised controlled trial over 12 months. BJOG. Aug 2022;129(9):1538-1545. [FREE Full text] [CrossRef] [Medline]
  262. Powell J, Williams V, Atherton H, Bennett K, Yang Y, Davoudianfar M, et al. Effectiveness and cost-effectiveness of a self-guided internet intervention for social anxiety symptoms in a general population sample: randomized controlled trial. J Med Internet Res. Jan 10, 2020;22(1):e16804. [FREE Full text] [CrossRef] [Medline]
  263. Stuhlreyer J, Roder C, Krug F, Zöllner C, Flor H, Klinger R. A digital application and augmented physician rounds reduce postoperative pain and opioid consumption after primary total knee replacement (TKR): a randomized clinical trial. BMC Med. Dec 05, 2022;20(1):469. [FREE Full text] [CrossRef] [Medline]
  264. Open API architecture policy. National Health Service, England. 2014. URL: https://www.england.nhs.uk/wp-content/uploads/2018/09/open-api-policy.pdf [accessed 2022-11-30]
  265. Evidence standards framework (ESF) for digital health technologies. National Institute for Health and Care Excellence. 2018. URL: https:/​/www.​nice.org.uk/​about/​what-we-do/​our-programmes/​evidence-standards-framework-for-digital-health-technologies [accessed 2022-11-11]
  266. The Fast-Track process for digital health applications (DiGA) according to section 139e SGB V. Federal Institute for Drugs and Medical Devices. 2022. URL: https:/​/www.​bfarm.de/​SharedDocs/​Downloads/​EN/​MedicalDevices/​DiGA_Guide.​pdf?__blob=publicationFile&v=2 [accessed 2022-10-15]
  267. Cowey A. Establishing the NHS digital academy: future vision and implementation areas for expansion. National Health Service Health Education, England. 2021. URL: https:/​/digital-transformation.​hee.nhs.uk/​binaries/​content/​assets/​digital-transformation/​nhs-digital-academy/​digital-academy-future-vision-report---mar-2021.​pdf [accessed 2023-01-15]
  268. Bradford WD, Kleit A, Krousel-Wood MA, Re RM. Comparing willingness to pay for telemedicine across a chronic heart failure and hypertension population. Telemed J E Health. Aug 2005;11(4):430-438. [CrossRef] [Medline]
  269. Chang J, Savage SJ, Waldman DM. Estimating willingness to pay for online health services with discrete-choice experiments. Appl Health Econ Health Policy. Aug 2017;15(4):491-500. [CrossRef] [Medline]
  270. Chen N, Liu P. Assessing elderly user preference for telehealth solutions in China: exploratory quantitative study. JMIR Mhealth Uhealth. Jan 12, 2022;10(1):e27272. [FREE Full text] [CrossRef] [Medline]
  271. NHS apps library. National Health Service Digit. 2021. URL: https://digital.nhs.uk/services/nhs-apps-library [accessed 2023-01-31]
  272. Early Value Assessment (EVA) for medtech. National Institute for Health and Care Excellence. 2023. URL: https://www.nice.org.uk/about/what-we-do/eva-for-medtech [accessed 2023-02-20]
  273. Aanestad M, Grisot M, Hanseth O, Vassilakopoulou P. Strategies for building eHealth infrastructures. In: Information Infrastructures within European Health Care: Working with the Installed Base. Cham, Switzerland. Springer; 2017.
  274. Ramirez M, Duran MC, Pabiniak CJ, Hansen KE, Kelley A, Ralston JD, et al. Family caregiver needs and preferences for virtual training to manage behavioral and psychological symptoms of dementia: interview study. JMIR Aging. Feb 10, 2021;4(1):e24965. [FREE Full text] [CrossRef] [Medline]
  275. Cox NS, Dal Corso S, Hansen H, McDonald CF, Hill CJ, Zanaboni P, et al. Telerehabilitation for chronic respiratory disease. Cochrane Database Syst Rev. Jan 29, 2021;1(1):CD013040. [FREE Full text] [CrossRef] [Medline]
  276. Buntin MB. Confronting challenges in the US health care system: potential opportunity in a time of crisis. JAMA. Apr 13, 2021;325(14):1399-1400. [CrossRef] [Medline]
  277. VC digital health deal count by country worldwide HY1 2020. Statista. 2022. URL: https://www.statista.com/statistics/1063913/vc-backed-digital-health-deals-in-select-countries/ [accessed 2023-01-27]
  278. Tikkanen R, Osborn R, Mossialos E, Djordjevic A, Wharton G. International profiles of health care systems. The Commonwealth Fund. 2020. URL: https:/​/www.​commonwealthfund.org/​sites/​default/​files/​2020-12/​International_Profiles_of_Health_Care_Systems_Dec2020.​pdf [accessed 2022-11-26]
  279. Folland S, Goodman A, Stano M. The economics of health and health care. 8th edition. London, United Kingdom. Routledge, Taylor & Francis Group; 2017.
  280. Anderson M, Pitchforth E, Asaria M, Brayne C, Casadei B, Charlesworth A, et al. LSE-Lancet Commission on the future of the NHS: re-laying the foundations for an equitable and efficient health and care service after COVID-19. Lancet. May 22, 2021;397(10288):1915-1978. [FREE Full text] [CrossRef] [Medline]
  281. Wegwijzer bekostiging digitale zorg 2023. Dutch Healthcare Authority. 2022. URL: https://puc.overheid.nl/nza/doc/PUC_655318_22/1/ [accessed 2022-11-11]


CFIR: Consolidated Framework for Implementation Research
NHS: National Health Service
NICE: National Institute of Health and Care Excellence
PRISMA-ScR: Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews


Edited by K Williams; submitted 07.04.23; peer-reviewed by R Hrzic, E Onaku; comments to author 23.05.23; revised version received 31.05.23; accepted 16.06.23; published 25.07.23.

Copyright

©Robin van Kessel, Andres Roman-Urrestarazu, Michael Anderson, Ilias Kyriopoulos, Samantha Field, Giovanni Monti, Shelby D Reed, Milena Pavlova, George Wharton, Elias Mossialos. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 25.07.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.