This paper is in the following e-collection/theme issue:

Viewpoints and Perspectives (514) E-Health Policy and Health Systems Innovation (230) Telehealth and Telemonitoring (1671) Public Health Policy (62)

Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/46873, first published .
The Complexity of Transferring Remote Monitoring and Virtual Care Technology Between Countries: Lessons From an International Workshop

The Complexity of Transferring Remote Monitoring and Virtual Care Technology Between Countries: Lessons From an International Workshop

The Complexity of Transferring Remote Monitoring and Virtual Care Technology Between Countries: Lessons From an International Workshop

Authors of this article:

Quynh Pham1, 2, 3 Author Orcid Image ;   David Wong4, 5 Author Orcid Image ;   Kaylen J Pfisterer1, 6 Author Orcid Image ;   Dionne Aleman2, 7 Author Orcid Image ;   Nick Bansback8 Author Orcid Image ;   Joseph A Cafazzo1, 2 Author Orcid Image ;   Alexander J Casson9, 10 Author Orcid Image ;   Brian Chan11 Author Orcid Image ;   William Dixon12 Author Orcid Image ;   Gerasimos Kakaroumpas13 Author Orcid Image ;   Claudia Lindner5 Author Orcid Image ;   Niels Peek5 Author Orcid Image ;   Henry WW Potts14 Author Orcid Image ;   Barbara Ribeiro15 Author Orcid Image ;   Emily Seto1, 2 Author Orcid Image ;   Charlotte Stockton-Powdrell5 Author Orcid Image ;   Alexander Thompson16 Author Orcid Image ;   Sabine van der Veer5 Author Orcid Image
Article Authors Cited by (1) Tweetations (7) Metrics

    Viewpoint

    1Centre for Digital Therapeutics, University Health Network, Toronto, ON, Canada

    2Institute for Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada

    3Tefler School of Management, University of Ottawa, Ottawa, ON, Canada

    4Department of Computer Science, The University of Manchester, Manchester, United Kingdom

    5Division of Informatics, Imaging and Data Sciences, Faculty of Biology, Medicine and Health, Manchester Academic Health Science Centre, The University of Manchester, Manchester, United Kingdom

    6Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada

    7Department of Mechanical & Industrial Engineering, University of Toronto, Toronto, ON, Canada

    8School of Population and Public Health, University of British Columbia, Vancouver, BC, Canada

    9Department of Electrical and Electronic Engineering, The University of Manchester, Manchester, United Kingdom

    10EPSRC Henry Royce Institute, Manchester, United Kingdom

    11KITE Research Institute, Toronto Rehabilitation Institute, University Health Network, Toronto, ON, Canada

    12Centre for Epidemiology Versus Arthritis, University of Manchester, Manchester, United Kingdom

    13Alliance Manchester Business School, The University of Manchester, Manchester, United Kingdom

    14Institute of Health Informatics, University College London, London, United Kingdom

    15Manchester Institute of Innovation Research, Alliance Manchester Business School, The University of Manchester, Manchester, United Kingdom

    16Manchester Centre for Health Economics, Division of Population Health, Faculty of Biology, Medicine and Health, Manchester Academic Health Science Centre, The University of Manchester, Manchester, United Kingdom

    Corresponding Author:

    Quynh Pham, PhD

    Centre for Digital Therapeutics

    University Health Network

    R. Fraser Elliott Building, 4th Floor

    190 Elizabeth Street

    Toronto, ON, M5G 2C4

    Canada

    Phone: 1 (416) 340 4800 ext 4765

    Email: q.pham@uhn.ca


    International deployment of remote monitoring and virtual care (RMVC) technologies would efficiently harness their positive impact on outcomes. Since Canada and the United Kingdom have similar populations, health care systems, and digital health landscapes, transferring digital health innovations between them should be relatively straightforward. Yet examples of successful attempts are scarce. In a workshop, we identified 6 differences that may complicate RMVC transfer between Canada and the United Kingdom and provided recommendations for addressing them. These key differences include (1) minority groups, (2) physical geography, (3) clinical pathways, (4) value propositions, (5) governmental priorities and support for digital innovation, and (6) regulatory pathways. We detail 4 broad recommendations to plan for sustainability, including the need to formally consider how highlighted country-specific recommendations may impact RMVC and contingency planning to overcome challenges; the need to map which pathways are available as an innovator to support cross-country transfer; the need to report on and apply learnings from regulatory barriers and facilitators so that everyone may benefit; and the need to explore existing guidance to successfully transfer digital health solutions while developing further guidance (eg, extending the nonadoption, abandonment, scale-up, spread, sustainability framework for cross-country transfer). Finally, we present an ecosystem readiness checklist. Considering these recommendations will contribute to successful international deployment and an increased positive impact of RMVC technologies. Future directions should consider characterizing additional complexities associated with global transfer.

    J Med Internet Res 2023;25:e46873

    doi:10.2196/46873

    Keywords

    digital health innovation; digital health intervention; digital health landscape; digital health solution; health care system; regulatory pathway; remote monitoring; remote monitoring; technology transfer; virtual care 


    Remote monitoring and virtual care (RMVC) technologies are an increasingly common class of digital health innovation, estimated to be worth US $143 billion in 2023 [1]. RMVC technology enables patients to electronically collect health data outside of traditional care settings using internet-connected devices (eg, smartphones and sensors) and transmit these data to share it with health care professionals. This has the potential to increase access to and productivity of services and improve patient outcomes [2,3]. One way to efficiently increase the positive impact of RMVC technologies is to transfer successful products between countries. Given the similarities between Canada and the United Kingdom, one may expect the transfer of digital health innovations between the 2 countries to be relatively straightforward. Similarities pertain to payment structure and health insurance coverage, some population demographics (proportion urban, aging, etc), supports to facilitate data sharing and data-driven insights (electronic health records, data science initiatives, etc), and the presence of academic teaching hospitals (Table 1).

    Although there have been successful examples, including the Maple virtual care platform and Ieso digital cognitive behavioral therapy [4,5], these have been scarce and accompanied by similar high-profile instances in which the rollout of RMVC technologies was slower than anticipated [6]. We, therefore, aimed to increase our understanding of factors that may influence the successful transfer of RMVC technology between countries, using the transfer between Canada and the United Kingdom as an example.

    Table 1. Examples of similarities between Canada and the United Kingdom as contexts for deploying remote monitoring and virtual care (RMVC) technology.
    Area of similarityCanadaUnited Kingdom
    Health care systemCentralized and publicly funded by province or territory (eg, Ontario Health Insurance Plan)Centralized and publicly funded by devolved nation (eg, National Health Service England)
    Urban population82% of people live in urban areas84% of people live in urban areas
    Health challenges and outcomesHigh prevalence of long-term conditions; life expectancy of 82 yearsHigh prevalence of long-term conditions; life expectancy of 81 years
    Burgeoning digital health sectors, including data science and artificial intelligenceVector Institute; Digital Technology Supercluster; Toronto Innovation Acceleration PartnersAlan Turing Institute; Health Data Research UK; Health Innovation Manchester
    Robust administrative and electronic health record research databasesInstitute for Clinical Evaluative Sciences in Ontario, PopData BCClinical Practice Research Datalink
    Academic and hospital networksAcademic health science networks (eg, Health Research BC)Academic health science centers (eg, Manchester Academic Health Science Centre)
    Paying out-of-pocket and health insurance coverageSome out-of-pocket and health insurance payment for certain health care services (eg, dental and medications)Some out-of-pocket payment for certain health care services in specific populations (eg, dental [age >18 years] and medication [ages 16-60 years])

    Overview

    Our objective was to identify factors that may add complexity when transferring RMVC technology between Canada and the United Kingdom. We organized a workshop with 15 experts from both countries on behalf of the International Centre for Translational Digital Health [7]. Initially, when this workshop was held, this center was a collaboration between the University of Toronto (Canada) and the University of Manchester (United Kingdom); it now includes the University of Melbourne (Australia) since 2022 [7]. Workshop participants were experts in medical engineering, health informatics, clinical medicine, and health policy and implementation. They examined 3 cases representing different RMVC technologies (Textboxes 1-3), with group discussions focusing on identifying differences between Canada and the United Kingdom that might add complexity when transferring the example RMVC from one country to the other.

    Textbox 1. Example RMVC technology 1: neural network–assisted sampling for intermittent ambulatory blood pressure measurements.

    The aim of the system (Figure 1), developed at the University of Manchester, is to reduce the burden of taking ambulatory blood pressure readings by requiring fewer readings to still obtain the same underlying average. This is intended to reduce burden on users as cuffs will inflate less often (which is uncomfortable) and to reduce burden on caregivers or clinicians who will have fewer readings to interpret.

    Blood pressure varies with activity, and guidelines for in-clinic blood pressure monitoring ask participants to sit stationary for 5 minutes before a reading. Home-based, ambulatory-based, and wearable-based blood pressure monitoring are widely available, but they do not account for this. The system uses human activity recognition to allow the “5 minute” stationary condition to be applied to out-of-the-clinic measurements. The novel device requires users to wear an accelerometer device for monitoring motion, and this is used to determine whether they have met the measurement requirements before a reading is taken. It is an example of using machine learning for data-driven adaptive sampling. A complete prototype exists and is ready for preclinical testing.

    ‎
    Figure 1. Neural network sampling for intermittent ambulatory blood pressure measurements.
    Textbox 2. Example RMVC technology 2: Remote Monitoring of Rheumatoid Arthritis (REMORA), smartphone-based symptom tracking for rheumatoid arthritis integrated into electronic health records systems.

    REMORA is a United Kingdom research program to develop, evaluate, and scale up a complex intervention that enables people with rheumatoid arthritis to daily track their symptoms on their smartphone to improve clinical care, self-management, and outcomes (Figure 2).

    The diagram above shows that clinicians prescribe remote symptom tracking to patients (1), who then download the REMORA app from the app store. After authenticating themselves using the login functionality of the National Health Service (NHS) (2), they start tracking their symptoms. Symptom data is sent to a data repository within a secure, regional NHS environment, alongside the patient’s e-consent for secondary use of their symptom data for research (3). A visualization summarizes the symptom data graphically (4), which clinicians can access within their local electronic health record to discuss with patients as part of the consultation (5).

    A successful proof-of-concept study in 2015 integrated and displayed daily symptom tracking data from the app in the electronic health record at a single hospital site. It showed that patients and clinicians considered the system feasible and beneficial [8], as well as how shared insights from the symptom data may change the power dynamics of the consultation [9]. In 2021, we established and tested a scalable infrastructure to deploy our proof-of-concept, which enabled its evaluation in an ongoing multisite trial in all rheumatology outpatient departments across Greater Manchester and North West London.

    ‎
    Figure 2. Remote Monitoring of Rheumatoid Arthritis, a smartphone-based symptom tracking for rheumatoid arthritis integrated into electronic health records systems.
    Textbox 3. Example RMVC technology 3: Medly, a smartphone–based heart failure management program.

    Medly was developed at the University Health Network in Toronto, Canada. Medly consists of two core components (Figure 3): (1) the Medly system to support active monitoring of heart failure patients, clinical management, and patient self-care; (2) Medly Service that includes key people (ie, clinicians providing the clinical services) and the processes required to operationalize the Medly System.

    The Medly app prompts patients to enter their daily readings, including weight, blood pressure, heart rate, and heart failure–related symptoms. Patients use a Bluetooth weight scale and blood pressure monitor to send readings automatically or manually enter the values on the app. The Medly algorithm, a rules-based expert system validated by heart failure specialists, immediately analyzes the entered readings against set personalized thresholds and provides the patient with instant feedback and instructions. Automated alerts are also sent to the patient’s care team (usually a nurse) when readings are outside of their predefined thresholds for further assessment and triage.

    The Medly dashboard provides Medly clinicians with real-time contextualized data on their patients’ clinical status and recent symptoms consistent with acute exacerbations. Clinicians also use secure email and messaging to review and respond to patient alerts.

    Medly was developed following ISO 13485 Medical Device Quality Management standards and is rated by Health Canada as a Class II Software as a Medical Device. It is used as standard of care at the University Health Network since 2016 and has been deployed as standard of care at some other health care institutions across Ontario. A body of evidence on its clinical effectiveness and implementation outcomes exists through several trials and evaluations [10-12].

    ‎
    Figure 3. Medly, a smartphone-based heart failure management program.

    Guiding Framework

    We grounded our workshop discussion on the complexity of adoption by using 3 example technologies. Each technology was assessed using the evidence-based and theory-informed nonadoption, abandonment, scale-up, spread, sustainability (NASSS) framework [13]. The NASSS framework is used to both predict and evaluate the complexity of technology in health care (or social care) [13]. It comprises 7 dimensions to rate the complexity of the technology: condition, technology, value proposition, adopters, organization, wider system or external context, and embedding and adaptation over time. The workshop discussion focused on all NASSS dimensions except embedding and adaptation over time (pertaining to later-stage technologies with refined deployment over time), in addition to questions from the short NASSS complexity assessment tool [14]. More specifically, each technology was evaluated for (1) its assessment of complexity while considering application between different jurisdictions, (2) the importance placed on the complexity as a barrier to implementation success, and (3) the degree to which it would be the same or different between jurisdictions. After the workshop, we analyzed contemporaneous notes and audio recordings of the discussions to extract key themes from the complexities, described next.


    There were several apparent similarities between Canada and the United Kingdom that, upon further probing, yielded nuanced differences where unexpected complexity could arise; we describe these below. They are intended as key illustrative examples rather than an exhaustive list.

    Differences in Addressing Needs of Minority Groups

    The Indigenous peoples of Canada comprise 5% of the total population in Canada; this significant minority group is not present in the United Kingdom [15]. This adds an important layer of culturally compassionate considerations for equitable access to RMVC technology transfer. Both Canada and the United Kingdom have significant immigrant populations. By 2031, 32% of Canada’s population and 15% of the United Kingdom’s population will comprise ethnic minorities [16,17]. The COVID-19 pandemic has escalated RMVC from relative novelty to necessity for timely access to services in both countries. However, minority communities, who may have worse access to technology, poorer capacity to use technology due to lower digital literacy, and inferior outcomes related to technology use [18-20], were unable to benefit equally from this shift in service delivery. From discussing REMORA (Textbox 2) and Medly (Textbox 3), it appeared that efforts to address such ethnic health inequalities in the United Kingdom did not focus on any one minority group. However, in Canada these focused primarily on the Indigenous population, requiring additional considerations to ensure RMVC solutions are created in authentic partnership. More broadly, special jurisdictions (ie, Quebec, Scotland, Northern Ireland, and Wales) may add additional complexity for implementation at the National level. Without accounting deeply for these needs from the outset, vendors may experience unanticipated cultural and governmental barriers to transfer (eg, culturally appropriate adaptations, language differences: Canadian French vs Canadian English vs France French).

    Differences in Physical Geography

    Canada’s physical geography is substantially more expansive than that of the United Kingdom, implying much larger climate variation and greater distances to clinical centers providing a differential incentive for RMVC. Since temperature can diminish the reliability of remote monitoring devices [21], differences in climate between the United Kingdom and parts of Canada were identified as a potential complexity when discussing the ambulatory blood pressure measurement system (case 1; see Textbox 1). Canada’s geography also impacts communication infrastructure, including the price and reliability of high-speed internet. For example, 92% of rural areas in the United Kingdom have access to superfast, relatively cheap broadband [22] versus less than 50% of rural Canada [23]. This means that Canadians, particularly those in more rural areas, may encounter higher barriers to accessing reliable RMVC than rural populations of the United Kingdom. We identified this as a key complicating factor for transferring REMORA (case 2) from the United Kingdom to Canada.

    Differences in Clinical Pathways

    Implementing new RMVC technology almost always involves some integration into existing clinical pathways. Alignment between the technology on the one hand and the pathways and associated organizational routines on the other will, therefore, affect the technology’s acceptance and scalability. When discussing cases 1 and 2, we considered differences in clinical pathways to have a limited impact on complexity. This was mainly because these technologies, in their current form, focus on providing more complete and accurate information to inform clinical decisions within existing pathways. So, once they are technically integrated into electronic health record systems, they require relatively minor changes to their ways of working. However, Medly (case 3) involved a change from consultant-led to nurse-led delivery of heart failure services. Interestingly, for transfer from Canada to the United Kingdom, this would not necessarily add complexity because nurse-led care models are more common in the United Kingdom compared to Canada for a range of conditions, including heart failure [24]. However, it would complicate transfer of a similar RMVC technology in the other direction.

    Differences in Value Propositions

    Creating a cohesive set of value propositions that meets the demands of patients [25] as well as other stakeholders (eg, policy makers, regulators, and payers) can be challenging [26]. This is partly because countries have only recently developed frameworks that define how value should be conceptualized for RMVC and other digital health technologies, and what evidence is required to demonstrate this value. For example, in 2018, the National Institute for Health and Care Excellence (NICE) for England and Wales developed the evidence standards framework for digital health technologies [27], while Canada only recently launched the Canadian Network for Digital Health Evaluation in collaboration with pan-Canadian organizations to start developing such frameworks [28]. Companies can increase the value of their product by incorporating NICE guidelines [27,29], meeting the Digital Technology Assessment Criteria for health and social care [30,31], and taking their technology through the Innovation and Technology Payment program [32].

    The challenge of developing value propositions is amplified when transferring technologies between countries. Even between countries with publicly funded health care systems, there may be substantial variation in how services are funded. In the United Kingdom, for example, innovations such as RMVC are typically commissioned by regional policy makers in Integrated Care Systems [33], whereas in Canada, commissioning RMVC technology usually happens at the local practice level. Another example is that, in Canada, clinicians are generally paid according to the procedures used to treat a patient (fee-for-service), while in the United Kingdom, primary care clinicians are mainly paid through a set amount per patient (capitation). This implies that aiming to, for example, reduce the duration of visits, such as for Medly (case 3), may be attractive for uptake in the United Kingdom, but may face barriers to adoption in Canada if that leads to decreased income for clinicians.

    Differences in Government Priorities and Support for Digital Innovation

    Despite the mandate and priority identified by Canadian Federal and Provincial bodies to innovate virtual care delivery during the pandemic (including CAD $240.5 [US $180.5] million investment [34]), the Ontario Medical Officer Health released a letter urging physicians to avoid providing virtual care in lieu of in-person care [35]. The 2022 Canadian virtual care policy framework update continues to scope RMVC technologies solely as “an additional channel for access that complements traditional face-to-face models of care” [34]. In contrast, the United Kingdom directly incorporates digital health into policy documents such as the NHS Long Term Plan [36], Digital First Primary Care [37], and the 2022 Plan for Digital Health and Social Care [38]. The United Kingdom has also increased investment in digital innovation directly within the NHS as well as through academic and industry routes. For example, the NHS Artificial Intelligence Laboratory recently funded £140 (US $177.61) million worth of AI Health and Care Awards [39]. RMVC will likely remain a high priority in the United Kingdom, given that both the current government [40] and the main opposition party [41] have assigned an important role to digital transformation in solving NHS pressures. This difference in government priorities and support arose as a key complexity for cases 1 and 2, where there would be transfer from the United Kingdom to Canada.

    Differences in Regulatory Considerations

    Regulations for digital technologies in various sectors, including health care, are continually evolving in both countries. And while the general flavor of technology regulations is similar between Canada and the United Kingdom, there are some critical differences. In Canada, RMVC technologies that are considered medical devices are licensed through Health Canada and regulated at the level of individual clinicians by the Colleges of Physicians and Surgeons of its different provinces or territories. In the United Kingdom, regulation is the responsibility of government bodies (eg, Care Quality Commission in England) or independent regulators (eg, General Medical Council, Medicines and Healthcare Products Regulatory Agency, and notified bodies for applying for CE (conformité européenne) mark and United Kingdom Conformity Assessed marking). In the context of case 3, we discussed how this would increase complexity when transferring Medly to the United Kingdom because Canadian innovators need to be aware of and comply with the most up-to-date regulations of the United Kingdom. However, they could collaborate with the United Kingdom’s partners early on to start preparing an application for CE marking and the Innovation and Technology Payment program by submitting the available evidence for Medly’s clinical and cost-effectiveness, developing a scalable growth plan, and assessing whether they could rapidly meet an increasing demand for their product once approved. It is worth noting that most regulation for remote and virtual care delivery overlaps with face-to-face forms [42]. This means that, in addition to having to navigate the requirements specific for RMVC technology, innovators transferring their technologies from one country to the other need to engage with the broader regulatory landscape for health care delivery.

    Two additional considerations for legislation and policy should include an assessment of approaches to procurement and approaches to privacy and security, which are both nuanced but can significantly impact transferability. For example, some jurisdictions require public sector procurement at the local, regional, or national levels. In Canada, it may be more straightforward to make direct partnerships (eg, directly contacting clinical champions). Within the United Kingdom, for optimized success of uptake, taking a top-down (eg, regional- or national-level support) and bottom-up (local-level support) approach is needed for movement. Similarly, differences in data-privacy regulations may affect the ability to transfer technology. For example, the General Data Protection Regulation (GDPR) [43] act provides strict data privacy guidelines in Europe around data storage and use compared to Canada’s Personal Information Protection and Electronic Documents Act (PIPEDA) [44,45]. This may make the spread easier in countries with stricter data privacy guidelines, but more difficult in the reverse direction. Differences in data-privacy guidelines may also impact the vendor’s business case (ie, prohibitive vs profitable use of data and data residency).


    We identified several key differences between 2 countries that, at first glance, seem very similar. This suggests that one should anticipate significant complexity and barriers when considering the international deployment of RMVC technologies. We found that the anticipated increase in complexity often had a particular direction. For example, more detailed frameworks for regulations and value propositions in the United Kingdom hamper transfer from Canada, but not vice versa. Based on these differences and their directionality, we provide an overview of lessons learned (Table 2) with an initial “checklist” of key considerations for transferring RMVC technology from one country to the other (Table 3).

    Table 2. Summary of key differences, lessons learned, and anticipated directionality for transferring remote monitoring and virtual care (RMVC) technology between Canada and the United Kingdom.
    Key differenceDirectionalityWorkshop learnings and recommendations
    Addressing unmet needs of minority groupsIncreases complexity when transferring RMVC technology from the United Kingdom to CanadaFor countries with deeply rooted colonization histories and Indigenous communities, such as Canada, it is more complex to understand equity and undertake meaningful cocreation.
    Physical geographyIncreases complexity when transferring RMVC technology from the United Kingdom to CanadaClimate differences or geographical range can affect RMVC operationalization, from temperature sensitivity in inclement weather conditions to service availability in remote areas. “Remote” does not mean the same in Canada compared to the United Kingdom.
    Clinical pathwaysContingent on degree of alignment of pathwaysAlignment of the RMVC technology with existing clinical pathways will affect its acceptance and scalability. For example, it may be easier to transfer nurse-led models of care to the United Kingdom where this is more common compared to in Canada.
    Value propositionsContingent on (available evidence for) cost-effectiveness of RMVC technologyDefined costing structures and evidence frameworks affect uptake. For example, transfer from capitation-based funding in the United Kingdom to fee-for-service in Canada may add complexity; comparable evidence for efficacy acceptable in the United Kingdom may be insufficient for adoption in Canada.
    Government priorities and support for digital innovationIncreases complexity when transferring RMVC technology from the United Kingdom to CanadaIncorporation of digital health and RMVC technology into health care strategies and policies in the United Kingdom is currently more mature than in Canada. This may change with time.
    Regulatory considerationsIncreases complexity when transferring RMVC technology from Canada to the United KingdomRegulatory pathways in the United Kingdom consist of several elements without offering a clear and single point of access. This makes them harder to navigate compared to in Canada, where Health Canada licenses RMVC technology.
    Table 3. Recommendations for transferring remote monitoring and virtual care (RMVC) technology between countries with similar health care systems (ie, Canada and the United Kingdom).

    		Recommendation
    Addressing unmet needs of minority groups
    • Assess appropriateness of RMVC technology to provide compassionate and culturally sensitive care. This includes cocreation with partners and ensuring interventions are Indigenous-directed where appropriate.
    Physical geography
    • Characterize physical RMVC system requirements to ensure compatibility with the intended deployment context.
    • Establish a shared understanding of the definition of “remote” in each country early on.
    Clinical pathways
    • Analyze and map existing clinical pathways and assess the degree of change required for implementing RMVC technology in the intended deployment context.
    Value propositions
    • Ensure an understanding of the costing structure and required evidence base to inform perceived value of the RMVC technology in the intended deployment context.
    Government priorities and support for digital innovation
    • Understand governmental priorities to assess feasibility, inform points of synergy, and explore opportunities for acceleration.
    Regulatory considerations
    • Map regulatory pathways between countries to identify key alignments and divergences.
    Supplementary recommendations
    • Formally consider whether the country-specific differences we highlighted may impact your RMVC technology, and identify ways to overcome the challenges related to these differences
    • Identify which pathways are available to you as an innovator to support cross-country transfer.
    • Report on and apply learnings from the regulatory barriers and facilitators identified in previous attempts to transfer and deploy digital health technologies.
    • Explore what guidance exists on how to transfer digital health technologies across countries, and identify what further guidance may need developing (eg, an extension of the NASSSa framework [14] for cross-country transfer).

    aNASSS: nonadoption, abandonment, scale-up, spread, sustainability.

    As part of future work around facilitating international deployment of RMVC technology, conducting similar workshops could explore differences between countries with comparable health care systems (eg, Australia and the Netherlands). Additionally, nuances of complexities in scaling, spreading, and sustaining technologies between countries with more dissimilar infrastructure, like the health care system, warrant further exploration. More dissimilar health care systems will impart additional complexities across NASSS domains, such as socio-cultural influences of condition management (eg, family shared care), potentially increased disparities in health and digital literacies and technology access, value proposition (who will benefit most), extent of changes needed to routines, how adoption funding decisions are made, as well as additional regulatory impacts, all of which will ultimately affect the embedding and adaptation of technology over time. More broadly, we advocate the creation of a space to publish on successful and failed cross-country transfers of digital health and RMVC technology. This will encourage and enable the digital health research community to share their experiences and findings more widely, thereby expediting learning about the technology transfer and deployment process. Given the reality of the global digital divide, such learning is pertinent for improving equitable access to remote and virtual care services. While outside the scope of this viewpoint paper, as evidence is generated, future work to derive an evidence-based model such as an updated NASSS targeting transfer between countries would be invaluable for directing and prioritizing international and global technology transfer efforts.

    Acknowledgments

    CL was funded by a Sir Henry Dale Fellowship jointly funded by the Wellcome Trust and the Royal Society (223267/Z/21/Z). This research was funded in whole, or in part, by the Wellcome Trust (grant 223267/Z/21/Z).

    Conflicts of Interest

    JAC is a founder of Medly Therapeutics, Incorporated - a spinoff company of the University Health Network, where he is a senior scientist. WGD has received consultancy fees from Google unrelated to this work. HWWP has PhD students respectively working at and supported by Patients Know Best, BetterPoints Ltd, and AstraZeneca.

    1. Telehealth market size, share and COVID-19 impact analysis, by type (products and services), by application (telemedicine, patient monitoring, continuous medical education, and others), by modality (real-time (synchronous), store-and-forward (asynchronous), and remote patient monitoring), by end-user (hospital facilities, homecare, and others), and regional forecast, 2023-2030. Fortune Business Insights. 2021. URL: https://www.fortunebusinessinsights.com/industry-reports/telehealth-market-101065 [accessed 2023-04-24]
    2. Noah B, Keller MS, Mosadeghi S, Stein L, Johl S, Delshad S, et al. Impact of remote patient monitoring on clinical outcomes: an updated meta-analysis of randomized controlled trials. NPJ Digit Med. 2018;1:20172. [FREE Full text] [CrossRef] [Medline]
    3. Snoswell CL, Taylor ML, Comans TA, Smith AC, Gray LC, Caffery LJ. Determining if telehealth can reduce health system costs: scoping review. J Med Internet Res. 2020;22(10):e17298. [FREE Full text] [CrossRef] [Medline]
    4. Maple. 2020. URL: https://www.getmaple.ca/ [accessed 2023-04-24]
    5. Online therapy. ieso. URL: https://www.iesohealth.com/ [accessed 2023-04-24]
    6. Labine J. AHS pauses partnership with Big White Wall following complaints about name. Edmonton Journal. 2020. URL: https:/​/edmontonjournal.​com/​news/​local-news/​ahs-pauses-partnership-with-big-white-wall-following-complaints-about-name [accessed 2022-06-27]
    7. International Centre for Translational Digital Health. 2022. URL: https://digital-health.mie.utoronto.ca/ [accessed 2023-04-24]
    8. Austin L, Sharp CA, van der Veer SN, Machin M, Humphreys J, Mellor P, et al. Providing 'the bigger picture': benefits and feasibility of integrating remote monitoring from smartphones into the electronic health record: Findings from the Remote Monitoring of Rheumatoid Arthritis (REMORA) study. Rheumatology (Oxford). 2020;59(2):367-378. [FREE Full text] [CrossRef] [Medline]
    9. Laverty L, Gandrup J, Sharp CA, Ercia A, Sanders C, Dowding D, et al. Using patient-generated health data in clinical practice: how timing influences its function in rheumatology outpatient consultations. Patient Educ Couns. 2022;105(3):625-631. [CrossRef] [Medline]
    10. Ware P, Ross HJ, Cafazzo JA, Boodoo C, Munnery M, Seto E. Outcomes of a heart failure telemonitoring program implemented as the standard of care in an outpatient heart function clinic: pretest-posttest pragmatic study. J Med Internet Res. 2020;22(2):e16538. [FREE Full text] [CrossRef] [Medline]
    11. Seto E, Leonard KJ, Cafazzo JA, Barnsley J, Masino C, Ross HJ. Mobile phone-based telemonitoring for heart failure management: a randomized controlled trial. J Med Internet Res. 2012;14(1):e31. [FREE Full text] [CrossRef] [Medline]
    12. Artanian V, Ross HJ, Rac VE, O'Sullivan M, Brahmbhatt DH, Seto E. Impact of remote titration combined with telemonitoring on the optimization of guideline-directed medical therapy for patients with heart failure: internal pilot of a randomized controlled trial. JMIR Cardio. 2020;4(1):e21962. [FREE Full text] [CrossRef] [Medline]
    13. Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, et al. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017;19(11):e367. [FREE Full text] [CrossRef] [Medline]
    14. Greenhalgh T, Maylor H, Shaw S, Wherton J, Papoutsi C, Betton V, et al. The NASSS-CAT tools for understanding, guiding, monitoring, and researching technology implementation projects in health and social care: protocol for an evaluation study in real-world settings. JMIR Res Protoc. 2020;9(5):e16861. [FREE Full text] [CrossRef] [Medline]
    15. Indigenous population continues to grow and is much younger than the non-indigenous population, although the pace of growth has slowed. Statistics Canada, Government of Canada. 2022. URL: https://www150.statcan.gc.ca/n1/daily-quotidien/220921/dq220921a-eng.htm [accessed 2023-02-28]
    16. Ethnic diversity and immigration. Statistics Canada. 2011. URL: https://www150.statcan.gc.ca/n1/pub/11-402-x/2011000/chap/imm/imm-eng.htm [accessed 2023-04-24]
    17. Demography: future trends. The King's Fund. URL: https://www.kingsfund.org.uk/projects/time-think-differently/trends-demography [accessed 2023-04-24]
    18. Litchfield I, Shukla D, Greenfield S. Impact of COVID-19 on the digital divide: a rapid review. BMJ Open. 2021;11(10):e053440. [FREE Full text] [CrossRef] [Medline]
    19. Eruchalu CN, Pichardo MS, Bharadwaj M, Rodriguez CB, Rodriguez JA, Bergmark RW, et al. The expanding digital divide: digital health access inequities during the COVID-19 pandemic in New York city. J Urban Health. 2021;98(2):183-186. [FREE Full text] [CrossRef] [Medline]
    20. Pham Q, El-Dassouki N, Lohani R, Jebanesan A, Young K. The future of virtual care for older ethnic adults beyond the COVID-19 pandemic. J Med Internet Res. 2022;24(1):e29876. [FREE Full text] [CrossRef] [Medline]
    21. Jones J, Hayes J. A comparison of electronic-reliability prediction models. IEEE Trans Rel. 1999;48(2):127-134. [FREE Full text] [CrossRef]
    22. Statistical digest of rural England: broadband. Department for Environment Food & Rural Affairs. 2021. URL: https:/​/assets.​publishing.service.gov.uk/​government/​uploads/​system/​uploads/​attachment_data/​file/​996572/​Broadband_June_2021_final_with_cover_page.​pdf [accessed 2023-04-24]
    23. Waiting to connect: the expert panel on high-throughput networks and remote communities in Canada. Council of Canadian Academies. 2021. URL: https://www.cca-reports.ca/wp-content/uploads/2022/01/Waiting-to-Connect_FINAL-EN_digital.pdf [accessed 2023-04-24]
    24. Chronic heart failure in adults: diagnosis and management. National Institute for Health and Care Excellence (NICE). URL: https://www.nice.org.uk/guidance/ng106 [accessed 2022-06-27]
    25. Afzal C, Al-Ubaydli M, Simon A, Guy B, Paul C, Kay F, et al. An innovator's guide to the NHS: navigating the barriers to digital health. Boehringer Ingelheim. 2020. URL: https://www.boehringer-ingelheim.co.uk/sites/gb/files/documents/innovators_guide.pdf [accessed 2023-04-24]
    26. Greenhalgh T, Fahy N, Shaw S. The Bright Elusive Butterfly of value in health technology development comment on "providing value to new health technology: the early contribution of entrepreneurs, investors, and regulatory agencies". Int J Health Policy Manag. 2018;7(1):81-85. [FREE Full text] [CrossRef] [Medline]
    27. Unsworth H, Dillon B, Collinson L, Powell H, Salmon M, Oladapo T, et al. The NICE evidence standards framework for digital health and care technologies - developing and maintaining an innovative evidence framework with global impact. Digit Health. 2021;7:20552076211018617. [FREE Full text] [CrossRef] [Medline]
    28. Canada's first digital health evaluation network. Canada's Drugs and Health Technology Agency. 2021. URL: https://www.cadth.ca/news/canadas-first-digital-health-evaluation-network [accessed 2022-06-27]
    29. Evidence standards framework for digital health technologies. National Institute for Health and Care Excellence (NICE). URL: https://www.nice.org.uk/corporate/ecd7 [accessed 2022-09-12]
    30. Digital Technology Assessment Criteria (DTAC). NHS 75 England - Transformation Directorate. URL: https://transform.england.nhs.uk/key-tools-and-info/digital-technology-assessment-criteria-dtac/ [accessed 2023-02-27]
    31. How to use the DTAC. NHS 75 England - Transformation Directorate. URL: https:/​/transform.​england.nhs.uk/​key-tools-and-info/​digital-technology-assessment-criteria-dtac/​how-to-use-the-dtac/​ [accessed 2023-02-27]
    32. Innovation and technology payment. NHS 75 England - Accelerated Access Collaborative. URL: https:/​/www.​england.nhs.uk/​aac/​what-we-do/​innovation-for-healthcare-inequalities-programme/​innovation-and-technology-payment/​ [accessed 2023-02-27]
    33. What are integrated care systems? NHS 75 - England. URL: https://www.england.nhs.uk/integratedcare/what-is-integrated-care/ [accessed 2023-02-02]
    34. Pan-Canadian virtual care priorities in response to COVID-19. Health Canada. 2022. URL: https:/​/www.​canada.ca/​en/​health-canada/​corporate/​transparency/​health-agreements/​bilateral-agreement-pan-canadian-virtual-care-priorities-covid-19.​html [accessed 2022-07-19]
    35. COVID-19 update regarding the provision of in-person and virtual care. College of Physicians and Surgeons of Ontario. URL: https:/​/www.​cpso.on.ca/​en/​News/​COVID-19-Updates/​Information-for-Physicians/​COVID-19-update-regarding-the-provision-of-in-(1) [accessed 2022-06-27]
    36. Plan NLT, Watson P. Chapter 5: digitally-enabled care will go mainstream across the NHS. NHS Long Term Plan. URL: https:/​/www.​longtermplan.nhs.uk/​online-version/​chapter-5-digitally-enabled-care-will-go-mainstream-across-the-nhs/​ [accessed 2022-06-27]
    37. National general practice improvement programme. NHS 75 England. URL: https://www.england.nhs.uk/gp/digital-first-primary-care/ [accessed 2023-02-02]
    38. Department of Health and Social Care. A plan for digital health and social care. GOV.UK. 2022. URL: https:/​/www.​gov.uk/​government/​publications/​a-plan-for-digital-health-and-social-care/​a-plan-for-digital-health-and-social-care [accessed 2023-04-24]
    39. Joshi I. Round 3 of the artificial intelligence in health and care award is now open. NHS 75 England - Transformation Directorate. 2021. URL: https:/​/www.​nhsx.nhs.uk/​blogs/​round-3-of-the-artificial-intelligence-in-health-and-care-award-is-now-open [accessed 2022-06-27]
    40. Department of Health and Social Care. Health secretary sets out ambitious tech agenda. GOV.UK. 2022. URL: https://www.gov.uk/government/news/health-secretary-sets-out-ambitious-tech-agenda [accessed 2023-04-24]
    41. Starmer K. A Tory party mired in scandal can't fix the NHS - but a labour government can. The Guardian. 2022. URL: https:/​/www.​theguardian.com/​commentisfree/​2022/​jan/​14/​tory-party-nhs-labour-government-conservatives-keir-starmer [accessed 2022-04-01]
    42. Regulatory approaches to telemedicine. Europe Economics. 2023. URL: https://www.gmc-uk.org/-/media/documents/regulatory-approaches-to-telemedicine_docx-73978543.docx [accessed 2023-04-24]
    43. UK GDPR guidance and resources. Information Commissioner's Office. URL: https:/​/ico.​org.uk/​for-organisations/​guide-to-data-protection/​guide-to-the-general-data-protection-regulation-gdpr/​ [accessed 2023-04-24]
    44. PIPEDA in brief. Office of the Privacy Commissioner of Canada. 2018. URL: https:/​/www.​priv.gc.ca/​en/​privacy-topics/​privacy-laws-in-canada/​the-personal-information-protection-and-electronic-documents-act-pipeda/​pipeda_brief/​ [accessed 2023-04-24]
    45. Bateman R. GDPR vs PIPEDA. TermsFeed. 2023. URL: https://www.termsfeed.com/blog/gdpr-vs-pipeda/ [accessed 2023-04-24]

    ‎
    CE: conformité européenne
    NASSS: nonadoption, abandonment, scale-up, spread, sustainability
    NICE: National Institute for Health and Care Excellence
    RMVC: remote monitoring and virtual care

    Edited by T Leung; submitted 08.03.23; peer-reviewed by T Jamieson, M Gomes; comments to author 17.04.23; revised version received 25.04.23; accepted 31.05.23; published 01.08.23.

    Copyright

    ©Quynh Pham, David Wong, Kaylen J Pfisterer, Dionne Aleman, Nick Bansback, Joseph A Cafazzo, Alexander J Casson, Brian Chan, William Dixon, Gerasimos Kakaroumpas, Claudia Lindner, Niels Peek, Henry WW Potts, Barbara Ribeiro, Emily Seto, Charlotte Stockton-Powdrell, Alexander Thompson, Sabine van der Veer. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 01.08.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.