Review
Abstract
Background: Despite more than 2 decades of telehealth use in Australia and the rapid uptake during the COVID-19 pandemic, little is known about its unintended consequences beyond its planned and intended outcomes.
Objective: The aim of this review was to synthesize evidence on the unintended consequences of telehealth use in Australia to clarify its impact beyond its planned and intended outcomes.
Methods: We conducted a search of 4 electronic databases: Ovid MEDLINE, Ovid Embase, EBSCO CINAHL, and Scopus. A critical interpretive synthesis approach was adopted for its flexibility and interpretive nature. We extracted data about study characteristics and the types and models of telehealth services. The extracted unintended consequences were coded and mapped into the domains and dimensions of the Australian Health Performance Framework.
Results: Of the 4241 records identified by the search, 94 (2.22%) studies were eligible for data extraction and analysis. Of these 94 studies, 23 (24%) reported largely positive unintended consequences of telehealth associated with health status, while 6 (6%) noted a potential negative impact of telehealth on socioeconomic status. The findings of 4 (4%) of the 94 studies highlighted societal and financial consequences of telehealth beyond the health system. Almost all studies (93/94, 99%) reported unintended consequences under the 5 dimensions of the Australian Health Performance Framework.
Conclusions: Our synthesis offers a framework for understanding the unintended consequences of the use of telehealth as an alternative to in-person care in Australia. While we have documented many unintended benefits of telehealth use, our findings also shed light on many challenges of delivering care via telehealth across different domains and dimensions. These findings hold significant practice and policy-making implications for ensuring safe and high-quality care delivery via telehealth.
doi:10.2196/57848
Keywords
Introduction
Background
The COVID-19 pandemic has resulted in a rapid increase in telehealth use globally. During the pandemic, telehealth emerged as a promising model of care to improve health care delivery and increase access for underserved communities. In Australia, during the first year of the pandemic in 2020, telehealth use grew almost exponentially because many health services rapidly moved to provide their services online [
- ]. Throughout the pandemic and beyond, a high consumer preference has been reported for telehealth as an alternative to standard care when it is clinically appropriate and safe, with several reported benefits such as flexibility, convenience, and time and cost savings [ - ]. This pattern of a dramatic increase in the uptake of telehealth during the COVID-19 pandemic and, subsequently, its sustained use over time is similar across many other countries, such as the United States, the United Kingdom, and New Zealand [ , ].Telehealth is broadly defined as using information and communication technologies to provide health care at a distance [
]. This definition includes models where a physician-patient interaction, whether synchronous or asynchronous, is not necessarily required, such as in patient monitoring, online support groups, or consumer mobile apps [ ]. However, in this review, we focus primarily on synchronous telehealth or synchronous telehealth in conjunction with asynchronous models that act as an alternative to standard in-person care; this includes one-to-one patient-clinician interactions and models where clinician-clinician interactions appertain to case management.Unintended consequences are the unplanned and often unforeseen outcomes of introducing an intervention, such as telehealth [
, ]. These outcomes can be (1) positive outcomes (accidental benefits), (2) adverse outcomes (drawbacks), or (3) neutral outcomes with no intrinsic positive or negative value [ , ]. To provide safe and effective care via telehealth, an understanding of its unintended or unexpected consequences is warranted to mitigate drawbacks, optimize unexpected benefits, and understand system-wide and long-term impact. There has thus far been limited research investigating this issue, with only 1 secondary analysis carried out in Canada [ ]. Guided by the model proposed by Bloomrosen et al [ ] for investigating the unintended consequences of health information technologies, the study by Alami et al [ ] documented findings on the unintended consequences of telehealth across various domains. However, the Canadian data sources were primarily evaluation documents that did not account for published empirical research beyond the 10 projects investigated. Furthermore, despite defining unintended consequences as positive, neutral, or negative unforeseen outcomes, the reported consequences were primarily negative, such as rigidity of technology to accommodate existing workflows and processes, cognitive overload, invasion of patients’ privacy, increase in administrative workload, and the additional costs associated with telehealth. Few neutral consequences were documented in the study, such as the restructuring of hierarchical relationships and the emergence of new modes of clinical practice [ ].Objectives
A comprehensive synthesis of primary and secondary empirical studies on this subject is thus still lacking. In this review, we aimed to close this knowledge gap by synthesizing findings on the unintended consequences of telehealth to fully understand the impact of telehealth, focusing not only on the microlevel (individual users) and the mesolevel (organizational processes and workflows) but also on a policy macrolevel or national level. The objective of the review was to investigate the current state of knowledge on the multilevel unintended consequences of telehealth implementation in the Australian health system. We used a critical interpretive synthesis (CIS) [
] approach due to the diversity of telehealth literature and the lack of consensus on terms and concepts. This review is part of a larger research project using systems sciences as a conceptual lens to understand telehealth’s unintended consequences [ ]. This conceptual framework informed the design and analysis of this review, emphasizing the rippling effects of telehealth implementation across the complex health care system.Research Questions
The following research questions (RQs) were formulated to achieve the review objective:
- RQ1: How is telehealth implementation being evaluated or assessed?
- RQ2: What are the findings on the types and models of telehealth services implemented?
- RQ3: What are the findings on the unintended consequences of telehealth implementation?
While the first 2 RQs were used to extract study characteristics, the third RQ served as an initial guide for the CIS. In line with the principles of this methodology, our inquiry evolved and was refined throughout the review process, as detailed in the Methods section.
We focused our review on studies conducted within Australia to provide a picture of unintended consequences within a single, contained health care system. Health systems vary across different countries in terms of structure, funding models, and policies, but Australia represents a high-income country with a well-resourced hybrid health system that deals with fragmentation and challenges similar to those in comparable international health systems [
], making our findings relevant to such systems.Methods
The CIS Method
A CIS offers an appropriate alternative to a standard systematic review. Its exploratory nature allows for flexibility in including diverse study types [
], including studies that do not focus directly on the unintended consequences of telehealth or ostensibly on the topic of unintended consequences but could still inform the analysis. Moreover, CIS provided us with the interpretive freedom necessary to build a framework and draw conclusions from studies that reported on the unintended consequences of telehealth without necessarily using the term “unintended consequences.” This interpretive flexibility is necessary when building a knowledge base and synthesizing evidence where the literature is diverse and complex [ ].Search Strategy
A search strategy was developed in consultation with a clinical librarian to search the databases Ovid MEDLINE, Embase, EBSCO CINAHL, and Scopus using keywords and Medical Subject Headings terms related to “telehealth,” its “implementation,” and “unintended consequences” in “Australia” (
). We did not apply date limits to the search to ensure a comprehensive account of the available evidence. The search was conducted in November 2022.Eligibility Criteria
Qualitative and mixed methods allow for the exploration of issues and variables that might be unexpected and therefore remain unmeasured in quantitative studies. They provide richness and depth, facilitating a better understanding of any unintended consequences of telehealth beyond the planned outcomes [
]; as such, they served as our primary data sources. The inclusion and exclusion criteria are presented in .Inclusion criteria
- Published in a peer-reviewed journal
- Examined synchronous telehealth (telephone or video) or synchronous telehealth in conjunction with asynchronous models for service delivery as part of the Australian health system
- Qualitative or mixed methods evaluations that examined the implementation of synchronous telehealth or synchronous telehealth in conjunction with asynchronous models or its unintended consequences in both routine practice or evaluation of specific programs or quantitative studies in which the main focus was the unintended outcomes of telehealth
- Unlimited in setting or specialty because the goal was to identify the unintended consequences of synchronous telehealth as a modality and an alternative model of care regardless of the specialty or setting; however, we extracted setting and specialty data for each study included
- Published in English and available in full text
Exclusion criteria
- Reviews, protocols, opinion pieces, commentaries, perspectives, conference proceedings, and books
- Focused solely on asynchronous telehealth modalities: store and forward, patient monitoring, mobile apps, studies on telehealth for education or professional development purposes only, or studies assessing telehealth readiness
- Carried out across multiple countries
- Not available in full text or not in English
- Examining after-hours helpline and triage programs (these were excluded because such programs primarily serve as entry points for assessment and referral services rather than as replacements for standard care [ , ])
Study Screening
To facilitate screening and duplicate removal, all references were downloaded to a reference manager (EndNote 20; Clarivate) and then uploaded to the web-based screening platform Rayyan (Rayyan Systems Inc). The first author (SO) removed all duplicates, and then 2 reviewers (SO and KC) independently completed a blind review of a random sample of titles and abstracts (2%) against the aforementioned inclusion and exclusion criteria. Cohen κ was calculated (0.82; near-perfect agreement) to determine interrater reliability, and the few discrepancies in the inclusion or exclusion decisions were discussed between the 2 reviewers (SO and KC). When necessary, a third reviewer (LAE) was consulted until a consensus was reached. A single reviewer (SO) screened the remainder of the titles and abstracts against the inclusion and exclusion criteria and conducted the full-text screening of the included references. As there is no search protocol for conducting a CIS, we followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines.
Data Extraction
Study characteristics and findings on the types and models of telehealth services were extracted into a custom template in NVivo 20 (Lumivero) and Excel (Microsoft Corp). We extracted theoretical frameworks or models only if they underpinned the design and analysis of the study, with sufficient detail provided to explain their application.
summarizes the data items captured to answer RQs 1 and 2. To answer RQ 3, we identified any unintended benefits or drawbacks by examining the reported results in each included study, with the relevant text extracted verbatim and added to NVivo for coding and analysis.Research questions and data items
- How is telehealth implementation being evaluated or assessed?
- Study design and methods used
- Data collection tools
- Theories and frameworks used to understand the impact of telehealth
- Locations and regions of studies
- Types and number of participants
- What are the findings on the types and models of telehealth services implemented?
- The types of telehealth services implemented
- Settings and specialties
- Models of care implemented
- Whether it was synchronous or a mix of synchronous and asynchronous models
- Modalities of telehealth (video vs telephone)
- If the study was conducted before or after the COVID-19 pandemic
- What are the findings on the unintended consequences of telehealth?
- Any identified unintended consequences
- Whether they are positive, negative, or neutral
Dixon-Woods et al [
] point out that the precise definitions of many constructs in a CIS may evolve during the review process. Our research process exemplified this approach because we began data extraction without a rigid definition of unintended consequences. Instead, we initially extracted all benefits and drawbacks of telehealth from included studies; for instance, we initially considered reduced travel time for patients an unintended positive consequence. However, in all included studies, the intended goal of telehealth implementation, whether explicit or implied, was to improve or sustain access to health care services. This definition encompassed using telehealth to ensure continuity of access during the COVID-19 pandemic and to improve access for patients with barriers such as geographic and mobility disadvantages. Therefore, we conducted another round of analysis to refine our understanding of unintended consequences, excluding benefits related to the reduced burden of accessing care in terms of money and time because these were apparently intended outcomes from the studies. Hence, in all instances, an unintended consequence was subsequently defined as either (1) any benefit of telehealth implementation other than improving or sustaining patients’ access to health care services or (2) any drawback because drawbacks are usually not planned or intended although they can be foreseen or expected.While we recorded whether each study was conducted before or after the COVID-19 pandemic, our data extraction focused on unintended consequences that were not explicitly tied to the unique circumstances of the pandemic. Therefore, we did not extract or include transient consequences solely attributable to the COVID-19 context (eg, consequences related to extreme social distancing measures). Our rationale was that these transient consequences might have limited applicability to long-term, routine telehealth implementation in typical care provision. This methodological approach ensured that our analysis focused on enduring issues relevant to long-term, routine telehealth implementation, regardless of whether the study was conducted before or during the COVID-19 pandemic. Nevertheless, by documenting the temporal context (before or after the pandemic) for each study in
[ - , - ], we provide the necessary information to interpret the results in light of the implementation context.Quality Appraisal
We wanted to be inclusive in our review and not omit any study based on quality issues; therefore, we purposely did not use a structured tool to appraise studies. This is in agreement with the growing case against the exclusion of relevant qualitative studies in reviews on quality grounds alone rather than relevance because they can nevertheless inform and contribute to the understanding as well as the richness of the final findings of a review [
, , ].Data Synthesis and Analysis
To analyze the extracted data, an iterative coding process was used, switching between inductive and deductive coding and following a best-fit framework-based synthesis of evidence [
- ]. This approach allowed us to identify relevant frameworks for analysis as we coded, while minimizing the risk of missing some relevant evidence that did not fit an a priori framework, thus capturing all unintended consequences extracted from the included studies. As we undertook this process, our initial broad question “What are the unintended consequences of telehealth?” evolved into “How do unintended consequences of telehealth manifest across different domains of health care performance?” because it became apparent that telehealth’s unintended consequences could be conceptualized in terms of accessibility, appropriateness, safety, efficiency, effectiveness, and continuity of care. We recognized that these concepts aligned closely with the definitions in the Australian Health Performance Framework (AHPF) [ ], a framework with which we were familiar from previous work in the Australian health care context, which is described in detail in the following subsection. We chose to use the AHPF domains instead of defining entirely new constructs as typical when conducting a CIS for the following reasons: (1) the AHPF provided a robust, established framework that could accommodate the complexity of our findings; (2) its use allows for better comparison with other telehealth studies in the Australian context; and (3) it offers a more accessible account of the evidence for policy makers and practitioners.Our initial inductive coding process resulted in 137 codes; after an iterative process of refining, merging, and deleting redundant codes, 82 (59.9%) unique codes were deductively mapped and translated into the domains and dimensions of the AHPF. As an example to demonstrate this iterative inductive-deductive process, we initially coded a wide range of positive and negative effects of telehealth related to continuity of care, such as facilitating multidisciplinary care and undermining rapport building. As we analyzed the data, we recognized that this theme aligned with the continuity of care dimension in the AHPF. However, we found it necessary to modify the framework to better summarize and capture consistent variations and nuances in the findings within each dimension (
); for example, we added subcategories under continuity of care, such as interpersonal continuity and management continuity, to capture telehealth’s unintended consequences related to the patient-clinician relationship and care management across teams. Thus, we adapted the existing AHPF to document the full impact of telehealth and its unintended consequences within the Australian health system. This approach aligns with the view of Dixon-Woods et al [ ] of CIS as a flexible approach that can be adapted to the needs of the RQ, rather than a rigid, prescriptive methodology. NVivo (version 20; Lumivero LLC) was used to facilitate coding and analysis.Mapping the Findings to the AHPF Domains
The AHPF supports reporting by different health organizations at different levels to assess the performance of health care delivery in Australia, focusing on four key domains (in gray in
): (1) determinants of health, (2) health status, (3) health system, and (4) health system context [ ]. Within each domain, there are dimensions to guide the assessment of that specific domain; for example, in the health system domain, the AHPF uses accessibility, effectiveness, efficiency and sustainability, safety, appropriateness, and continuity of care as dimensions to guide the assessment of the performance of the Australian health system.We mapped all extracted consequences into the 4 key domains of the AHPF. Due to the greater abundance of findings falling under the health system domain than under other domains, the system-level consequences constituted most of the evidence presented in this review and necessitated the use of both dimensions and subcategories (shown in brown and blue in
, respectively), as discussed previously. To map these extracted consequences to the health system domain of the AHPF, we primarily used the definitions provided in the framework for each dimension. Where there was no clear definition, we supplemented with definitions from other sources, as summarized in . While we used the AHPF as an organizing framework, our approach went beyond simple mapping to achieve synthesis. We integrated findings across the included studies to generate new insights into how unintended consequences manifest in telehealth implementation; for instance, by synthesizing the findings related to effectiveness and appropriateness, we developed a new understanding of how telehealth can improve health outcomes by facilitating the involvement of carers in care delivery. By situating our findings within the AHPF, we emphasize telehealth’s overarching impact across various health care performance domains, offering a systems-level perspective on telehealth’s unintended consequences.Definitions and dimensions
- Accessibility is the ability to access affordable, convenient care at the right time and place, taking into account the various needs and circumstances of patients [ , ]; benefits in terms of time, burden, and costs of accessing care were not included in the final synthesis because they were considered intended benefits (discussed in the Data Extraction section above)
- Continuity of care refers to uninterrupted care or service across programs, practitioners, and levels over time [ ]; as such, consequences under this dimension include findings on care planning and coordination, information sharing between providers, facilitation of multidisciplinary care, frequency of visits, and interpersonal exchange between patients and their providers [ , ]
- Appropriateness is defined as providing care that is person-centered and culturally sensitive, allowing patients to be involved in the decision-making regarding their health choices; when care is appropriate, patients are encouraged to share their experiences and provide feedback on the care they receive without fear of consequences, thus ensuring their dignity and the confidentiality of their health information during and after receiving care [ ]
- Safety refers to the reduction or avoidance of harm due to, and during, health care provision or from the environment in which care is delivered [ ]; any findings about patients’ safety, staff safety, and medicolegal issues resulting from lack of safety in health care were mapped under this dimension
- Effectiveness refers to achieving the desired clinical outcomes, taking into consideration patients’ perspectives; as such, patient-reported outcomes and patient-reported experiences constitute an essential component of evaluating health care effectiveness [ ]; moreover, indicators such as preventable hospitalizations, preventable deaths, and screening and immunization rates are all measures of health care effectiveness [ ]; any consequences of telehealth that support or undermine desirable clinical outcomes were mapped under this dimension
- Efficiency and sustainability refers to achieving desirable clinical outcomes at the minimum cost possible and optimal use of health care resources. such as workforce and physical resources, all while innovating to meet increasing health care demands without overstretching the workforce [ ]; therefore, findings on telehealth impact on the cost of service, health workforce recruitment and retention, and supporting clinicians were mapped under this dimension
Results
Study Selection and Characteristics
Of the 4241 records retrieved, 2340 (55.18%) were screened after 1901 (44.82%) duplicates were removed. After title and abstract screening, 2125 (90.81%) of the 2340 studies were excluded, resulting in 215 (9.19%) studies progressing to full-text review. Studies for which abstracts were unavailable progressed directly to full-text review. In addition, survey studies that fulfilled the inclusion criteria progressed to full-text screening because they could have open-ended sections with relevant data on unintended consequences. At the full-text review stage, of the 215 studies, 121 (56.3%) were excluded, leaving 94 (43.7%) studies (
) that evaluated telehealth programs in Australia and were eligible for data extraction and analysis. summarized the PRISMA search and screening protocol followed and the number of studies at each stage.More than half of the included studies (50/94, 53%) were published in the last 3 years (after the onset of the COVID-19 pandemic;
). Nearly a third of the studies (29/94, 31%) were conducted in multiple states or territories across Australia, with the remainder being conducted in Queensland (23/94, 24%), Victoria (18/94, 19%), New South Wales (14/94, 15%), South Australia (5/94, 5%), Western Australia (3/94, 3%), Tasmania (1/94, 1%), and the Northern Territory (1/94, 1%). The fewest studies were conducted in a metropolitan setting (18/94, 19%), with most being conducted in rural or regional settings (32/94, 34%) or in mixed settings (31/94, 33%). Of the 94 studies, 13 (14%) lacked data about whether the study was in metropolitan, rural, or regional settings.Year | Studies, n (%) |
2000 | 2 (2) |
2002 | 1 (1) |
2003 | 1 (1) |
2009 | 1 (1) |
2012 | 5 (5) |
2014 | 4 (4) |
2015 | 5 (5) |
2016 | 5 (5) |
2017 | 1 (1) |
2018 | 3 (3) |
2019 | 5 (5) |
2020 | 10 (11) |
2021 | 18 (19) |
2022 | 32 (34) |
2023 | 1 (1) |
Most of the included studies (79/94, 84%) evaluated a synchronous-only model, whereas 16% (15/94) assessed a telehealth model using both synchronous and asynchronous modalities. Almost a third of the included studies (28/94, 30%) examined telehealth in various allied health settings, with the remainder being conducted in other primary care settings (8/94, 9%), mental health (14/94, 15%), or other specialties (oncology 7/94, 7%; palliative care 4/94, 4%; rheumatology 3/94, 3%; emergency medicine 3/94, 3%; surgery 3/94, 3%; hematology 2/94, 2%; geriatrics 2/94, 2%; gynecology and reproductive medicine 2/94, 2%; pulmonology 1/94, 1%; hepatology 1/94, 1%; nephrology 1/94, 1%; endocrinology 1/94, 1%; cardiology 1/94, 1%; anesthesia 1/94, 1%; radiology 1/94, 1%; multiple 11/94, 12%). The majority of the included studies evaluated a patient-to-provider telehealth model (71/94, 76%) whereas the remainder of the studies assessed provider-to-provider models (11/94, 12%), group therapy (3/94, 3%), or a combination of models (9/94, 10%), as shown in
.Study characteristics | Studies, n (%) | |
Methods | ||
Mixed methods | 50 (53) | |
Qualitative | 42 (45) | |
Quantitative | 2 (2) | |
States or territories | ||
Queensland | 23 (24) | |
Victoria | 18 (19) | |
New South Wales | 14 (15) | |
South Australia | 5 (5) | |
Western Australia | 3 (3) | |
Tasmania | 1 (1) | |
Northern Territory | 1 (1) | |
Multiple | 29 (31) | |
Regions | ||
Regional or rural | 32 (34) | |
Mixed | 31 (33) | |
Metropolitan | 18 (19) | |
Not reported | 13 (14) | |
Type of telehealth | ||
Synchronous | 79 (84) | |
Synchronous+asynchronous | 15 (16) | |
Modalities | ||
Video | 54 (57) | |
Video+telephone | 34 (36) | |
Telephone | 5 (5) | |
Not reported | 1 (1) | |
Specialties | ||
Allied health | 28 (30) | |
Mental health (psychology and psychiatry) | 14 (15) | |
Primary care | 8 (9) | |
Other specialist services | 44 (47) | |
Participant groups | ||
Health care providers | 46 (49) | |
Consumers | 23 (24) | |
Health care providers+consumers | 22 (23) | |
Not applicable | 3 (3) | |
Models of care | ||
Patient to provider | 71 (76) | |
Provider to provider | 11 (12) | |
Group therapy | 3 (3) | |
Multiple | 9 (10) |
Approximately half of the studies investigated the perspectives of providers in a range of different roles (46/94, 49%), nearly a quarter examined the views of consumers and carers (23/94, 24%), and 23% (22/94) included the perspectives of both consumers and health care providers. A few of the studies (3/94, 3%) did not recruit participants: they either examined existing documents or analyzed routinely collected data. Only 14 (15%) of the 94 studies used theoretical frameworks or models to underpin the study design and analysis, with the Nonadoption, Abandonment, Scale-up, Spread, and Sustainability Framework [
] being the most commonly used framework among these 14 studies (n=3, 21%).Unintended Consequences of Telehealth in Australia
The unintended consequences of telehealth extracted from the included studies were mapped into the 4 domains of the AHPF, as described in the following subsections and summarized in
.Health Status
Under this domain, nearly a fourth of the studies (23/94, 24%) reported unintended consequences of telehealth associated with health status, with most of the studies (17/23, 74%) reporting positive consequences; for example, 71% (12/17) of these studies reported that telehealth improved patients’ mental and physical well-being, mostly because patients were in the comfort of their homes where they felt more relaxed, less vulnerable, and in control compared to being in an unfamiliar or clinical environment [
, - ]. Some of the studies (6/17, 35%) highlighted other contributing factors to this improved well-being, such as the reduction in travel-induced anxiety and fatigue [ , - ], as well as the social support resulting from connecting with people with similar experiences or challenges in group therapy [ ]. However, several of the studies (10/23, 43%) highlighted some negative unintended consequences of telehealth, such as evoking behavioral reactions in children [ , , ] and negative emotions from seeing one’s image on the screen [ , , , ], including for those with, for example, eating disorders [ , ] or hearing aids [ ]. In some of the studies (5/23, 22%), telehealth was found to provoke anxiety and discomfort in patients [ , , , ].Determinants of Health
Of the 94 studies, 6 (6%) reported a potential negative impact of telehealth on individuals’ socioeconomic status and other determinants of health. Specifically, 5 (83%) of these 6 studies reported concerns about the potential of telehealth to increase the digital divide due to the increased financial burden on consumers, resulting from internet and equipment costs [
, - ]. In 2 (33%) of the 6 studies, lack of digital literacy [ ], particularly among the older populations [ ], was highlighted as another factor that could increase this digital gap.The Health System Context
The findings of 4 (4%) of the 94 studies under the health system context emphasized telehealth’s impact on factors external to, and generally beyond, the direct influence of the health system. Although 2 (50%) of these 4 studies reported positive outcomes of telehealth associated with this domain, such as societal productivity gain [
] and the environmental benefits of reduced travel [ ], 2 (50%) studies highlighted the potential for financial exploitation through telehealth [ , ].The Health System
This domain accounts for a majority of the reported unintended consequences of telehealth synthesized in this review. Of the 94 included studies, 93 (99%) reported findings with unintended consequences falling across the dimensions of the health system domain as detailed in the following subsections.
Accessibility
There were no reported unintended consequences under this dimension because all extracted outcomes were related to reducing the cost and time of accessing care and, as such, were considered intended benefits, as indicated earlier.
Safety
In 30 (32%) of the 93 studies, the safety of care provision was shown to be impacted by telehealth, with more than half (n=18, 60%) noting 9 negative consequences. In 10 (56%) of these 18 studies, telehealth was reported to jeopardize patient safety due to patient misidentification [
], medication errors [ , ], the risk of misdiagnosis [ , , , - ], or delayed treatment [ , ]. Of these 10 studies, 6 (60%) highlighted some factors that give rise to these risks of misdiagnosis and delayed treatments in telehealth, such as lack of nonvisual cues [ , , , ], patients not preparing properly for a telehealth consultation as they would for an in-person consultation [ ], and the lack of a physical examination [ , , , ]. According to 8 (44%) of the 18 studies noting negative consequences, the lack of a physical examination was believed to have led to overreliance on patient-reported symptoms [ , , , , ], potentially increasing medicolegal liabilities [ , , ]. Moreover, the findings of 3 (17%) of the 18 studies suggest that the use of telehealth could lead to medicolegal liabilities due to conflicting state registration requirements, potentially causing uncertainty surrounding professional liability in case of clinical incidents [ ]; a lack of local services to deal with adverse events [ ]; and challenges obtaining informed consent from patients due to miscommunication challenges [ ]. Difficulties in evaluating, identifying, and addressing risk through telehealth were reported in 8 (44%) of the 18 studies involving patients considered vulnerable, including those who have experienced domestic violence or are at risk for suicide [ , , , , , - ].By contrast, 16 (53%) of the 30 studies noted 5 positive telehealth outcomes associated with health care safety. Of these 16 studies, 5 (31%) demonstrated that telehealth improved staff safety by reducing occupational risks associated with home visits [
, , ], work-related travel [ ], exposure to illness [ ], and carrying work equipment [ ]; and 13 (81%) highlighted the potential of telehealth to improve patient safety by reducing accidents resulting from patient transportation [ , ] and minimizing exposure to illness [ , , ], which was particularly beneficial for patients with a compromised immune system [ , , , ]. According to 4 (25%) of the 16 studies, telehealth provided a safe space for psychological support for patients considered vulnerable [ , , , ]. Finally, the findings from 1 (6%) of the 16 studies suggested that telehealth has the potential to reduce medicolegal liabilities by reducing accidents while transporting patients, minimizing the risk of misdiagnosis by providing additional expertise through second opinions, and providing better incident auditing [ ].Appropriateness
Of the 93 studies, 77 (83%) documented several unintended consequences under the appropriateness dimension in terms of person-centered care, the appropriateness of the setting, and the privacy and confidentiality of patients.
Of these 77 studies, 75 (97%) reported telehealth consequences—primarily positive—related to person-centered care. Several telehealth benefits were documented in numerous studies (60/75, 80%), such as minimizing social isolation for older adult patients [
, ], allowing patients to receive care in a familiar and comfortable environment [ , , - , - , , , , - ], allowing patients to receive care close to their support network [ , , , ], and accommodating patients’ personal needs and circumstances [ - , , , , - , , - , , , , , , - , , - , , , - , - , - ]. These factors helped patients to feel relaxed and encouraged them to open up more easily [ , , - , ]. In 5 (7%) of the 75 studies, telehealth was reported to empower patients and reinforce their autonomy [ , , , , ], in contrast to findings from a study in which several patients described their role as “passive” during telehealth consultations compared to in-person consultations [ ].In several of the studies (11/75, 15%), clinicians shared their views on how telehealth allows them to see patients in their personal spaces, enabling them to provide more personalized care [
, , , , , , , , , , ]. A number of studies (20/75, 27%) highlighted that telehealth facilitated the involvement of family members and carers and supported them in having an active role in care delivery [ , , , , , , , , , , , , , , , - ]. However, this increased involvement was viewed differently by clinicians and carers; some carers complained about the increased burden and responsibilities [ , , , ]. By contrast, clinicians were anxious about losing control due to reliance on carers to perform tasks they would have otherwise performed themselves in an in-person consultations if not for the limitations of delivering care via telehealth [ , ]. In addition, clinicians complained about parents’ noncompliance to given instructions, which affected the quality of care provided during telehealth consultations [ , ].A number of studies (12/75, 16%) pointed out other consequences of telehealth that undermined person-centered care. In 7 (58%) of these 12 studies, clinicians raised concerns about the cultural, cognitive, and social inappropriateness of telehealth for various groups such as Indigenous communities [
, ], patients with mental or cognitive impairment [ , , ], patients with hearing impairments [ , ], patients who were acutely unwell [ , ], and rural and remote communities where an essential part of delivering care to patients is knowing their social circumstances [ ]. Furthermore, according to the findings from 8 (67%) of the 12 studies, communication challenges were reported in telehealth consultations involving non–English-speaking patients or patients who required interpreters to be present [ , , , , , , , ]. In 1 (8%) of the 12 studies, clinicians shared their concerns that telehealth patients were being overserviced and overloaded with information relating to their health [ ].Of the 77 studies, 4 (5%) reported findings about the appropriateness of telehealth as a health care delivery setting compared to physical or brick-and-mortar settings. In 2 (50%) of these 4 studies, patients shared that telehealth removed the sense of safety and certainty that came from being surrounded by health professionals in physical settings where they felt more supported and had multiple opportunities to raise any concerns or issues [
, ]. A different study reported scheduling confusion and inappropriate timing of telehealth consultations [ ], which was supported by findings from another study in which patients shared their frustration that clinicians prioritized in-person consultations and fitted telehealth consultations in between, leading to scheduling confusion and inappropriate timing of consultations [ ].Telehealth consequences related to patient privacy and confidentiality were documented in 19 (25%) of the 77 studies, with negative consequences being reported in most of them (n=16, 84%). Of the 19 studies, 8 (42%) reported clinicians’ concerns about patients’ privacy and confidentiality in telehealth consultations due to lack of private spaces to discuss sensitive matters, especially for patients considered vulnerable [
, , , , , , , ]. Similarly, in 5 (26%) of the 19 studies, telehealth was viewed as blurring the boundaries between private and clinical spaces [ , , , ], thereby invading the privacy of both patients [ , , ] and clinicians [ ]. In 5 (26%) of the 19 studies, patients were reportedly concerned about their privacy and confidentiality in telehealth consultations due to a distrust of technology [ ], fear of cybersecurity breaches [ ], and the possibility that other people might overhear their conversations [ , , ]. According to 2 (11%) of the 19 studies, errors such as clinicians calling the wrong person [ ] or patients mistakenly joining other patients’ consultations [ ] were reported as jeopardizing privacy during telehealth consultations. In addition, 2 (11%) of the 19 studies documented clinicians’ views on the inappropriateness of a telehealth physical examination because patients get undressed in front of the camera [ , ].These issues notwithstanding, 6 (32%) of the 19 studies reported positive consequences of telehealth associated with patient privacy and confidentiality. Of these 6 studies, 4 (67%) reported that telehealth allowed patients to seek care anonymously—in contrast to in-person care where patients may be seen or questioned by acquaintances when seeking care [
, , , ]. This feature of telehealth was particularly valued in small and Indigenous communities and when the topic was sensitive because patients had the option to seek care outside their community [ ]. In 2 (33%) of the 6 studies, patients shared that telehealth allowed them to talk freely in the privacy of their homes compared to hospitals and other clinical settings where there is a risk of other people overhearing their conversations [ ], all while controlling the level of exchange they prefer with the ability to turn the video on and off [ ].Effectiveness
Of the 93 studies, 49 (53%) reported telehealth’s unintended consequences pertaining to the effectiveness of care in terms of clinical practice and clinical outcomes, as well as patient experience. Documented in 28 (57%) of the 49 studies, the most cited negative unintended consequence of telehealth under this dimension was the clinicians’ inability to make clinical decisions when delivering care via telehealth, potentially impacting clinical outcomes [
, , , - , , , , , - , , , - , , , , , , , ]. The factors contributing to these challenges in clinical decision-making were presented in a number of studies (26/49, 53%), such as a lack of nonverbal cues as well as communication challenges [ , , , - , , , , , , , ], the inability to examine patients in person [ , , , , , - , , , , , , , , ], and a lack of local and contextual understanding of the patients’ circumstances, particularly when providing care via telehealth to rural and regional patients [ , ].According to a number of studies (17/49, 35%), telehealth forced clinicians to change and adapt their clinical practices and processes to fit the new mode of delivery [
, , , , , , , , , - , , - , ]. In several cases (10/17, 59%), this adaptation was believed to be a consequence of the inherent limitations of telehealth, such as the inability to examine patients in person [ , ], a lack of nonverbal cues that affect communication and rapport building [ , , , , ], and the inability of the health professional to guide and provide physical support to patients or encourage participation [ , , ]. In addition, in 2 (12%) of the 17 studies, clinicians adapted their clinical practices to ensure patients’ privacy during telehealth consultations [ ] and to mitigate the risk of medicolegal liabilities [ ]. Regardless, in a few studies (4/49, 8%), telehealth was viewed as potentially improving clinical effectiveness by reducing avoidable hospitalizations [ , , ] and polypharmacy [ ].Unintended consequences in relation to patient-reported experiences of receiving care via telehealth were documented in 17 (35%) of the 49 studies in which patients shared concerns and a lack of confidence in the care they received and questioned whether it was as thorough and accurate as in-person care [
, , , , , , , , , , , , , , , , ]. Their primary concerns included that clinicians may have missed something when delivering care via telehealth due to the lack of an in-person physical examination and physical interactions [ , , , , , , , , , , , ], communication challenges [ , , , ], and telehealth consultations being rushed by clinicians [ , , , ].Continuity of Care
Of the 93 studies, 75 (81%) documented telehealth’s unintended consequences associated with the 4 categories of continuity of care: informational continuity, interpersonal continuity, longitudinal continuity, and management continuity.
On the basis of the findings of 7 (9%) of these 75 studies, informational continuity was hindered by the use of telehealth, such as when sharing documents, test results, and prescriptions with patients [
, , , , ] or with other clinicians to assist in clinical decision-making [ , , ]. However, these findings are in contrast to what was reported in a study in which clinicians reported better access to, and sharing of, resources [ ]. Likewise, in 2 (3%) of the 75 studies, telehealth was believed to improve informal knowledge sharing between providers to support care delivery [ , ].In a number of studies (18/75, 24%), telehealth was viewed as facilitating case management and multidisciplinary care because it improved care coordination and communication between teams [
, , , , , , , , , , , ]; supported better recordkeeping and documentation [ , , ]; and improved care planning [ , , , , , ], which was particularly beneficial in the management of chronic and complex conditions [ , , ]. In addition, the findings from 6 (8%) of the 75 studies suggested that telehealth supported longitudinal continuity across the continuum of care by streamlining the referral process [ , ], allowing clinicians to make informed discharge decisions [ , ], and improving the follow-up experience for patients [ , ]. Finally, a division of clinical responsibilities, role reassignment, and changes in power dynamics were noted as unintended consequences of telehealth when multiple clinicians were involved in case management [ , ].Of the 75 studies, 65 (87%) reported unintended consequences of telehealth related to interpersonal continuity of care in terms of interpersonal exchange and therapeutic relationship building. Specifically, in 56 (86%) of the 65 studies, telehealth was viewed as hindering effective communication and patient engagement [
, - , - , - , - , - , , , - , - , , , , , , , , , , , , - , - , , ], largely due to the lack of nonverbal information [ , , , , - , - , - , - , , , - , , , , , , , , , , , , , , ] and, to a lesser extent, due to the increase in distractions during telehealth consultations compared to in-person consultations [ , , , , , , , , , , , ], particularly in the case of children or young patients [ , , , , , , , , , , ]. Nevertheless, these findings are in contrast to those reported in 12 (18%) of the 65 studies that documented an improvement in communication and patients’ engagement in telehealth [ , , - , , , , , , ], primarily due to patients being comfortable in their homes and more inclined to open up about sensitive health issues [ , , , , ], fewer distractions for both patients and clinicians [ , , ], and the increased interest in technology among children [ ]. Of the 12 studies, 2 (17%) suggested that patients opened up more easily and were less inhibited over telehealth because they were unaffected by clinicians’ presence and any nonverbal cues that may have signaled patients to stop talking [ , ].In 41 (63%) of the 65 studies reporting unintended consequences of telehealth related to interpersonal continuity of care, telehealth interactions were noted as impersonal, thus undermining rapport building and affecting the therapeutic patient-provider relationship [
, , , , - , , , - , , , - , , , , , , , , , , , , - , , , , ]. However, contrary to these findings, 10 (15%) of the 65 studies reported better therapeutic relationship building in telehealth as a consequence of the improved communication and engagement in telehealth [ , ] as well as the increased frequency of contact between patients and their providers over extended periods of time [ , , , , , , , ].Efficiency and Sustainability
Of the 93 studies, 63 (68%) reported unintended consequences of telehealth associated with the efficiency and sustainability of health care in terms of its impact on health workforce and resources use. According to the findings from 11 (17%) of these 63 studies, health professionals reported that telehealth supported them in their daily tasks by providing access to a second opinion or specialized expertise [
, , , , , , , , - ] and thereby minimized their feeling of isolation [ , ], potentially improving rural workforce retention [ , ]. In addition, other unintended benefits of telehealth for clinicians were documented in many of the studies (11/63, 17%), such as improved digital literacy and confidence using technology [ , , ], improved work-life balance [ ], and increased flexibility in terms of the time and location of consultations [ , , , , , , , , ]. However, according to a study, this increased flexibility made possible by telehealth caused decision paralysis for clinicians [ ].On the basis of the findings from 11 (17%) of the 63 studies, telehealth caused health care providers cognitive fatigue [
, , , , , , , , , , ] due to the increased energy demand to maintain patient engagement [ , ], the higher concentration required due to the lack of nonverbal cues [ , ], the new routines and administrative work resulting from delivering care via telehealth [ , ], and the constant anticipation of what comes next and the adaptation to accommodate these new routines and changes [ , , ]. In 1 (2%) of the 63 studies, telehealth was reported to have caused ergonomic fatigue due to the extended periods providers spent sitting when providing care via telehealth [ ]. As documented in 7 (11%) of the 63 studies, telehealth was viewed as less rewarding and less satisfying to clinicians than in-person care delivery due to the absence of the personal touch and therapeutic connection [ , , , , , , ]. Finally, 7 (11%) of the 63 studies noted a consequence of telehealth where it was reported to affect clinicians’ roles and professional identity [ , , , , , , ].A number of studies (23/63, 37%) documented both positive and negative unintended consequences of telehealth associated with workforce sustainability and professional development. In particular, 2 (9%) of the 23 studies reported concerns about telehealth deskilling metropolitan clinicians providing care to rural regions via telehealth due to a lack of the hands-on experience necessary to build clinical skills [
] as well as rural clinicians due to a lack of opportunities to practice [ ]. Thus, as noted in 3 (13%) of the 23 studies, telehealth could potentially threaten the viability and sustainability of rural practice by leading to the loss of rural patients to metropolitan providers [ , , ]. Furthermore, in 2 (9%) of the 23 studies, telehealth was viewed as a technological replacement for health professionals [ ], potentially leading to shortages in the workforce and exacerbating health care accessibility issues in the long term [ ]. Nevertheless, as evidenced by a number of studies (18/23, 78%), telehealth was reportedly efficient for student supervision [ , ], improved clinicians’ access to informal training and education, and supported capacity building and continuing professional development for rural health professionals [ , , , , , - , , , , , , , , ]. However, 2 (9%) of the 23 studies presented contradictory findings because several clinicians shared difficulties teaching junior physicians and students via telehealth [ , ].Of the 63 studies, 51 (81%) documented 12 unintended consequences pertaining to the impact of telehealth on the use of resources in health care. On the basis of evidence from a number of studies (29/51, 57%), telehealth enhanced productivity, improved the timeliness of care, and enabled better use of physical resources; for instance, in 20 (69%) of the 29 studies, telehealth was reported to have saved clinicians’ time [
, , , , , ], particularly time spent on commuting or traveling to clinical facilities or patients’ homes [ , , , , , , , , , , ] and social and nonclinical activities [ ], allowing them to service more patients [ , , , , , , ]. Other reported telehealth benefits associated with time use included allowing providers to multitask [ , ], improving appointment scheduling [ , ] and attendance by patients [ , , , , , ], speeding up the referral process [ ], and streamlining patient triage [ , , , ]. According to 6 (12%) of the 51 studies, telehealth can potentially reduce health care system expenditures due to reduced cancellation rates [ ], saving clinicians’ travel time [ , , ], avoiding unnecessary patient transportation [ ], and reducing reimbursements of patient travel [ ]. Finally, in 3 (6%) of the 51 studies, telehealth was reported to have resulted in efficient use of the physical resources essential for health care delivery because it freed up space in hospitals [ ], lowered demand for community transport services [ ], and reduced instrument breakage [ ]. By contrast, many studies (34/51, 67%) noted unintended drawbacks of telehealth related to the degradation of efficiency in health care delivery. As evidenced in 21 (62%) of the 34 studies, this degradation in efficiency was primarily due to the increased time spent by clinicians on administrative and nonclinical workloads [ , , , , , , , , , , , , , , , , , , , , ]. Furthermore, 16 (47%) of the 34 studies reported other sources of inefficiencies in telehealth, such as the duplication of efforts by both patients and clinicians [ , , ]; poor triaging [ ]; impaired and disrupted workflows [ , , - , ]; and patients not preparing properly for a telehealth consultation as they would for an in-person consultation, wasting the clinician’s time and theirs [ , , , , , , , , , , ]. According to 3 (9%) of the 34 studies, inefficiencies in telehealth care delivery added to health care delivery costs, making telehealth cost-ineffective and financially unviable for providers [ , , ]. Finally, the findings from 6 (18%) of the 34 studies noted telehealth’s impact on health care efficiency because it added new processes and workflows or adapted existing ones [ , , , , , ].Discussion
Principal Findings
Our synthesis of studies evaluating telehealth in Australia suggests that there are both positive and negative unintended consequences, often affecting the same aspect of health care. This conclusion was particularly evident in how telehealth impacted patients’ privacy because several of the included studies (4/94, 4%) documented a positive impact of telehealth on privacy in small and Indigenous remote communities because it allowed anonymity [
, , , ]. By contrast, other included studies (8/94, 9%) reported privacy and confidentiality concerns, particularly for groups considered vulnerable, such as children and those who have experienced domestic violence [ , , , , , , , ], as a result of the blurred boundaries between personal and therapeutic or clinical spaces. These findings are in line with another issue highlighted in our review that telehealth compromised the safety of domestic violence victims and patients who are at risk of suicide because it was challenging to assess risks in the surrounding environment via telehealth [ , , , , - ]. These issues notwithstanding, a number of studies (13/94, 14%) in our review reported positive consequences of telehealth on patient safety due to various factors appertaining to the provision of care at home and in a familiar environment, as well as the elimination of unnecessary travel [ , , - , , , , - ].While the findings from our review present telehealth as a model that largely supports a person-centered approach to care delivery, the included studies also recorded challenges undermining person-centered care delivery via telehealth. Notably, telehealth was often reported to be inappropriate and unfit for the personal and cultural needs of certain groups, such as culturally and linguistically diverse communities [
, , , , , , ], Indigenous patients [ , ], and patients with cognitive and hearing impairments [ , , ]. The positive impact of telehealth on longitudinal and management continuity of care featured prominently throughout our review. However, telehealth was viewed as a hindrance to interpersonal continuity of care and challenging for rapport building, and as such, telehealth seems better suited as a complementary model rather than a substitute for in-person care because strong interpersonal therapeutic relationships are necessary for safe, efficient, and person-centered care.At times, telehealth resulted in neutral consequences with no clear intrinsic positive or negative attributes. Identifying these consequences can provide significant leverage to influence and improve care delivery via telehealth because they were often intermediate consequences that could lead to long-term positive or negative outcomes; for example, we categorized the introduction of new workflows and processes as a neutral consequence because it is not inherently positive or negative. However, the findings from multiple studies (5/94, 5%) in our review indicated increased workload and inefficiencies in service delivery due to these new workflows and processes [
, , , , ]. Alternatively, according to 1 (1%) of the 94 included studies, telehealth provided an opportunity to redesign service delivery because it improved existing processes [ ]. Another noteworthy issue is the differentiation between actual and potential outcomes because some of the studies (12/94, 13%) highlighted several potential unintended consequences—in addition to actual consequences—which were often voiced as concerns by stakeholders. These were often long-term consequences associated with workforce sustainability [ , , , ], the determinants of health [ , , - ], and the broader financial context within which the health system operates [ , ]. Including these potential outcomes in our review enables policy makers and health care planners to anticipate and prepare for future challenges and opportunities, facilitating proactive risk mitigation and benefit maximization, which is particularly important in the rapidly evolving field of telehealth.International Relevance
While our study primarily focused on the Australian context, the unintended consequences of telehealth implementation identified in this review have broader international relevance. Many of our findings resonate with research conducted in countries with similar health care systems or those facing comparable geographic challenges. These findings suggest that certain unintended consequences of telehealth may be inherent to the modality itself rather than being solely context specific; for instance, a recent review, which included studies from multiple countries, corroborates our findings on telehealth’s ability to empower patients, foster a perceived safe environment, and enhance family involvement [
]. While the review focused on telehealth for pain management, the findings from our review show that these patterns extend beyond pain management to encompass other specialties such as geriatric care, mental health services, and allied health disciplines, underscoring telehealth’s capacity to facilitate a person-centered approach to health care delivery. Furthermore, the potential of telehealth to address significant contributors to clinicians’ burnout, as highlighted in a Canadian study [ ], corroborates our findings on the unexpected positive impacts of telehealth on clinicians’ work-life balance, underscoring the importance of considering telehealth not only as a tool for patient care but also as a potential strategy for improving health care workforce sustainability.Conversely, our review also uncovered negative unintended consequences of telehealth that align with international findings. The cognitive and physical fatigue experienced by clinicians due to increased administrative workload and heightened concentration demands, as identified in our Australian-focused review, are mirrored in an international scoping review [
]. These findings suggest that the challenges of adapting to telehealth modalities are a universal experience for health care providers across different health care systems. More critically, our findings highlight telehealth’s potential to exacerbate existing health care disparities, a concern corroborated by research from the United States, suggesting that specific populations—particularly older adults, those with lower socioeconomic status, and non–English-speaking patients—faced challenges in accessing telehealth services during the COVID-19 pandemic [ ]. This alarming trend underscores the crucial need to prioritize equity of access in telehealth implementation, regardless of the health care system context.While many of our findings have international parallels, some of our results may be more specific to the Australian context; for instance, our observations regarding providing support and informal training for rural clinicians through telehealth might be particularly relevant to Australia’s unique geographic and demographic circumstances. While countries such as Canada or the United States might face similar rural health care challenges, the specific implementation and impact of telehealth in these areas may differ due to variations in health care systems, policies, and cultural factors. Therefore, caution is needed when interpreting and translating these findings to other health care systems.
Implications for Practice and Policy Making
One challenge in telehealth consultations that was featured repeatedly in multiple studies (17/94, 18%) in our review is the inability to examine patients in person [
, , , , , - , , , , , , , , ]. Some of the reported ways to mitigate the risk of wrong assessment due to this lack of in-person physical examination included selecting appropriate patients and cases for telehealth [ ], spending extra time eliciting information from patients [ ], lowering the diagnostic threshold [ , ], and conducting initial in-person assessments to gain a better understanding of the patient’s condition and circumstances [ , ]. Evidently, clinicians rely on their discretion when determining which cases or conditions are appropriate and safe for telehealth and what risk mitigation strategies to use. Professional bodies should frequently release evidence-based guidelines on which aspects of health care delivery and what cases are appropriate and safe for telehealth to assist clinicians in decision-making and ensure standardization. Recently, the Medical Board of Australia released telehealth guidelines incorporating feedback from professionals and the community [ ]. However, these guidelines lack details on cases, conditions, or aspects of care that are more suited to telehealth than in-person care; in addition, they do not provide recommendations on risk mitigation strategies beyond the technological and procedural aspects and routine precautions that apply to the provision of care in general, regardless of modality.Adopting a hybrid mode where providers combine telehealth and in-person care may lead to higher job satisfaction for clinicians because this mode can offer the rewarding feeling of providing care face-to-face that is lacking when delivering care via telehealth [
, , , , , , ], while balancing work and personal life [ ]. As such, the hybrid delivery mode could reduce burnout and help attract and retain health professionals in rural and regional areas that experience health workforce shortages. However, an unintended consequence of telehealth that was identified in our review is its potential to threaten rural practice [ , ], necessitating safeguards to ensure that rural and regional areas receive funding, training opportunities, and the on-the-ground workforce necessary to ensure the quality and safety of health care delivered to these communities. Furthermore, the fact that challenges were reported when delivering care to rural and regional patients due to a lack of context and local knowledge [ , ] underscores the need for clinicians to dedicate time to acquiring contextual knowledge and understanding patients’ specific circumstances to build solid therapeutic relationships and ensure the relevance of the clinical advice provided.One issue that was featured in our review is the ambiguity regarding clinical roles and responsibilities when multiple clinicians are involved in care delivery via telehealth [
, , ], suggesting the need for policy or laws to govern care provision via telehealth when multiple clinicians are involved, especially across various states or territories. We will need to specify roles and clinical responsibilities and be ready to deal with any medicolegal issues that may arise in such situations. Finally, perhaps the most concerning finding is the potential of telehealth to widen the digital divide, increasing disparities in health care access among specific groups such as older patients or those with limited digital literacy skills [ , ]. Initiatives to improve patients’ digital literacy [ , ] and provide patient information and guidelines on preparing for telehealth consultations [ , ] may support inclusive and equitable health care access via telehealth.Strengths and Limitations
The strength of this review is the inclusion of diverse qualitative, quantitative, and mixed methods studies from 4 databases, ensuring a comprehensive account of the unintended consequences of telehealth for the Australian health system. Our review translated these findings on the unintended consequences of telehealth into the AHPF dimensions, outlining a framework for assessing telehealth impact across the various health system domains and beyond and enabling comparison and standardization. Moreover, by systematically reviewing and categorizing unintended consequences, our study provides insights into which consequences are most frequently reported in the literature. This quantification helps prioritize areas for further research and policy attention, especially because recent policy changes and government funding have signaled a push toward incorporating telehealth as a standard modality of health service provision [
]. Thus, evidence-based insights such as those generated by our review are crucial for offering detailed recommendations for practitioners and policy makers on improving health care delivery via telehealth. To our knowledge, this review is the first attempt to synthesize evidence on the unintended consequences of telehealth, not only in Australia but also internationally.While a CIS has strong characteristics such as flexibility and interpretive freedom in the inclusion and synthesis of results, it can be a double-edged sword in cases such as our review where there are few to no published studies explicitly focused on the topic. Therefore, the evidence extracted from the included studies depends entirely on the authors’ interpretation of what can be considered an unintended consequence of telehealth, possibly leading to the exclusion of some relevant evidence. In our review, this negative impact was mitigated by the significant number of studies included, ensuring comprehensiveness. Furthermore, to minimize the impact of subjectivity when extracting data, we used explicit definitions for what constituted an unintended versus an intended consequence to guide our data extraction.
While our review identified overarching patterns and themes that cut across different telehealth modalities and specialties, a limitation of this study is the broad categorization of telehealth modalities without distinguishing between videoconferencing and telephone-based telehealth or between specialty-related consequences and the generalization of videoconferencing technologies. This approach may obscure important nuances specific to different modalities, technologies, or specialties; for instance, videoconferencing may present unique challenges related to technology use and nonverbal communication that are not present in telephone-based telehealth. These unique challenges underscore the need for more detailed analysis. Similarly, certain specialties may encounter distinct unintended consequences based on their specific care requirements.
Moreover, we did not distinguish between the various models of videoconferencing telehealth, such as dedicated videoconferencing units with pan, tilt, and zoom capabilities; computer-based videoconferencing; and mobile phone–based videoconferencing apps. These technologies may have unique characteristics that could lead to specific unintended consequences. While our approach offers valuable insights into general trends across telehealth implementations, it may not capture these modality-, specialty-, or technology-specific nuances.
Future Directions
There is still a dearth of studies focusing solely on the unintended consequences of telehealth. One plausible explanation could be that telehealth uptake only expanded recently, and long-term outcomes often take time to emerge. In addition, designing a study to investigate unintended consequences using conventional methods can be challenging. To capture the broader impact of telehealth and grasp the complex dynamics that could lead to the emergence of these consequences, studies with designs suited to study the complex nature of telehealth implementation are needed. Recent work proposed a complexity-informed and system-thinking–guided approach to investigate such unintended consequences, emphasizing the interconnectedness between the various actors involved in telehealth implementation [
]. Such theoretical frameworks can provide a holistic understanding of the situation compared to the linear reductionist approach that is often used to study and evaluate telehealth programs.There is little to no research examining the impact of telehealth beyond the health system and how telehealth influences, and is influenced by, factors such as the determinants of health and the broader health context, such as financial and societal aspects. We found that only 6 (6%) of the 94 studies touched upon the issue, and it was a secondary observation briefly noted by participants [
, , - ]. One noteworthy finding of our review is the potential of telehealth to threaten rural practice [ , ], suggesting a need for further research that investigates the impact of telehealth on rural workforce sustainability and rural practice viability. This is particularly important given the complexities of rural health and rural practice [ , ] and the growing perception of telehealth as a favorable solution to health care inaccessibility in rural areas [ , - ]. Furthermore, additional research is necessary to investigate the safety of health care provision via telehealth and to examine and compare the effectiveness of telehealth in terms of clinical outcomes across various settings, population groups, and specialties.Further research is needed to address some of the aforementioned limitations regarding the broad categorization of telehealth modalities. Such research should focus on conducting comparative analyses between different telehealth modalities and exploring how unintended consequences manifest across various specialties. These focused studies could provide a more granular understanding of how the choice of the telehealth modality and the specific medical context influence the nature and prevalence of unintended consequences. This would further enhance our understanding of telehealth implementation and guide more tailored strategies for mitigating potential negative outcomes in specific telehealth contexts. Future research could also build on our findings by conducting a more granular analysis of unintended consequences associated with specific videoconferencing technologies. Such studies could explore how factors such as image quality, ease of use, mobility, and specific features (eg, screen-sharing and recording capabilities) influence the nature and prevalence of unintended consequences. Moreover, as telehealth technologies continue to evolve rapidly, ongoing research will be crucial to understanding the implications of emerging videoconferencing tools and platforms and exploring consequences related to augmented reality features, artificial intelligence–assisted communication, or integration with other medical devices and systems.
Conclusions
The unintended consequences of telehealth synthesized in our review provide a framework for understanding the full impact of telehealth across the health care system and beyond. Identifying these consequences offers various opportunities to more fully leverage the advantages of telehealth while mitigating any potential harm, ultimately sustaining its adoption beyond the COVID-19 pandemic for safe and high-quality care across different settings and population groups. Planning and implementing a telehealth project is a complex undertaking, and while it is not entirely possible to plan and anticipate every possible unintended outcome, the consequences presented in our review provide a road map for planning, implementing, and scaling up telehealth projects to realize their full potential.
Acknowledgments
The authors would like to thank and acknowledge Jeremy Cullis for assistance with the development of the search strategy. This work was supported by a Macquarie University Research Excellence Scholarship (20224427) awarded to SO for PhD research. DL was affiliated with the Australian Institute of Health Innovation at Macquarie University at the time of the study and is currently affiliated with the Daffodil Centre.
Authors' Contributions
SO conceived and designed the study, conducted database search, screened studies, extracted data, performed data analysis and synthesis, wrote the original draft, and reviewed and edited subsequent drafts. KC contributed to abstract screening, reviewed and edited subsequent drafts, and provided guidance and supervision throughout the study. LAE, DL, and JB reviewed and edited subsequent drafts and provided guidance and supervision throughout the study. All authors approved the final version for publication.
Conflicts of Interest
None declared.
Search strategy.
DOCX File , 31 KBList of selected characteristics of the included studies and extracted unintended consequences.
XLSX File (Microsoft Excel File), 25 KBReferences
- Thomas E, Gallagher R, Grace SL. Future-proofing cardiac rehabilitation: transitioning services to telehealth during COVID-19. Eur J Prev Cardiol. Jul 10, 2021;28(7):e35-e36. [FREE Full text] [CrossRef] [Medline]
- Zhou X, Snoswell CL, Harding LE, Bambling M, Edirippulige S, Bai X, et al. The role of telehealth in reducing the mental health burden from COVID-19. Telemed J E Health. Apr 2020;26(4):377-379. [FREE Full text] [CrossRef] [Medline]
- Snoswell CL, Caffery LJ, Haydon HM, Thomas EE, Smith AC. Telehealth uptake in general practice as a result of the coronavirus (COVID-19) pandemic. Aust Health Rev. Aug 28, 2020;44(5):737-740. [CrossRef]
- Snoswell CL, Caffery LJ, Hobson G, Taylor ML, Mendis R, Haydon HM, et al. Telehealth and coronavirus: Medicare Benefits Schedule (MBS) activity in Australia. Centre for Online Health, The University of Queensland. Apr 16, 2024. URL: https://coh.centre.uq.edu.au/telehealth-and-coronavirus-medicare-benefits-schedule-mbs-activity-australia [accessed 2024-08-12]
- Zurynski Y, Ellis LA, Dammery G, Smith CL, Halim N, Ansell J, et al. The voice of Australian health consumers: the 2021 Australian health consumer sentiment survey. NHMRC Partnership Centre for Health System Sustainability, Consumers Health Forum of Australia. 2022. URL: https://healthsystemsustainability.com.au/wp-content/uploads/2022/03/PCHSS_ConsumerSentimentSurveyReport_FINAL3.pdf [accessed 2023-11-15]
- Adams L, Lester S, Hoon E, van der Haak H, Proudman C, Hall C, et al. Patient satisfaction and acceptability with telehealth at specialist medical outpatient clinics during the COVID-19 pandemic in Australia. Intern Med J. Jul 2021;51(7):1028-1037. [FREE Full text] [CrossRef] [Medline]
- Barton CJ, Ezzat AM, Merolli M, Williams CM, Haines T, Mehta N, et al. "It's second best": a mixed-methods evaluation of the experiences and attitudes of people with musculoskeletal pain towards physiotherapist delivered telehealth during the COVID-19 pandemic. Musculoskelet Sci Pract. Apr 2022;58:102500. [FREE Full text] [CrossRef] [Medline]
- Fogarty A, Savopoulos P, Seymour M, Cox A, Williams K, Petrie S, et al. Providing therapeutic services to women and children who have experienced intimate partner violence during the COVID-19 pandemic: challenges and learnings. Child Abuse Negl. Aug 2022;130(Pt 1):105365. [FREE Full text] [CrossRef] [Medline]
- Savira F, Robinson S, Toll K, Spark L, Thomas E, Nesbitt J, et al. Consumer preferences for telehealth in Australia: a discrete choice experiment. PLoS One. Mar 31, 2023;18(3):e0283821. [FREE Full text] [CrossRef] [Medline]
- Thomas EE, Haydon HM, Mehrotra A, Caffery LJ, Snoswell CL, Banbury A, et al. Building on the momentum: sustaining telehealth beyond COVID-19. J Telemed Telecare. May 2022;28(4):301-308. [CrossRef] [Medline]
- Omboni S, Padwal RS, Alessa T, Benczúr B, Green BB, Hubbard I, et al. The worldwide impact of telemedicine during COVID-19: current evidence and recommendations for the future. Connect Health. Jan 04, 2022;1:7-35. [FREE Full text] [CrossRef] [Medline]
- Telehealth. National Institutes of Health ,National Institute of Biomedical Imaging and Bioengineering. URL: https://www.nibib.nih.gov/science-education/science-topics/telehealth#pid-1421 [accessed 2023-11-15]
- Osman S, Churruca K, Ellis LA, Braithwaite J. Systems archetypes to investigate the unintended consequences of telehealth in rural Australia: a systems thinking approach to telehealth evaluation and policymaking. Int J Health Plann Manage. Mar 2024;39(2):204-219. [CrossRef] [Medline]
- Alami H, Gagnon MP, Fortin JP. Some multidimensional unintended consequences of telehealth utilization: a multi-project evaluation synthesis. Int J Health Policy Manag. Jun 01, 2019;8(6):337-352. [FREE Full text] [CrossRef] [Medline]
- Baert P. Unintended consequences: a typology and examples. Int Sociol. Jun 1991;6(2):201-210. [CrossRef]
- Bloomrosen M, Starren J, Lorenzi NM, Ash JS, Patel VL, Shortliffe EH. Anticipating and addressing the unintended consequences of health IT and policy: a report from the AMIA 2009 Health Policy Meeting. J Am Med Inform Assoc. 2011;18(1):82-90. [FREE Full text] [CrossRef] [Medline]
- Dixon-Woods M, Cavers D, Agarwal S, Annandale E, Arthur A, Harvey J, et al. Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Med Res Methodol. Jul 26, 2006;6:35. [FREE Full text] [CrossRef] [Medline]
- Dixit SK, Sambasivan M. A review of the Australian healthcare system: a policy perspective. SAGE Open Med. Apr 12, 2018;6:2050312118769211. [FREE Full text] [CrossRef] [Medline]
- Jabeen S. Unintended outcomes evaluation approach: a plausible way to evaluate unintended outcomes of social development programmes. Eval Program Plann. Jun 2018;68:262-274. [CrossRef] [Medline]
- Keatinge D, Rawlings K. Outcomes of a nurse-led telephone triage service in Australia. Int J Nurs Pract. Feb 2005;11(1):5-12. [CrossRef] [Medline]
- Knight K, Kenny A, Endacott R. Assessing clinical urgency via telephone in rural Australia. Nurs Health Sci. Jun 2015;17(2):201-207. [CrossRef] [Medline]
- Baker FA, Tamplin J. Music therapy service provision via telehealth in response to covid-19 restrictions: a survey of Australian practitioners and consumers. Aust J Music Ther. Jan 01, 2021;32(1):1-24. [FREE Full text]
- Banbury A, Parkinson L, Gordon S, Wood D. Implementing a peer-support programme by group videoconferencing for isolated carers of people with dementia. J Telemed Telecare. Oct 2019;25(9):572-577. [CrossRef] [Medline]
- Chapman JE, Ponsford J, Bagot KL, Cadilhac DA, Gardner B, Stolwyk RJ. The use of videoconferencing in clinical neuropsychology practice: a mixed methods evaluation of neuropsychologists' experiences and views. Aust Psychol. Mar 11, 2021;55(6):618-633. [CrossRef]
- Gibbs V, Cai RY, Aldridge F, Wong M. Autism assessment via telehealth during the Covid 19 pandemic: experiences and perspectives of autistic adults, parents/carers and clinicians. Res Autism Spectr Disord. Oct 2021;88:101859. [FREE Full text] [CrossRef] [Medline]
- Hines M, Bulkeley K, Dudley S, Cameron S, Lincoln M. Delivering quality allied health services to children with complex disability via telepractice: lessons learned from four case studies. J Dev Phys Disabil. Feb 16, 2019;31(5):593-609. [CrossRef]
- Lee JJ, Burbury K, Underhill C, Harris S, Shackleton K, McBurnie J, et al. Exploring Australian regional cancer patients' experiences of clinical trial participation via telehealth. J Telemed Telecare. Aug 2022;28(7):508-516. [CrossRef] [Medline]
- McQueen M, Strauss P, Lin A, Freeman J, Hill N, Finlay-Jones A, et al. Mind the distance: experiences of non-face-to-face child and youth mental health services during COVID-19 social distancing restrictions in Western Australia. Aust Psychol. Jun 09, 2022;57(5):301-314. [CrossRef]
- Smith SJ, Smith AB, Kennett W, Vinod SK. Exploring cancer patients', caregivers', and clinicians' utilisation and experiences of telehealth services during COVID-19: a qualitative study. Patient Educ Couns. Oct 2022;105(10):3134-3142. [FREE Full text] [CrossRef] [Medline]
- Smyth L, Roushdy S, Jeyasingham J, Whitbread J, O'Brien P, Lloyd C, et al. Clinician perspectives on rapid transition to telehealth during COVID-19 in Australia - a qualitative study. Aust Health Rev. Feb 2023;47(1):92-99. [CrossRef] [Medline]
- Venville A, O'Connor S, Roeschlein H, Ennals P, McLoughlan G, Thomas N. Mental health service user and worker experiences of psychosocial support via telehealth through the COVID-19 pandemic: qualitative study. JMIR Ment Health. Aug 12, 2021;8(8):e29671. [FREE Full text] [CrossRef] [Medline]
- Chatterton ML, Marangu E, Clancy EM, Mackay M, Gu E, Moylan S, et al. Telehealth service delivery in an Australian regional mental health service during COVID-19: a mixed methods analysis. Int J Ment Health Syst. Aug 19, 2022;16(1):43. [FREE Full text] [CrossRef] [Medline]
- Brown J, Doherty D, Claus AP, Gilbert K, Nielsen M. In a pandemic that limits contact, can videoconferencing enable interdisciplinary persistent pain services and what are the patient's perspectives? Arch Phys Med Rehabil. Mar 2022;103(3):418-423. [FREE Full text] [CrossRef] [Medline]
- Devadula S, Langbecker D, Vecchio P, Tesiram J, Meiklejohn J, Benham H. Tele-rheumatology to regional hospital outpatient clinics: patient perspectives on a new model of care. Telemed J E Health. Jul 2020;26(7):912-919. [CrossRef] [Medline]
- Fairweather GC, Lincoln MA, Ramsden R. Speech-language pathology teletherapy in rural and remote educational settings: decreasing service inequities. Int J Speech Lang Pathol. Dec 2016;18(6):592-602. [CrossRef] [Medline]
- Van Dam PJ, Caney D, Turner RC, Griffin P, Dwyer M, Prior S. Telehealth experiences of vulnerable clients living in Tasmania. Aust J Rural Health. Apr 2022;30(2):188-196. [FREE Full text] [CrossRef] [Medline]
- Pitt R, Hill AJ, Theodoros D, Russell T. “I definitely think it’s a feasible and worthwhile option”: perspectives of speech-language pathologists providing online aphasia group therapy. Aphasiology. Jun 08, 2018;32(9):1031-1053. [CrossRef]
- Filbay S, Bennell KL, Morello R, Smith L, Hinman RS, Lawford BJ. Exploring experiences with telehealth-delivered allied healthcare services for people with permanent and significant disabilities funded through a national insurance scheme: a qualitative study examining challenges and suggestions to improve services. BMJ Open. Sep 14, 2022;12(9):e065600. [FREE Full text] [CrossRef] [Medline]
- Thrum M, Driscoll C, Keogh T. Investigating the satisfaction of clinicians and clients in a teleaudiology trial. J Hear Sci. Dec 31, 2018;8(4):34-47. [CrossRef]
- Ayres L, Pelkowitz L, Simon P, Thompson SC. Necessity as the catalyst of change: exploring client and provider perspectives of accelerated implementation of telehealth by a regional Australian community service organisation during COVID-19 restrictions. Int J Environ Res Public Health. Oct 30, 2021;18(21):11433. [FREE Full text] [CrossRef] [Medline]
- Isautier JM, Copp T, Ayre J, Cvejic E, Meyerowitz-Katz G, Batcup C, et al. People's experiences and satisfaction with telehealth during the COVID-19 pandemic in Australia: cross-sectional survey study. J Med Internet Res. Dec 10, 2020;22(12):e24531. [FREE Full text] [CrossRef] [Medline]
- Bradford NK, Young J, Armfield NR, Herbert A, Smith AC. Home telehealth and paediatric palliative care: clinician perceptions of what is stopping us? BMC Palliat Care. Jun 16, 2014;13:29. [FREE Full text] [CrossRef] [Medline]
- Smithson R, Roche E, Wicker C. Virtual models of chronic disease management: lessons from the experiences of virtual care during the COVID-19 response. Aust Health Rev. Jun 2021;45(3):311-316. [CrossRef] [Medline]
- Sutarsa IN, Kasim R, Steward B, Bain-Donohue S, Slimings C, Hall Dykgraaf S, et al. Implications of telehealth services for healthcare delivery and access in rural and remote communities: perceptions of patients and general practitioners. Aust J Prim Health. Dec 2022;28(6):522-528. [CrossRef] [Medline]
- White J, Byles J, Walley T. The qualitative experience of telehealth access and clinical encounters in Australian healthcare during COVID-19: implications for policy. Health Res Policy Syst. Jan 15, 2022;20(1):9. [FREE Full text] [CrossRef] [Medline]
- Snoswell CL, Smith AC, Page M, Scuffham P, Caffery LJ. Quantifying the societal benefits from telehealth: productivity and reduced travel. Value Health Reg Issues. Mar 2022;28:61-66. [FREE Full text] [CrossRef] [Medline]
- Mackenzie L, Noble N, Proietto A, Jones J, Norton G, Palazzi K. Acceptability and feasibility of telehealth outpatient video-link consultations: a national cross-sectional survey of surgeons prior to the COVID-19 pandemic. Aust J Rural Health. Apr 2023;31(2):244-255. [FREE Full text] [CrossRef] [Medline]
- De Guzman KR, Snoswell CL, Giles CM, Smith AC, Haydon HM. GP perceptions of telehealth services in Australia: a qualitative study. BJGP Open. Mar 22, 2022;6(1):BJGPO.2021.0182. [FREE Full text] [CrossRef] [Medline]
- Thomas EE, de Camargo Catapan S, Haydon HM, Barras M, Snoswell C. Exploring factors of uneven use of telehealth among outpatient pharmacy clinics during COVID-19: a multi-method study. Res Social Adm Pharm. Sep 2022;18(9):3602-3611. [FREE Full text] [CrossRef] [Medline]
- Wade VA, Eliott JA, Hiller JE. A qualitative study of ethical, medico-legal and clinical governance matters in Australian telehealth services. J Telemed Telecare. Mar 2012;18(2):109-114. [CrossRef] [Medline]
- Aung E, Pasanen L, LeGautier R, McLachlan SA, Collins A, Philip J. The role of telehealth in oncology care: a qualitative exploration of patient and clinician perspectives. Eur J Cancer Care (Engl). Mar 2022;31(2):e13563. [CrossRef] [Medline]
- Butt Z, Kirsten L, Beatty L, Kelly B, Dhillon H, Shaw JM. Barriers and enablers to implementing telehealth consultations in psycho-oncology. Psychooncology. Aug 2022;31(8):1365-1373. [FREE Full text] [CrossRef] [Medline]
- Jhaveri D, Emeto TI, Alele FO, Strom A, Benham H. Use of telemedicine for rheumatology practice in Queensland, Australia: experiences before and during the COVID-19 pandemic. Intern Med J. Oct 2022;52(10):1685-1690. [CrossRef] [Medline]
- McPherson K, Nahon I. Telehealth and the provision of pelvic health physiotherapy in regional, rural and remote Australia. Aust N Z Continence J. 2021;27(3):66-70. [CrossRef]
- Thomas EE, Taylor ML, Ward EC, Hwang R, Cook R, Ross JA, et al. Beyond forced telehealth adoption: a framework to sustain telehealth among allied health services. J Telemed Telecare. Apr 2024;30(3):559-569. [FREE Full text] [CrossRef] [Medline]
- Collier A, Morgan DD, Swetenham K, To TH, Currow DC, Tieman JJ. Implementation of a pilot telehealth programme in community palliative care: a qualitative study of clinicians' perspectives. Palliat Med. Apr 2016;30(4):409-417. [CrossRef] [Medline]
- Wiadji E, Mackenzie L, Reeder P, Gani JS, Carroll R, Smith S, et al. Utilization of telehealth by surgeons during the COVID 19 pandemic in Australia: lessons learnt. ANZ J Surg. Apr 2021;91(4):507-514. [FREE Full text] [CrossRef] [Medline]
- Olver IN, Selva-Nayagam S. Evaluation of a telemedicine link between Darwin and Adelaide to facilitate cancer management. Telemed J. 2000;6(2):213-218. [CrossRef] [Medline]
- Eapen V, Dadich A, Balachandran S, Dani A, Howari R, Sequeria AZ, et al. E-mental health in child psychiatry during COVID-19: an initial attitudinal study. Australas Psychiatry. Oct 2021;29(5):498-503. [CrossRef] [Medline]
- Fogarty A, Jones A, Seymour M, Savopoulos P, Evans K, O'Brien J, et al. The parenting skill development and education service: telehealth support for families at risk of child maltreatment during the COVID‐19 pandemic. Child Fam Soc Work. Dec 02, 2021;27(3):392-404. [CrossRef]
- Knott V, Habota T, Mallan K. Attitudes of Australian psychologists towards the delivery of therapy via video conferencing technology. Aust Psychol. Mar 11, 2021;55(6):606-617. [CrossRef]
- Johnsson G, Bulkeley K. Practitioner and service user perspectives on the rapid shift to teletherapy for individuals on the autism spectrum as a result of COVID-19. Int J Environ Res Public Health. Nov 11, 2021;18(22):11812. [FREE Full text] [CrossRef] [Medline]
- Haydon HM, Caffery LJ, Snoswell CL, Thomas EE, Taylor M, Budge M, et al. Optimising specialist geriatric medicine services by telehealth. J Telemed Telecare. Dec 2021;27(10):674-679. [CrossRef] [Medline]
- Toll K, Spark L, Neo B, Norman R, Elliott S, Wells L, et al. Consumer preferences, experiences, and attitudes towards telehealth: qualitative evidence from Australia. PLoS One. Aug 31, 2022;17(8):e0273935. [FREE Full text] [CrossRef] [Medline]
- Hardie RA, Thomas J, Li J, Pearce C, Georgiou A. General practice perspective on the use of telehealth during the COVID-19 pandemic in Australia using an Action Research approach: a qualitative study. BMJ Open. Oct 27, 2022;12(10):e063179. [FREE Full text] [CrossRef] [Medline]
- James S, Ashley C, Williams A, Desborough J, Mcinnes S, Calma K, et al. Experiences of Australian primary healthcare nurses in using telehealth during COVID-19: a qualitative study. BMJ Open. Aug 06, 2021;11(8):e049095. [FREE Full text] [CrossRef] [Medline]
- Sutherland R, Hodge A, Chan E, Silove N. Clinician experiences using standardised language assessments via telehealth. Int J Speech Lang Pathol. Dec 2021;23(6):569-578. [CrossRef] [Medline]
- Swales M, Theodoros D, Hill AJ, Russell T. Speech-language pathologists' perceptions of the use of telepractice in the delivery of services to people with Parkinson's disease: a national pilot survey. Int J Speech Lang Pathol. Aug 2020;22(4):387-398. [CrossRef] [Medline]
- Auret K, Pikora T, Pola M. Specialist haematology consultation services in regional Western Australia: evaluating a model combining telehealth and onsite clinics. Intern Med J. Mar 2022;52(3):451-457. [CrossRef] [Medline]
- Fix L, Seymour JW, Sandhu MV, Melville C, Mazza D, Thompson TA. At-home telemedicine for medical abortion in Australia: a qualitative study of patient experiences and recommendations. BMJ Sex Reprod Health. Jul 2020;46(3):172-176. [FREE Full text] [CrossRef] [Medline]
- Javanparast S, Roeger L, Kwok Y, Reed RL. The experience of Australian general practice patients at high risk of poor health outcomes with telehealth during the COVID-19 pandemic: a qualitative study. BMC Fam Pract. Apr 08, 2021;22(1):69. [FREE Full text] [CrossRef] [Medline]
- Kelly JT, Warner MM, Conley M, Reidlinger DP, Hoffmann T, Craig J, et al. Feasibility and acceptability of telehealth coaching to promote healthy eating in chronic kidney disease: a mixed-methods process evaluation. BMJ Open. Jan 29, 2019;9(1):e024551. [FREE Full text] [CrossRef] [Medline]
- Kohlhoff J, Cibralic S, Horswood D, Turnell A, Maiuolo M, Morgan S. Feasibility and acceptability of internet-delivered parent-child interaction therapy for rural Australian families: a qualitative investigation. Rural Remote Health. Jan 2020;20(1):5306. [FREE Full text] [CrossRef] [Medline]
- McGrath P. Technology-based patient consultations: research findings from haematology patients in regional, rural and remote queensland. Patient. Apr 2015;8(2):199-206. [CrossRef] [Medline]
- O'Brian S, Smith K, Onslow M. Webcam delivery of the Lidcombe program for early stuttering: a phase I clinical trial. J Speech Lang Hear Res. Jun 01, 2014;57(3):825-830. [CrossRef] [Medline]
- Owen N. Feasibility and acceptability of using telehealth for early intervention parent counselling. Adv Ment Health. Oct 18, 2019;18(1):39-49. [CrossRef]
- Raatz MK, Ward EC, Marshall J. Telepractice for the delivery of pediatric feeding services: a survey of practice investigating clinician perceptions and current service models in Australia. Dysphagia. Apr 2020;35(2):378-388. [CrossRef] [Medline]
- Jhaveri D, Larkins S, Kelly J, Sabesan S. Remote chemotherapy supervision model for rural cancer care: perspectives of health professionals. Eur J Cancer Care (Engl). Jan 2016;25(1):93-98. [CrossRef] [Medline]
- Mooi JK, Whop LJ, Valery PC, Sabesan SS. Teleoncology for indigenous patients: the responses of patients and health workers. Aust J Rural Health. Oct 2012;20(5):265-269. [CrossRef] [Medline]
- Callisaya ML, Lee AH, Khushu A. Rapid implementation of telehealth in geriatric outpatient clinics due to COVID-19. Intern Med J. Jul 2021;51(7):1151-1155. [FREE Full text] [CrossRef] [Medline]
- Cartledge S, Rawstorn JC, Tran M, Ryan P, Howden EJ, Jackson A. Telehealth is here to stay but not without challenges: a consultation of cardiac rehabilitation clinicians during COVID-19 in Victoria, Australia. Eur J Cardiovasc Nurs. Aug 29, 2022;21(6):548-558. [FREE Full text] [CrossRef] [Medline]
- Hill AJ, Miller LE. A survey of the clinical use of telehealth in speech-language pathology across Australia. J Clin Pract Speech Lang Pathol. 2012;14(3):110-117. [FREE Full text]
- Newman L, Bidargaddi N, Schrader G. Service providers' experiences of using a telehealth network 12 months after digitisation of a large Australian rural mental health service. Int J Med Inform. Oct 2016;94:8-20. [CrossRef] [Medline]
- Pasanen L, Le Gautier R, Wong A, Wawryk O, Collins A, Schwetlik S, et al. Telehealth in outpatient delivery of palliative care: a qualitative study of patient and physician views. Palliat Support Care. Jul 12, 2022;21(6):980-987. [CrossRef]
- Phillips D, Matheson L, Pain T, Kingston GA. Evaluation of an occupational therapy led paediatric burns telehealth review clinic: exploring the experience of family/carers and clinicians. Rural Remote Health. Feb 2022;22(1):6887. [FREE Full text] [CrossRef] [Medline]
- Roberts S, Spain B, Hicks C, London J, Tay S. Telemedicine in the Northern territory: an assessment of patient perceptions in the preoperative anaesthetic clinic. Aust J Rural Health. Jun 2015;23(3):136-141. [CrossRef] [Medline]
- Shiner CT, Vratsistas-Curto A, Bramah V, McDonell K, Mahoney AE, Sweeney S, et al. Assessing unmet rehabilitation needs and the feasibility of a telehealth rehabilitation consultation service for road trauma survivors recently discharged from hospital. Disabil Rehabil. Jul 2022;44(15):3795-3804. [CrossRef] [Medline]
- Snoswell CL, Caffery LJ, Haydon HM, Wickramasinghe SI, Crumblin K, Smith AC. A cost-consequence analysis comparing patient travel, outreach, and telehealth clinic models for a specialist diabetes service to Indigenous people in Queensland. J Telemed Telecare. Oct 2019;25(9):537-544. [CrossRef] [Medline]
- Wade VA, Karnon J, Eliott JA, Hiller JE. Home videophones improve direct observation in tuberculosis treatment: a mixed methods evaluation. PLoS One. 2012;7(11):e50155. [FREE Full text] [CrossRef] [Medline]
- Wiadji E, Mackenzie L, Reeder P, Gani JS, Ahmadi S, Carroll R, et al. Patient perceptions of surgical telehealth consultations during the COVID 19 pandemic in Australia: lessons for future implementation. ANZ J Surg. Sep 21, 2021;91(9):1662-1667. [FREE Full text] [CrossRef] [Medline]
- Bassilios B, Pirkis J, King K, Fletcher J, Blashki G, Burgess P. Evaluation of an Australian primary care telephone cognitive behavioural therapy pilot. Aust J Prim Health. 2014;20(1):62-73. [CrossRef] [Medline]
- Haines KJ, Sawyer A, McKinnon C, Donovan A, Michael C, Cimoli C, et al. Barriers and enablers to telehealth use by physiotherapists during the COVID-19 pandemic. Physiotherapy. Mar 2023;118:12-19. [FREE Full text] [CrossRef] [Medline]
- Campbell J, Theodoros D, Russell T, Hartley N, Gillespie N. Role and process change and satisfaction with an educational and developmental psychologist telehealth service for rural children. Educ Dev Psychol. May 03, 2021;38(1):143-157. [CrossRef]
- Erickson S, Bridgman K, Furlong L, Stark H. Speech-language pathologist perspectives of the implementation of telepractice-delivered stuttering treatment for school-age children. Lang Speech Hear Serv Sch. Jan 05, 2022;53(1):30-43. [CrossRef] [Medline]
- Hines M, Lincoln M, Ramsden R, Martinovich J, Fairweather C. Speech pathologists' perspectives on transitioning to telepractice: what factors promote acceptance? J Telemed Telecare. Dec 2015;21(8):469-473. [CrossRef] [Medline]
- Sutherland R, Hodge A, Chan E, Silove N. Barriers and facilitators: clinicians' opinions and experiences of telehealth before and after their use of a telehealth platform for child language assessment. Int J Lang Commun Disord. Nov 2021;56(6):1263-1277. [CrossRef] [Medline]
- Shannon MM, Callum SM, Callisaya ML. Uncovering healthcare staff attitudes to the rapid deployment of telehealth in Victoria, 2020-2021: a 12-month telehealth experience. Intern Med J. Jun 2023;53(6):1018-1026. [CrossRef] [Medline]
- Mclaughlin EJ, Ellett LC, Readman E, Mooney S. Telehealth for gynaecology outpatients during the COVID-19 pandemic: patient and clinician experiences. Aust N Z J Obstet Gynaecol. Aug 2022;62(4):553-559. [FREE Full text] [CrossRef] [Medline]
- Fairweather GC, Lincoln MA, Ramsden R. Speech-language pathology telehealth in rural and remote schools: the experience of school executive and therapy assistants. Rural Remote Health. 2017;17(3):4225. [FREE Full text] [CrossRef] [Medline]
- Bagot KL, Cadilhac DA, Vu M, Moss K, Bladin CF, VST Collaborators. Telemedicine in the acute health setting: a disruptive innovation for specialists (an example from stroke). J Telemed Telecare. Dec 2015;21(8):443-448. [CrossRef] [Medline]
- Johnsson G, Kerslake R, Crook S. Delivering allied health services to regional and remote participants on the autism spectrum via video-conferencing technology: lessons learned. Rural Remote Health. Sep 2019;19(3):5358. [FREE Full text] [CrossRef] [Medline]
- Buist A, Coman G, Silvas A, Burrows G. An evaluation of the telepsychiatry programme in Victoria, Australia. J Telemed Telecare. 2000;6(4):216-221. [CrossRef] [Medline]
- Rainsford S, Hall Dykgraaf S, Phillips C. Effectiveness of telehealth palliative care Needs Rounds in rural residential aged care during the COVID-19 pandemic: a hybrid effectiveness-implementation study. Aust J Rural Health. Feb 2022;30(1):108-114. [FREE Full text] [CrossRef] [Medline]
- Martin-Khan M, Fatehi F, Kezilas M, Lucas K, Gray LC, Smith AC. Establishing a centralised telehealth service increases telehealth activity at a tertiary hospital. BMC Health Serv Res. Dec 03, 2015;15:534. [FREE Full text] [CrossRef] [Medline]
- Bagot KL, Bladin CF, Vu M, Kim J, Hand PJ, Campbell B, et al. Exploring the benefits of a stroke telemedicine programme: an organisational and societal perspective. J Telemed Telecare. Dec 2016;22(8):489-494. [CrossRef] [Medline]
- Zilliacus E, Meiser B, Lobb E, Barlow-Stewart K, Tucker K. A balancing act--telehealth cancer genetics and practitioners' experiences of a triadic consultation. J Genet Couns. Dec 2009;18(6):598-605. [CrossRef] [Medline]
- Harrison JD, Durcinoska I, Butow PN, White K, Solomon MJ, Young JM. Localized versus centralized nurse-delivered telephone services for people in follow up for cancer: opinions of cancer clinicians. Asia Pac J Clin Oncol. Jun 2014;10(2):175-182. [CrossRef] [Medline]
- Robinson S. Video-conferencing: under-used by rural general practitioners. Aust Health Rev. 2002;25(6):131-135. [CrossRef] [Medline]
- Guilfoyle C, Wootton R, Hassall S, Offer J, Warren M, Smith D, et al. User satisfaction with allied health services delivered to residential facilities via videoconferencing. J Telemed Telecare. 2003;9 Suppl 1:S52-S54. [CrossRef] [Medline]
- Sharpe K, Elcock M, Aitken P, Furyk J. The use of telehealth to assist remote hospital resuscitation and aeromedical retrieval tasking: a 12-month case review. J Telemed Telecare. Jul 2012;18(5):260-266. [CrossRef] [Medline]
- Johnston K, Smith D, Preston R, Evans R, Carlisle K, Lengren J, et al. "From the technology came the idea": safe implementation and operation of a high quality teleradiology model increasing access to timely breast cancer assessment services for women in rural Australia. BMC Health Serv Res. Nov 30, 2020;20(1):1103. [FREE Full text] [CrossRef] [Medline]
- Neuhaus M, Langbecker D, Caffery LJ, Taylor M, Garner L, Williams G, et al. Telementoring for hepatitis C treatment in correctional facilities. J Telemed Telecare. Dec 2018;24(10):690-696. [CrossRef] [Medline]
- Dixon-Woods M, Sutton A, Shaw R, Miller T, Smith J, Young B, et al. Appraising qualitative research for inclusion in systematic reviews: a quantitative and qualitative comparison of three methods. J Health Serv Res Policy. Jan 2007;12(1):42-47. [CrossRef] [Medline]
- Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. Jul 10, 2008;8:45. [FREE Full text] [CrossRef] [Medline]
- Carroll C, Booth A, Leaviss J, Rick J. "Best fit" framework synthesis: refining the method. BMC Med Res Methodol. Mar 13, 2013;13:37. [FREE Full text] [CrossRef] [Medline]
- Carroll C, Booth A, Cooper K. A worked example of "best fit" framework synthesis: a systematic review of views concerning the taking of some potential chemopreventive agents. BMC Med Res Methodol. Mar 16, 2011;11:29. [FREE Full text] [CrossRef] [Medline]
- Ritchie J, Spencer L. Qualitative data analysis for applied policy research. In: The Qualitative Researcher's Companion. Thousand Oaks, CA. SAGE Publications; 2002.
- Dixon-Woods M. Using framework-based synthesis for conducting reviews of qualitative studies. BMC Med. Apr 14, 2011;9:39. [FREE Full text] [CrossRef] [Medline]
- Australia's health performance framework. Australian Institute of Health and Welfare, Australian Government. URL: https://www.aihw.gov.au/reports-data/australias-health-performance/australias-health-performance-framework [accessed 2023-10-29]
- The Australian health performance framework. The National Health Information and Performance Principal Committee. Sep 2017. URL: https://www.aihw.gov.au/getmedia/1c95574c-ac07-4126-8b7c-31eb29d9b381/oos318_attachment-1.pdf.aspx [accessed 2024-08-12]
- Continuity and coordination of care: a practice brief to support implementation of the WHO Framework on integrated people-centred health services. World Health Organization. Nov 07, 2018. URL: https://www.who.int/publications/i/item/9789241514033 [accessed 2024-08-12]
- Deeny S, Gardner T, Al-Zaidy S, Barker I, Steventon A. Reducing hospital admissions by improving continuity of care in general practice. The Health Foundation. Feb 2017. URL: https://www.health.org.uk/publications/reducing-hospital-admissions-by-improving-continuity-of-care-in-general-practice# [accessed 2024-08-12]
- Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, et al. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. Nov 01, 2017;19(11):e367. [FREE Full text] [CrossRef] [Medline]
- Fernandes LG, Devan H, Fioratti I, Kamper SJ, Williams CM, Saragiotto BT. At my own pace, space, and place: a systematic review of qualitative studies of enablers and barriers to telehealth interventions for people with chronic pain. Pain. Feb 01, 2022;163(2):e165-e181. [CrossRef] [Medline]
- Appireddy R, Khan S, Leaver C, Martin C, Jin A, Durafourt BA, et al. Home virtual visits for outpatient follow-up stroke care: cross-sectional study. J Med Internet Res. Oct 07, 2019;21(10):e13734. [FREE Full text] [CrossRef] [Medline]
- Hilty DM, Armstrong CM, Smout SA, Crawford A, Maheu MM, Drude KP, et al. Findings and guidelines on provider technology, fatigue, and well-being: scoping review. J Med Internet Res. May 25, 2022;24(5):e34451. [FREE Full text] [CrossRef] [Medline]
- Eberly LA, Khatana SA, Nathan AS, Snider C, Julien HM, Deleener ME, et al. Telemedicine outpatient cardiovascular care during the COVID-19 pandemic: bridging or opening the digital divide? Circulation. Aug 04, 2020;142(5):510-512. [FREE Full text] [CrossRef] [Medline]
- Telehealth consultations with patients. Medical Board Ahpra. URL: https://www.medicalboard.gov.au/Codes-Guidelines-Policies/Telehealth-consultations-with-patients.aspx [accessed 2024-01-16]
- Digital health. Good Things Foundation Australia. URL: https://goodthingsaustralia.org/our-programs/digital-health/ [accessed 2024-08-04]
- About Canberra health literacy hub. Canberra Health Literacy Hub. URL: https://cbrhl.org.au/about-canberra-health-literacy/ [accessed 2024-01-15]
- How to prepare for a telehealth consultation. Cancer Council. Apr 30, 2020. URL: https://www.cancer.org.au/blog/how-to-prepare-for-a-telehealth-consultation [accessed 2024-01-15]
- Preparing for a virtual appointment. Agency for Clinical Innovation. URL: https://aci.health.nsw.gov.au/__data/assets/pdf_file/0008/654857/Preparing-for-a-virtual-appointment.pdf [accessed 2024-01-15]
- MBS telehealth services - from 1 July 2024. Department of Health and Aged Care, Australian Government. URL: https://www.mbsonline.gov.au/internet/mbsonline/publishing.nsf/Content/Factsheet-Telehealth-Updates-April%202023 [accessed 2024-07-02]
- Osman S, Churruca K, Ellis LA, Braithwaite J. Beyond the planned and expected: the unintended consequences of telehealth in rural and remote Australia through a complexity lens. Med J Aust. Jun 03, 2024;220(10):496-498. [CrossRef] [Medline]
- Moffatt JJ, Eley DS. The reported benefits of telehealth for rural Australians. Aust Health Rev. Aug 2010;34(3):276-281. [CrossRef] [Medline]
- Gagnon MP, Duplantie J, Fortin JP, Landry R. Exploring the effects of telehealth on medical human resources supply: a qualitative case study in remote regions. BMC Health Serv Res. Jan 11, 2007;7(1):6. [FREE Full text] [CrossRef] [Medline]
- Calleja Z, Job J, Jackson C. Offsite primary care providers using telehealth to support a sustainable workforce in rural and remote general practice: a rapid review of the literature. Aust J Rural Health. Feb 2023;31(1):5-18. [CrossRef] [Medline]
Abbreviations
AHPF: Australian Health Performance Framework |
CIS: critical interpretive synthesis |
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses |
RQ: research question |
Edited by G Eysenbach; submitted 27.02.24; peer-reviewed by V Minichiello, M Mars, B Wolfe-Piggott; comments to author 11.06.24; revised version received 01.07.24; accepted 16.07.24; published 27.08.24.
Copyright©Sagda Osman, Kate Churruca, Louise A Ellis, Dan Luo, Jeffrey Braithwaite. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 27.08.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.