Review
Abstract
Background: The virulent and unpredictable nature of COVID-19 combined with a change in reimbursement mechanisms both forced and enabled the rapid adoption of telemedicine around the world. Thus, it is important to now assess the effects of this rapid adoption and to determine whether the barriers to such adoption are the same today as they were under prepandemic conditions.
Objective: The objective of this systematic literature review was to examine the research literature published during the COVID-19 pandemic to identify facilitators, barriers, and associated medical outcomes as a result of adopting telemedicine, and to determine if changes have occurred in the industry during this time.
Methods: The systematic review was performed in accordance with the Kruse protocol and the results are reported in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. We analyzed 46 research articles from five continents published during the first year of the COVID-19 pandemic that were retrieved from searches in four research databases: PubMed (MEDLINE), CINAHL, Science Direct, and Web of Science.
Results: Reviewers identified 25 facilitator themes and observations, 12 barrier themes and observations, and 14 results (compared to a control group) themes and observations. Overall, 22% of the articles analyzed reported strong satisfaction or satisfaction (zero reported a decline in satisfaction), 27% reported an improvement in administrative or efficiency results (as compared with a control group), 14% reported no statistically significant difference from the control group, and 40% and 10% reported an improvement or no statistically significant difference in medical outcomes using the telemedicine modality over the control group, respectively.
Conclusions: The pandemic encouraged rapid adoption of telemedicine, which also encouraged practices to adopt the modality regardless of the challenges identified in previous research. Several barriers remain for health policymakers to address; however, health care administrators can feel confident in the modality as the evidence largely shows that it is safe, effective, and widely accepted.
doi:10.2196/31752
Keywords
Introduction
Rationale
The virulent nature of COVID-19 forced social distancing and a decrease of in-person visits to clinics around the world. Telemedicine presented health care providers with solutions that enabled a social-distancing window into the clinical environment and a continuation of the doctor-patient relationship.
Telemedicine is defined by the World Health Organization as healing from a distance through information communications technologies by all health care professionals for the “exchange of valid information for diagnosis, treatment and prevention of disease and injuries, research and evaluation” [
]. Telemedicine is not a perfect means of patient care; however, it offers great advantages to overcome geographical barriers to improve health outcomes [ ]. Validated and peer-reviewed international statistics are elusive on adoption figures, but a recent question-and-answer session indicates overall low adoption of telemedicine internationally [ ]. In the United States, prior to the pandemic, telemedicine had only been adopted by 8% of providers [ ]. Providers have recognized wide acceptance of telemedicine by patients; however, prior to the desperate circumstances of COVID-19, they had not been willing to adopt telemedicine on a wide scale [ ]. The largest challenges to the adoption of telemedicine were identified as technically challenged staff, resistance to change, cost, reimbursement, and education level of the patient [ ]. Telemedicine saves patients time, consultation fees, and travel expenses [ ]. However, telemedicine requires users at both ends to possess certain levels of technological skills such as those required to enable video teleconferencing [ ]. Fortunately, some countries enacted legislation to expand the adoption of telemedicine. For example, in the United States, telemedicine was not easily reimbursed by federal programs until the Coronavirus Aid, Relief, and Economic Security (CARES) Act legislation [ ], which greatly increased reimbursement mechanisms for the telemedicine modality. This change in reimbursement structure should not be ignored, and it most likely provided a significant catalyst to the adoption of telemedicine.A large number of articles were published in the first 12 months of the pandemic (February 2020 to February 2021) on the rapid implementation efforts of telemedicine to enable clinics and hospitals to continue to see patients and care for their needs [
, ]. However, providers acknowledge some of the shortfalls inherent to this modality, such as lack of technical infrastructure, cost, lack of technical staff, computer literacy of both staff and patients, and a negative impact on the patient-to-provider relationship [ , - ]. A systematic review performed in 2020 on telemedicine and COVID-19 evaluated 44 articles along four service lines and identified 10 themes of efficiency [ ]. However, the authors did not evaluate facilitators and barriers to adoption or health outcomes. Another systematic review [ ] was performed in 2016 on the barriers to the adoption of telemedicine worldwide, which evaluated 30 articles across all service lines in all countries; however, it also did not evaluate facilitators or health outcomes.Although analyses have been published that highlight the advantages to the adoption of telemedicine, with an 8% adoption rate in the United States, the conclusions of these previous studies may not be as robust as possible. The circumstances presented by the pandemic have encouraged wider adoption of this modality of care. Therefore, with proper systematic review techniques, reviewer observations this far into the pandemic will undoubtedly be more robust and widely applicable to medicine.
Objectives
The purpose of this systematic review was to evaluate the facilitators and barriers to the adoption of telemedicine worldwide, including an analysis of health outcomes and patient satisfaction. A brief comparison of the results of this review with those of reviews performed prior to COVID-19 was further performed to identify changes in these factors in light of the pandemic.
Methods
Protocol and Registration
The Kruse protocol for writing a systematic review was followed, and the findings are reported in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) guidelines [
, ]. This systematic review was registered in PROSPERO on August 2, 2021 (ID CRD42021235933).Eligibility Criteria
The search parameters were established to find articles published in 2020 and 2021 concerning telemedicine in all aspects of care and for all ages of patients, published in peer-reviewed journals, using any method of study (mixed method, quantitative, and qualitative). Other systematic reviews were excluded because we wanted to compare our results to these previous reviews without confounding the findings. The Johns Hopkins Nursing Evidence-Based Practice Rating Scale (JHNEBP) was used to assess the quality of all articles analyzed [
]. Any studies below level IV C were discarded due to poor quality.Information Sources
Four research databases were searched: PubMed (MEDLINE), CINAHL (excluding MEDLINE), Web of Science, and Science Direct. We also performed a journal-specific search of the Journal of Medical Internet Research.
Search Strategy
Google Scholar was used to determine the general trends of publication on this topic previously and to collect key terms from published articles. These key terms were entered into the US Library of Medicine’s Medical Subject Headings (MeSH) to create an exhaustive search string using Boolean terms. The actual search string used was: (telemedicine OR telehealth OR “mobile health” OR mhealth OR ehealth) AND (COVID-19 OR coronavirus). The same search string was used in all databases. Similar filters were used in each database (not all filters are the same between databases).
Study Selection Process
Once the search string was entered into each database, we filtered the results and screened abstracts for applicability. Although filters for the four research databases differ, we generally filtered for the date range (2020-2021), scholarly journals (no theses or opinions), and “full text” to ensure that we would have access to the entire article. Articles were rejected for a variety of reasons: protocol (no results to analyze); opinion (no data); reviews; did not use telemedicine; or did not contribute to our objective statement of identifying facilitators, barriers, or effects on patient satisfaction. The κ statistic was calculated to identify the level of agreement between reviewers [
].Data Collection Process
An Excel spreadsheet was used as a data-extraction tool to collect data for reporting and analysis. This spreadsheet was standardized according to the Kruse protocol [
]. We held three consensus meetings to screen abstracts, analyze articles, and discuss possible themes. After the second consensus meeting, we performed a narrative analysis to identify themes in the articles analyzed [ ]. Because there were only two authors on this project, both authors analyzed all articles (n=46).Data Items
In accordance with the Kruse protocol, PRISMA standard, and JHNEBP, the following fields were collected: database source; date of publication; journal; authors; study title; PICOS (participants, intervention, results, outcomes, study design); sample size; bias within study; effect size; country of origin; statistics used; quality metrics from the JHNEBP scale; and reviewer observations as they relate specifically to the objective statement in areas of patient satisfaction, and facilitators and barriers to adoption [
, , ]. All data items were independently collected and discussed in subsequent consensus meetings.Risk of Bias Within and Across Studies
The JHNEBP rating scale was used for assessment of bias within and across studies. Observations of bias and methodological weaknesses were noted [
]. The JHNEBP ratings also provided insight into bias because poor-quality results can limit the external validity of the experiment.Summary Measures
Because we included mixed methods and qualitative studies, we were unable to standardize summary measures as would be performed in a meta-analysis.
Additional Analyses
We performed a narrative, or thematic, analysis of the observations to convert them into themes (common threads between articles) [
]. We calculated the frequency of occurrence of both themes and individual observations and report these in a series of affinity matrices (tables). This technique was used to identify the statistical probability for identifying each theme, which does not identify a level of importance but rather identifies a frequency of mention of these themes in the literature during the period of observation.Results
Study Selection
The database search and study selection process are illustrated in
. The κ statistic was 0.95, indicating almost perfect agreement between reviewers [ , ]. Several studies made it through all filters, but were still eliminated because they were protocols (no results), opinions, out of the date range, or other systematic reviews.Study Characteristics
Reviewers collected study characteristics identified by the PRISMA standard such as PICOS (see
). Of the 46 six studies analyzed over the 15-month period, 2 (4%) involved adolescents, 6 (13%) involved adults >60 years, and 38 (83%) involved adults >18 years as participants. Most participants were current or former patients who agreed to participate in studies. More than half the interventions were mobile health (mHealth), telephone/televideo, or eHealth (26/46, 56%). The rest were interventions involving telemonitoring, patient portals, telecoaching, web chat, and social media, which could be cross-platform. In these 46 studies, 18 resulted in a positive outcome over a control group (23%), 12 of which involved medically measured outcomes (21%) as opposed to clinical and administrative outcomes. Only 9 of the 46 (20%) studies resulted in no statistically significant difference between the intervention and control groups, which means that positive results could be obtained through telemedicine commensurate with those obtained using traditional means of care. Four articles analyzed were published in 2021 [ - ], with the remaining 42 articles published in 2020 [ - ]. Further explanation of the results and medical outcomes can be found the Additional Analysis subsection.Study | Participant | Intervention | Results (compared to the control group or other studies) | Medical outcomes | Design |
Ben-Arye et al [ | ]Adult patients (>18 years) undergoing adjuvant, neoadjuvant, or palliative treatment for solid tumors | eHealth | Improved compliance/adherence | Not reported | Prospective, controlled, and nonrandomized study |
Yu et al [ | ]Older adult patients (50% >60 years, 60% women, 68% one-time telehealth users) and 45 physicians | Telephone or televideo | Improved patient satisfaction | Not reported | Cross-sectional |
Richards et al [ | ]Adult respondents from a neurosurgical outpatient clinic (mean age 63 years, 50.3% men) | Telephone or televideo | Improved patient satisfaction | Not reported | Qualitative |
Kurihara et al [ | ]Adult patients with Parkinson disease (61% women, mean age 67 years) at Fukuoka University Hospital | Telemedicine self-testing | No control group (nonexperimental) | Not reported | Cross-sectional |
Alkire et al [ | ]Adults (Gen X, Millennial) | Patient portals | No control group (nonexperimental) | Not reported | Nonexperimental |
Ballin et al [ | ]Older adults, 70-year-old men, and women with central obesity | Supervised and web-based | No significant difference; decreased fat mass | Improved in at least one area: decreased fat mass | Randomized controlled trial |
Banbury et al [ | ]Adults >50 years with at least one chronic condition | Telemonitoring | Telemedicine improved results compared to control: companionship, emotional support, health literacy, self-management | Not reported | Mixed methods, quasiexperimental, nonrandomized trial |
Barnett et al [ | ]Adults (22-27 years; 10 men, 10 women), clients of an alcohol and drug counseling service across Australia, and 8 counselors | Webchat | No control group (nonexperimental) | Not reported | Qualitative study, nonexperimental |
Batalik et al [ | ]Adult cardiac rehabilitation patients | Home-based telerehab | No statistically significant difference | No statistically significant difference | Randomized controlled trial |
Beller et al [ | ]Adult patients scheduled for video visits through the University of Virginal urology departments | Televideo | No control group (nonexperimental) | Not reported | Cohort |
Bernabe-Ortiz et al [ | ]Adult participants from a randomized clinical trial on a 1-year mHealtha intervention on blood pressure and body weight 4 years postcompletion | mHealth | Telemedicine improved results compared to control: decreased fat mass | Improved in at least one area; decreased body weight | Retrospective study of a randomized clinical trial |
Bilgrami et al [ | ]Adults with inflammatory bowel disease | Telemedicine self-testing | No statistically significant difference | No statistically significant difference | Randomized controlled trial |
Broers et al [ | ]Adult patients with cardiovascular disease | eHealth | No statistically significant difference; increased quality of life | Not reported | Randomized controlled trial |
Cho et al [ | ]Adult participants (30-59 years) with at least 2 conditions defined by the Third Report of the National Cholesterol Education Program expert panel (abdominal obesity, high blood pressure, high triglycerides, low high-density lipoprotein cholesterol, and high fasting glucose level) | mHealth | Telemedicine improved results compared to control (decreased fat mass) | Improved in at least one area: decreased fat mass, decreased body weight | Randomized controlled trial |
Claes et al [ | ]Adult patients with cardiovascular disease from 3 European hospitals | eHealth | Improved health behaviors | Not reported | Randomized controlled trial |
Coorey et al [ | ]Adults who had completed 12 months of follow-up from the Consumer Navigation of Electronic Cardiovascular Tools trial | eHealth | No control group (nonexperimental): improved self-management, improved health literacy | Not reported | Qualitative analysis of a randomized controlled study |
Ding et al [ | ]Adults (mean age 70.1 years) with chronic heart failure | Telemonitoring | Telemedicine improved results compared to controls: improved compliance/adherence | Not reported | Randomized controlled trial |
Geramita et al [ | ]Adult lung transplant recipients | mHealth | No statistically significant difference | Not reported | Randomized controlled follow-up study |
Gong et al [ | ]Adult hypertension | mHealth | Telemedicine improved results compared to controls: improved compliance/adherence | Improved in at least one area: reductions in blood pressure | Randomized controlled trial |
Han et al [ | ]Adults (<55 years) prepandemic (S1) and 273 follow-up surveys (S2); university-affiliated, and physicians | eHealth | No control group (nonexperimental): telemedicine improved results compared to controls, improved compliance/adherence | Not reported | Qualitative |
Harding et al [ | ]Adult caregivers with 837 patient assessment outcomes | mHealth | No control group (nonexperimental) | Not reported | Qualitative (pilot study) |
Hsia et al [ | ]Pediatric patients with asthma | mHealth | Telemedicine improved results compared to controls: improved self-management, improved patient satisfaction | Improved self-management, decreased medication use, increase in controlled asthma | Prospective study |
Hsieh et al [ | ]Insured adults (>20 years) | Patient portals | No control group (nonexperimental) | Not reported | Qualitative |
Hutchesson et al [ | ]Adult Australian women with a recent history of preeclampsia | mHealth | No statistically significant difference | No statistically significant difference | Pilot randomized controlled trial |
Jiménez-Marrero et al [ | ]Adult patients with chronic heart failure | Televideo | Telemedicine improved results compared to controls, decreased cost | Improved in at least one area: decreased incidence of heart failure | Randomized controlled trial |
Katt et al [ | ]180 patients with upper-extremity condition and 302 physicians | Telephone or televideo | Improved patient satisfaction | Not reported | Qualitative |
Kobe et al [ | ]Adult patients (52% men, mean age 62 years, 55.5% African American) of Duke University Health System with type 2 diabetes, poorly controlled hypertension, and on prescription hypertension and diabetes medication | Telephone or televideo | Telemedicine improved results compared to control | Improved in at least one area, improved annual rate eGFRb decline | Secondary analysis of randomized controlled trial |
Lai et al [ | ]Adults with Parkinson disease (telehealth mean age 63 years, control mean age 70 years; 70% men, predominantly White) | Telemonitoring | Telemedicine improved results compared to control: improved compliance/adherence, health behaviors, and patient satisfaction | Not reported | Mixed methods |
Lemelin et al [ | ]Adult women (mean age 32 years) with gestational diabetes mellitus | Telecoaching | Improved patient satisfaction: telemedicine improved results compared to control | Identified other areas for intervention | Prospective and controlled clinical trial |
Manning et al [ | ]Adults from families with toddlers | Televideo | No statistically significant difference | Not reported | Mixed method quasiexperimental and longitudinal design |
Marques et al [ | ]Adult Valladolid University students (74% women, 67.5% aged 18-23 years) | mHealth | No control group (nonexperimental) | Not reported | Qualitative |
Martins et al [ | ]Adult patients (mean age 62 years, 50% women) with suspected acute strokes at a Brazil university hospital | mHealth | Telemedicine improved results compared to control | Improved in at least one area: decreased mortality, decreased intracranial hemorrhage | Prospective observational |
McGillicuddy et al [ | ]Adults (mean 51.5-52.1 years) with kidney transplants (majority men, African American) | mHealth | Telemedicine improved results compared to control | Improved in at least one area: reduction in mean tacrolimus trough coefficient of variation | Randomized controlled clinical trial |
Mo et al [ | ]Adult patients (51.7-53.5 years) with chronic heart failure (approximately 66% men) | Telephone or televideo | Telemedicine improved results compared to control: improved emotional support | Improved in at least one area: mental health inventory, quality of life | Open-label interventional study |
Mustonen et al [ | ]Adult patients (>45 years; mean age 65 years) with type 2 diabetes and coronary artery disease (approximately 40% women) | Telecoaching | No statistically significant difference | Not reported | Posttrial analysis of a randomized controlled trial |
O’Shea et al [ | ]Adults (77% men, mean age 61 years) | eHealth | Not reported | Not reported | Posttrial analysis of an acceptability and feasibility trial |
Perri et al [ | ]Adults (mean 55.4 years) from 14 counties in Florida (83% women, 73.9% White) | Telephone or televideo | Telemedicine improved results compared to control: decreased fat mass, improved self-management | Improved in at least one area: decreased body weight | Randomized clinical trial |
Piera-Jiménez et al [ | ]Adults (majority 50-70 years and men) from Spain, the Netherlands, and Taiwan | Telemonitoring | Telemedicine improved results compared to control | Improved in at least one area, improved quality of life | Financial randomized controlled trial |
Press et al [ | ]Adults (mean 54.5 years) with asthma or chronic obstructive pulmonary disease (majority Black women) | mHealth | Telemedicine improved results compared to control: improved self-management health behaviors | Increase in controlled asthma | Randomized controlled trial |
Ramirez-Correa et al [ | ]Adults (mean 39.9 years, 56% men) | Telemedicine self-testing | No control group (nonexperimental) | Not reported | Cross-sectional |
Ronan et al [ | ]Adults with cystic fibrosis involved in a study on an online Tai Chi intervention | Televideo | No statistically significant difference, improved health behaviors | Not reported | Qualitative analysis of a mixed methods randomized controlled feasibility study |
Sacco et al [ | ]Older adults (mean age 88.2 years), 59.8% women | Telephone or video | Improved patient satisfaction, improved emotion support | Not reported | Cross-sectional survey |
Scheerman et al [ | ]Adolescents (12-17 years) and mothers | Social media | Telemedicine improved results compared to control, improved health behaviors | Not reported | Cluster randomized controlled trial |
Schrauben et al [ | ]Adult Chronic Renal Insufficiency Cohort (CRIC) Study participants (mean age 68 years, eGFR 54 mL/min/1.73, 59% men) | mHealth | No control group (nonexperimental) | Not reported | Cross-sectional survey |
Shareef et al [ | ]Elderly and disabled people (average age 74.5 years, 59% women) in retirement homes and rehabilitation centers | Robotics or artificial intelligence | Improved companionship | Not reported | Experiment and follow-up survey |
van Dijk et al [ | ]Adult women (mean age 30 years), either less than 13 weeks pregnant or trying to become pregnant, and 36 men | mHealth | Improved compliance/adherence, improved health behaviors | Improved in at least one area, improved self-management | Randomized controlled trial |
amHealth: mobile health.
beGFR: estimated glomerular filtration rate.
Risk of Bias Within and Across Studies
summarizes the quality indicators assessed for each article with the JHNEBP tool. The strength of evidence most frequently observed was level III followed by level I and level II. Nearly half of the articles reported strong-evidence studies that included both a control group and randomization; the next most common study type was nonexperimental (no control group) or qualitative, with the least frequent type being quasiexperimental (included a control group but no randomization). The quality of evidence most frequently observed was A (high quality), followed by B (good quality). The most common combination of strength and quality was III B, followed closely by I A, which speaks to both the strength and quality of evidence evaluated by this review. The III B combination highlights the number of qualitative studies with smaller samples or selection bias.
Evidence | Occurrence, n (%) | |
Strength | ||
I (Experimental study or randomized controlled trial) | 22 (48) | |
III (Nonexperimental, qualitative) | 17 (37) | |
II (quasiexperimental) | 7 (15) | |
Quality | ||
A (High quality) | 27 (59) | |
B (Good quality) | 17 (37) | |
C (Low quality) | 2 (4) |
Many studies used geographically localized samples, which may limit the external validity of the results. Some studies focused only on one gender or race, speaking to the convenience sample or volunteer-basis of their design. Asking for volunteers in a technology-oriented experiment invites bias because the self-selection allows for those who are already technology-oriented or comfortable with technology to participate. This group as the intervention can skew the results because those already comfortable with technology will not experience the frustration experienced by those who are not comfortable with technology. This selection bias also limits the external validity of the results. A comprehensive list of bias, country of origin, sample size, strength, and quality of evidence identified for each study can be found in
.Thematic Analysis Based on Results of Individual Studies
During the analysis phase of the systematic review process, the reviewers recorded observations to identify instances of patient satisfaction, as well as both facilitators and barriers to the adoption of telemedicine. A thematic analysis was then performed to make sense of the observations [
]. Multiple instances of the same observation become a theme. A translation of observations to themes is provided in . The summary of analysis is provided in , which lists the themes/observations from reviewers that correspond with the objective statement and sorts articles from the most recent to the oldest.Authors | Patient satisfaction | Facilitators | Barriers |
Ben-Arye et al [ | ]Not reported | Technical literacy, availability of technology, past experience with technology | Availability of technology, confidentiality/security |
Yu et al [ | ]Strong satisfaction | Concerns adequately addressed, improved health behaviors, pandemic created acceptance of technology | Some patients prefer in-person consultations, decrease in patient-provider communication, technical literacy |
Richards et al [ | ]Strong satisfaction | Convenience of telemedicine, increased patient-provider communication, concerns adequately addressed, increased access | Not reported |
Kurihara et al [ | ]Not reported | Pandemic created acceptance of technology, past experience with technology | Some patients prefer in-person consultations, technical literacy |
Alkirie et al [ | ]Not reported | Technical literacy, past experience with technology, perceived usefulness, increased patient-provider communication, perceived ease of use | Technology needs further development, technical literacy |
Ballin et al [ | ]Not reported | Increased connectedness, self-management, flexibility, and access | Technology needs further development |
Banbury et al [ | ]Not reported | Enabled social interaction; decreased anxiety; increased connectedness, technical literacy, and access; televideo enables reading of body language; education; convenience of telemedicine | Health literacy, availability of technology, technical literacy |
Barnett et al [ | ]Not reported | Increased efficiency, access, and patient-provider communication, and improved standard of care | Technology needs further development, decrease in patient-provider communication, technical literacy, confidentiality/security |
Batalik et al [ | ]Not reported | Technical literacy, increased self-management, increased access, increased flexibility | Discomfort for wearable monitors, technical literacy, technology needs further development |
Beller et al [ | ]Not reported | Pandemic created acceptance of technology, availability of technology, fewer miles driven to appointment, convenience of telemedicine, faster initiation of treatment, decreased costs | Limits of reimbursement for telemedicine, some patients prefer in-person consultations, connectivity, technical literacy |
Bernabe-Ortiz et al [ | ]Not reported | Increased connectedness, increased adherence, improved health behaviors | Perceived lack of usefulness, lack of personal desire to get better, some patients prefer in-person consultations |
Bilgrami et al [ | ]Not reported | Pandemic created acceptance of technology | Not reported |
Broers et al [ | ]Strong satisfaction | Perceived usefulness, perceived ease of use, increased adherence | Decrease in quality of life after intervention |
Cho et al [ | ]Not reported | Increased adherence, increased self-management, increased weight loss, technical literacy | Technical literacy, availability of technology |
Claes et al [ | ]Not reported | Technical literacy, perceived ease of use | Technology needs further development |
Coorey et al [ | ]Not reported | Increased adherence, increased self-management | Lack of personal desire to get better, technology needs further development, technical literacy |
Ding et al [ | ]Not reported | Increased adherence, increased self-management | Technology needs further development, cost |
Geramita et al [ | ]Not reported | Long-term use may not be required to develop good habits | Cost, confidentiality/security, technology needs further development |
Gong et al [ | ]Not reported | Increased adherence, increased self-management | Not reported |
Han et al [ | ]Not reported | Pandemic created acceptance of technology, increased efficiency, increased self-management, increased access, availability of technology | Cost, technical literacy, interoperability, availability of technology |
Harding et al [ | ]Not reported | Not reported | Connectivity, confidentiality/security, technical literacy |
Hsia et al [ | ]Strong satisfaction | Increased quality of life, decreased emergency room visits, increased adherence, availability of technology, pandemic created acceptance of technology, perceived ease of use, convenience of telemedicine | Connectivity, technical literacy, cost, availability of technology |
Hsieh et al [ | ]Not reported | Health literacy, perceived usefulness, perceived ease of use | Some patients prefer in-person consultations, technical literacy, cost |
Hutchesson et al [ | ]Strong satisfaction | Increased self-management, perceived usefulness, perceived ease of use | Technology needs further development, perceived lack of usefulness |
Jiménez-Marrero et al [ | ]Not reported | Decreased costs, increased adherence, increased self-management | Cost |
Katt et al [ | ]Strong satisfaction | Convenience of telemedicine, pandemic created acceptance of technology, faster initiation of treatment, perceived ease of use | Some patients prefer in-person consultations, workflow issues for providers |
Kobe et al [ | ]Not reported | Not reported | Some patients prefer in-person consultations |
Lai et al [ | ]Strong satisfaction | Convenience of telemedicine, increased social support, increased self-management | Technology needs further development, connectivity, decrease in patient-provider communication, technical literacy |
Lemelin et al [ | ]Strong satisfaction | Education, increased social support | Not reported |
Manning et al [ | ]Not reported | Pandemic created acceptance of technology | Connectivity, availability of technology |
Marquez et al [ | ]Not reported | Past experience with technology, decreased costs, pandemic created acceptance of technology, faster initiation of treatment, increased access | Some patients prefer in-person consultations |
Martins et al [ | ]Not reported | Faster initiation of treatment, availability of technology, increased access | Lack of infrastructure, limits of reimbursement for telemedicine, connectivity, confidentiality/security |
McGillicuddy et al [ | ]Not reported | Increased social support, health literacy | Not reported |
Mo et al [ | ]Not reported | Increased quality of life, increased social support | Not reported |
Mustonen et al [ | ]Not reported | Decreased costs | Not reported |
O’Shea et al [ | ]Satisfaction | Increased self-management | Technical literacy, perceived lack of usefulness, technology needs further development |
Perri et al [ | ]Not reported | Increased weight loss, increased adherence, increased self-management | Not reported |
Piera-Jiménez et al [ | ]Not reported | Decreased costs, no significant difference in cost care | Cost |
Press et al [ | ]Not reported | Decreased costs, education, increased access | Availability of technology, technical literacy |
Ramirez-Correa et al [ | ]Not reported | Increased patient-provider communication, education, pandemic created acceptance of technology | Connectivity |
Ronan et al [ | ]Not reported | Convenience of telemedicine, pandemic created acceptance of technology, increased social support | Technical literacy, technology needs further development, availability of technology |
Sacco et al [ | ]Strong satisfaction | Increased social support, increased connectedness | Not reported |
Scheerman et al [ | ]Not reported | Increased social support, improved standard of care | Not reported |
Schrauben et al [ | ]Not reported | Health literacy, education | Technical literacy, health literacy, confidentiality/security |
Shareef et al [ | ]Not reported | Enabled social interaction, increased social support | Confidentiality/security, technical literacy, perceived lack of usefulness |
van Dijk et al [ | ]Not reported | Improved health behaviors, increased adherence | Not reported |
Patient satisfaction was reported as “strong satisfaction” or “satisfaction” in 9 (20%) and 1 (2%) of the 46 studies, respectively, and 36 studies did not report any measure of patient satisfaction. No studies reported a decline in patient satisfaction as a result of using telemedicine as the intervention.
Twenty-five facilitator themes and seven individual observations were identified in the literature by the two reviewers. Only two studies did not identify facilitators. Facilitator themes are listed in
.Themes/observations | References | Occurrence, n (%) |
Increased self-management | [ | , , , , , , , , , , , ]12 (9.1) |
Pandemic created acceptance of technology | [ | , , , , , , , , , , ]11 (8.3) |
Increased adherence | [ | , , , , , , , , , ]10 (7.6) |
Increased access | [ | , - , , , , ]9 (6.8) |
Increased social support | [ | , , , , - , ]8 (6.1) |
Convenience of telemedicine | [ | , , , , , , ]7 (5.3) |
Perceived ease of use | [ | , , , - , ]7 (5.3) |
Decreased costs | [ | , , , , , ]6 (4.5) |
Education | [ | , , , , ]5 (3.8) |
Technical literacy | [ | , , , , ]5 (3.8) |
Availability of technology | [ | , , , , ]5 (3.8) |
Increased patient-provider communication | [ | , , , ]4 (3.0) |
Faster initiation of treatment | [ | , , , ]4 (3.0) |
Increased connectedness | [ | , , , ]4 (3.0) |
Perceived usefulness | [ | , , , ]4 (3.0) |
Past experience with technology | [ | , , , ]4 (3.0) |
Health literacy | [ | , , ]3 (2.3) |
Improved health behaviors | [ | , , ]3 (2.3) |
Increased efficiency | [ | , ]2 (1.5) |
Concerns adequately addressed | [ | , ]2 (1.5) |
Enabled social interaction | [ | , ]2 (1.5) |
Increased quality of life | [ | , ]2 (1.5) |
Improved standard of care | [ | , ]2 (1.5) |
Increased flexibility | [ | , ]2 (1.5) |
Increased weight loss | [ | , ]2 (1.5) |
Decreased anxiety | [ | ]1 (0.8) |
Increased technical literacy | [ | ]1 (0.8) |
Televideo enables reading of body language | [ | ]1 (0.8) |
Fewer miles driven to appointment | [ | ]1 (0.8) |
Long-term use may not be required to develop good habits | [ | ]1 (0.8) |
Decreased emergency room visits | [ | ]1 (0.8) |
No significant difference in cost of care | [ | ]1 (0.8) |
Not reported | [ | , ]2 (N/Aa) |
aN/A: not applicable.
The most commonly identified themes were increased self-management, acceptance of the technology from the pandemic, adherence to treatment protocols, access, and social support. For the 46 articles, these themes represent 38% of all 132 occurrences. Other themes included convenience of telemedicine and perceived ease of use, decreased cost, opportunity for education, technical literacy, availability of technology, an increase in patient-provider communication, faster initiation of treatment, increased connectedness, perceived usefulness, and past experience with technology. Health literacy and improved health behaviors were identified less frequently, and increased office efficiencies, medical concerns adequately addressed, enabled social interaction, increased quality of life, improved standard of care, increased flexibility, and increased weight loss were the least frequent themes identified. The following seven individual observations accounted for 5% of the total observations: decreased anxiety, increased technical literacy, televideo enabled reading of body language, fewer miles driven to appointment, long-term use may not be required to develop good habits, decreased emergency room visits, and no significant difference in cost of care.
Twelve themes and five individual observations were identified as barriers from the literature by the reviewers; 11 studies did not identify barriers (11%).
lists the themes and individual observations.The most commonly listed barriers were technical literacy, technology needs further development, availability of technology, and patient preference, accounting for 55% of the total 86 occurrences. Cost, connectivity, and confidentiality/security were also identified, as well as health literacy, limits of reimbursement for telemedicine, and lack of personal desire to get better with less frequent occurrences (2 each). The remaining five observations made up a total of 6% of the total occurrences: decrease in quality of life after intervention, discomfort for wearing monitors, workflow issues for providers, lack of data infrastructure, and interoperability.
Themes/observations | References | Occurrence, n (%) |
Technical literacy | [ | , , , - , , , - , , , , , , ]19 (22) |
Technology needs further development | [ | , , , , - , , , , ]12 (14) |
Availability of technology | [ | , , , , , , , ]8 (9) |
Cost | [ | , , , , , , ]7 (8) |
Connectivity | [ | , , , , , , ]7 (8) |
Confidentiality/security | [ | , , , , , , ]7 (8) |
Some patients prefer in-person consultations | [ | , , , , , , , ]8 (9) |
Perceived lack of usefulness | [ | , , , ]4 (5) |
Decrease in patient-provider communication | [ | , , ]3 (3) |
Health literacy | [ | , ]2 (2) |
Limits of reimbursement for telemedicine | [ | , ]2 (2) |
Lack of personal desire to get better | [ | , ]2 (2) |
Decrease in quality of life after intervention | [ | ]1 (1) |
Discomfort for wearable monitors | [ | ]1 (1) |
Workflow issues for providers | [ | ]1 (1) |
Lack of infrastructure | [ | ]1 (1) |
Interoperability | [ | ]1 (1) |
Not reported | [ | , , , , - , , , , ]11 (N/Aa) |
aN/A: not applicable.
Additional Analyses
Distribution of Publications by Country
Eighteen of the 46 studies (39%) were performed in North America, 11 (24%) were performed in Europe, 7 (15%) were performed in Asia, 5 (11%) were performed in Australia, 3 (7%) were performed in South America, and 2 (4%) were performed in multiple countries and continents.
Comparisons to a Control Group
summarizes the themes and observations recorded for results as compared to the control group identified by the two reviewers. There is some overlap between this set of observations and medical outcomes; the latter represent clinical observations only, whereas the former are both clinical and administrative in nature. Ten themes and four individual observations were identified by the reviewers for a total of 66 occurrences in the literature. Eleven studies were nonexperimental in nature, which had no control group.
Eighteen of the studies demonstrated either a clinical or administrative improvement compared to the control group, whereas nine reported no statistically significant results from the control group. Both of these themes demonstrate the efficacy of the telemedicine modality. The remainder of the list in
demonstrates the specific improvements that occurred (multiple improvements occurred in multiple articles), including improved patient satisfaction, improved behaviors, improved compliance/adherence to treatment protocol, improved self-management of condition or disease, decreased fat mass, improved emotional support, improved companionship, and improved health literacy. The remainder were individual observations that combined accounted for 5% of the total observations: improved informational support, decreased cost, and increased quality of life. Only one article did not report a result as compared to the control group because it was a posttrial analysis and it did not address the control group.Themes/observations | References | Occurrence, n (%) |
Telemedicine improved results compared to control | [ | , , , , , , , , - , - , - , ]18 (27) |
No statistically significant difference | [ | , , , , , , , , ]9 (14) |
Improved patient satisfaction | [ | , , , , , , ]7 (11) |
Improved health behaviors | [ | , , , , , ]6 (9) |
Improved compliance/adherence | [ | , , , , , ]6 (9) |
Improved self-management | [ | , , , , ]5 (8) |
Decreased fat mass | [ | , , , ]4 (6) |
Improved emotional support | [ | , , ]3 (5) |
Improved companionship | [ | , ]2 (3) |
Improved health literacy | [ | , ]2 (3) |
Improved informational support | [ | ]1 (2) |
Decreased cost | [ | ]1 (2) |
Increased quality of life | [ | ]1 (2) |
Not reported | [ | ]1 (2) |
No control group (nonexperimental) | [ | , , , , , , , , , , ]11 (N/Aa) |
aN/A: not applicable.
Medical Outcomes Commensurate With an Intervention
summarizes the medical outcomes observed. Seven themes and nine individual observations were recorded commensurate with the adoption of telemedicine for a total of 30 occurrences. Twenty-eight studies did not report clinical outcomes.
Twelve studies reported 12 statistically significant improvements in clinical outcomes and three reported no statistically significant difference between modalities of care. Both of these themes demonstrated the efficacy of the telemedicine modality. The most commonly observed theme for medical outcomes was decreased body weight, followed by decreased fat mass, improved self-management, increase in controlled asthma, and increased quality of life. The following individual observations contributed to 30% of the total observations: reduction in blood pressure, reduction in mean tacrolimus trough coefficient of variation, improved annual rate of estimated glomerular filtration rate (eGFR) decline, decrease in medication use, decrease incidence of heart failure, decreased mortality, improved mental health inventory, decreased intracranial hemorrhage, and telemedicine identified other areas for intervention.
Themes/observations | References | Occurrence, n (%) |
Improved in at least one area | [ | , , , , , , - , , , ]12 (40) |
No statistically significant difference | [ | , , ]3 (10) |
Decreased body weight | [ | , , ]3 (10) |
Decreased fat mass | [ | , ]2 (7) |
Improved self-management | [ | , ]2 (7) |
Increase in controlled asthma | [ | , ]2 (7) |
Improved quality of life | [ | , ]2 (7) |
Reductions in blood pressure | [ | ]1 (3) |
Reduction in mean tacrolimus trough coefficient of variation | [ | ]1 (3) |
Improved annual rate of eGFRa decline | [ | ]1 (3) |
Decreased medication use | [ | ]1 (3) |
Decreased incidence of heart failure | [ | ]1 (3) |
Identified other areas for intervention | [ | ]1 (3) |
Decreased mortality | [ | ]1 (3) |
Improved mental health inventory | [ | ]1 (3) |
Decreased intracranial hemorrhage | [ | ]1 (3) |
Not reported | [ | - , , , , , - , , , , , , , , , , - ]28 (N/Ab) |
aeGFR: estimated glomerular filtration rate.
bN/A: not applicable.
Interactions Between Observations
Interventions of mHealth resulted in seven occurrences of a result (clinical and administrative outcomes) and six occurrences of an improvement in at least one clinical outcome. The interventions with telephone or televideo resulted in four instances of improved patient satisfaction and a decrease in eGFR and weight loss. The interventions of eHealth resulted in very few instances of either clinical or administrative outcomes other than improved compliance and health behaviors.
Discussion
Principal Findings
Telemedicine is examined in countries worldwide, and it is clear that the COVID-19 pandemic caused a rapid adoption of this modality of medicine to ensure the viability of practices. A key issue for discussion is the differences in findings between this systematic review and another recent similar review [
]. This systematic review identified key facilitators and barriers, and further analyzed health outcomes. The other similar review identified themes of effectiveness but failed to meet the expectations for a systematic review in terms of medical outcomes [ ]. Common themes between the two reviews were: rapid telemedicine expansion, education, improved access, convenience, and patient satisfaction.Summary of Evidence
This systematic review exercised a set Boolean search string in four common research databases to analyze 46 articles originating from five continents for themes of facilitators, barriers, and medical outcomes. Nearly 50% of the articles demonstrated the strongest evidence and nearly 60% demonstrated the highest quality of evidence. Various forms of telemedicine were examined: eHealth, mHealth, audio only, telemonitoring, telecoaching, telerehab, robotics or artificial intelligence, and televideo. Twenty-five facilitator themes and individual observations, 12 results themes and observations, and 7 medical outcome themes and observations were recorded and analyzed. Forty-one percent of barrier themes recorded either an improvement or no statistically significant improvement in results compared to the control group. Forty percent of the observations recorded an improvement in at least one medical outcome.
Health care administrators can focus on the findings demonstrating that implementation of telemedicine will increase self-management [
, , , , , , , , , , , ], adherence [ , , , , , , , , , ], access [ , - , , , , ], and social support [ , , , , - , ]. Telemedicine is shown to be an effective modality of treatment [ , , , , , , , , - , - , - , ] at a decreased cost [ , , , , , ]. Patients perceive the modality to be convenient and easy to use [ , , , - , ], and its implementation increases patient satisfaction [ , , , , , , ].Health policymakers should focus on several barriers to increase the adoption of telemedicine. Because technical literacy, availability of technology, and connectivity are listed as the most often cited barriers, public programs should be offered to assist those with these difficulties. Technical literacy is often associated along age or socioeconomic lines, and researchers acknowledge the dearth of research in the area of how to overcome this obstacle [
]. However, community centers that provide access to computers, classes on computers, and a dedicated broadband connection can all contribute to solutions to these barriers.A key similarity between the 2020 systematic review [
] and this review is the rapid expansion of telemedicine. Eleven articles analyzed in this review used a phrase similar to “the pandemic created an acceptance of telemedicine technology” [ , , , , , , , , , , ]. A systematic review published in 2018 cited cost as the chief barrier to adoption, whereas this review only found cost as a barrier in 8% of all observations [ ]. The COVID-19 pandemic forced acceptance of the technology and enabled providers to not focus so intently on the cost of its implementation.Limitations
This systematic review selected 46 articles for analysis from four commonly available research databases. A larger group for analysis could have yielded richer results. This review also only utilized two researchers to analyze the data; additional researchers could have identified additional themes. Selection bias was controlled through independent analysis of all articles by both reviewers followed by consensus meetings. Publication bias is the largest limitation because we were unable to query and analyze unpublished articles.
Conclusion
The COVID-19 pandemic caused huge problems to deliver medicine traditionally. However, these problems created an environment that limited face-to-face medical encounters and fostered legislation to reimburse the telemedicine modality for broad and rapid adoption of telemedicine to expand the access of care beyond the physical walls of the clinic. Physicians should feel confident that the telemedicine modality will be reimbursed and will have very little effect on patient satisfaction. Health care administrators who have not already adopted telemedicine should feel confident in the technology; however, they should ensure that sufficient confidentiality and security measures are in place. Policymakers should enact legislation to remove or mitigate barriers such as availability of technology, technical literacy, and connectivity, as these are commonly referred to in the literature.
Authors' Contributions
KH and CK contributed equally to this project. Both authors were involved in each step of the research and publication process.
Conflicts of Interest
None declared.
Sample size, bias, effect size, country of origin, and statistics used.
DOCX File , 60 KB
Observation-to-theme conversion for patient satisfaction as well as facilitators and barriers to adoption.
DOCX File , 81 KBReferences
- World Health Organization. Telemedicine: opportunities and developments in member states: report on the second global survey on eHealth 2009. Geneva, Swizerland: World Health Organization; 2010.
- FitzGerald M, Williams R. Commonwealth Fund. 2020 Nov 20. URL: https://www.commonwealthfund.org/blog/2020/variations-telemedicine-across-world-qa-tiago-cravo-oliveira-hashiguchi [accessed 2021-02-15]
- Bokolo AJ. Exploring the adoption of telemedicine and virtual software for care of outpatients during and after COVID-19 pandemic. Ir J Med Sci 2021 Feb;190(1):1-10 [FREE Full text] [CrossRef] [Medline]
- Fieux M, Duret S, Bawazeer N, Denoix L, Zaouche S, Tringali S. Telemedicine for ENT: Effect on quality of care during Covid-19 pandemic. Eur Ann Otorhinolaryngol Head Neck Dis 2020 Sep;137(4):257-261 [FREE Full text] [CrossRef] [Medline]
- Kruse SC, Karem P, Shifflett K, Vegi L, Ravi K, Brooks M. Evaluating barriers to adopting telemedicine worldwide: A systematic review. J Telemed Telecare 2016 Oct 16;24(1):4-12. [CrossRef]
- Kuroda N. Decision making on telemedicine for patients with epilepsy during the coronavirus disease 2019 (COVID-19) crisis. Front Neurol 2020;11:722. [CrossRef] [Medline]
- Ben-Pazi H, Beni-Adani L, Lamdan R. Accelerating telemedicine for cerebral palsy during the COVID-19 pandemic and beyond. Front Neurol 2020;11:746. [CrossRef] [Medline]
- Royce TJ, Sanoff HK, Rewari A. Telemedicine for cancer care in the time of COVID-19. JAMA Oncol 2020 Nov 01;6(11):1698-1699. [CrossRef] [Medline]
- Hong Z, Li N, Li D, Li J, Li B, Xiong W, et al. Telemedicine during the COVID-19 pandemic: experiences from Western China. J Med Internet Res 2020 May 08;22(5):e19577 [FREE Full text] [CrossRef] [Medline]
- Mojdehbakhsh RP, Rose S, Peterson M, Rice L, Spencer R. A quality improvement pathway to rapidly increase telemedicine services in a gynecologic oncology clinic during the COVID-19 pandemic with patient satisfaction scores and environmental impact. Gynecol Oncol Rep 2021 May;36:100708 [FREE Full text] [CrossRef] [Medline]
- Chang PJ, Jay GM, Kalpakjian C, Andrews C, Smith S. Patient and provider-reported satisfaction of cancer rehabilitation telemedicine visits during the COVID-19 pandemic. PM R 2021 Dec;13(12):1362-1368 [FREE Full text] [CrossRef] [Medline]
- Duarte A, Gouveia E Melo R, Lopes A, Rato JP, Valente J, Pedro LM. Lessons learned from the impact of the COVID-19 pandemic in a vascular surgery department and preparation for future outbreaks. Ann Vasc Surg 2021 May;73:97-106 [FREE Full text] [CrossRef] [Medline]
- Regelmann MO, Conroy R, Gourgari E, Gupta A, Guttmann-Bauman I, Heksch R, PES Drug and Therapeutics Committee and Practice Management Committee. Pediatric endocrinology in the time of COVID-19: considerations for the rapid implementation of telemedicine and management of pediatric endocrine conditions. Horm Res Paediatr 2020;93(6):343-350 [FREE Full text] [CrossRef] [Medline]
- Betancourt JA, Rosenberg MA, Zevallos A, Brown JR, Mileski M. The impact of COVID-19 on telemedicine utilization across multiple service lines in the United States. Healthcare (Basel) 2020 Oct 01;8(4):380 [FREE Full text] [CrossRef] [Medline]
- Kruse CS. Writing a systematic review for publication in a health-related degree program. JMIR Res Protoc 2019 Oct 14;8(10):e15490 [FREE Full text] [CrossRef] [Medline]
- Page M, McKenzie J, Bossuyt P, Boutron I, Hoffmann T, Mulrow C, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021 Mar 29;372:n71 [FREE Full text] [CrossRef] [Medline]
- Newhouse R, Dearholt S, Poe S, Pugh L, White K. The Johns Hopkins nursing evidence-based practice rating scale. Johns Hopkins University School of Nursing. 2005. URL: https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd =&ved=2ahUKEwjuheqN3-30AhXummoFHa7zBSsQFnoECAMQAQ&url=http%3A%2F%2Fevidencebasednurse.weebly.com%2Fuploads%2F4%2F2%2F0%2F8%2F42081989%2Fjhnedp_evidence _rating_scale.pdf&usg=AOvVaw0TqXuL2_eg1w4Da9XXoKNu [accessed 2021-02-15]
- Light RJ. Measures of response agreement for qualitative data: Some generalizations and alternatives. Psychol Bull 1971;76(5):365-377. [CrossRef]
- Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006 Jan;3(2):77-101. [CrossRef]
- Moher D, Liberati A, Tetzlaff J, Altman D, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 2009 Jul 21;6(7):e1000097 [FREE Full text] [CrossRef] [Medline]
- McHugh ML. Interrater reliability: the kappa statistic. Biochem Med 2012;22(3):276-282 [FREE Full text] [Medline]
- Ben-Arye E, Gressel O, Ben-Arye E, Samuels N. Feasibility of an online integrative oncology treatment program during COVID-19. J Pain Symptom Manage 2021 Feb;61(2):e1-e3 [FREE Full text] [CrossRef] [Medline]
- Kurihara K, Nagaki K, Inoue K, Yamamoto S, Mishima T, Fujioka S, et al. Attitudes toward telemedicine of patients with Parkinson’s disease during the COVID‐19 pandemic. Neurol Clin Neurosci 2020 Nov 18;9(1):77-82. [CrossRef]
- Richards AE, Curley K, Christel L, Zhang N, Kouloumberis P, Kalani MA, et al. Patient satisfaction with telehealth in neurosurgery outpatient clinic during COVID-19 pandemic. Interdisciplin Neurosurg 2021 Mar;23:101017. [CrossRef]
- Yu J, Afridi SM, Cozart AC, Isea L, Guan J. Evaluation and feedback for telehealth from patients and physicians during the early stage of COVID-19 pandemic period. Cureus 2021 Jan 11;13(1):e12633 [FREE Full text] [CrossRef] [Medline]
- Alkire (née Nasr) L, O'Connor GE, Myrden S, Köcher S. Patient experience in the digital age: An investigation into the effect of generational cohorts. J Retail Consum Serv 2020 Nov;57:102221. [CrossRef]
- Ballin M, Hult A, Björk S, Lundberg E, Nordström P, Nordström A. Web-based exercise versus supervised exercise for decreasing visceral adipose tissue in older adults with central obesity: a randomized controlled trial. BMC Geriatr 2020 May 12;20(1):173 [FREE Full text] [CrossRef] [Medline]
- Banbury A, Nancarrow S, Dart J, Gray L, Dodson S, Osborne R, et al. Adding value to remote monitoring: Co-design of a health literacy intervention for older people with chronic disease delivered by telehealth - The telehealth literacy project. Patient Educ Couns 2020 Mar;103(3):597-606. [CrossRef] [Medline]
- Barnett A, Savic M, Pienaar K, Carter A, Warren N, Sandral E, et al. Enacting 'more-than-human' care: Clients' and counsellors' views on the multiple affordances of chatbots in alcohol and other drug counselling. Int J Drug Policy 2021 Aug;94:102910 [FREE Full text] [CrossRef] [Medline]
- Batalik L, Dosbaba F, Hartman M, Batalikova K, Spinar J. Benefits and effectiveness of using a wrist heart rate monitor as a telerehabilitation device in cardiac patients: A randomized controlled trial. Medicine (Baltimore) 2020 Mar;99(11):e19556. [CrossRef] [Medline]
- Beller HL, Rapp DE, Noona SW, Winkelman AJ, Zillioux JM, Smith RP, et al. Tele-urology during COVID-19: rapid implementation of remote video visits. Urol Pract 2020 Nov;7(6):442-447. [CrossRef]
- Bernabe-Ortiz A, Pauschardt J, Diez-Canseco F, Miranda JJ. Sustainability of mHealth effects on cardiometabolic risk factors: five-year results of a randomized clinical trial. J Med Internet Res 2020 Apr 21;22(4):e14595 [FREE Full text] [CrossRef] [Medline]
- Bilgrami Z, Abutaleb A, Chudy-Onwugaje K, Langenberg P, Regueiro M, Schwartz DA, et al. Effect of TELEmedicine for inflammatory bowel disease on patient activation and self-efficacy. Dig Dis Sci 2020 Jan;65(1):96-103 [FREE Full text] [CrossRef] [Medline]
- Broers ER, Kop WJ, Denollet J, Widdershoven J, Wetzels M, Ayoola I, et al. A personalized eHealth intervention for lifestyle changes in patients with cardiovascular disease: randomized controlled trial. J Med Internet Res 2020 May 22;22(5):e14570 [FREE Full text] [CrossRef] [Medline]
- Cho SMJ, Lee JH, Shim J, Yeom H, Lee SJ, Jeon YW, et al. Effect of smartphone-based lifestyle coaching app on community-dwelling population with moderate metabolic abnormalities: randomized controlled trial. J Med Internet Res 2020 Oct 09;22(10):e17435 [FREE Full text] [CrossRef] [Medline]
- Claes J, Cornelissen V, McDermott C, Moyna N, Pattyn N, Cornelis N, et al. Feasibility, acceptability, and clinical effectiveness of a technology-enabled cardiac rehabilitation platform (Physical Activity Toward Health-I): randomized controlled trial. J Med Internet Res 2020 Feb 04;22(2):e14221 [FREE Full text] [CrossRef] [Medline]
- Coorey G, Peiris D, Neubeck L, Redfern J. A realist evaluation approach to explaining the role of context in the impact of a complex eHealth intervention for improving prevention of cardiovascular disease. BMC Health Serv Res 2020 Aug 18;20(1):764 [FREE Full text] [CrossRef] [Medline]
- Ding H, Jayasena R, Chen SH, Maiorana A, Dowling A, Layland J, et al. The effects of telemonitoring on patient compliance with self-management recommendations and outcomes of the innovative telemonitoring enhanced care program for chronic heart failure: randomized controlled trial. J Med Internet Res 2020 Jul 08;22(7):e17559 [FREE Full text] [CrossRef] [Medline]
- Geramita E, DeVito Dabbs AJ, DiMartini A, Pilewski J, Switzer G, Posluszny D, et al. Impact of a mobile health intervention on long-term nonadherence after lung transplantation: follow-up after a randomized controlled trial. Transplantation 2020 Mar;104(3):640-651 [FREE Full text] [CrossRef] [Medline]
- Gong K, Yan Y, Li Y, Du J, Wang J, Han Y, APP Study Group et al. Mobile health applications for the management of primary hypertension: A multicenter, randomized, controlled trial. Medicine (Baltimore) 2020 Apr;99(16):e19715. [CrossRef] [Medline]
- Han JK, Al-Khatib SM, Albert CM. Changes in the digital health landscape in cardiac electrophysiology: a pre-and peri-pandemic COVID-19 era survey. Cardiovasc Dig Health J 2021 Feb;2(1):55-62. [CrossRef]
- Harding R, Carrasco JM, Serrano-Pons J, Lemaire J, Namisango E, Luyirika E, et al. Design and evaluation of a novel mobile phone application to improve palliative home-care in resource-limited settings. J Pain Symptom Manage 2021 Jul;62(1):1-9. [CrossRef] [Medline]
- Hsia BC, Singh AK, Njeze O, Cosar E, Mowrey WB, Feldman J, et al. Developing and evaluating ASTHMAXcel adventures: a novel gamified mobile application for pediatric patients with asthma. Ann Allergy Asthma Immunol 2020 Nov;125(5):581-588 [FREE Full text] [CrossRef] [Medline]
- Hsieh P, Lai H. Exploring people's intentions to use the health passbook in self-management: An extension of the technology acceptance and health behavior theoretical perspectives in health literacy. Technol Forecast Soc Change 2020 Dec;161:120328. [CrossRef]
- Hutchesson MJ, Taylor R, Shrewsbury VA, Vincze L, Campbell LE, Callister R, et al. Be Health for Your Heart: a pilot randomized controlled trial evaluating a web-based behavioral intervention to improve the cardiovascular health of women with a history of preeclampsia. Int J Environ Res Public Health 2020 Aug 10;17(16):5779 [FREE Full text] [CrossRef] [Medline]
- Jiménez-Marrero S, Yun S, Cainzos-Achirica M, Enjuanes C, Garay A, Farre N, et al. Impact of telemedicine on the clinical outcomes and healthcare costs of patients with chronic heart failure and mid-range or preserved ejection fraction managed in a multidisciplinary chronic heart failure programme: A sub-analysis of the iCOR randomized trial. J Telemed Telecare 2018 Sep 07;26(1-2):64-72. [CrossRef]
- Katt BM, Imbergamo C, Fletcher D, Aita D, Nakashian M, Kwok M, et al. Telehealth for upper extremity conditions: perceptions of the patient and provider. JAAOS Glob Res Rev 2020 Sep 10;4(9):e20.00127-e20.00113. [CrossRef]
- Kobe E, Diamantidis C, Bosworth H, Davenport C, Oakes M, Alexopoulos AS, et al. Racial differences in the effectiveness of a multifactorial telehealth intervention to slow diabetic kidney disease. Med Care 2020 Nov;58(11):968-973 [FREE Full text] [CrossRef] [Medline]
- Lai B, Bond K, Kim Y, Barstow B, Jovanov E, Bickel CS. Exploring the uptake and implementation of tele-monitored home-exercise programmes in adults with Parkinson’s disease: A mixed-methods pilot study. J Telemed Telecare 2018 Aug 22;26(1-2):53-63. [CrossRef]
- Lemelin A, Paré G, Bernard S, Godbout A. Demonstrated cost-effectiveness of a telehomecare program for gestational diabetes mellitus management. Diabetes Technol Ther 2020 Mar;22(3):195-202. [CrossRef] [Medline]
- Manning B, Harpole A, Harriott E, Postolowicz K, Norton E. Taking language samples home: feasibility, reliability, and validity of child language samples conducted remotely with video chat versus in-person. J Speech Lang Hear Res 2020 Dec 14;63(12):3982-3990 [FREE Full text] [CrossRef] [Medline]
- Marques G, Drissi N, Díez de la Torre I, de Abajo BS, Ouhbi S. Impact of COVID-19 on the psychological health of university students in Spain and their attitudes toward Mobile mental health solutions. Int J Med Inform 2021 Mar;147:104369. [CrossRef] [Medline]
- Martins SC, Weiss G, Almeida AG, Brondani R, Carbonera LA, de Souza AC, et al. Validation of a smartphone application in the evaluation and treatment of acute stroke in a comprehensive stroke center. Stroke 2020 Jan;51(1):240-246. [CrossRef]
- McGillicuddy JW, Chandler JL, Sox LR, Taber DJ. Exploratory analysis of the impact of an mHealth medication adherence intervention on tacrolimus trough concentration variability: post hoc results of a randomized controlled trial. Ann Pharmacother 2020 Dec;54(12):1185-1193 [FREE Full text] [CrossRef] [Medline]
- Mo Y, Wang H, Huang G, Chu M. Effectiveness of nurse-led program on mental health status and quality of life in patients with chronic heart failure. Medicine (Baltimore) 2020 Aug 14;99(33):e21746. [CrossRef] [Medline]
- Mustonen E, Hörhammer I, Absetz P, Patja K, Lammintakanen J, Talja M, et al. Eight-year post-trial follow-up of health care and long-term care costs of tele-based health coaching. Health Serv Res 2020 Apr;55(2):211-217 [FREE Full text] [CrossRef] [Medline]
- O'Shea O, Woods C, McDermott L, Buys R, Cornelis N, Claes J, et al. A qualitative exploration of cardiovascular disease patients' views and experiences with an eHealth cardiac rehabilitation intervention: The PATHway Project. PLoS One 2020;15(7):e0235274 [FREE Full text] [CrossRef] [Medline]
- Perri MG, Shankar MN, Daniels MJ, Durning PE, Ross KM, Limacher MC, et al. Effect of telehealth extended care for maintenance of weight loss in rural US communities: a randomized clinical trial. JAMA Netw Open 2020 Jun 01;3(6):e206764 [FREE Full text] [CrossRef] [Medline]
- Piera-Jiménez J, Winters M, Broers E, Valero-Bover D, Habibovic M, Widdershoven JWMG, et al. Changing the health behavior of patients with cardiovascular disease through an electronic health intervention in three different countries: cost-effectiveness study in the Do Cardiac Health: advanced new generation ecosystem (Do CHANGE) 2 randomized controlled trial. J Med Internet Res 2020 Jul 28;22(7):e17351 [FREE Full text] [CrossRef] [Medline]
- Press VG, Arora VM, Kelly CA, Carey KA, White SR, Wan W. Effectiveness of virtual vs in-person inhaler education for hospitalized patients with obstructive lung disease: a randomized clinical trial. JAMA Netw Open 2020 Jan 03;3(1):e1918205 [FREE Full text] [CrossRef] [Medline]
- Ramírez-Correa P, Ramírez-Rivas C, Alfaro-Pérez J, Melo-Mariano A. Telemedicine acceptance during the COVID-19 pandemic: an empirical example of robust consistent partial least squares path modeling. Symmetry 2020 Sep 25;12(10):1593. [CrossRef]
- Ronan P, Mian A, Carr SB, Madge SL, Lorenc A, Robinson N. Learning to breathe with Tai Chi online - qualitative data from a randomized controlled feasibility study of patients with cystic fibrosis. Eur J Integr Med 2020 Dec;40:101229 [FREE Full text] [CrossRef] [Medline]
- Sacco G, Lléonart S, Simon R, Noublanche F, Annweiler C, TOVID Study Group. Communication technology preferences of hospitalized and institutionalized frail older adults during COVID-19 confinement: cross-sectional survey study. JMIR Mhealth Uhealth 2020 Sep 18;8(9):e21845 [FREE Full text] [CrossRef] [Medline]
- Scheerman JFM, Hamilton K, Sharif MO, Lindmark U, Pakpour AH. A theory-based intervention delivered by an online social media platform to promote oral health among Iranian adolescents: a cluster randomized controlled trial. Psychol Health 2020 Apr;35(4):449-466. [CrossRef] [Medline]
- Schrauben S, Appel L, Rivera E, Lora C, Lash J, Chen J, CRIC Study Investigators. Mobile health (mHealth) technology: assessment of availability, acceptability, and use in CKD. Am J Kidney Dis 2021 Jun;77(6):941-950.e1. [CrossRef] [Medline]
- Shareef MA, Kumar V, Dwivedi YK, Kumar U, Akram MS, Raman R. A new health care system enabled by machine intelligence: Elderly people's trust or losing self control. Technol Forecast Soc Change 2021 Jan;162:120334. [CrossRef]
- van Dijk MR, Koster MPH, Oostingh EC, Willemsen SP, Steegers EAP, Steegers-Theunissen RPM. A mobile app lifestyle intervention to improve healthy nutrition in women before and during early pregnancy: single-center randomized controlled trial. J Med Internet Res 2020 May 15;22(5):e15773 [FREE Full text] [CrossRef] [Medline]
- Munn Z, Peters MDJ, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol 2018 Nov 19;18(1):143 [FREE Full text] [CrossRef] [Medline]
- Neumeyer X, Santos SC, Morris MH. Overcoming barriers to technology adoption when fostering entrepreneurship among the poor: the role of technology and digital literacy. IEEE Trans Eng Manage 2021 Dec;68(6):1605-1618. [CrossRef]
Abbreviations
CARES: Coronavirus Aid, Relief, and Economic Security |
eGFR: estimated glomerular filtration rate |
JHNEBP: Johns Hopkins Nursing Evidence-Based Practice Rating Scale |
MeSH: Medical Subject Headings |
mHealth: mobile health |
PICOS: participants, intervention, results, outcomes, study design |
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses |
Edited by G Eysenbach; submitted 02.07.21; peer-reviewed by G Deckard, T Menser; comments to author 23.07.21; revised version received 23.08.21; accepted 22.11.21; published 04.01.22
Copyright©Clemens Kruse, Katharine Heinemann. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 04.01.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.