Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/45111, first published .
Effectiveness of eHealth Smoking Cessation Interventions: Systematic Review and Meta-Analysis

Effectiveness of eHealth Smoking Cessation Interventions: Systematic Review and Meta-Analysis

Effectiveness of eHealth Smoking Cessation Interventions: Systematic Review and Meta-Analysis

Review

1Global Health Research Center, Duke Kunshan University, Kunshan, China

2Department of Global Health, School of Public Health, Wuhan University, Wuhan, China

3Division of Social Sciences, Duke Kunshan University, Kunshan, China

4Data Science Research Center, Duke Kunshan University, Kunshan, China

5Duke Global Health Institute, Duke University, Durham, NC, United States

6Institute for Global Health and Development, Peking University, Beijing, China

Corresponding Author:

Lijing L Yan, PhD

Global Health Research Center

Duke Kunshan University

3rd floor, Academic Building

Kunshan, 215316

China

Phone: 86 0 512 5777 9988

Email: lijing.yan@duke.edu


Related ArticleThis is a corrected version. See correction statement in: https://www.jmir.org/2024/1/e56438

Background: Rapid advancements in eHealth and mobile health (mHealth) technologies have driven researchers to design and evaluate numerous technology-based interventions to promote smoking cessation. The evolving nature of cessation interventions emphasizes a strong need for knowledge synthesis.

Objective: This systematic review and meta-analysis aimed to summarize recent evidence from randomized controlled trials regarding the effectiveness of eHealth-based smoking cessation interventions in promoting abstinence and assess nonabstinence outcome indicators, such as cigarette consumption and user satisfaction, via narrative synthesis.

Methods: We searched for studies published in English between 2017 and June 30, 2022, in 4 databases: PubMed (including MEDLINE), PsycINFO, Embase, and Cochrane Library. Two independent reviewers performed study screening, data extraction, and quality assessment based on the GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) framework. We pooled comparable studies based on the population, follow-up time, intervention, and control characteristics. Two researchers performed an independent meta-analysis on smoking abstinence using the Sidik-Jonkman random-effects model and log risk ratio (RR) as the effect measurement. For studies not included in the meta-analysis, the outcomes were narratively synthesized.

Results: A total of 464 studies were identified through an initial database search after removing duplicates. Following screening and full-text assessments, we deemed 39 studies (n=37,341 participants) eligible for this review. Of these, 28 studies were shortlisted for meta-analysis. According to the meta-analysis, SMS or app text messaging can significantly increase both short-term (3 months) abstinence (log RR=0.50, 95% CI 0.25-0.75; I2=0.72%) and long-term (6 months) abstinence (log RR=0.77, 95% CI 0.49-1.04; I2=8.65%), relative to minimal cessation support. The frequency of texting did not significantly influence treatment outcomes. mHealth apps may significantly increase abstinence in the short term (log RR=0.76, 95% CI 0.09-1.42; I2=88.02%) but not in the long term (log RR=0.15, 95% CI −0.18 to 0.48; I2=80.06%), in contrast to less intensive cessation support. In addition, personalized or interactive interventions showed a moderate increase in cessation for both the short term (log RR=0.62, 95% CI 0.30-0.94; I2=66.50%) and long term (log RR=0.28, 95% CI 0.04-0.53; I2=73.42%). In contrast, studies without any personalized or interactive features had no significant impact. Finally, the treatment effect was similar between trials that used biochemically verified or self-reported abstinence. Among studies reporting outcomes besides abstinence (n=20), a total of 11 studies reported significantly improved nonabstinence outcomes in cigarette consumption (3/14, 21%) or user satisfaction (8/19, 42%).

Conclusions: Our review of 39 randomized controlled trials found that recent eHealth interventions might promote smoking cessation, with mHealth being the dominant approach. Despite their success, the effectiveness of such interventions may diminish with time. The design of more personalized interventions could potentially benefit future studies.

Trial Registration: PROSPERO CRD42022347104; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=347104

J Med Internet Res 2023;25:e45111

doi:10.2196/45111

Keywords



Background

Smoking is a major risk factor for cancer and cardiovascular, respiratory, and many other chronic diseases worldwide [1]. In addition to the significant health burden it imposes, smoking also incurs massive economic costs. The United States alone lost a staggering US $864.5 billion in 2020 due to this issue [2], whereas limited-income countries, such as China, with higher smoking prevalence, face similar challenges [3]. Smoking cessation is crucial for minimizing mortality risk and improving quality of life [4]. Hence, finding effective ways to promote smoking cessation among smokers continues to be a vital public health goal. However, traditional smoking cessation services such as counseling can be expensive [5,6] and poorly received because of factors such as patients’ lack of time or reluctance to seek cessation services in clinical settings [7]. These challenges necessitate the development of cost-effective models for reducing tobacco consumption.

eHealth technologies, such as websites, mobile apps, and SMS text messages, have emerged as low-cost accessible interventions. Many of these technologies offer interactive experiences to users [8], which can enhance patient adherence to cessation services [9]. As such, they are ideal tools for revolutionizing health care [10] and promoting smoking cessation for diverse user groups, including ordinary daily smokers and pregnant women who wish to quit for their children’s well-being.

Numerous studies have investigated the effectiveness of eHealth cessation interventions over the past decade, but their findings have been inconsistent [11]. For example, a systematic review of 108 studies in 2018 found evidence suggesting that web-based and mobile health (mHealth) interventions could moderately increase abstinence rates, whereas computer-assisted interventions did not show the same effect [12]. Another 2019 systematic review of 26 studies indicated that automated text messaging interventions were more effective than minimal smoking cessation support, whereas the effectiveness of mobile apps on abstinence remains unclear [13]. However, these systematic reviews have some notable limitations. Recent reviews only evaluated abstinence as the outcome variable and did not include other outcomes such as cigarette consumption [14]. In addition, the reviews did not differentiate between self-reported versus biochemically verified abstinence. Another drawback is that previous reviews primarily synthesized evidence from high-income countries, which may not be generalizable to low- and middle-income countries [15]. Finally, the most recent review, which covered the entire eHealth intervention landscape, only included studies published until 2017 [12]. Since then, the use of eHealth has skyrocketed and many new studies have been published.

Objectives

With the rapid development of eHealth technologies [16], smoking cessation interventions are constantly evolving and are dynamic in nature, encompassing both delivery channels and intervention materials. Therefore, this systematic review aimed to (1) summarize recent evidence (from 2017 to mid-2022) on the effectiveness of eHealth-based smoking cessation interventions, grouped by treatment characteristics, study population, and outcome verification, and (2) assess important nonabstinence outcome indicators such as cigarette consumption and user satisfaction via narrative synthesis.


This study was designed and reported in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement [17]. A detailed protocol containing the objectives and methods of this systematic review is registered in PROSPERO (2022; CRD42022347104).

Search Strategy

A systematic search was performed across 4 electronic databases—PubMed (including MEDLINE), PsycINFO, Embase, and Cochrane Library—to gather studies published between 2017 and mid-2022. The search strategy was first created for PubMed using a combination of keywords and Medical Subject Heading terms. To make the search more precise, keywords were mapped to Medical Subject Heading terms where possible. We later applied the search strategy to other databases, namely PsycINFO, Embase, and the Cochrane Library, using their own thesaurus terms and advanced search features. The search terms were classified into four categories: (1) smoking cessation—the theme of the intervention; (2) device—the device used to carry out the intervention; (3) intervention channel—the specific approach used to engage the participants; and (4) randomized controlled trials (RCTs)—the study design. Each database was searched accordingly. The search strategy for PubMed is shown in Table 1. Multimedia Appendix 1 [18] documents search terms for all databases. The search results were limited to studies published in English from January 1, 2017, to June 30, 2022, given that previous review papers on eHealth smoking cessation interventions primarily collected studies published before 2017 [12].

Table 1. Search strategy: PubMed key terms.
TopicsKey terms
Smoking cessation“Smoking Cessation”(MeSHa terms)
Device(“Cell Phone”[MeSH terms] OR “smartphone”[MeSH terms] OR “computers”[MeSH terms] OR “Computers, Handheld”[MeSH terms])
Intervention channel(“Online Systems”[MeSH terms] OR “Technology”[MeSH terms] OR “Social Media”[MeSH terms] OR “Mobile Applications”[MeSH terms] OR “Text Messaging”[MeSH terms] OR “telemedicine”[MeSH terms] OR “Internet-Based Intervention”[MeSH terms] OR “multimedia”[MeSH terms] OR “Electronic Mail”[MeSH terms])
RCTb,c([Randomized controlled trial(Pt)] OR [controlled clinical trial(Pt)] OR [randomized(tiab) OR randomized(tiab)] OR [placebo(tiab)] OR [drug therapy(sh)] OR [randomly(tiab)] OR [trial(tiab)] OR [groups(tiab)]) NOT (animals[mh] NOT humans[mh])

aMeSH: Medical Subject Heading.

bRCT: randomized controlled trial.

cKey terms for RCTs were retrieved from McGill Library [18].

Eligibility Criteria

Population

The study population included adults (aged ≥18 years) who were current smokers during enrollment in the study. We were interested in investigating the effectiveness of cessation interventions only on cigarette smoking.

Intervention

Studies reporting eHealth-based smoking cessation interventions, defined as interventions delivered through mobile-based, web-based, computer-based, portable device-based, and social media–based channels, were included. The intervention content may consist of educational readings, videos, and counseling based on various therapies; text messaging; social media; and even biochemical testing (eg, carbon monoxide checkers). Interventions were then classified into the following 3 groups under the broader category of eHealth interventions: web-based, mHealth (SMS text messages and apps), or computer-assisted interventions. Web-based interventions refer to cessation services available on websites, whereas mHealth interventions are defined as any cessation materials delivered through mobile phones. Finally, computer-assisted interventions refer to cessation services that are accessible via computers. eHealth intervention can either be delivered in a stand-alone setting or as an adjunct to other therapies. Interventions were considered personalized or interactive if the intervention content was tailored to each participant, based on his or her response or ability to offer interactive experience through live feedback.

Control or Comparator

Studies that included placebo or control interventions, non-eHealth interventions, or no interventions as controls were included. Placebo or control interventions may consist of delivering less related content through electronic channels, such as a reduced version of an mHealth cessation app. Non-eHealth interventions may include smoking cessation content provided in nonelectronic media, such as self-help cessation materials. This systematic review included only studies with at least 1 control group.

Outcomes

Studies reporting biochemically verified or self-reported abstinence were measured at ≥3 months of follow-up. Other outcomes, such as reduction in cigarette consumption and adherence to the intervention, as measured by the satisfaction rate, were also recorded when available but were not mandatory.

Study Design

Only RCTs were included in this review, including both full-scale RCTs and pilot RCTs. Conference abstracts were excluded from the study.

Exclusion Criteria

Studies were excluded if they (1) included people using smokeless tobacco products or e-cigarettes, (2) only used eHealth technology during the recruitment of participants and not as part of the intervention, and (3) had a follow-up period shorter than 3 months.

Study Selection

Two independent reviewers (YEF and ZZ) screened titles and abstracts for potential inclusion. A relatively good interrater reliability was achieved (proportionate agreement=81%, Cohen κ=0.61). The same pair of reviewers also independently performed a full-text review after screening for final inclusion. Any conflicts between the 2 reviewers were discussed in the presence of a third author (selected from the author list, either RW or BY), who contributed to the final consensus. The study selection process was performed using the Covidence workflow platform.

Data Extraction

Two reviewers (YEF and ZZ) independently performed data extraction using the same data extraction template with multiple categories for detailed information input on the Covidence platform [19]. Extracted data included the following: (1) study information (country of study, trial registration, funding sources, and declarations of interest); (2) study participants (inclusion or exclusion criteria, population characteristics, and sample size); (3) intervention and control details; (4) theoretical framework; (5) outcome measurements; and (6) key study results (abstinence rate, reduction in cigarette consumption, and satisfaction rate at ≥3 month follow-up). Any conflicts between the 2 authors were discussed between the reviewers or in the presence of a third author (either RW or BY) for final consensus.

Risk of Bias (Quality) Assessment

Quality assessment was based on the GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) framework for quality assessment [17]. Two reviewers (YEF and ZZ) first conducted the risk of bias assessment independently under the guidance of the Cochrane Handbook for Systematic Reviews of Interventions [20] and the Cochrane Tobacco Addiction Group. Two reviewers assessed the risk of bias for each included study via five prespecified domains using version 2 of the Cochrane risk-of-bias tool for randomized trials (RoB 2) [21]: (1) bias arising from the randomization process, (2) bias due to deviations from intended interventions, (3) bias due to missing outcome data, (4) bias in measurement of the outcome, and (5) bias in selection of the reported result. After data extraction, each reviewer judged each domain as having low, high, or some concern. Disagreements were resolved between the 2 authors in the presence of a third author. The certainty of the evidence was rated as very low, low, moderate, or high based on the risks of bias, imprecision, inconsistency, indirectness, and publication bias.

Synthesis of Results

The primary outcome of this systematic review was to evaluate the impact of eHealth-based smoking cessation interventions on the abstinence rate measured at ≥3-month follow-up via self-report or biochemical verification. Short- and long-term abstinence was defined as the abstinence result measured at the 3- and 6-month follow-ups, respectively. The measurements were 7-day point prevalence abstinence (PPA), 30-day PPA, or prolonged PPA. These measurements were used interchangeably in this review because there is evidence suggesting that such data handling does not significantly affect the results [22]. Only intention-to-treat analysis data were selected. All initially randomized participants were included, and any missing data caused by withdrawal were considered smokers based on the Cochrane Tobacco Group guidelines [23]. Nonabstinence outcomes were not subjected to meta-analysis because of the limited number of studies reporting the statistics and variation in outcome measurement standards. Subsequently, the reductions in cigarette consumption and satisfaction rates were narratively synthesized.

For the primary outcome of abstinence rate, dichotomous data on quit or smoking participants’ numbers in either the treatment or control groups at follow-ups were entered into Stata 17 software [24] to calculate the log risk ratio (RR). The included studies were stratified into different subgroups based on their study participants, eHealth interventions or controls, and outcome verification for comparable results in the meta-analysis. Where 2 or more studies were deemed comparable, we performed a meta-analysis to calculate the combined effects of the interventions on the abstinence rate. For studies that were not included in the meta-analysis, we summarized the abstinence outcomes for each study. Considering the potential treatment effect heterogeneity, differences in trial size, and the limited number of included studies, this study used the Sidik-Jonkman random-effects model method to pool log RRs and 95% CIs calculated for the abstinence outcome [25]. Heterogeneity was assessed using I2 statistic, given its robustness with small sample sizes. Publication bias was assessed using funnel plots.


Study Selection

After removing duplicates, we identified a total of 464 studies in the initial database search. After screening and full-text assessments, 39 studies were deemed eligible for this review, of which 28 were included in the meta-analysis. Figure 1 shows the PRISMA flowchart, which illustrates the process of study selection and rationales for exclusion during full-text assessments.

Figure 1. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) diagram of searching and screening process.

Study Characteristics

Overview

All included studies were RCTs (31/39, 80%) or pilot RCTs (8/39, 21%) published between 2017 and 2022. The key characteristics of the included studies are summarized in Table 2. Most studies were conducted in high-income economies (28/39, 72%; ie, the United States, the United Kingdom, France, Switzerland, Spain, Argentina, Hong Kong, and Japan). However, a relatively substantial number of studies were found in low- and middle-income countries or regions (11/39, 28%) defined by the World Bank [26] (ie, China, Thailand, India, Brazil, Turkey, and Vietnam).

Table 2. Summary of characteristics of included studies (n=39).
CharacteristicsMeta-analysis (n=28), n (%)Non–meta-analysis (n=11), n (%)Total studies (n=39), n (%)
Intervention

Web-based1 (4)0 (0)1 (3)

mHealtha25 (89)5 (45)30 (77)

Multiplatform2 (7)6 (55)8 (21)
Country

High-income countries or regions19 (68)9 (82)28 (72)

Low- and middle-income countries or regions9 (32)2 (18)11 (28)
Delivery

Personalized or interactive19 (68)10 (91)29 (74)

Not personalized or interactive9 (32)1 (9)10 (26)
Participants

Adult smokers only with intention to quit18 (64)8 (73)26 (67)

Adult smokers with or without intention to quit0 (0)1 (9)1 (3)

Pregnant smokers5 (18)0 (0)5 (13)

Smokers with mental disorders3 (11)0 (0)3 (77)

Other susceptible individuals2 (7)2 (18)4 (10)
eHealth role

eHealth as primary intervention23 (82)11 (100)34 (87)

eHealth as adjunct intervention5 (18)0 (0)5 (13)
Theoretical framework

Cognitive behavioral therapy1 (4)2 (18)3 (8)

Mindfulness (acceptance and commitment therapy)4 (14)2 (18)6 (15)

Social cognitive theory3 (11)1 (9)4 (10)

Multitheories4 (14)0 (0)4 (10)

Other6 (21)2 (18)8 (21)

Not stated10 (36)4 (36)14 (36)
Abstinence verification

Self-reported10 (36)7 (64)17 (44)

Biochemically verified18 (64)4 (36)22 (56)
Reported outcome other than abstinence (percentage may not add up to 100%)

Cigarette consumption10 (36)4 (36)14 (36)

User satisfaction15 (54)4 (36)19 (38)
Longest reported length of follow-up

3 months10 (36)2 (18)12 (31)

6 months (including late pregnancy)14 (50)5 (45)19 (49)

12 months4 (14)4 (36)8 (21)

amHealth: mobile health.

Participants

A total of 37,341 participants from 39 studies were included in this review. The sample size per study varied from 49 to 8000 participants. Most participants (26/39, 67% of studies) were nonclinical adult smokers who intended to quit smoking. The term intention-to-quit refers to smokers who were willing to quit smoking upon recruitment. Other study participants included adult smokers who did not necessarily intend to quit smoking and were recruited in occupational settings (1/39, 3%), pregnant smokers (5/39, 13%), and smokers with mental disorders (3/39, 8%). It is worth noting that studies involving pregnant smokers (5/39, 13%) included participants aged ≥16 years. The average age of pregnant women ranged from 26.6 to 28 years, suggesting that most recruited participants were adults. Therefore, we included these studies in our analysis to provide a comprehensive overview of eHealth-based cessation interventions. Other susceptible populations identified included smokers from lower socioeconomic backgrounds, patients currently with tuberculosis, and hospitalized patients in clinical settings (4/39, 10%; Table 2).

Interventions

Notably, most studies reported the use of mHealth interventions (30/39, 77%) comprising SMS text messages or mobile apps. For clarity, we henceforth refer SMS text messages and apps that only provide messaging services as SMS or app text messaging. In addition to mHealth, 1 study used web-based intervention (1/39, 3%), and 8 studies adopted mixed approaches (8/39, 21%), where mHealth and web-based channels were both used in the intervention packages. Most eHealth interventions (34/39, 87%) were delivered as primary interventions. Over two-thirds (29/39, 74%) of the interventions involved some degree of personalization through tailored intervention materials based on user feedback or by providing interactive experiences. More than one-third (14/39, 36%) of the studies did not specify a theoretical framework. The theoretical frameworks mentioned were primarily acceptance and commitment therapy, social cognitive theory, cognitive and behavioral therapy, or mixed theories.

Outcomes

More than half (22/39, 56%) of the studies adopted biochemical verification through carbon monoxide testing or cotinine testing for PPA measurements. The remaining studies used self-reported abstinence data. The duration of follow-up ranged from 3 months (12/39, 31%) to 6 months or before delivery (19/39, 49%) to 12 months (8/39, 21%). Apart from the primary outcome of smoking abstinence, 13 (13/39, 33%) studies reported changes in cigarette consumption, whereas 19 (19/39, 38%) studies reported user satisfaction after intervention.

Risk of Bias in Included Studies

All included studies underwent a risk of bias assessment based on the guidelines suggested by the Cochrane Handbook for Systematic Reviews of Interventions [20]. Bias in measurement of the outcome was rated as low risk because the Cochrane Tobacco Addiction Group stated that blinding participants made cessation interventions impossible [13]. In summary, we evaluated 26 (26/39, 67%) studies to be at low risk of bias (considered low risk of bias for all domains), 8 (8/39, 21%) studies with some concerns (considered with some concerns for at least 1 domain, but with no judgments of high risk), and 5 (5/39, 13%) studies at high risk (considered high risk of bias in at least 1 domain). The risk of bias per domain is shown in Figure 2. Incomplete outcome data was the primary cause of high risk of bias (4/39, 10%). It is worth noting that 33% (13/39) studies reported a high attrition rate (>20%), but 9 were deemed to have a low risk of bias or some concerns because there was no evidence for differential missing data.

Figure 2. Risk of bias graph based on review authors’ judgments across all included studies (n=39) [27-65]. Risk of bias domains: D1: bias arising from the randomization process; D2: bias due to deviations from intended intervention; D3: bias due to missing outcome data; D4: bias in the measurement of the outcome; D5: bias in selection of the reported result. Judgement: ⊕: high, : some concerns, ⊗: low.

Meta-Analysis of Smoking Abstinence Results (Primary Outcome)

Overview

A total of 28 studies were included in the meta-analysis because of similarities in the target population, intervention, control, and outcomes. To ensure comparability among the studies in the meta-analysis, they were divided into short-term (3-month follow-up) and long-term (6-month follow-up) studies involving general adult smokers (19/28, 69%). The results are presented in tabular format to facilitate the presentation of more information, and all forest plots are available in Multimedia Appendix 2 [38-65]. Within each follow-up category, the studies were grouped based on the type of intervention and control (Table 3): (1) high-frequency SMS or app text messaging versus low-frequency SMS or app text messaging; (2) SMS or app text messaging versus minimal cessation support (including self-help materials and standard practice); (3) mHealth app versus less intensive smoking cessation support (including existing cessation services or a mobile app with fewer functions); and (4) mHealth app + psycho or pharmacological therapy versus psycho or pharmacological therapy alone. In addition, we conducted exploratory analyses by pooling the same groups of studies based on personalization or interactive level (personalized or interactive vs nonpersonalized or interactive) or outcome verification types (biochemically verified vs self-reported; Table 4). For studies targeting special populations (10/28, 36%), we pooled the abstinence results of studies targeting the same population only by participant characteristics. Finally, detailed information on each study included in the meta-analysis is provided in Multimedia Appendix 3 [38-65].

Table 3. Summary of eHealth intervention effects on abstinence by intervention type and follow-up, based on GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) guidelines.
Outcome and follow-upSummary of the effectNumber of participants and studiesQuality of the evidence (GRADE)aSummary for intervention
Smokers with intention to quit (by follow-up)

High-frequency SMS or app text messaging versus low-frequency SMS or app text messaging


3 monthsLog RRb=−0.01, 95% CI −0.25 to 0.28; I2=38.77%; Little or no increasec8958 participants; 2 studiesd,e; LowMay make little or no increase on cessation


6 monthsLog RR=0.00, 95% CI −0.07 to 0.08; I2=0.46%; Little or no increase8958 participants; 2 studiesd,e; LowMay make little or no increase on cessation

SMS or app text messaging versus minimal smoking cessation support


3 monthsLog RR=0.50, 95% CI 0.25 to 0.75; I2=0.72%; Moderate increase1367 participants; 5 studiesd; ModerateProbably increase cessation moderately


6 monthsLog RR=0.77, 95% CI 0.49 to 1.04; I2=8.65%; Important increase1153 participants; 3 studiesd; ModerateProbably increase cessation significantly

mHealthg app versus less intensive smoking cessation support


3 monthsLog RR=0.76, 95% CI 0.09 to 1.42; I2=88.02%; Important increase1167 participants; 4 studiesd,f; LowMay increase cessation significantly


6 monthsLog RR=0.15, 95% CI −0.18 to 0.48; I2=80.06%; Little or no increase9360 participants; 6 studiese,f; LowMay make little or no increase on cessation

mHealth app + psycho or pharmacological therapy versus psycho or pharmacological therapy


6 monthsLog RR=0.25, 95% CI −0.18 to 0.67; I2=16.91%; Little or no increase340 participants; 2 studiese,f; LowMay make little or no increase on cessation
Smokers of special population (any follow-up)

Adult smokers with mental disordersLog RR=−0.25, 95% CI −1.92 to 1.42; I2=72.32%; Little or no increase813 participants; 3 studiese,f; LowMay make little or no increase on cessation

Hospitalized adult smokersLog RR=1.00, 95% CI 0.22 to 1.78; I2=3.45%; Important increase466 participants; 2 studiesd,e; LowMay increase cessation significantly

Pregnant smokers (including adolescents)Log RR=0.34, 95% CI −0.01 to 0.68; I2=25.84%; Little or no increase2319 participants; 5 studiese,h; Very lowMay make little or no increase on cessation

aGRADE Working Group grades of evidence. High quality: The authors have a lot of confidence that the true effect is similar to the estimated effect. Moderate quality: The authors believe that the true effect is probably close to the estimated effect. Low certainty: The true effect might be markedly different from the estimated effect. Very low certainty: The true effect is probably markedly different from the estimated effect [66].

bRR: risk ratio.

cThe italicization serves as an abstract description of the effect size based on the 95% CI: 95% CI crosses 0=little or no increase, 95% CI does not cross 0 nor 1=moderate increase, and 95% CI does not cross 0 but cross 1=important increase.

dDowngraded 1 level for significant risk of bias: one study was rated as high risk of bias (2 unclear risk of bias count as one high risk of bias).

eDowngraded 1 level for imprecision: CIs encompass both clinically significant harm and clinically significant benefit, or fewer than 500 participants overall.

fDowngraded 1 level of inconsistency: considerable unexplained statistical heterogeneity (I2>50%).

gmHealth: mobile health.

hDowngraded 2 levels for serious risk of bias: 2 or more studies rated as high risk of bias (2 unclear risk of bias count as one high risk of bias).

Table 4. Summary of exploratory analyses on eHealth intervention effects on abstinence by personalization or interactive level or outcome verification, based on GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) guidelines.
Outcome verification and follow-upSummary of the effectNumber of participants and studiesQuality of the evidence (GRADE)aSummary for intervention
Smokers with intention to quit (by follow-up)—personalization or interactive level

3 months (short-term)


Personalized or interactiveLog RRb=0.62, 95% CI 0.30 to 0.94; I2=66.50%; Moderate increasec2701 participants; 8 studiesd,e; Very lowMay increase cessation moderately (true effect is probably markedly different)


Not personalized or interactiveLog RR=0.17, 95% CI −0.21 to 0.54; I2=67.39%; Little or no increase8791 participants; 3 studiese,f,g; Very lowMay make little or no increase on cessation (true effect is probably markedly different)

6 months (long-term)


Personalized or interactiveLog RR=0.28, 95% CI 0.04 to 0.53; I2=73.42%;Moderate increase10,695 participants; 9 studiese,f; LowMay increase cessation moderately


Not personalized or interactiveLog RR=0.23, 95% CI −0.26 to 0.72; I2=82.52%; Little or no increase9116 participants; 4 studiese,f,g; Very lowMay make little or no increase on cessation (true effect is probably markedly different)
Smokers with intention to quit (by follow-up)—verification

3 months (short-term)


Biochemically verified resultsLog RR=0.45, 95% CI 0.15 to 0.74; I2=21.39%; Moderate increase1375 participants; 4 studies; HighIncrease cessation moderately


Self-reported resultsLog RR=0.56, 95% CI 0.15 to 0.96; I2=87.88%; Moderate increase10,117 participants; 7 studiesd,e,g; Very lowMay cessation moderately (true effect is probably markedly different)

6 months (long-term)


Biochemically verified resultsLog RR=0.26, 95% CI −0.02 to 0.54; I2=34.82%; Little or no increase2195 participants; 7 studiesf,g; LowMay make little or no increase on cessation


Self-reported resultsLog RR=0.31, 95% CI −0.05 to 0.68; I2=95.06%; Little or no increase17,616 participants; 6 studiese,f,g; Very lowMay make little or no increase on cessation (true effect is probably markedly different)

aGRADE Working Group grades of evidence. High quality: The authors have a lot of confidence that the true effect is similar to the estimated effect. Moderate quality: The authors believe that the true effect is probably close to the estimated effect. Low certainty: The true effect might be markedly different from the estimated effect. Very low certainty: The true effect is probably markedly different from the estimated effect [66].

bRR: risk ratio.

cThe italicization serves as an abstract description of the effect size based on the 95% CI: 95% CI crosses 0=little or no increase, 95% CI does not cross 0 nor 1=moderate increase, and 95% CI does not cross 0 but cross 1=important increase.

dDowngraded 2 levels for serious risk of bias: 2 or more studies rated as high risk of bias (2 unclear risk of bias count as one high risk of bias).

eDowngraded 1 level of inconsistency: considerable unexplained statistical heterogeneity (I2>50%).

fDowngraded 1 level for significant risk of bias: one study was rated as high risk of bias (2 unclear risk of bias count as one high risk of bias).

gDowngraded 1 level for imprecision: CIs encompass both clinically significant harm and clinically significant benefit, or fewer than 500 participants overall.

High-Frequency SMS or App Text Messaging and Low-Frequency SMS or App

Only 2 studies have compared high-frequency SMS or app text messaging with low-frequency SMS or app text messaging. When pooled, no statistically significant difference between the intervention and control outcomes was found in the short-term (log RR=−0.01, 95% CI −0.25 to 0.28; I2=38.77%) or long-term (log RR=0.00, 95% CI −0.07 to 0.08; I2=0.46%).

SMS or App Text Messaging Versus Minimal Smoking Cessation Support

In total, 5 studies compared the abstinence results of SMS or app text messaging with minimal smoking cessation support in the short term, and 3 reported long-term results (with an overlap between the studies). After pooling, a significant increase was found with moderate certainty in short-term abstinence in the intervention group (log RR=0.50, 95% CI 0.25-0.75; I2=0.72%). The effect was even more significant in the long-term follow-up (log RR=0.77, 95% CI 0.49-1.04; I2=8.65%).

mHealth App Versus Less Intensive Smoking Cessation Support

Among the studies included in the meta-analysis, 8 compared the mHealth app with less intensive smoking cessation support, with 4 reporting short-term results and 6 reporting long-term results (with overlap between the studies). The pooled abstinence outcome suggests that mHealth apps may have a significant short-term effect on abstinence for intervention (log RR=0.76, 95% CI 0.09 to 1.42; I2=88.02%), whereas no significant effect was found in the long term (log RR=0.15, 95% CI −0.18 to 0.48; I2=80.06%).

mHealth App + Psycho or Pharmacological Therapy Versus Psycho or Pharmacological Therapy Alone

Only long-term effects on abstinence were collected for studies that compared the mHealth app plus psycho or pharmacological therapy with psycho or pharmacological therapy alone (2/28, 7%). The difference in the abstinence outcome was not significant (log RR=0.25, 95% CI −0.18 to 0.67; I2=16.91%).

Personalized or Interactive Versus Not Personalized or Interactive

The same studies pooled in the subgroup analysis by intervention type in the short- and long-term were also pooled in the exploratory analyses by personalization or interaction level (Table 4). Compared with the studies with no personalization or interactive features that yielded nonsignificant results (short-term log RR=0.17, 95% CI −0.21 to 0.54; I2=67.39%; long-term log RR=0.23, 95% CI −0.26 to 0.72; I2= 82.52%), those that offered a certain level of personalization or interactive content reached moderate increases in abstinence both in the short term (log RR=0.62, 95% CI 0.30-0.94; I2= 66.50%) and long-term (log RR=0.28, 95% CI 0.04-0.53; I2=73.42%).

Biochemically Verified Outcomes Versus Self-Reported Outcomes

In the second exploratory analysis, we compared the intervention effect between studies that adopted biochemically verified and self-reported results. Studies that used biochemical verification for abstinence found a moderate increase in cessation in the short term (log RR=0.45, 95% CI 0.15-0.74; I2=21.39%), which is similar to the studies that used self-reported results (log RR=0.56, 95% CI 0.15 to 0.96; I2=87.88%). For long-term effects, neither of the 2 groups of studies achieved significant results (biochemical verification, log RR=0.26, 95% CI −.02 to 0.54; I2=34.82%; self-reported, log RR=0.31, 95% CI −0.05 to 0.68; I2=95.06%). Meanwhile, the estimates in the 2 exploratory analyses should be interpreted with caution given the substantial statistical heterogeneity.

eHealth Interventions Targeting Specific Populations

A total of 10 studies reported interventions that targeted comparable populations with special characteristics. Because of the limited number of studies, no further categorization was made based on follow-up, intervention, or control. Hospitalized adult smokers benefited more from eHealth interventions (log RR=1.00, 95% CI 0.22-1.78; I2=3.45%) than pregnant smokers (log RR=0.34, 95% CI −0.01 to 0.68; I2=25.84%). Findings on smokers with mental disorders were contradictory and nonsignificant (log RR=−0.25, 95% CI −1.92 to 1.42; I2=72.32%; Figure 3).

Figure 3. Forest plot of eHealth intervention effects by characteristics of study population (any follow-ups) [40,41,44,47,49,51,57,60-62].

Publication Bias

Funnel plots were generated for each pooled result and are presented in Multimedia Appendix 2. Because of the limited number of studies in each group, assessing publication bias is challenging. Therefore, we decided to focus on the subgroup with the largest number of studies (n=13), which included long-term abstinence. Figure 4 displays the funnel plot assessing publication bias among the studies that measured long-term abstinence in adult smokers. Visual inspection of the plot revealed a relatively symmetrical distribution of the included studies, indicating that our study was unlikely to be affected by publication bias.

Figure 4. Funnel plot of long-term abstinence results [42,43,46,48,50,53-56,58,59,63,65].

Narrative Synthesis

For studies not included in the meta-analysis (n=11), we have summarized the treatment effect on abstinence outcomes in Table 5 because of their distinct features in the study population or interventions. Overall, 2 studies that used multiplatform eHealth intervention or mHealth apps accompanied by SMS text messaging reported a significant increase in abstinence at 3- and 6-month follow-ups [27,28]. A significant increase in abstinence at 6 months was reported in 2 studies using mHealth counseling and SMS messaging accompanied by pharmacotherapy, respectively, as interventions [29,30]. In addition, one study reported a text referral program to refer smokers to cessation services, which may improve cessation outcomes [31]. Finally, acceptance and commitment therapy were suggested to be more effective than US clinical practice guidelines in the context of the mHealth app group [32]. The remaining 5 studies reported no significant differences between intervention and control on cessation outcomes [33-37].

For nonabstinence outcomes, a total of 20 studies reported a reduction in cigarette consumption and user satisfaction (Multimedia Appendix 4 [28,32-34,37-50,52,53,58,60,62,64]). Among the 14 studies that reported cigarette consumption outcomes, only 3 suggested that the intervention can reduce cigarette consumption significantly compared with controls [38-40]. Finally, 19 studies assessed user satisfaction after the intervention, and 18 reported good user satisfaction, whereas the remaining 1 study specifically investigated user adherence to the program [38]. Among the studies that reported high user satisfaction, 8 compared user satisfaction between the intervention and control groups and found significantly higher satisfaction in the intervention arm [28,32,34,41-45].

Table 5. Summary of eHealth intervention effects for studies not included in the meta-analysis (n=11).
StudyIntervention vs controlPersonalized or interactiveStudy population (verification)Intervention quit, nIntervention smoking, nControl quit, nControl smoking, nRRa (95% CI)Summary of outcome
Masaki et al [27]Integrated eHealth + pharmacotherapy vs control eHealth + pharmacotherapyYesAdult smokers with intention to quit (biochemically validated)3 months: 215; 6 months: 182; 12 months: 1493 months: 70; 6 months: 103; 12 months: 1363 months: 190; 6 months: 145; 12 months: 1193 months: 97; 6 months: 142; 12 months: 1683 months: 1.14 (1.03-1.27); 6 months: 1.26 (1.09-1.46); 12 months: 1.26 (1.06-1.50)Significant increase on cessation outcome at all follow-ups
Fernandes et al [29]mHealthb counseling vs minimal smoking cessation supportYesAdult patients with TBc (self-reported)6 months: 546 months: 266 months: 346 months: 486 months: 1.63 (1.21-2.19)Significant increase on cessation outcome at 6 months
Weng et al [33]Tailored SMS text messaging vs nonsmoking or untailored SMS text messagingYesAdult smokers not necessarily have intention to quit (self-reported)3 months: 50; 6 months: 57; 12 months: 653 months: 254; 6 months: 247; 12 months: 2393 months: 76; 6 months: 81; 12 months: 903 months: 299; 6 months: 294; 12 months: 2853 months: 0.81 (0.59-1.12); 6 months: 0.87 (0.64-1.18); 12 months: 0.89 (0.67-1.18)No significant increase on cessation outcome at all follow-ups
Graham et al [34]SMS or app text messaging + web-based vs web-basedYesAdult smokers with the intention to quit (self-reported)3 months: 58; 9 months: 723 months: 253; 9 months: 2393 months: 60; 9 months: 713 months: 247; 9 months: 2363 months: 0.95 (0.69-1.32); 9 months: 1.00 (0.75-1.33)No significant increase on cessation outcome at all follow-ups
Gram et al [35]SMS text messaging vs mailYesAdult smokers with the intention to quit (self-reported)3 months: 319; 6 months: 2523 months: 1869; 6 months: 19363 months: 313; 6 months: 2363 months: 1834; 6 months: 19113 months: 1.00 (0.87-1.16); 6 months: 1.05 (0.89-1.24)No significant increase on cessation outcome at 3 and 6 months
Danaher et al [28]mHealth app + SMS text messaging vs computer-assisted interventionYesAdult smokers with the intention to quit (self-reported)3 months: 131; 6 months: 1563 months: 502; 6 months: 4773 months: 73; 6 months: 1233 months: 565; 6 months: 5153 months: 1.81 (1.39-2.36); 6 months: 1.28 (1.04-1.58)Significant increase on cessation outcome at 3 and 6 months
Weng et al [31]On-site referral vs text-based referral vs minimal smoking cessation supportYesAdult smokers with the intention to quit; (biochemically validated)On-site referral; 3 months: 27; 6 months: 30; text-based referral; 3 months: 23; 6 months: 30On-site referral; 3 months: 368; 6 months: 365; text-based referral; 3 months: 362; 6 months: 3553 months: 18; 6 months: 153 months: 365; 6 months: 368On-site referral; 3 months: 1.45 (0.81-2.60); 6 months: 1.9392 (1.06-3.55); text-based referral; 3 months: 1.27 (0.70-2.32); 6 months: 1.99 (1.09-3.64)No significant increase on cessation outcome at 3 months; significant increase on cessation outcome at 6 months
Kruse et al [36]SMS or app text messaging + pharmacotherapy vs SMS or app text messaging vs pharmacotherapy vs minimal smoking cessation supportNoAdult smokers with the intention to quit; (biochemically validated)SMS + NRTd; 3 months: 2; SMS; 3 months: 3; NRT; months: 3SMS + NRT; 3 months: 37; SMS; 3 months: 36; NRT; 3 months: 333 months: 13 months: 38SMS + NRT; 3 months: 2.00 (0.19-21.16); SMS; 3 months: 3.00 (0.33-27.6); NRT; 3 months: 3.25 (0.35-29.85)No significant increase on cessation outcome at 3 months
Vidrine et al [30]SMS or app text messaging + pharmacotherapy vs phone call + pharmacotherapy vs pharmacotherapyYesSocioeconomically disadvantaged adult smokers with the intention to quit; (biochemically validated)SMS or app text messaging + pharmacotherapy; 6 months: 28; phone call + pharmacotherapy; 6 months: 19SMS or app text messaging + pharmacotherapy; 6 months: 160; Phone call + pharmacotherapy; 6 months: 1946 months: 136 months: 210SMS or app text messaging + pharmacotherapy; 6 months: 2.55 (1.36-4.79); phone call + pharmacotherapy; 6 months: 1.53; (0.78-3.02)Significant increase on SMS or app text messaging + pharmacotherapy; outcome at 6 months; no significant increase on phone call + pharmacotherapy; outcome at 6 months
White et al [37]Tailored SMS text messaging vs nonsmoking or untailored SMS text messagingYesAdult smokers with the intention to quit; (self-reported)3 months: 83 months: 933 months: 33 months: 963 months: 2.61 (0.71-9.57)No significant increase on cessation outcome at 3 months
Bricker et al [32]mHealth app vs mHealth app based on a different theoryYesAdult smokers with the intention to quit; (self-reported)3 months: 285; 6 months: 359; 12 months: 3563 months: 929; 6 months: 855; 12 months: 8583 months: 168; 6 months: 259; 12 months: 3023 months: 1033; 6 months: 942; 12 months: 8993 months: 1.68 (1.41-2.00); 6 months: 1.37 (1.19-1.57); 12 months: RR=1.17 (1.02-1.33)Significant increase in cessation outcome at 3-, 6- and 12-month follow-ups

aRR: risk ratio.

bmHealth: mobile health.

cTB: tuberculosis.

dNRT: nicotine replacement therapy.


Principal Findings

This systematic review included 39 RCTs of eHealth smoking cessation interventions, published between 2017 and 2022 [27-65]. Most of the interventions were classified as mHealth interventions involving mobile SMS or app text messaging and mobile apps. This result suggests that cessation intervention delivery channels have shifted away from internet-based interventions [67] or telephone counseling [15], which were prevalent more than 5 years ago. After pooling the 28 included studies, we found mixed results across studies using different subcategories of eHealth interventions and personalization or interactive status. In addition, the intervention effect on abstinence varied among the study populations. Finally, the meta-analysis indicated that studies using biochemical verification yielded results similar compared with studies only used self-reported abstinence. Among the studies not included in the meta-analysis, approximately half (6/11, 55%) reported a statistically significant positive effect on increasing abstinence. In addition to abstinence, a small number of studies (14/39, 36%) evaluated the effects of eHealth interventions on reduced cigarette consumption. Although almost all studies assessed user satisfaction and revealed a high degree of satisfaction postintervention, less than half of them found significant differences between the intervention and control groups.

This study examined 3 types of mHealth interventions: SMS or app text messaging, stand-alone mHealth apps, and mHealth apps used alongside psycho or pharmacological therapy. These interventions have produced different treatment effects on abstinence. Our findings support a previous review [13] that suggests that SMS or app text messaging is more effective than minimal cessation support in promoting abstinence. However, our study also revealed that increasing the frequency of texting may not have a positive impact on abstinence and may even discourage adherence to the intervention [46]. In addition, a previous review found no evidence that smartphone apps can improve the likelihood of smoking cessation and called for further research in this domain [13]. In contrast, in our study, we found that more recent RCTs testing smartphone apps found an increased chance of abstinence among adult smokers in the short term. Compared with the existing knowledge, we believe this change may be due to the improvements in the overall quality of cessation apps that allow more personalized designs, which subsequently increases acceptability among smokers [68]. Finally, our study found that the use of mHealth apps in conjunction with psycho or pharmacological therapy produces abstinence results similar to those of therapy alone. However, the certainty of the evidence is low, indicating the need for further research in this area.

Our review found a high attrition rate and poor long-term treatment effects among identified mHealth smoking cessation studies, which aligns with previous reviews [12,13]. Previous interventions summarized by Belita and Sidani [69] in their systematic review have also shown high attrition rates ranging from 30% to 50% preinclusion and 10% to 50% postinclusion, with a pooled rate of 10.8% to 77%. Such a high attrition rate can easily render many potential therapies ineffective. Although mHealth technologies can adequately address some logistical factors, such as travel, they are neither important nor significantly associated with attrition rates. Therefore, priority should be given to identifying and comprehending the factors that significantly influence the attrition rate. For example, user satisfaction is an important measure of potential adherence from the perspective of eHealth developers [70]. However, we found that most of the included studies reported high satisfaction rates but still had relatively poor user adherence, as evidenced by the high attrition bias rate (13/39, 33%). This finding suggests that the assessment of user satisfaction alone may not be a reliable factor for predicting adherence, at least in terms of smoking cessation interventions. Researchers and mHealth app developers should consider narrowing the intervention scope based on demographic factors at the design stage and improving personalization based on clinical, behavioral, and health belief factors at the development stage [69]. In fact, the eHealth cessation interventions that managed to achieve the most significant increase in abstinence in our meta-analysis targeted hospitalized smokers (log RR=1.00, 95% CI 0.22-1.78; I2=3.45%) [40,47]. The success may be due to the good program adherence evidenced by the low attrition rate, thanks to the institutional environment that encourages prohealth behaviors, as well as the intervention material dedicated to this specific population.

To explore the association between personalization status and treatment effect, we pooled studies targeting general smokers according to their personalization or interactive level and found improved abstinence results. Previous research has also suggested that such content can improve medication adherence [71] and eHealth application retention [72], thereby enhancing its effectiveness. It is not surprising that interventions that included some level of personalized or interactive content achieved a significant increase in abstinence rates both in the short and long term. By contrast, studies that lacked any personalized or interactive features showed null effects after pooling. However, caution should be exercised when interpreting these findings because of high within-group heterogeneity.

Finally, we found that studies using either biochemical verification or self-reporting for measuring abstinence showed similar treatment effects. Previous research has produced mixed results on whether self-reported abstinence is a reliable indicator of biochemically verified abstinence. Although some studies have suggested that self-reported quitting is mostly accurate [73], others have found a high proportion of self-reported quitters failing biochemical verification in clinical settings [74]. However, our review brings a new perspective to the debate, suggesting that studies using biochemical verification do not necessarily outperform those using self-reports. We found that the effect sizes of studies using both methods were consistently similar in both the short and long term (Table 4). Although biochemical verification is encouraged by the Society for Research on Nicotine and Tobacco for its scientific rigor, it can be expensive [75]. Our findings support the feasibility of eHealth-based cessation programs, which are scalable to large-scale interventions where biochemical verification is not possible. Nonetheless, given the possibility of false reporting, trials evaluating potential population-level interventions may need to be considered using biochemical verification of smoking populations that are most susceptible to false reports. For instance, a study has recommended using biochemical assessment, preferably with cotinine plasma, in intervention studies and with student populations [76]. Second, there are a variety of biochemical verification methods that target different biomarkers. This diversity has prompted an update of the 2002 Society for Research on Nicotine and Tobacco reports on whether and how to apply biomarker verification to tobacco use and abstinence [75]. Given this complexity, researchers in relevant fields should focus on standardizing currently accepted biochemical verification methods and their cut-off points to improve interstudy compatibility, rather than seeking the most accurate method.

Strengths and Limitations

This study provides a comprehensive and updated evaluation of the potential role of eHealth interventions in facilitating smoking cessation. Its robustness lies in the inclusion of recent well-funded studies that demonstrate the advancement of digital technology and its accessibility in both high- and lower-income nations (Multimedia Appendix 5 [27-65]). The present review included multiple outcome assessment criteria and treated populations to provide a more holistic evaluation. However, we acknowledge that this study has some limitations. First, our focus was limited to studies published in English in the last 5 years, which means that we may have overlooked relevant research conducted in other languages or low- to middle-income countries. Second, due to the significant heterogeneity of methodological design and outcome verification among studies, not all were suitable for inclusion in the meta-analysis. This limitation led to fewer studies being synthesized, which undermined the certainty of the evidence. In addition, the small sample sizes in some studies resulted in relatively large CIs for effect size estimation, making it difficult to determine a significant effect. Third, despite our attempt to synthesize the intervention effect on special populations and nonabstinence outcomes, such as cigarette consumption, the heterogeneity in outcome measurement among the collected evidence prevented us from drawing any conclusion.

Future Recommendations

Future studies could standardize the intervention evaluation strategy by following the World Health Organization Practical Guide to Monitoring and Evaluating Digital Health Interventions [77] for better comparability between trials. In addition, mobile app development should adopt a human-centered design approach and prioritize improving participant adherence and engagement [78,79] to reduce attrition and achieve better long-term cessation outcomes (≥6 months). Furthermore, research is necessary to understand the effectiveness of eHealth interventions on susceptible populations and intermediate outcomes such as reduction in cigarette consumption.

Conclusions

The use of eHealth technologies for smoking cessation has gained momentum in recent years. Our review highlighted the timeliness of eHealth interventions, particularly mHealth, in promoting abstinence, although their effectiveness may wane over time. Future studies could benefit from adopting a learning by doing approach and incorporating the concept of human-centered design to develop personalized intervention designs that address individual smoker needs and reduce attrition, ultimately leading to better long-term abstinence outcomes. In addition, owing to the dynamic nature of eHealth interventions, monitoring and evaluation can be challenging. Standardized evaluation strategies should be implemented to improve interstudy comparability.

Acknowledgments

The authors thank Jas Santos for her help in editing the language of this paper. This review was supported by the Hou Tu Research (HTR) Fund of Duke Kunshan University (2022LY012).

Authors' Contributions

YEF developed the review protocol and executed the search strategies. YEF and ZZ conducted the initial screening, full-text review, and data extraction, whereas RW and BY resolved the conflicts. YEF conducted narrative analysis and meta-analyses, which were later confirmed by BY. LLY oversaw the project. All authors contributed to the manuscript drafting.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Search strategies.

DOC File , 51 KB

Multimedia Appendix 2

Meta-analysis of forest and funnel plots (random effects).

DOC File , 829 KB

Multimedia Appendix 3

Summary of eHealth intervention effects (meta studies).

DOCX File , 27 KB

Multimedia Appendix 4

Summary of eHealth intervention effects on nonabstinence outcomes.

DOCX File , 18 KB

Multimedia Appendix 5

Funding information of included randomized controlled trials.

DOCX File , 22 KB

  1. GBD 2015 Tobacco Collaborators. Smoking prevalence and attributable disease burden in 195 countries and territories, 1990-2015: a systematic analysis from the Global Burden of Disease Study 2015. Lancet. May 13, 2017;389(10082):1885-1906. [FREE Full text] [CrossRef] [Medline]
  2. Nargis N, Hussain AK, Asare S, Xue Z, Majmundar A, Bandi P, et al. Economic loss attributable to cigarette smoking in the USA: an economic modelling study. Lancet Public Health. Oct 2022;7(10):e834-e843. [CrossRef]
  3. Huang S, Wei H, Yao T, Mao Z, Sun Q, Yang L. The impact of smoking on annual healthcare cost: an econometric model analysis in China, 2015. BMC Health Serv Res. Mar 28, 2021;21(1):187. [FREE Full text] [CrossRef] [Medline]
  4. Smoking cessation. A report of the Surgeon General. U.S. Department of Health and Human Services. Atlanta, GA. U.S. Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health; 2020. URL: https://www.hhs.gov/sites/default/files/2020-cessation-sgr-full-report.pdf [accessed 2022-09-14]
  5. Levy DE, Regan S, Perez GK, Muzikansky A, Friedman ER, Rabin J, et al. Cost-effectiveness of implementing smoking cessation interventions for patients with cancer. JAMA Netw Open. Jun 01, 2022;5(6):e2216362. [FREE Full text] [CrossRef] [Medline]
  6. Quynh Mai V, Van Minh H, Truong Nam N, Thao Anh H, Minh Van N, Thi Trang N, et al. Cost analysis of community-based smoking cessation services in vietnam: a cluster-randomized trial. Health Serv Insights. Aug 08, 2021;14:11786329211030932. [FREE Full text] [CrossRef] [Medline]
  7. Sharpe T, Alsahlanee A, Ward KD, Doyle F. Systematic review of clinician-reported barriers to provision of smoking cessation interventions in hospital inpatient settings. J Smok Cessat. Jan 30, 2018;13(4):233-243. [CrossRef]
  8. Barroso-Hurtado M, Suárez-Castro D, Martínez-Vispo C, Becoña E, López-Durán A. Smoking cessation apps: a systematic review of format, outcomes, and features. Int J Environ Res Public Health. Nov 06, 2021;18(21):11664. [FREE Full text] [CrossRef] [Medline]
  9. Li R, Liang N, Bu F, Hesketh T. The effectiveness of self-management of hypertension in adults using mobile health: systematic review and meta-analysis. JMIR Mhealth Uhealth. Mar 27, 2020;8(3):e17776. [FREE Full text] [CrossRef] [Medline]
  10. Meier CA, Fitzgerald MC, Smith JM. eHealth: extending, enhancing, and evolving health care. Annu Rev Biomed Eng. 2013;15:359-382. [CrossRef] [Medline]
  11. Mersha AG, Bovill M, Eftekhari P, Erku DA, Gould GS. The effectiveness of technology-based interventions for smoking cessation: an umbrella review and quality assessment of systematic reviews. Drug Alcohol Rev. Nov 06, 2021;40(7):1294-1307. [CrossRef] [Medline]
  12. Do HP, Tran BX, Pham QL, Nguyen LH, Tran TT, Latkin CA, et al. Which eHealth interventions are most effective for smoking cessation? A systematic review. Patient Prefer Adherence. Oct 2018;Volume 12:2065-2084. [CrossRef]
  13. Whittaker R, McRobbie H, Bullen C, Rodgers A, Gu Y, Dobson R. Mobile phone text messaging and app-based interventions for smoking cessation. Cochrane Database Syst Rev. Oct 22, 2019;10(10):CD006611. [FREE Full text] [CrossRef] [Medline]
  14. Silang K, Sanguino H, Sohal PR, Rioux C, Kim HS, Tomfohr-Madsen LM. eHealth interventions to treat substance use in pregnancy: a systematic review and meta-analysis. Int J Environ Res Public Health. Sep 22, 2021;18(19):9952. [FREE Full text] [CrossRef] [Medline]
  15. Matkin W, Ordóñez-Mena JM, Hartmann-Boyce J. Telephone counselling for smoking cessation. Cochrane Database Syst Rev. May 02, 2019;5(5):CD002850. [FREE Full text] [CrossRef] [Medline]
  16. Senbekov M, Saliev T, Bukeyeva Z, Almabayeva A, Zhanaliyeva M, Aitenova N, et al. The recent progress and applications of digital technologies in healthcare: a review. Int J Telemed Appl. Dec 3, 2020;2020:8830200-8830218. [FREE Full text] [CrossRef] [Medline]
  17. Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. Jul 21, 2009;339(jul21 1):b2535. [FREE Full text] [CrossRef] [Medline]
  18. EPIB 629 knowledge synthesis. McGill Library. URL: https://libraryguides.mcgill.ca/epib629/rct-filters [accessed 2022-12-16]
  19. Covidence systematic review software. Veritas Health Innovation. URL: https://www.covidence.org/ [accessed 2022-12-07]
  20. Higgins JP, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al, editors. Cochrane Handbook for Systematic Reviews of Interventions. London, England. The Cochrane Collaboration; 2019.
  21. Sterne JA, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. Aug 28, 2019;366:l4898. [FREE Full text] [CrossRef] [Medline]
  22. Hughes JR, Carpenter MJ, Naud S. Do point prevalence and prolonged abstinence measures produce similar results in smoking cessation studies? A systematic review. Nicotine Tob Res. Jul 2010;12(7):756-762. [FREE Full text] [CrossRef] [Medline]
  23. Gupta SK. Intention-to-treat concept: a review. Perspect Clin Res. Jul 2011;2(3):109-112. [FREE Full text] [CrossRef] [Medline]
  24. Stata Statistical Software: Release 17. StatCorp. College Station, TX. StataCorp LLC; 2021. URL: https://www.stata.com/ [accessed 2022-12-07]
  25. IntHout J, Ioannidis JP, Borm GF. The Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis is straightforward and considerably outperforms the standard DerSimonian-Laird method. BMC Med Res Methodol. Mar 18, 2014;14:25. [FREE Full text] [CrossRef] [Medline]
  26. World Bank country and lending groups. The World Bank. URL: https:/​/datahelpdesk.​worldbank.org/​knowledgebase/​articles/​906519-world-bank-country-and-lending-groups [accessed 2023-03-27]
  27. Masaki K, Tateno H, Nomura A, Muto T, Suzuki S, Satake K, et al. A randomized controlled trial of a smoking cessation smartphone application with a carbon monoxide checker. NPJ Digit Med. 2020;3:35. [FREE Full text] [CrossRef] [Medline]
  28. Danaher BG, Tyler MS, Crowley RC, Brendryen H, Seeley JR. Outcomes and device usage for fully automated internet interventions designed for a smartphone or personal computer: the MobileQuit smoking cessation randomized controlled trial. J Med Internet Res. Jun 06, 2019;21(6):e13290. [FREE Full text] [CrossRef] [Medline]
  29. Fernandes L, Narvekar A, Lawande D. Efficacy of smoking cessation intervention delivered through mobile tele-counseling among smokers with tuberculosis in a Revised National Tuberculosis Control Program. Indian J Tuberc. Apr 2022;69(2):207-212. [CrossRef] [Medline]
  30. Vidrine DJ, Frank-Pearce SG, Vidrine JI, Tahay PD, Marani SK, Chen S, et al. Efficacy of mobile phone-delivered smoking cessation interventions for socioeconomically disadvantaged individuals: a randomized clinical trial. JAMA Intern Med. Mar 01, 2019;179(2):167-174. [FREE Full text] [CrossRef] [Medline]
  31. Weng X, Luk TT, Suen YN, Wu Y, Li HC, Cheung YT, et al. Effects of simple active referrals of different intensities on smoking abstinence and smoking cessation services attendance: a cluster-randomized clinical trial. Addiction. Oct 25, 2020;115(10):1902-1912. [CrossRef] [Medline]
  32. Bricker JB, Watson NL, Mull KE, Sullivan BM, Heffner JL. Efficacy of smartphone applications for smoking cessation: a randomized clinical trial. JAMA Intern Med. Nov 01, 2020;180(11):1472-1480. [FREE Full text] [CrossRef] [Medline]
  33. Weng X, Lau OS, Ng CH, Li WH, Lam TH, Wang MP. Effect of a workplace mobile phone-based instant messaging intervention on smoking cessation: a cluster-randomized controlled trial. Addiction. Jun 06, 2022;117(6):1758-1767. [CrossRef] [Medline]
  34. Graham AL, Papandonatos GD, Cha S, Amato MS, Jacobs MA, Cohn AM, et al. Effectiveness of an optimized text message and internet intervention for smoking cessation: a randomized controlled trial. Addiction. Apr 28, 2022;117(4):1035-1046. [FREE Full text] [CrossRef] [Medline]
  35. Gram IT, Larbi D, Wangberg SC. Comparing the efficacy of an identical, tailored smoking cessation intervention delivered by mobile text messaging versus email: randomized controlled trial. JMIR Mhealth Uhealth. Sep 27, 2019;7(9):e12137. [FREE Full text] [CrossRef] [Medline]
  36. Kruse GR, Park ER, Chang Y, Haberer JE, Abroms LC, Shahid NN, et al. Proactively offered text messages and mailed nicotine replacement therapy for smokers in primary care practices: a pilot randomized trial. Nicotine Tob Res. Aug 24, 2020;22(9):1509-1514. [FREE Full text] [CrossRef] [Medline]
  37. White JS, Toussaert S, Thrul J, Bontemps-Jones J, Abroms L, Westmaas JL. Peer mentoring and automated text messages for smoking cessation: a randomized pilot trial. Nicotine Tob Res. Mar 16, 2020;22(3):371-380. [CrossRef] [Medline]
  38. Goldenhersch E, Thrul J, Ungaretti J, Rosencovich N, Waitman C, Ceberio MR. Virtual reality smartphone-based intervention for smoking cessation: pilot randomized controlled trial on initial clinical efficacy and adherence. J Med Internet Res. Jul 29, 2020;22(7):e17571. [FREE Full text] [CrossRef] [Medline]
  39. Chulasai P, Chinwong D, Vientong P, Lertsinudom S, Kanjanarat P, Hall JJ, et al. Smartphone application for smoking cessation (Quit with US): a randomized controlled trial among young adult light smokers in Thailand. Int J Environ Res Public Health. Jul 06, 2022;19(14):8265. [FREE Full text] [CrossRef] [Medline]
  40. do Amaral LM, Ronzani TM, Cruvinel E, Richter K, Oliveira Andrade R, Lanzieri IO, et al. Text messaging interventions to support smoking cessation among hospitalized patients in Brazil: a randomized comparative effectiveness clinical trial. BMC Res Notes. Mar 26, 2022;15(1):119. [FREE Full text] [CrossRef] [Medline]
  41. Abroms LC, Chiang S, Macherelli L, Leavitt L, Montgomery M. Assessing the National Cancer Institute's SmokefreeMOM text-messaging program for pregnant smokers: pilot randomized trial. J Med Internet Res. Oct 03, 2017;19(10):e333. [FREE Full text] [CrossRef] [Medline]
  42. Etter JF, Khazaal Y. The Stop-tabac smartphone application for smoking cessation: a randomized controlled trial. Addiction. May 19, 2022;117(5):1406-1415. [FREE Full text] [CrossRef] [Medline]
  43. O'Connor M, Whelan R, Bricker J, McHugh L. Randomized controlled trial of a smartphone application as an adjunct to acceptance and commitment therapy for smoking cessation. Behav Ther. Jan 2020;51(1):162-177. [CrossRef] [Medline]
  44. Brunette MF, Ferron JC, McGurk SR, Williams JM, Harrington A, Devitt T, et al. Brief, web-based interventions to motivate smokers with schizophrenia: randomized trial. JMIR Ment Health. Mar 08, 2020;7(2):e16524. [FREE Full text] [CrossRef] [Medline]
  45. Hébert ET, Ra CK, Alexander AC, Helt A, Moisiuc R, Kendzor DE, et al. A mobile just-in-time adaptive intervention for smoking cessation: pilot randomized controlled trial. J Med Internet Res. Mar 09, 2020;22(3):e16907. [FREE Full text] [CrossRef] [Medline]
  46. Augustson E, Engelgau MM, Zhang S, Cai Y, Cher W, Li R, et al. Text to quit China: an mHealth smoking cessation trial. Am J Health Promot. Jan 05, 2016;31(3):217-225. [CrossRef]
  47. Cruvinel E, Richter KP, Colugnati F, Ronzani TM. An experimental feasibility study of a hybrid telephone counseling/text messaging intervention for post-discharge cessation support among hospitalized smokers in brazil. Nicotine Tob Res. Nov 19, 2019;21(12):1700-1705. [FREE Full text] [CrossRef] [Medline]
  48. Carrasco-Hernandez L, Jódar-Sánchez F, Núñez-Benjumea F, Moreno Conde J, Mesa González M, Civit-Balcells A, et al. A mobile health solution complementing psychopharmacology-supported smoking cessation: randomized controlled trial. JMIR Mhealth Uhealth. Apr 27, 2020;8(4):e17530. [FREE Full text] [CrossRef] [Medline]
  49. Minami H, Nahvi S, Arnsten JH, Brinkman HR, Rivera-Mindt M, Wetter DW, et al. A pilot randomized controlled trial of smartphone-assisted mindfulness-based intervention with contingency management for smokers with mood disorders. Exp Clin Psychopharmacol. Oct 2022;30(5):653-665. [CrossRef] [Medline]
  50. Alessi SM, Rash CJ, Petry NM. A randomized trial of adjunct mHealth abstinence reinforcement with transdermal nicotine and counseling for smoking cessation. Nicotine Tob Res. Mar 01, 2017;19(3):290-298. [FREE Full text] [CrossRef] [Medline]
  51. Abroms LC, Johnson PR, Leavitt LE, Cleary SD, Bushar J, Brandon TH, et al. A randomized trial of text messaging for smoking cessation in pregnant women. Am J Prev Med. Dec 2017;53(6):781-790. [FREE Full text] [CrossRef] [Medline]
  52. Jiang N, Nguyen N, Siman N, Cleland CM, Nguyen T, Doan HT, et al. Adaptation and assessment of a text messaging smoking cessation intervention in Vietnam: pilot randomized controlled trial. JMIR Mhealth Uhealth. Oct 08, 2021;9(10):e27478. [FREE Full text] [CrossRef] [Medline]
  53. Garrison KA, Pal P, O'Malley SS, Pittman BP, Gueorguieva R, Rojiani R, et al. Craving to quit: a randomized controlled trial of smartphone app-based mindfulness training for smoking cessation. Nicotine Tob Res. Mar 16, 2020;22(3):324-331. [FREE Full text] [CrossRef] [Medline]
  54. Schwaninger P, Berli C, Scholz U, Lüscher J. Effectiveness of a dyadic buddy app for smoking cessation: randomized controlled trial. J Med Internet Res. Sep 09, 2021;23(9):e27162. [FREE Full text] [CrossRef] [Medline]
  55. Liao Y, Wu Q, Kelly BC, Zhang F, Tang YY, Wang Q, et al. Effectiveness of a text-messaging-based smoking cessation intervention ("Happy Quit") for smoking cessation in China: a randomized controlled trial. PLoS Med. Dec 18, 2018;15(12):e1002713. [FREE Full text] [CrossRef] [Medline]
  56. Xia W, Li HC, Cai W, Song P, Zhou X, Lam KW, et al. Effectiveness of a video-based smoking cessation intervention focusing on maternal and child health in promoting quitting among expectant fathers in China: a randomized controlled trial. PLoS Med. Sep 29, 2020;17(9):e1003355. [FREE Full text] [CrossRef] [Medline]
  57. Coleman T, Clark M, Welch C, Whitemore R, Leonardi-Bee J, Cooper S, et al. Effectiveness of offering tailored text message, self-help smoking cessation support to pregnant women who want information on stopping smoking: MiQuit3 randomised controlled trial and meta-analysis. Addiction. Apr 05, 2022;117(4):1079-1094. [CrossRef] [Medline]
  58. Cobos-Campos R, Apiñaniz Fernández de Larrinoa A, Sáez de Lafuente Moriñigo A, Parraza Diez N, Aizpuru Barandiaran F. Effectiveness of text messaging as an adjuvant to health advice in smoking cessation programs in primary care. A randomized clinical trial. Nicotine Tob Res. Aug 01, 2017;19(8):901-907. [CrossRef] [Medline]
  59. Affret A, Luc A, Baumann C, Bergman P, Le Faou AL, Pasquereau A, et al. Effectiveness of the e-Tabac Info Service application for smoking cessation: a pragmatic randomised controlled trial. BMJ Open. Oct 27, 2020;10(10):e039515. [FREE Full text] [CrossRef] [Medline]
  60. Pollak KI, Lyna P, Gao X, Noonan D, Bejarano Hernandez S, Subudhi S, et al. Efficacy of a texting program to promote cessation among pregnant smokers: a randomized control trial. Nicotine Tob Res. Jun 12, 2020;22(7):1187-1194. [FREE Full text] [CrossRef] [Medline]
  61. Pallejà-Millán M, Rey-Reñones C, Barrera Uriarte ML, Granado-Font E, Basora J, Flores-Mateo G, et al. Evaluation of the Tobbstop mobile app for smoking cessation: cluster randomized controlled clinical trial. JMIR Mhealth Uhealth. Jun 26, 2020;8(6):e15951. [FREE Full text] [CrossRef] [Medline]
  62. Naughton F, Cooper S, Foster K, Emery J, Leonardi-Bee J, Sutton S, et al. Large multi-centre pilot randomized controlled trial testing a low-cost, tailored, self-help smoking cessation text message intervention for pregnant smokers (MiQuit). Addiction. Jul 02, 2017;112(7):1238-1249. [FREE Full text] [CrossRef] [Medline]
  63. BinDhim NF, McGeechan K, Trevena L. Smartphone Smoking Cessation Application (SSC App) trial: a multicountry double-blind automated randomised controlled trial of a smoking cessation decision-aid 'app'. BMJ Open. Jan 21, 2018;8(1):e017105. [FREE Full text] [CrossRef] [Medline]
  64. Intarut N, Wongkongdech R, Thronsao C. The effects of text message and infographic on reducing the number cigarettes consumption: a randomized controlled trial. Asian Pac J Cancer Prev. Nov 01, 2020;21(11):3413-3419. [CrossRef]
  65. Durmaz S, Ergin I, Durusoy R, Hassoy H, Caliskan A, Okyay P. WhatsApp embedded in routine service delivery for smoking cessation: effects on abstinence rates in a randomized controlled study. BMC Public Health. Apr 08, 2019;19(1):387. [FREE Full text] [CrossRef] [Medline]
  66. What is GRADE? BMJ Best Practice. URL: https://bestpractice.bmj.com/info/us/toolkit/learn-ebm/what-is-grade/ [accessed 2022-12-16]
  67. Taylor GM, Dalili MN, Semwal M, Civljak M, Sheikh A, Car J. Internet-based interventions for smoking cessation. Cochrane Database Syst Rev. Sep 04, 2017;9(9):CD007078. [FREE Full text] [CrossRef] [Medline]
  68. Car J, Tan WS, Huang Z, Sloot P, Franklin BD. eHealth in the future of medications management: personalisation, monitoring and adherence. BMC Med. Apr 05, 2017;15(1):73. [FREE Full text] [CrossRef] [Medline]
  69. Belita E, Sidani S. Attrition in smoking cessation intervention studies: a systematic review. Can J Nurs Res. Dec 2015;47(4):21-40. [CrossRef] [Medline]
  70. Barbosa CD, Balp MM, Kulich K, Germain N, Rofail D. A literature review to explore the link between treatment satisfaction and adherence, compliance, and persistence. Patient Prefer Adherence. 2012;6:39-48. [FREE Full text] [CrossRef] [Medline]
  71. Pouls BP, Vriezekolk JE, Bekker CL, Linn AJ, van Onzenoort HA, Vervloet M, et al. Effect of interactive ehealth interventions on improving medication adherence in adults with long-term medication: systematic review. J Med Internet Res. Jan 08, 2021;23(1):e18901. [FREE Full text] [CrossRef] [Medline]
  72. Hashim MJ. User interactivity in eHealth applications: a novel taxonomy. In: Proceedings of the 12th International Conference on Innovations in Information Technology (IIT). Presented at: 12th International Conference on Innovations in Information Technology (IIT); Nov 28-30, 2016, 2016; Al Ain, United Arab Emirates. [CrossRef]
  73. Raherison C, Marjary A, Valpromy B, Prevot S, Fossoux H, Taytard A. Evaluation of smoking cessation success in adults. Respir Med. Oct 2005;99(10):1303-1310. [FREE Full text] [CrossRef] [Medline]
  74. Scheuermann TS, Richter KP, Rigotti NA, Cummins SE, Harrington KF, Sherman SE, et al. Consortium of Hospitals Advancing Research on Tobacco (CHART). Accuracy of self-reported smoking abstinence in clinical trials of hospital-initiated smoking interventions. Addiction. Dec 23, 2017;112(12):2227-2236. [FREE Full text] [CrossRef] [Medline]
  75. Benowitz NL, Bernert JT, Foulds J, Hecht SS, Jacob P, Jarvis MJ, et al. Biochemical verification of tobacco use and abstinence: 2019 update. Nicotine Tob Res. Jun 12, 2020;22(7):1086-1097. [FREE Full text] [CrossRef] [Medline]
  76. Patrick DL, Cheadle A, Thompson DC, Diehr P, Koepsell T, Kinne S. The validity of self-reported smoking: a review and meta-analysis. Am J Public Health. Jul 1994;84(7):1086-1093. [CrossRef] [Medline]
  77. World Health Organization. Monitoring and evaluating digital health interventions: a practical guide to conducting research and assessment. World Health Organization. 2016. URL: https://apps.who.int/iris/handle/10665/252183 [accessed 2022-12-15]
  78. Kreps GL, Neuhauser L. New directions in eHealth communication: opportunities and challenges. Patient Educ Couns. Mar 2010;78(3):329-336. [CrossRef] [Medline]
  79. Bock BC, Graham AL, Whiteley JA, Stoddard JL. A review of web-assisted tobacco interventions (WATIs). J Med Internet Res. Nov 06, 2008;10(5):e39. [FREE Full text] [CrossRef] [Medline]


GRADE: Grading of Recommendations, Assessment, Development, and Evaluations
mHealth: mobile health
PPA: point prevalence abstinence
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
RCT: randomized controlled trial
RoB 2: version 2 of the Cochrane risk-of-bias tool for randomized trials
RR: risk ratio


Edited by A Mavragani; submitted 16.12.22; peer-reviewed by J Zhang, H Tateno, D Kale; comments to author 19.02.23; revised version received 13.04.23; accepted 24.04.23; published 28.07.23.

Copyright

©Yichen E Fang, Zhixian Zhang, Ray Wang, Bolu Yang, Chen Chen, Claudia Nisa, Xin Tong, Lijing L Yan. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 28.07.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.