Published on in Vol 17, No 11 (2015): November

Smoking Cessation Intervention on Facebook: Which Content Generates the Best Engagement?

Smoking Cessation Intervention on Facebook: Which Content Generates the Best Engagement?

Smoking Cessation Intervention on Facebook: Which Content Generates the Best Engagement?

Original Paper

1Center for Tobacco Control Research and Education, University of California, San Francisco, San Francisco, CA, United States

2Department of Psychiatry, University of California, San Francisco, San Francisco, CA, United States

Corresponding Author:

Johannes Thrul, PhD

Center for Tobacco Control Research and Education

University of California, San Francisco

530 Parnassus Avenue, Suite 366

San Francisco, CA, 94143-1390

United States

Phone: 1 415 514 9340

Fax:1 415 514 9345

Email: Johannes.Thrul@ucsf.edu


Background: Social media offer a great opportunity to deliver smoking cessation treatment to young adults, but previous online and social media interventions targeting health behavior change have struggled with low participant engagement. We examined engagement generated by content based on the Transtheoretical Model of Behavior Change (TTM) in a motivationally tailored smoking cessation intervention on Facebook.

Objective: This study aimed to identify which intervention content based on the TTM (Decisional Balance and 10 processes of change) generated the highest engagement among participants in pre-action stages of change (Precontemplation, Contemplation, and Preparation).

Methods: Participants (N=79, 20% female, mean age 20.8) were assessed for readiness to quit smoking and assigned to one of 7 secret Facebook groups tailored to their stage of change. Daily postings to the groups based on TTM Decisional Balance and the 10 processes of change were made by research staff over 3 months. Engagement was operationalized as the number of participant comments to each post. TTM content-based predictors of number of comments were analyzed and stratified by baseline stage of change, using negative binomial regression analyses with and without zero inflation.

Results: A total of 512 TTM-based posts generated 630 individual comments. In Precontemplation and Contemplation groups, Decisional Balance posts generated above average engagement (P=.01 and P<.001). In Contemplation groups, posts based on the TTM processes Dramatic Relief and Self-Liberation resulted in below average engagement (P=.01 and P=.005). In Preparation groups, posts based on Consciousness Raising generated above average engagement (P=.009). Participant engagement decreased over time and differed between groups within Precontemplation and Contemplation stages, but was independent of day of the week and time of day the content was posted to the groups. No participant baseline characteristics significantly predicted engagement.

Conclusions: Participants not ready to quit in the next 30 days (in Precontemplation or Contemplation) engaged most when prompted to think about the pros and cons of behavior change, while those in the Preparation stage engaged most when posts increased awareness about smoking and smoking cessation. Findings support tailoring intervention content to readiness to quit and suggest intervention components that may be most effective in generating high participant engagement on social media.

J Med Internet Res 2015;17(11):e244

doi:10.2196/jmir.4575

Keywords



Smoking is the biggest behavioral risk factor for premature morbidity and mortality in the United States, and young adults are the age group with the highest smoking prevalence [1]. Young adults are also an underserved population given that few are reached by currently available evidence-based smoking cessation interventions [2,3]. Novel cessation interventions to reach young adults smokers are clearly needed.

Recent reviews of Internet [4] or social media interventions [5] for health behavior change and a meta-analysis of Web- and computer-based smoking cessation interventions [6] have concluded that these kinds of interventions can have small but significant beneficial effects (eg, effects of Web-based interventions on smoking cessation—relative risk 1.40) [6]. However, low participant engagement with online or social media interventions is a critical obstacle to improving health behavior outcomes [5,7,8]. Research on Internet-based health promotion interventions suggests that peer and counselor support, email/telephone contact, and regular updates to the website improve participant engagement [9]. Further, the results of a Web-based smoking cessation intervention suggested that a prescriptive message tone (vs a motivational tone), a dictated content viewing order (vs navigation autonomy), and email reminders increased engagement among participants [10]. Compared to other online interventions, social media offer several potential advantages for participant engagement, since they can reach large audiences [11] that are already regular users and familiar with the platform. Further, social media are typically more interactive and require the user to engage more than traditional websites [12] and can promote social connectedness and sharing of experiences [13]. However, little is known about how characteristics of social media interventions are related to participant engagement.

The Transtheoretical Model (TTM) is a well-researched theory of health behavior change [14,15], conceptualizing the process of behavior change into five different stages: Precontemplation (not ready to change in the near future), Contemplation (intending to change within the next 6 months), Preparation (intending to change within the next 30 days), Action (achievement of intended change for less than 6 months), and Maintenance (achievement of intended change for 6 months or more) [15]. Additional dimensions of the TTM include Decisional Balance, or the balance between pros and cons of the problematic behavior and of behavior change [16], and 10 processes of change that aid progression from one stage to the next [17]. See Table 1 for an overview and definition for all TTM content used in the current study.

Table 1. Transtheoretical Model (TTM) content (Decisional Balance and 10 processes of change).
TTM contentDefinition
Decisional BalancePros and cons of behavior and behavior change
Counter-ConditioningSubstituting healthy alternative behaviors and thoughts for old behaviors
Consciousness RaisingLearning new facts, ideas, and tips that support the behavior change
Dramatic ReliefExperiencing negative emotions that go along with old behaviors and positive emotions that go along with new behaviors
Environmental ReevaluationRealizing the negative impact of one’s behavior and the positive impact of change on others
Helping RelationshipsSeeking and using social support to make and sustain change
Reinforcement ManagementIncreasing rewards for healthy behavior change and decreasing the rewards for old behaviors
Stimulus ControlRemoving reminds/cues to engage in old behavior, and using cues to engage in the new healthy behavior
Self-LiberationMaking a firm commitment to change
Social LiberationRealizing that social norms are changing to support new behavior
Self-ReevaluationRealizing that the behavior change is an important part of one’s identity

Previous research suggests that processes of change focused on cognitions, affects, and evaluations are more appropriate in earlier stages, while commitment, conditioning, and stimulus control are more appropriate in the more advanced stages [18]. The TTM and its components are frequently used to design Internet-based interventions to promote health behavior change and TTM-based interventions were found to result in significant effects on health-related behaviors including smoking cessation [4,19,20]. With regard to smoking cessation interventions on Facebook, mixed-methods formative work suggested that an intervention tailored to readiness to quit smoking would likely appeal to the widest range of young adult smokers [21]. Yet, there is no evidence as to how social media intervention content should be tailored to best engage young adult smokers who are in different stages of change.

Engagement in Facebook interventions to change health behavior has previously been operationalized as posting, commenting, or liking of content [22,23], and previous studies also reported that engagement in social media interventions more generally tends to decrease over time [23-25]. In order to develop effective social media interventions for smoking cessation, it is important to know how intervention content should be tailored to produce high participant engagement. However, to our knowledge, no study has examined how intervention content is associated with participant engagement in a smoking cessation intervention delivered through Facebook. Intervention engagement is a meaningful outcome to study, since results from behavioral smoking cessation counseling studies suggest that abstinence increases with overall contact time (up to 90 minutes) as well as with number of treatment sessions [26]. With regard to digital health interventions, one previous study suggests that higher engagement in a Web-based smoking cessation intervention was positively associated with smoking cessation outcomes [27].

In the context of a feasibility trial of the Tobacco Status Project, a Facebook smoking cessation intervention for young adults, this study aimed to identify which intervention content based on the TTM generated the highest engagement among participants in pre-action stages of change (Precontemplation, Contemplation, Preparation).


Procedure

Recruitment efforts included a paid Facebook ad campaign conducted between June and August 2013 actively targeting young adults 18-25 years old, with details reported previously [28]. When meeting eligibility criteria and consenting to study participation, participants were assigned to private (secret) Facebook groups (invitation only, group and content not visible to anyone but participants) of varying sizes tailored to readiness to quit smoking [14,15]. Upon completion of the baseline assessment, participants were individually randomized to an incentive condition based on the following criteria: (1) those in the “personal” incentive condition were told they would receive a US $50 gift card if they commented daily on all 90 posts to their secret Facebook group, (2) those in the “altruistic” incentive group were told they would be given a US $50 gift card to the Just Give website to donate to a charitable organization of their choice if they commented on all 90 posts, (3) those in the no incentive condition were not given an incentive to comment. Upon completion of the intervention, data from secret groups were extracted from Facebook through the Facebook application programming interface (API) [29] for analysis.

Intervention

All participants were invited to a secret Facebook group tailored to their stage of change: Precontemplation (ie, Not Ready to Quit); Contemplation (ie, Thinking About Quitting); or Preparation (ie, Getting Ready to Quit). Research staff made one daily Facebook post for 90 days tailored to their readiness to quit to each group. Posts were adapted from US Clinical Practice Guidelines [26] and Transtheoretical Model skills for smoking cessation [30]. Within each stage of change, TTM content included posts related to Decisional Balance or the 10 processes of change, according to TTM theory. For example, posts focusing on Decisional Balance were used in two of the three groups (Precontemplation and Contemplation) but focused more on eliciting the pros of change in Precontemplation and eliciting both pros and cons of change and reducing cons in the Contemplation groups, according to TTM theory. Table 2 gives an overview of the TTM content used in the different stages of change.

Table 2. Descriptive statistics of Transtheoretical Model (TTM) posts.
TTM contentTotal number of postsUsed in stageaAverage number of commentsSDRange
Decisional Balance48PC, C3.003.000-13
Counter-Conditioning27C, P0.741.770-9
Consciousness Raising137PC, C, P1.211.790-11
Dramatic Relief60PC, C0.681.300-6
Environmental Reevaluation19PC, C2.002.290-8
Helping Relationships18C, P1.221.660-6
Reinforcement Management50C, P0.460.680-3
Stimulus Control44PC, C, P0.540.810-4
Self-Liberation30C, P0.901.640-7
Social Liberation57PC, C1.792.700-16
Self-Reevaluation22PC, C, P1.051.590-7

aC: Contemplation; P: Preparation; PC: Precontemplation.

Posts had a mix of imagery, text, and Facebook poll formats. Sample posts can be found in Multimedia Appendix 1. Post order was randomized, but the same order was used for all groups within each stage of change. When posts clearly referenced previous posts (eg, the post of the day before), these were randomized as blocks.

Participants

Participants were 18-25 years old, English literate, and reported having smoked at least 100 cigarettes in their lifetime, currently smoked at least 3 days per week, and used Facebook at least 4 days per week.

Measures

Engagement

Engagement was operationalized as the number of comments a Facebook post received (regardless of the number of individuals commenting). Comments were used as a primary measure of engagement instead of likes or posts because participants were instructed to comment on study posts every day.

Participant Baseline Characteristics

At baseline, demographic information included age, gender, race/ethnicity, education, and household income. We also assessed average number of days smoking per week (from which we computed percent smoking 7 days per week as “daily”) and presence of past year quit attempt (y/n) [31]. Time to first cigarette upon waking (<30 min or >30 min) was used as a measure of dependence [32]. Smoking goal was assessed with one item with seven response options, categorized into three categories: No goal, controlled or reduced smoking, and abstinence [33]. The Tobacco Smoking Stages of Change Questionnaire [15] assessed motivation to quit at baseline, categorizing smokers into one of three pre-action stages of change. Upon completion of the baseline assessment, participants were individually randomized to three incentive conditions: (1) personal incentive, (2) altruistic incentive, and (3) no incentive (see Procedure section).

Transtheoretical Model Post Content

Posts were classified according the TTM Decisional Balance or one of ten processes of change (see Table 1).

Post Features

Features of Facebook posts included group membership (one of seven Facebook groups), time of day (1 hour intervals), and day of the week each post was uploaded onto Facebook.

Statistical Analysis

The relationship between engagement (total number of comments across all groups) and participant baseline characteristics and incentive group were examined using t tests. These analyses were based on total engagement throughout the intervention (718 total comments on posts based on TTM as well as other posts). To analyze our main research question of which TTM posts generated the best engagement, only the subset of posts that were based on TTM decisional balance and processes of change were selected (630 comments) and engagement was regressed on TTM post content. Since intervention posts were tailored to readiness to quit, these analyses were conducted separately by baseline readiness to quit smoking (Precontemplation, Contemplation, Preparation). In order to adequately address the over-dispersed outcome variable number of comments, negative binomial regression analyses were used [34], since fit indices suggested a better fit of negative binomial models compared to Poisson models. In the analyses for the Contemplation and Preparation stages, these models were additionally adjusted for excess zeros [35], which improved the model fit compared to negative binomial models without zero-inflation. Zero-inflated models estimate two equations simultaneously, one for the count model and one for the excess zeros. These excess zeros were regressed on the running number of the intervention day the individual post was made to the Facebook group (1-90; compared to posts with at least one comment). The rationale behind this was that as participants progressively disengaged with the Facebook intervention over time, a post made at a later time did not have the same likelihood to elicit engagement, as it had a lower chance to be read in the first place. The predictor TTM post content was dummy coded, and effect/deviation coding was used to estimate the difference in engagement between each individual theory post and the overall/average engagement (the mean of the outcome variable for a given level of the predictor was compared to the mean of the outcome variable for all levels of the predictor variable). The following covariates related to Facebook posts were examined: Group membership (one of seven Facebook groups), time of day (1-hour intervals), and day of the week each post was uploaded onto Facebook. These covariates were analyzed using analyses of variance (ANOVAs), and only significant variables were included in the final regression models. All analyses were conducted using Stata 11.2 [36].


Sample Description

Of the 586 respondents who met criteria to participate, 230 signed online consent, and 79 completed a baseline assessment and were assigned to one of seven Facebook groups (number of participants mean 13, SD 5, range 7-22). Participants had a mean age of 21 (SD 2), 20% (16/79) were female, 80% (63/79) non-Hispanic white, and 18% (14/79) non-heterosexual. The median household income was between US $21,000 and $40,000, and 28% (22/79) reported a household income >US $60,000. Well over half (48/79, 61%) reported at least some college education while 56% (44/79) were employed. Of all participants, 75% (59/79) smoked daily and for an average of 3 years (SD 1). Mean age of initiation was 14 (SD 3) with regular smoking by age 16 years (SD 3), on average. The sample averaged 12 cigarettes/day (SD 8), 52% (41/79) smoked within 30 minutes of waking, and 57% (45/79) had made a past year quit attempt. With regard to their smoking goals, 30% (24/79) reported no goal, 60% (47/79) reported a reduction goal, and 10% (8/79) reported an abstinence goal. Of the 79 participants at baseline, 33 participants (42%) were in the Precontemplation stages of change, 36 were in Contemplation (46%), and only a minority of 10 (13%) were in Preparation. Last, 47% (37/79) of participants received no incentive for commenting daily, 28% (22/79) received an altruistic incentive, and 25% (20/79) received a personal incentive. Incentive conditions were equally distributed across stages of change (Precontemplation: 27% altruistic, 24% personal; Contemplation: 28% altruistic, 25% personal; Preparation: 30% altruistic, 30% personal).

The entire sample of 79 participants made a total of 718 individual comments to any intervention content. Of all 79 participants, 48 (60.8%) commented at least once and contributed an average of 15 comments per participant. Further, 42 (53.2%) of participants commented more than once. The 21 users with the most comments (26.6% of the entire sample) accounted for 593 comments (82.6% of all comments). No participant baseline characteristic significantly predicted intervention engagement (results not shown).

Intervention Predictors of Engagement With Transtheoretical Model Posts

In order to analyze which TTM content generated the highest engagement, only posts based on TTM theory were selected for analysis. This resulted in the selection of 512 posts, which generated 630 comments. Content was posted between 8 am and 6 pm, and a majority of posts (73%) were made between 1 pm and 3 pm (all Pacific Time). Timing of the post (time of day and weekday) was not significantly associated with engagement. Time of day reached marginal significance (time of day: F9,502=1.9, P=.05; weekday: F6,505=0.7, P=.67). Table 2 displays descriptive statistics according to the TTM-based posts. Of all 512 posts, 268 (52.3%) received at least one comment. The 125 posts with the most comments (24.4% of all posts) received 487 comments (77.3% of all comments). As can be seen in Figure 1, intervention engagement with TTM posts decreased over time in each of the seven Facebook groups (range of correlation coefficients from -.81 to -.55; all P<.001) and the number of comments varied by group (F6,505=29.7; P<.001). Thus, a dummy variable for Facebook group was the only covariate we subsequently included in all further analyses.

Figure 1. Engagement with Transtheoretical Model (TTM) posts in each of the 7 groups over time (C: Contemplation; P: Preparation; PC: Precontemplation).
View this figure

Intervention Engagement According to Transtheoretical Model Post Content

The results of our negative binomial regression analyses to investigate which post content generated the best engagement are displayed in Table 3. Among participants in Precontemplation, Decisional Balance–based posts generated above average engagement compared to other posts (P=.01). Among those in Contemplation, Decisional Balance–based posts were also associated with above average engagement (P<.001) while Dramatic Relief and Self-Liberation posts were associated with below average engagement (P=.01 and P=.005). Last, among participants in Preparation, Consciousness Raising posts resulted in above average engagement (P=.009) and Helping Relationships–based posts were marginally but nonsignificantly associated with above average engagement (P=.08). Engagement differed between the two groups in Precontemplation (P<.001) and between the three groups in Contemplation (P<.001 and P=.02). Figure 1 shows engagement with TTM posts in each of the seven groups over time.

Table 3. Results of negative binomial regression analyses of Transtheoretical Model (TTM) content predicting intervention engagement, separately conducted for each baseline stage of change (adjusted for excess zeros in Contemplation and Preparation).

bStandard errortP
Precontemplation




TTM content


Consciousness RaisingOmitteda




Decisional Balance0.6850.2752.5.01


Dramatic Relief-0.5810.956-0.6.54


Environmental Reevaluation0.2850.3830.7.46


Stimulus Control-0.2040.704-0.3.77


Social Liberation0.0090.2750.0.97


Self-Reevaluation0.1130.7460.2.88


Group PC2bdummy-0.8830.190-4.7<.001
Contemplation

TTM content


Counter-ConditioningOmitteda




Consciousness Raising0.0230.1780.1.90


Decisional Balance0.9100.1954.7<.001


Dramatic Relief-0.5260.211-2.5.01


Environmental Reevaluation0.2370.2620.9.37


Helping Relationships0.1270.4770.3.79


Reinforcement Management-0.3740.558-0.7.50


Stimulus Control-0.2760.414-0.7.51


Self-Liberation-0.6690.239-2.8.005


Social Liberation0.3300.2021.6.10


Self-Reevaluation-0.3850.285-1.4.18


Group C2cdummy1.3400.2006.7<.001


Group C3ddummy-0.5950.258-2.3.02


Inflated zeros - Intervention day0.0590.0096.3<.001
Preparation

TTM content


Counter-ConditioningOmitteda




Consciousness Raising0.6280.2392.6.009


Helping Relationships0.5210.2931.8.08


Reinforcement Management-0.1180.283-0.4.68


Stimulus Control-0.1520.307-0.5.62


Self-Liberation-0.5690.868-0.7.51


Self-Reevaluation-0.2580.553-0.5.64


Group P2edummy0.0310.2130.1.89


Inflated zeros - Intervention day0.1050.0205.3<.001

aDummy for first TTM content (Consciousness Raising for Precontemplation, Counter-Conditioning for Contemplation and Preparation) omitted to estimate each model.

bPC2: Precontemplation 2.

cC2: Contemplation 2.

dC3: Contemplation 3.

eP2: Preparation 2.


Principal Findings

We investigated which intervention content based on the Transtheoretical Model generated the best engagement in a Facebook smoking cessation intervention for young adults tailored to participants’ readiness to quit smoking. Different intervention content generated varying levels of engagement according to TTM stage of change.

Participants in Precontemplation and Contemplation showed more than average engagement when posts were based on Decisional Balance. For those in Precontemplation, strategies focused more on increasing the pros of quitting, while posts in Contemplation groups acknowledged cons of quitting while simultaneously focusing on challenging the cons and increasing pros. Decisional Balance strategies are recommended by US Clinical Practice Guidelines for Smoking Cessation [26] and are consistent with motivational interviewing techniques of acknowledging ambivalence and guiding clients to focus on the positive aspects of quitting, effective with young smokers unmotivated to quit [37-39]. Changes in Decisional Balance have been shown to be associated with transitions from Precontemplation to Contemplation or Preparation for smoking [40-42] and other health risk behaviors including exercise [43] in previous studies. As applied to social media, Decisional Balance strategies can harness either a small social network (eg, an intervention group) or one’s larger Facebook social network to get help in generating pros and cons of smoking and smoking cessation.

For participants in Contemplation, we found that posts utilizing Dramatic Relief and Self-Liberation generated below-average engagement. Dramatic relief focuses on eliciting negative emotional responses to old behaviors (ie, smoking) and positive emotional responses to newly adopted behaviors (ie, quitting smoking). For Contemplation groups, Dramatic Relief posts were primarily focused on eliciting negative emotions related to smoking through, for example, links to the Legacy Foundation Truth Campaign YouTube videos of current or former tobacco users with severe consequences [44]. Findings suggest that posts focused on associating positive emotions with quitting or posts not linking to third-party websites (ie, YouTube) may have been a more effective strategy in implementing the Dramatic Relief process of change through social media. Self-Liberation posts focused on asking participants to take small steps toward quitting and to share their experience with other group members. It is not possible to know whether lower than average engagement suggests “steps” were not taken or were just not reported in groups. Future posts using Self-Liberation strategies could focus on having participants share strategies in extremely incremental steps or eliciting ideas from participants or group members about which steps they would be willing to take or would suggest for their peers to elicit more sharing in groups.

Posts based on Consciousness Raising resulted in above average engagement among participants in Preparation. The TTM posits that Consciousness Raising takes a less active role than processes such as Counter-Conditioning, Stimulus Control, and Reinforcement Management to help move people from Preparation to Action stages of change. Nevertheless, participants were most engaged with these posts, suggesting that those ready to quit are interested in information about quitting smoking. Posts focused on the health benefits of quitting, for example, may be most engaging in Preparation groups.

Engagement diminished over time in all groups, which is consistent with previous studies on health behavior change interventions using social media [23-25]. However, we also found that engagement was independent of time of day and day of week, suggesting that a Facebook smoking cessation intervention can deliver critical information to participants and has the potential to get them to engage every day. This is especially promising since 70% of Facebook users report daily use [11]. Furthermore, more than 50% of participants in the present intervention actively engaged two times or more, showing that the intervention was interesting enough for them to come back more than once. Compared to online smoking cessation interventions not using social media [10], about the same proportion of participants engaged with the intervention at all (63% vs 61% in our study). However, the participants in our study engaging at least once commented an average of 15 times, which compares favorably to an average of 1.4 visits made to a smoking cessation website [10]. Consistent with previous research [12], these findings suggest that social media can be harnessed to engage participants in smoking cessation and other health behavior change interventions.

We did not find baseline participant characteristics that predicted differences in engagement; however, participants clearly showed varying intensities of engagement. This suggests that we either did not capture important baseline predictors of engagement or that substantial variance in engagement gets introduced at the group level. Indeed, intervention engagement did differ by group. Unfortunately, this feasibility study with seven groups lacked the adequate sample size to investigate group-level factors such as group size, group composition (eg, gender ratio, percentage of daily smokers, or future smoking intentions), or group processes (eg, do a couple of very active participants motivate others to be more active as well?) that may have caused these group level differences. Future studies with larger samples are needed to investigate this topic.

Previous studies of both behavioral smoking cessation counseling [26] and Web-based smoking cessation intervention [27] suggested that higher engagement may lead to better smoking cessation outcomes. Of our 79 participants, 60 (75.9%) completed the follow-up assessment at end of treatment (3-month follow-up). Of these, 7 participants (11.7%) reported 7-day point prevalence abstinence at end of treatment. Participants with self-reported abstinence made an average of 22.4 (SD 21.9) comments, compared to 8.3 (SD 15.1) comments among non-abstinent participants. This difference was borderline statistically significant in a Wilcoxon-Mann-Whitney test (z=1.9; P=.05), indicating that engagement was associated with more favorable smoking cessation outcomes in our intervention. When conservatively assuming those not followed-up were still smoking (intent-to-treat or ITT), this difference was statistically significant: abstinent: 22.4 comments (SD 21.9); non-abstinent: 7.8 comments (SD 13.9); z=2.0; P=.04. However, it should be noted that due to our small participant sample, the achieved test power to detect this effect was only 56% (61% respectively for ITT analysis). A trial adequately powered to investigate this research question more in depth is warranted.

Limitations

Our findings should be interpreted with several limitations in mind. This study relied on a self-selected convenience sample of young adult smokers using Facebook, and the sample was predominantly male and white. Social networks were formed as part of the intervention rather than derived organically based on the participants’ Facebook or other preexisting social network. Strategies are needed to recruit more female and ethnic minority participants through Facebook targeting (eg, placing ads in locations where more ethnic minority smokers reside) and using images to target women and non-white smokers. Further, our intervention was tailored to baseline readiness to quit smoking in accordance with the TTM, and thus participants in each stage of change received different intervention content. This study design feature was accounted for by examining engagement stratified by baseline readiness to change; however, it precluded us from comparing engagement with TTM content between different stages of change. Our analysis of post features was theory-guided and focused on the TTM. We thus did not investigate how other aspects of Facebook posts, such as sentiment (positive/negative) or semantic content were related to participant engagement [45]. This should be examined in future studies. Comments are a conservative measure of engagement; indeed, the absence of commenting does not necessarily mean a person did not see or make some cognitive or behavioral change as a result of an intervention post. These, however, were impossible to measure in the context of this study conducted entirely on Facebook. In addition, we were not able to take the quality and depth of engagement (eg, comment content, length) into account. However, overall we argue that comments to Facebook posts are likely a more meaningful measure of active intervention engagement [46,47], compared to previous studies that looked at number of website visits or time spent viewing specific websites as measures of engagement (eg, [10,20]). In addition, time of day that the intervention content was posted was not randomized, and the majority of content was posted between 1 pm and 3 pm Pacific Time.

Conclusions

Social media such as Facebook provide unprecedented opportunities to reach large numbers of young adult smokers with smoking cessation interventions. However, it is crucial to investigate and improve participant engagement in these types of interventions. This study has important implications for interventions with young adult smokers on social media. Results underscore the importance of tailoring intervention content to readiness to quit smoking to maximally engage young adults in social media interventions. Decisional Balance was most engaging to those not ready to quit (Precontemplation, Contemplation stages of change), and Consciousness Raising was most engaging to those in Preparation. Results suggest that in order to increase participant engagement, social media smoking cessation interventions should use posts that increase the pros of quitting for participants in Precontemplation, posts that increase the pros while challenging the cons for participants in Contemplation, and posts that provide information on quitting smoking for participants in Preparation. Although social media are generally integrated into the lives of young adults, strategies are still needed to improve participant engagement in social media smoking cessation intervention over time. Future studies should also examine how engagement with specific intervention content is related to treatment outcomes.

Acknowledgments

This study was supported by the National Institute on Drug Abuse (NIDA K23 DA032578 and P50 DA09253). The preparation of this manuscript was supported in part by the National Cancer Institute (NCI CA113710). None of the funding sources had any further role in study design; in the collection, analysis, and interpretation of data; in the writing of the report; or in the decision to submit the paper for publication. The authors acknowledge the contributions of the staff and research participants in this study. AK is now at the National Center for PTSD, VA Boston Healthcare System.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Sample Facebook posts in precontemplation, contemplation, and preparation.

PDF File (Adobe PDF File), 693KB

  1. U.S. Department of Health and Human Services. The Health Consequences of Smoking — 50 Years of Progress: A Report of the Surgeon General. 2014.   URL: http://www.surgeongeneral.gov/library/reports/50-years-of-progress/full-report.pdf [accessed 2015-06-30] [WebCite Cache]
  2. Curry SJ, Sporer AK, Pugach O, Campbell RT, Emery S. Use of tobacco cessation treatments among young adult smokers: 2005 National Health Interview Survey. Am J Public Health 2007 Aug;97(8):1464-1469. [CrossRef] [Medline]
  3. Solberg LI, Asche SE, Boyle R, McCarty MC, Thoele MJ. Smoking and cessation behaviors among young adults of various educational backgrounds. Am J Public Health 2007 Aug;97(8):1421-1426. [CrossRef] [Medline]
  4. Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010;12(1):e4 [FREE Full text] [CrossRef] [Medline]
  5. Maher CA, Lewis LK, Ferrar K, Marshall S, De BI, Vandelanotte C. Are health behavior change interventions that use online social networks effective? A systematic review. J Med Internet Res 2014;16(2):e40 [FREE Full text] [CrossRef] [Medline]
  6. Myung S, McDonnell DD, Kazinets G, Seo HG, Moskowitz JM. Effects of Web- and computer-based smoking cessation programs: meta-analysis of randomized controlled trials. Arch Intern Med 2009 May 25;169(10):929-937. [CrossRef] [Medline]
  7. Kelders SM, Kok RN, Ossebaard HC, Van Gemert-Pijnen JC. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J Med Internet Res 2012;14(6):e152 [FREE Full text] [CrossRef] [Medline]
  8. Kohl LFM, Crutzen R, de Vries NK. Online prevention aimed at lifestyle behaviors: a systematic review of reviews. J Med Internet Res 2013;15(7):e146 [FREE Full text] [CrossRef] [Medline]
  9. Brouwer W, Kroeze W, Crutzen R, de NJ, de Vries NK, Brug J, et al. Which intervention characteristics are related to more exposure to internet-delivered healthy lifestyle promotion interventions? A systematic review. J Med Internet Res 2011;13(1):e2 [FREE Full text] [CrossRef] [Medline]
  10. McClure JB, Shortreed SM, Bogart A, Derry H, Riggs K, St JJ, et al. The effect of program design on engagement with an internet-based smoking intervention: randomized factorial trial. J Med Internet Res 2013;15(3):e69 [FREE Full text] [CrossRef] [Medline]
  11. Duggan M, Ellison N, Lampe C, Lenhart A, Madden M. Social Media Update. 2014.   URL: http://www.pewinternet.org/files/2015/01/PI_SocialMediaUpdate20144.pdf [WebCite Cache]
  12. Thackeray R, Neiger BL, Hanson CL, McKenzie JF. Enhancing promotional strategies within social marketing programs: use of Web 2.0 social media. Health Promot Pract 2008 Oct;9(4):338-343. [CrossRef] [Medline]
  13. Miron-Shatz T, Hansen MM, Grajales FJ, Martin-Sanchez F, Bamidis PD. Social Media for the Promotion of Holistic Self-Participatory Care: An Evidence Based Approach. Contribution of the IMIA Social Media Working Group. Yearb Med Inform 2013;8:162-168. [Medline]
  14. DiClemente CC, Prochaska JO, Fairhurst SK, Velicer WF, Velasquez MM, Rossi JS. The process of smoking cessation: an analysis of precontemplation, contemplation, and preparation stages of change. J Consult Clin Psychol 1991 Apr;59(2):295-304. [Medline]
  15. Prochaska JO, DiClemente CC. Stages and processes of self-change of smoking: toward an integrative model of change. J Consult Clin Psychol 1983 Jun;51(3):390-395. [Medline]
  16. Velicer WF, DiClemente CC, Prochaska JO, Brandenburg N. Decisional balance measure for assessing and predicting smoking status. J Pers Soc Psychol 1985 May;48(5):1279-1289. [Medline]
  17. Prochaska JO, Velicer WF, DiClemente CC, Fava J. Measuring processes of change: applications to the cessation of smoking. J Consult Clin Psychol 1988 Aug;56(4):520-528. [Medline]
  18. Prochaska JO, Velicer WF. The transtheoretical model of health behavior change. Am J Health Promot 1997;12(1):38-48. [Medline]
  19. Etter J. Comparing the efficacy of two Internet-based, computer-tailored smoking cessation programs: a randomized trial. J Med Internet Res 2005;7(1):e2 [FREE Full text] [CrossRef] [Medline]
  20. Strecher VJ, McClure JB, Alexander GL, Chakraborty B, Nair VN, Konkel JM, et al. Web-based smoking-cessation programs: results of a randomized trial. Am J Prev Med 2008 May;34(5):373-381 [FREE Full text] [CrossRef] [Medline]
  21. Ramo DE, Liu H, Prochaska JJ. A mixed-methods study of young adults' receptivity to using Facebook for smoking cessation: if you build it, will they come? Am J Health Promot 2015;29(4):e126-e135. [CrossRef] [Medline]
  22. Cavallo DN, Tate DF, Ries AV, Brown JD, DeVellis RF, Ammerman AS. A social media-based physical activity intervention: a randomized controlled trial. Am J Prev Med 2012 Nov;43(5):527-532 [FREE Full text] [CrossRef] [Medline]
  23. Valle CG, Tate DF, Mayer DK, Allicock M, Cai J. A randomized trial of a Facebook-based physical activity intervention for young adult cancer survivors. J Cancer Surviv 2013 Sep;7(3):355-368 [FREE Full text] [CrossRef] [Medline]
  24. Freyne J, Berkovsky S, Kimani S, Baghaei N, Brindal E. Improving health information access through social networking. 2010 Presented at: IEEE 23rd Int Symp Comput-Based Med Syst CBMS; October 2010; Bentley, Australia p. 334-339.
  25. Turner-McGrievy G, Tate D. Tweets, Apps, and Pods: Results of the 6-month Mobile Pounds Off Digitally (Mobile POD) randomized weight-loss intervention among adults. J Med Internet Res 2011;13(4):e120 [FREE Full text] [CrossRef] [Medline]
  26. Fiore M, Jaén C, Baker T, Bailey W, Benowitz N, Curry S. Treating Tobacco Use and Dependence. 2008 Update: Clinical Practice Guideline.   URL: http:/​/www.​ahrq.gov/​professionals/​clinicians-providers/​guidelines-recommendations/​tobacco/​clinicians/​update/​treating_tobacco_use08.​pdf [accessed 2015-07-01] [WebCite Cache]
  27. Strecher VJ, McClure J, Alexander G, Chakraborty B, Nair V, Konkel J, et al. The role of engagement in a tailored web-based smoking cessation program: randomized controlled trial. J Med Internet Res 2008;10(5):e36 [FREE Full text] [CrossRef] [Medline]
  28. Ramo DE, Rodriguez TMS, Chavez K, Sommer MJ, Prochaska JJ. Facebook Recruitment of Young Adult Smokers for a Cessation Trial: Methods, Metrics, and Lessons Learned. Internet Interv 2014 Apr;1(2):58-64 [FREE Full text] [CrossRef] [Medline]
  29. Facebook. Facebook Developers. 2015.   URL: https://developers.facebook.com/ [accessed 2015-07-01] [WebCite Cache]
  30. Pro-Change Behavior Systems. A Guide for Smoking Cessation. South Kingston, RI: Pro-Change Behavior Systems, Inc; 2009.
  31. Hall SM, Tsoh JY, Prochaska JJ, Eisendrath S, Rossi JS, Redding CA, et al. Treatment for cigarette smoking among depressed mental health outpatients: a randomized clinical trial. Am J Public Health 2006 Oct;96(10):1808-1814. [CrossRef] [Medline]
  32. Transdisciplinary Tobacco Use Research Center (TTURC) Tobacco Dependence, Baker TB, Piper ME, McCarthy DE, Bolt DM, Smith SS, et al. Time to first cigarette in the morning as an index of ability to quit smoking: implications for nicotine dependence. Nicotine Tob Res 2007 Nov;9 Suppl 4:S555-S570 [FREE Full text] [CrossRef] [Medline]
  33. Thrul J, Stemmler M, Bühler A, Goecke M. The role of participants' self-selected future smoking goals in adolescent smoking cessation interventions. Drug Alcohol Depend 2014 Aug 1;141:118-123. [CrossRef] [Medline]
  34. Long JS, Freese J. Regression Models for Categorical Dependent Variables Using Stata. 3rd edition. College Station, TX: Stata Press; 2014.
  35. Greene WH. Accounting for Excess Zeros and Sample Selection in Poisson and Negative Binomial Regression Models Internet.: NYU Working Paper No. EC-94-10; 1994.   URL: http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1293115 [accessed 2015-10-20] [WebCite Cache]
  36. StataCorp. Stata Statistical Software: Release 11. College Station, TX: StataCorp LP; 2009.
  37. Brown RA, Ramsey SE, Strong DR, Myers MG, Kahler CW, Lejuez CW, et al. Effects of motivational interviewing on smoking cessation in adolescents with psychiatric disorders. Tob Control 2003 Dec;12 Suppl 4:IV3-I10 [FREE Full text] [Medline]
  38. Woodruff SI, Conway TL, Edwards CC, Elliott SP, Crittenden J. Evaluation of an Internet virtual world chat room for adolescent smoking cessation. Addict Behav 2007 Sep;32(9):1769-1786. [CrossRef] [Medline]
  39. Woodruff SI, Edwards CC, Conway TL, Elliott SP. Pilot test of an Internet virtual world chat room for rural teen smokers. J Adolesc Health 2001 Oct;29(4):239-243. [Medline]
  40. Guo B, Aveyard P, Fielding A, Sutton S. Do the Transtheoretical Model processes of change, decisional balance and temptation predict stage movement? Evidence from smoking cessation in adolescents. Addiction 2009 May;104(5):828-838. [CrossRef] [Medline]
  41. Schumann A, Meyer C, Rumpf H, Hannöver W, Hapke U, John U. Stage of change transitions and processes of change, decisional balance, and self-efficacy in smokers: a transtheoretical model validation using longitudinal data. Psychol Addict Behav 2005 Mar;19(1):3-9. [CrossRef] [Medline]
  42. Velicer WF, Norman GJ, Fava JL, Prochaska JO. Testing 40 predictions from the transtheoretical model. Addict Behav 1999;24(4):455-469. [Medline]
  43. Jeon D, Kim K, Heo M. Factors Related to Stages of Exercise Behavior Change among University Students Based on the Transtheoretical Model. J Phys Ther Sci 2014 Dec;26(12):1929-1932 [FREE Full text] [CrossRef] [Medline]
  44. Truthorange. Gruen - Cancer at 17. 2011.   URL: https://www.youtube.com/watch?v=YvpFJ6QEYdU&feature=plcp [WebCite Cache]
  45. Bhattacharya S, Srinivasan P, Polgreen P. Engagement with health agencies on twitter. PLoS One 2014;9(11):e112235 [FREE Full text] [CrossRef] [Medline]
  46. Baek K, Holton A, Harp D, Yaschur C. The links that bind: Uncovering novel motivations for linking on Facebook. Comput Hum Behav 2011;27(6):2243-2248.
  47. Neiger BL, Thackeray R, Burton SH, Giraud-Carrier CG, Fagen MC. Evaluating social media's capacity to develop engaged audiences in health promotion settings: use of Twitter metrics as a case study. Health Promot Pract 2013 Mar;14(2):157-162. [CrossRef] [Medline]


C: contemplation
ITT: intention to treat
P: preparation
PC: precontemplation
TTM: Transtheoretical Model


Edited by P Bamidis; submitted 24.04.15; peer-reviewed by D Spachos, S Bhattacharya; comments to author 08.06.15; revised version received 20.07.15; accepted 07.10.15; published 11.11.15

Copyright

©Johannes Thrul, Alexandra B Klein, Danielle E Ramo. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 11.11.2015.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.