This paper is in the following e-collection/theme issue:

Recruitment of Research Participants (296)
Online Advertising as a Public Health and Recruitment Tool: Comparison of Different Media Campaigns to Increase Demand for Smoking Cessation Interventions

Online Advertising as a Public Health and Recruitment Tool: Comparison of Different Media Campaigns to Increase Demand for Smoking Cessation Interventions

Online Advertising as a Public Health and Recruitment Tool: Comparison of Different Media Campaigns to Increase Demand for Smoking Cessation Interventions

Authors of this article:

Amanda Graham ;   Pat Milner ;   Jessie Saul ;   Lillian Pfaff
Article Authors Cited by (94) Tweetations Metrics

    Original Paper

    1Georgetown University Medical Center / Lombardi Comprehensive Cancer Center, Washington, DC, Washington, DC, USA

    2Healthways QuitNet LLC, Boston, MA, USA

    3ClearWay Minnesota, Minneapolis, MN, USA

    4New Jersey Department of Health and Senior Services, Trenton, NJ, USA

    Corresponding Author:

    Amanda L Graham, PhD

    The Schroeder Institute for Tobacco Research and Policy Studies

    American Legacy Foundation

    1724 Massachusetts Avenue, NW

    Washington, DC 20036

    USA

    Phone: +1 202 454 5938

    Fax:+1 202 454 5785

    Email: agraham@americanlegacy.org


    Related ArticleCorrection in: http://www.jmir.org/2009/1/e2

    Background: To improve the overall impact (reach × efficacy) of cessation treatments and to reduce the population prevalence of smoking, innovative strategies are needed that increase consumer demand for and use of cessation treatments. Given that 12 million people search for smoking cessation information each year, online advertising may represent a cost-efficient approach to reach and recruit online smokers to treatment. Online ads can be implemented in many forms, and surveys consistently show that consumers are receptive. Few studies have examined the potential of online advertising to recruit smokers to cessation treatments.

    Objective: The aims of the study were to (1) demonstrate the feasibility of online advertising as a strategy to increase consumer demand for cessation treatments, (2) illustrate the tools that can be used to track and evaluate the impact of online advertising on treatment utilization, and (3) highlight some of the methodological challenges and future directions for researchers.

    Methods: An observational design was used to examine the impact of online advertising compared to traditional recruitment approaches (billboards, television and radio ads, outdoor advertising, direct mail, and physician detailing) on several dependent variables: (1) number of individuals who enrolled in Web- or telephone-based cessation treatment, (2) the demographic, smoking, and treatment utilization characteristics of smokers recruited to treatment, and (3) the cost to enroll smokers. Several creative approaches to online ads (banner ads, paid search) were tested on national and local websites and search engines. The comparison group was comprised of individuals who registered for Web-based cessation treatment in response to traditional advertising during the same time period.

    Results: A total of 130,214 individuals responded to advertising during the study period: 23,923 (18.4%) responded to traditional recruitment approaches and 106,291 (81.6%) to online ads. Of those who clicked on an online ad, 9655 (9.1%) registered for cessation treatment: 6.8% (n = 7268) for Web only, 1.1% (n = 1119) for phone only, and 1.2% (n = 1268) for Web and phone. Compared to traditional recruitment approaches, online ads recruited a higher percentage of males, young adults, racial/ethnic minorities, those with a high school education or less, and dependent smokers. Cost-effectiveness analyses compare favorably to traditional recruitment strategies, with costs as low as US $5-$8 per enrolled smoker.

    Conclusions: Developing and evaluating new ways to increase consumer demand for evidence-based cessation services is critical to cost-efficiently reduce population smoking prevalence. Results suggest that online advertising is a promising approach to recruit smokers to Web- and telephone-based cessation interventions. The enrollment rate of 9.1% exceeds most studies of traditional recruitment approaches. The powerful targeting capabilities of online advertising present new opportunities to reach subgroups of smokers who may not respond to other forms of advertising. Online advertising also provides unique evaluation opportunities and challenges to determine rigorously its impact and value.

    J Med Internet Res 2008;10(5):e50

    doi:10.2196/jmir.1001

    Keywords

    Internet; advertising; consumer demand; smoking cessation 


    Less than 5% of smokers are able to quit on their own [1,2]. Despite the availability of effective smoking cessation treatments [3], only one in five smokers use proven cessation aids when attempting to quit [4-8]. The population impact (reach × efficacy [9,10]) of cessation treatments could be dramatically increased by increasing the reach and utilization of evidence-based interventions such as telephone- and Web-based programs [3,11,12, 13-16]. Recent expert panels have called for innovative initiatives to increase consumer demand for cessation treatments [17,18]. The National Institutes of Health State-of-the-Science panel on tobacco called for research to “understand the role of different media in increasing consumer demand for and use of effective, individually oriented tobacco cessation treatments for diverse populations” [17].

    Historically, consumer demand for cessation treatments has been largely a function of marketing and promotion via traditional media (ie, television, newspaper, radio). Systematic reviews have shown that traditional mass media approaches are effective in increasing treatment utilization [19] and in promoting tobacco cessation when combined with telephone counseling [19,20]. However, there are a number of limitations to traditional media, including costs that can be prohibitive [21]. Mass media approaches tend to yield the lowest participation rates in community-based cessation trials (compared to telephone and other interpersonal methods), reaching only 2.2% of targeted smokers [22]. There is little flexibility with most traditional media formats since it is difficult and costly to switch approaches (eg, changing messages, altering ad content) once funds are spent. From the smoker’s perspective, access to cessation services is one-step-removed, requiring the smoker to write down contact information or to remember a call to action.

    Evaluation of the performance of traditional media is challenging as well. It is difficult to randomize to conditions, to control for “spillover” of media into control markets, or to determine how many people actually viewed a billboard or listened to a radio advertisement (ie, the “true denominator” [23]). For television advertising, gross rating points (GRPs) provide an estimate of the percentage of the target audience reached by an advertisement. Otherwise, evaluation relies on the number of individuals who make an initial call to a cessation program and on responses to questions such as “How did you hear of our program?” which may be affected by errors in recall when multiple media campaigns are running simultaneously.

    Online advertising may represent a cost-efficient strategy to increase consumer demand for smoking cessation treatments. Approximately 70% of US adults use the Internet [24], and use has increased steadily since 2000 across race, education, income, age, and rural/urban categories [25,26]. As of 2007, a majority of African Americans (62%) and Latinos (78%) reported using the Internet, as did 55% of individuals living in households with an annual income less than US $30,000 [27]. Approximately 12 million adults search for information on quitting smoking each year [28]. Online advertising can be implemented in many forms (eg, banner ads, text ads, or “paid search”), and surveys consistently show that consumers are receptive [29-31]. Online ads can provide smokers with immediate access to Web-based cessation treatments. Ads can be strategically placed on websites with known demographic profiles (eg, Univisión.com for a Latino audience) and geo-targeted by Internet Protocol (IP). Millions of individuals search the Internet each year for information on quitting smoking [28], and paid search ads allow a cessation program to have visibility at the top of the search results where searchers are likely to see the ad.

    Perhaps most importantly, online advertising provides new tools for research evaluation to track and estimate impact as well as a real-world laboratory to test various ad strategies and to make adjustments in real time based on the results [32]. With online ads, it is possible to track a number of “denominators,” including the number of times an ad is viewed, the number of ad clicks, the number of individuals who register for cessation treatment in response to an online ad, and the cost of recruiting smokers to treatment. This real-time evaluation of consumer demand permits continuous quality improvement throughout a marketing initiative so that if an ad is not performing well in terms of recruitment volume or cost-effectiveness, it can literally be replaced within hours.

    Online advertising is extremely sophisticated, with billions of dollars spent by marketing agencies each year [33,34]. However, the science of how to develop and test online advertising as a mechanism to boost consumer demand for behavioral health interventions is in its infancy [19]. Several studies in HIV and sexually transmitted disease (STD) prevention research have used online advertisements to recruit participants [35-39], but details about their effectiveness and cost-efficiency is limited. Smoking-related studies have used online advertising to recruit smokers to Web-based cessation programs [40,41] but provide little information about the approaches used. Other cessation studies have incorporated the Internet into recruitment efforts but have not used banner or paid search ads [42-45]. We know of no published studies that have examined the cost-effectiveness of online advertising or compared online advertising to traditional media approaches in recruiting smokers to cessation programs.

    The aims of this study are (1) to demonstrate the feasibility of online advertising as a strategy to increase consumer demand for cessation treatments, (2) to illustrate the tools that can be used to track and evaluate its impact on consumers by means of a comparison between traditional media campaigns and online marketing campaigns, and (3) to highlight some of the methodological challenges and future directions for researchers who wish to advance the science of online advertising. This study represents a preliminary investigation into the use of online advertising to cost-efficiently reach, recruit, and engage smokers in cessation treatments, and it raises a number of important questions regarding methodological issues unique to this type of research.


    Overview of Settings and Advertising Campaigns

    The study was conducted between December 1, 2004 and October 31, 2006 as a partnership between Healthways QuitNet LLC, ClearWay Minnesota, and the New Jersey Department of Health. During the study period, online advertising campaigns were run to promote QuitNet’s Web-based cessation program [13] and the state-run telephone quitlines in Minnesota and New Jersey. The advertising campaigns were managed by Healthways QuitNet, including negotiation of contracts with online advertising partners.

    Procedure

    This feasibility study used an observational design consisting of the delivery of advertising campaigns within two conditions: an online condition and a traditional mass media (comparison) condition. In both conditions, the timing of the advertising campaigns, delivered in two states, permitted their impact to be evaluated on several dependent variables: (1) number of individuals who enrolled in a cessation treatment, (2) the demographic, smoking, and treatment utilization characteristics of smokers recruited to treatment, and (3) the cost to enroll a smoker in treatment.

    Online Advertising Condition

    Within the online condition, several creative approaches and advertising partners were developed.

    Creative Approaches

    All online ads were banner or paid search (text) ads. There were four categories of creative approaches used in ads during the study period (see Multimedia Appendix for samples):

    1. Ads that focused on the importance of getting support during the quitting process (eg, “Don’t quit alone, Quit with us,” “Remember the buddy system? It works for quitting too”);
    2. Ads that used humor to capture the attention of Internet users (eg, “Cold turkey is good for sandwiches, not for quitting”);
    3. Ads that used website-specific concepts (eg, “Quitting has its highs and lows, but favorable conditions are on the way” placed on Weather.com)
    4. Paid search (text) ads (eg, “New Jersey QuitNet: Expert support, free resources, & med advice”)
    Advertising Partners

    There were three categories of advertising partners: (1) national websites, (2) local websites, and (3) search engines. Banner ads were placed on national and local websites and were purchased on a per impression basis using a negotiated cost per mille (CPM) rate, the cost of showing the ad to one thousand viewers. National websites included Yahoo!, AOL, Weather.com, 24/7 Real Media, and WebMD. All five sites were selected as advertising partners based on their broad reach. In addition, WebMD was selected to target Web users seeking health information. Local websites in Minnesota were StarTribune.com and PostBulletin.com, and NJ.com was used in New Jersey.

    Paid search ads were run on search engines and were purchased on a per click basis. Two types of campaigns were run on each search engine: (1) Geo-targeted campaigns displayed ads to Internet users in a specific geographic region based on their IP address. Generic keywords such as “quit smoking” or “stop smoking” can be used in this type of campaign. (2) Country-wide campaigns displayed ads to Internet users throughout the United States. In order to reach the target populations in Minnesota and New Jersey, ads included keywords such as “NJ Quit Smoking.” The search engines used in this study included Google, MSN Adcenter, and Overture (now part of Yahoo! Search). These search engines are known to have a user base with slightly different demographic characteristics [46], which provides additional opportunities for targeting specific segments of smokers. Banner ads were displayed prominently on the side or top of advertising partner websites, and paid search ads were displayed on search engine results pages.

    User Experience

    All ads included a call to action that instructed the viewer to “click here” to get more information. Clicking on the ad took the user to a landing page where he or she read a brief description of three cessation treatment options: (1) 24/7 online support, (2) telephone counseling, or (3) telephone and online support. If users selected the first option, they were taken immediately to the state-sponsored QuitNet website where they were prompted to register and begin using the website. If the individuals selected the second or third option, they were asked to fill out an online quitline referral form, which provided a quitline counselor with basic contact information; individuals selecting option three were then directed to the state-sponsored QuitNet website to register.

    Traditional Media Comparison Condition

    At the same time as the online advertising campaigns, a number of traditional media campaigns were also run in Minnesota and New Jersey to promote the QuitNet website. These campaigns included billboards, television and radio ads, outdoor advertising (eg, bus sides, bus shelters), direct mail, and physician detailing. To ensure a consistent look and feel between the traditional media campaigns and online ads, the same creative approaches were used. In the majority of cases, identical content was used for traditional media and online ads; however, in some cases, the similarity in creative approach focused primarily on the use of the same logo and color scheme. Only the traditional media ads listed the QuitNet URL in the call to action since this information was not necessary in online ads.

    Free search engine listings also generate a high volume of traffic to the QuitNet website [47]. As a result of this heterogeneous mix of marketing and promotion efforts, a large number of smokers register to use QuitNet’s service each month [47]. As a comparison group, we extracted registration data on all individuals who joined QuitNet during the study period in response to all other forms of advertising (ie, not an online ad).

    Measures

    Online Ad Tracking Data

    When an Internet user clicked on an online ad, a unique event identifier was stored on the Healthways QuitNet server along with information about the specific ad that had been displayed, the website on which it was displayed, and the type of cessation program that the individual chose from the landing page (Web only, phone only, Web plus phone, no action).

    Phone and Web Registration Data

    The unique identifier was also linked to registration data if the individual registered with QuitNet and/or telephone counseling. The QuitNet registration process asked individuals to select a username and password and to indicate their age, gender, race, education level, smoking rate, time to first cigarette, readiness to quit smoking, and reason for registration. Registration data for telephone counseling included email address, first and last name, telephone number, preferred contact time, and consent to share this information with a quitline counselor.

    QuitNet Utilization Data

    The following utilization metrics were extracted from the QuitNet database for all registered QuitNet users: number of log-ins, minutes per log-in, number of page views, and interactions with other users and expert counselors. Site usage was tracked by the system through short-term (length of session) and long-term (persistent between sessions) cookies, allowing for identification of users throughout their life cycle whether logged in or not. Utilization data for telephone counseling were gathered by the individual vendors in Minnesota and New Jersey and were not available at the time of this analysis.

    Statistical Analyses

    We summarize data regarding response rates, treatment enrollment, and costs using relative frequencies for categorical variables and descriptive statistics for continuous variables. Univariate analyses were conducted to examine differences on demographic and smoking variables between traditional media and online ad responders. Statistical significance levels were calculated using t tests to examine mean differences in continuous variables and chi-square or nonparametric tests to examine differences in proportions of categorical variables. For categorical variables with more than two levels, squared Pearson residuals were investigated to examine the source of any statistically significant differences.


    Overall Response Rates

    As shown in Figure 1, a total of 130,214 unique identifiers were created on the Healthways QuitNet server during the study period: 23,923 (18.4%) were for traditional media responders who registered with QuitNet, and 106,291 (81.6%) were for online ad clicks. Of the online ad clicks, 9655 individuals (9.1%) registered for some form of cessation treatment: 6.8% (n = 7268) selected Web only, 1.1% (n = 1119) selected phone only, and 1.2% (n = 1268) selected both Web and phone.

    ‎
    Figure 1. Response rates for online and offline ads
    View this figure

    Characteristics of Users Recruited via Online Ads Versus Traditional Media

    We examined differences in demographic and smoking variables between treatment users recruited via online ads and those recruited via traditional media. As shown in Table 1, there were differences for all variables examined. Compared to traditional media, online ads recruited a higher percentage of 18- to 24-year-olds (P < .001), men (P < .001), non-White individuals (P < .001), those with a high school degree or less (P = .02), those who had not yet quit smoking (ie, those in precontemplation, contemplation, or preparation phase of motivational readiness, P < .001), and those who smoked within 30 minutes of waking (P < .001). In addition, online ad responders smoked more (P = .002), although the very small mean difference (19.0 cigarettes/day vs 18.7 cigarettes/day) is not likely to be clinically meaningful.

    Table 1. Online vs traditional recruitment: demographic and smoking characteristics a
    Online Recruitment
    (n = 8536) b    		Traditional Recruitment
    (n = 23,923)    		P
    Age (years)< .001
    18-2414.112.6
    25-4457.359.2
    45-6427.526.8
    65+1.11.4
    Male41.738.3< .001
    Race/Ethnicity< .001
    White83.988.2
    Black / African American5.53.9
    Hispanic4.33.1
    Asian / Pacific Islander3.52.5
    Native American / Aboriginal0.60.7
    Other2.21.6
    Education.02
    High school / GED c or less24.623.2
    Some college / junior college40.940.2
    College grad or higher34.536.6
    Motivational readiness< .001
    Never smoker0.81.7
    Precontemplation1.51.0
    Contemplation40.436.5
    Preparation45.742.6
    Action10.716.5
    Maintenance0.91.7
    Cigarettes per day, mean (SD)19.0 (9.7)18.7 (9.4).002
    Time to first cigarette< .001
    Less than 30 minutes72.169.2
    30 minutes or more27.930.8

    a Values are percentages unless otherwise noted.

    b Does not include the 1119 individuals who registered for “phone only” since demographic data are not available on this group.

    c General equivalency diploma.

    Within the online ad condition, we examined differences between those who responded to paid search ads (n = 6163) and those who responded to banner ads (n = 2271). The rationale for these analyses was to explore whether individuals actively searching for cessation assistance via search engines (paid search responders) are different from those who respond to a more “passive” advertising strategy (banner ads). There were significant differences across the demographic categories we examined, with banner ads recruiting a larger percentage of 18- to 24-year-olds (14.9% vs 13.8%, P < .001), men (43.7% vs 41.0%, P = .03), non-White individuals (20.7% vs 14.6%, P < .001), those with a high school education or less (26.3% vs 23.9%, P = .03), and those who had not yet quit smoking (92.7% vs 82.7%, P < .001). Banner ad responders smoked slightly less than paid search responders (mean = 18.6, SD = 9.9 vs mean = 19.2, SD = 9.6; P = .01), although this statistically difference is not likely to be clinically meaningful. There were no differences between paid search responders and banner ad responders on time to first cigarette.

    We also compared online and traditional media responders on website utilization metrics to determine if online ad responders engaged with the QuitNet website to the same degree. The metrics examined included the total number of log-ins during the study period, average number of minutes per session, total time spent online, total number of pages viewed, and three metrics of community participation: the percentage who posted in one of the community forums, the percentage who sent email through QuitNet’s internal messaging system (QMail) to at least one other person, and the percentage who received QMail from at least one other person. Consistent with other studies [13,40], patterns of website utilization varied widely; therefore, given the very large skewness of these utilization variables, we report the median and interquartile range in Table 2. There were statistically significant differences on all metrics examined, with higher website utilization among traditional media responders. Although statistically significant due to the enormous power in this study, differences in website utilization are small in magnitude and not likely to be clinically meaningful.

    Table 2. Median (interquartile range) of QuitNet utilization among online and traditional media responders a
    Online Recruitment
    (n = 8536)    		Traditional Recruitment
    (n = 23,923)    		P
    Number of log-ins1 (1-3)1 (1-4)< .001
    Average session length (minutes)12 (8-19)12 (8-20).01
    Total minutes spent online20 (10-47)24 (12-63)< .001
    Total pages viewed35 (20-76)40 (22-98)< .001
    Percentage posting at least once in public forums8.311< .001
    Percentage who sent Qmail to at least 1 person28.135.5< .001
    Percentage who received Qmail from at least 1 person6.410< .001

    aBetween-group differences were analyzed using Wilcoxon W test for continuous data (median) and chi-square (proportions).

    Reach to Subgroups of Smokers by Selected Creative Approaches

    Next we explored whether certain online ads were more effective in recruiting specific subgroups of smokers than traditional media. As shown in Table 3, we examined the percentage of individuals in specific demographic and smoking subgroups recruited by traditional media approaches and compared it to the percentage recruited by specific types of online ads (ie, quitting with support, humorous, text ads). We focused on subgroups of smokers that are traditionally underrepresented in most cessation programs, including males, younger adults, racial/ethnic minorities, and those with lower levels of education. These analyses examined the impact of creative approach across multiple websites on which ads were placed in order to control for the potential influence of variations in website demographics [46]. For this reason, we excluded the creative approach that used website-specific concepts since ads were only placed on two websites (WebMD and Weather.com).

    Compared to traditional media, humorous ads were effective in recruiting a higher percentage of males (P < .001), young adults (P < .001), non-White individuals (P < .001), and those with a high school degree or less (P = .004). Humorous ads were also the only creative approach that was effective in recruiting smokers with lower levels of education. Ads that focused on the importance of support during quitting recruited a higher percentage of young adults (P < .001) and non-White individuals (P < .001) compared to traditional media. Paid search ads recruited a higher percentage of males (P < .001), young adults (P = .004), and non-White individuals (P < .001).

    Table 3. Demographic characteristics of individuals recruited to cessation treatment by recruitment approach
    Recruitment ApproachMale
    (%)    		Age 18-24 Years
    (%)    		Non-White
    (%)    		High School Degree or less
    (%)
    Traditional media (comparison group)38.212.511.823.2
    Humor (online)44.1 a15.9 a20.6 a26.8 b
    Quit with support (online)39.813.4 a21.2 a26.4
    Paid search (online text ad)41.0 a13.8 b14.6 a23.9

    aP < .001 (compared to traditional media).

    bP < .01 (compared to traditional media).

    Cost-Effectiveness

    To illustrate how the real-time data collection of online ads can be used to rapidly inform impact and improve cost-effectiveness, we present the results of selected online advertising campaigns run in New Jersey during two specific time periods: December 2004 to May 2005 and August 2006 to October 2006. During the entire study period, several ads were tested across multiple websites, each with cost-effectiveness results. The findings presented in Table 4 and Table 5 from these selected campaigns are designed to highlight the types of metrics that can be analyzed and several of the most important lessons learned.

    It is important to note that online media campaigns typically evaluate effectiveness by the click-through rate and the average cost per click. The click-through rate is a ratio of the number of clicks divided by the number of impressions, and the average cost per click is the fee charged by an advertiser divided by the number of clicks on an ad. While both metrics are useful measures of the performance of an individual ad and allow for comparison of ads across websites, they do not reflect the actual costs of getting an individual smoker enrolled in a smoking cessation treatment program. Thus, in the tables below, we present the total cost of each campaign, the number of individuals who clicked on ads during the campaign, and the number that enrolled in a cessation treatment program. The conversion rate is a ratio of the number of individuals who registered with a cessation program (Web only, phone only, Web plus phone) divided by the total number of individuals who clicked on the ads. The cost per registrant is calculated by dividing the total amount spent in a campaign by the number of cessation program registrants.

    Table 4 shows the results of a series of campaigns that were run between December 2004 and June 2005. The WebMD campaign was stopped after 1 month due to the low conversion rate and extremely high cost per registrant, and funds were allocated to a subsequent campaign with Google (Phase II). Similarly, funds were reallocated from the NJ.com campaign to Google (Phase II) in June 2005 given the low yield of ads on NJ.com.

    With a total budget of US $45,000, the online ads run on these six advertising sites during a 6-month period resulted in a total of 1285 individuals who registered with a cessation program. The average conversion rate was 9%, with a range of 2% to 16%. The only advertising partner to yield a conversion rate higher than 10% was Google, with the other partner sites producing much lower conversion rates. The average cost per registrant was US $35, with a range of US $7-$476.

    Table 4. Cost-effectiveness in early New Jersey campaigns (December 2004 to June 2005)
    AdvertiserSpend
    (US $)    		Number of Ad ClicksNumber Registered for Cessation TreatmentConversion RateCost per Registrant
    (US $)
    Google Phase I$5000465176216%$7
    Yahoo$10,00037692657%$38
    AOL$50001390443%$114
    Weather.com$10,0001238927%$109
    WebMD (Feb 1-28)$10,000476214%$476
    NJ.com (Jan 1-May 31)$45302061392%$116
    Google Phase II (June 1-31)$4705466211%$8
    Total Media Spend$45,00014,13112859%$35

    Using lessons learned from these campaigns and others, a different series of ads were run in New Jersey between August 2006 and October 2006, as shown in Table 5. During this 3-month period, 751 individuals registered with a cessation program at an average cost of US $38 per registrant. Although the overall conversion rate was slightly lower than in the earlier series of campaigns, three advertising partners produced conversion rates higher than 10%. In addition, the cost per registrant was far lower across advertising partners, with three of the sites averaging less than US $20 per registrant. In addition, ad placement appears to have improved based on the overall number of ad clicks (n = 11,110) during this 3-month time period as compared to 14,131 ad clicks during the previous 6-month campaign.

    Table 5. Cost-effectiveness in later New Jersey campaigns (August 2006 to October 2006)
    AdvertiserSpend
    (US $)    		Number of Ad ClicksNumber Registered for Cessation TreatmentConversion RateCost per Registrant
    (US $)
    Overture$1091152421%$5
    MSN$112881820%$6
    Google$7651414347611%$16
    Yahoo$10,01120081357%$74
    AOL$49992478713%$70
    24/7 Media$60002163271%$222
    Total Media Spend$28,88211,1107517%$38

    To reduce the population prevalence of smoking, innovative marketing initiatives are needed to increase awareness and utilization of proven cessation treatments. Data from this preliminary study are among the first to demonstrate the feasibility of using online advertising to recruit smokers to Web- and telephone-based cessation programs. Online advertising in just two states resulted in cessation treatment utilization by over 9600 smokers, almost half the number of registered users during the same time period as all other forms of advertising throughout the United States. If online advertising were implemented on a national basis, it could potentially result in more than 200,000 smokers using Web- or telephone-based cessation treatment.

    Since the results of these analyses were based on an observational study within the context of a set of real-world interventions, the assumptions made in interpreting the results and the inability to control for or rule out potential confounders implies that the conclusions are tentative and subject to alternative explanations. They are used to illustrate the feasibility and potential of online advertising, as well as some of the challenges and caveats that researchers will need to consider in terms of design, sampling, methods, and measurement in this new area of research. This paper explores new territory, and, since it was not designed at the outset as a research study, the discussion that follows should be considered as illustrative of the potential for this new informatics and communications technology to strengthen the science of dissemination as well as the dissemination of the science [48].

    These results illustrate the ability of online ads to reach specific subgroups of smokers that may not traditionally seek cessation assistance [49,50]. Compared to traditional media, online ads recruited a higher percentage of males, young adults, racial/ethnic minorities, and those with a high school degree or less, with banner ads driving much of the effect. Smoking continues to be more prevalent among these groups [51], making it critical to identify effective methods to increase consumer demand for cessation treatments. The potential of online advertising to reach and recruit smokers from these subgroups is promising. Website utilization data suggest that online ad responders are not merely “casual browsers” who happened to click on an online ad, but rather smokers who engaged with the website to a similar extent as smokers recruited via other channels. It is also interesting to note that online ads attracted a small percentage of “never smokers” despite the fact that messages targeted current smokers. Recently, research has focused on interventions designed for support persons as a way of increasing the reach of cessation treatments to smokers themselves [52]. Online advertising could be used to recruit support persons for these types of interventions.

    We also examined the effectiveness of various creative approaches in recruiting specific types of smokers. Humorous ads were the most effective in reaching subgroups of smokers who are less likely to participate in cessation treatment and were the only creative approach that recruited a higher percentage of those with a high school degree or less compared with traditional media. It is interesting to note that ads focused on the importance of getting support did not increase the percentage of men using cessation treatment over traditional media, whereas paid search ads did recruit a higher percentage of men. These data provide just an initial glimpse into the many types of analyses that are possible and also raise important questions that should be addressed in future research where rigorous, controlled research designs could be employed to tease apart specific parametric effects. Specifically, what types of communication messages or creative approaches are most effective for specific subgroups of smokers? Are gain-framed or loss-framed messages more effective in online advertising in recruiting smokers to treatment? To what extent is cultural targeting important, and is targeting at the surface level (ie, matching of materials and messages to characteristics of the target population) or deep level (ie, messages and interventions incorporate information about cultural, social, environmental, psychological, and historical factors that differentially influence health behaviors) more effective?

    This study is also the first to present detailed information about the cost-effectiveness of various online advertising strategies. Consistent with a social implementation approach to cost-effectiveness, we excluded costs associated with development and preparation [53]. On average, it cost US $36 to recruit a smoker to Web- or phone-based treatment using online ads. Paid search advertising on search engines tended to be the most cost-effective approach, with a cost of US $5-$8 per registrant. Paid search also yielded the highest absolute number of registrants and the highest conversion rates. These results compare favorably to the few reports of costs associated with traditional recruitment methods, which range from US $19-$500 per enrolled smoker depending on the recruitment channel [54-57]. The ability to closely monitor the performance of ads resulted in pulling funds from two underperforming campaigns (WebMD and NJ.com) and reallocating these funds to a campaign that more than doubled the conversion rate and dramatically reduced the cost per registrant.

    This study employed an observational approach to determine preliminary feasibility and cost-effectiveness of online advertising. Future research studies will need to identify the most rigorous and appropriate research designs and statistical methods to be used with this kind of “real-world” data. In particular, the balance between internal and external validity must be carefully considered [58]. Many of the threats to internal validity inherent in this kind of research can be addressed by giving careful consideration to research design and methodological issues, while at the same time strengthening the external validity of the study by, for example, specifying the characteristics and behavior of users at each level of “denominator” in a manner that is simply not possible with traditional media campaigns. Studies of traditional mass media often use interrupted time series designs with a comparison group. Geo-targeting in Internet research may permit the same type of comparison group to be created. Time series regression analysis may be the most appropriate statistical approach for interrupted time series designs [19] as it accounts for underlying time trends and auto-correlation between individual observations. Quasi-experimental Latin Square designs [59] and adaptive clinical designs as discussed by Collins et al [60] may also be ideally suited for this type of research. Future research should also explore the degree to which various online advertising strategies are linked to treatment utilization and/or cessation outcomes.

    Results should be considered within the context of several other limitations. First, a percentage of those who completed the quitline referral form may have been unreachable or uninterested in telephone counseling, so the estimates of those recruited to “phone only” may have be inflated. Second, this study relied on cookies to track website utilization among registered QuitNet members. Individuals who regularly delete cookies from their computer cannot be tracked with the same accuracy as those who do not. Related to this issue, cookies (along with email address) were also used to minimize duplicate enrollment on QuitNet. It is possible that the same individual could be represented more than once as a QuitNet user if they had deleted cookies, registered from a different computer, and/or registered using a different email address. It is also possible that some individuals were represented more than once in the total number of online ad clicks (n = 106,291) as it was not possible to identify unique individuals in this process. Third, a small percentage (< 3%) of those who registered on the QuitNet website indicated that they were seeking assistance for someone else rather than for themselves. For this preliminary study, we elected to include them in the total number of individuals who registered for some type of treatment given the growing literature on the importance of support persons. Future studies may consider analyzing this subgroup separately. Finally, it is possible that online ad responders had seen promotional materials in other (offline) places prior to clicking on a banner ad or paid search ad. This prior exposure may have primed them to click on an online ad. It will be important for future research studies to more clearly understand this “multiple exposure” effect.

    In summary, multiple marketing and promotion channels are critical to raise awareness of the importance of cessation, to motivate smokers to consider cessation, and to link smokers to proven cessation treatments [18]. Online advertising is forecast to experience enormous growth over the next 3 to 5 years, encroaching on budgets typically allocated for traditional media [33,34]. This feasibility study illustrates the potential of online advertising to promote the utilization of evidence-based cessation treatment. The tools available to track and evaluate program, process, and outcome metrics require careful consideration of both internal and external validity issues in designing research studies in this new domain. The technology and tools available can both strengthen the science of dissemination and also help improve interventions that will more effectively disseminate the products of evidence-based science. Despite the limitations of this observational study, the results provide useful and informative preliminary support to warrant more investment in the design and conduct of future studies to advance the science of marketing and consumer demand in the Internet age.

    Acknowledgments

    The authors would like to thank Drs. Nathan Cobb and David Abrams for their comments on the manuscript. Dr. Graham was supported in part by the National Cancer Institute (R01CA104836). Dr. Graham was with Georgetown University Medical Center / Lombardi Comprehensive Cancer Center, Washington, DC, USA, at the time of the study, and is now with The Schroeder Institute for Tobacco Research and Policy Studies at the American Legacy Foundation

    Conflicts of Interest

    None declared.

    ‎

    Multimedia Appendix 1

    Examples of online ads (focused on support, humor, website-specific concepts, and paid search (text) ads). Note: Some ads are animated, but the animation will not show in the PDF file. For the original gif files download Multimedia Appendix 2.

    PDF file (Adobe PDF), 288 KB
    ‎

    Multimedia Appendix 2

    Examples of online ads, original jpg/gif files (compressed). To view animated gif's, open files with your web browser (eg. Internet Explorer) or similar software.

    ZIP file (compressed), 100 KB
    1. ; Centers for Disease Control and Prevention (CDC). Cigarette smoking among adults--United States, 1998. MMWR Morb Mortal Wkly Rep 2000 Oct 6;49(39):881-884 [FREE Full text] [Medline]
    2. Cohen S, Lichtenstein E, Prochaska JO, Rossi JS, Gritz ER, Carr CR, et al. Debunking myths about self-quitting. Evidence from 10 prospective studies of persons who attempt to quit smoking by themselves. Am Psychol 1989 Nov;44(11):1355-1365. [Medline] [CrossRef]
    3. ; A clinical practice guideline for treating tobacco use and dependence: A US Public Health Service report. The Tobacco Use and Dependence Clinical Practice Guideline Panel, Staff, and Consortium Representatives. JAMA 2000 Jun 28;283(24):3244-3254. [Medline] [CrossRef]
    4. Cokkinides VE, Ward E, Jemal A, Thun MJ. Under-use of smoking-cessation treatments: results from the National Health Interview Survey, 2000. Am J Prev Med 2005 Jan;28(1):119-122. [Medline] [CrossRef]
    5. Zhu S, Melcer T, Sun J, Rosbrook B, Pierce JP. Smoking cessation with and without assistance: a population-based analysis. Am J Prev Med 2000 May;18(4):305-311. [Medline] [CrossRef]
    6. Goldstein MG, Niaura R, Willey-Lessne C, DePue J, Eaton C, Rakowski W, et al. Physicians counseling smokers. A population-based survey of patients' perceptions of health care provider-delivered smoking cessation interventions. Arch Intern Med 1997 Jun 23;157(12):1313-1319. [Medline] [CrossRef]
    7. Pierce JP, Gilpin EA. Impact of over-the-counter sales on effectiveness of pharmaceutical aids for smoking cessation. JAMA 2002 Sep 11;288(10):1260-1264 [FREE Full text] [Medline] [CrossRef]
    8. Thorndike AN, Biener L, Rigotti NA. Effect on smoking cessation of switching nicotine replacement therapy to over-the-counter status. Am J Public Health 2002 Mar;92(3):437-442 [FREE Full text] [Medline]
    9. Abrams DB, Orleans CT, Niaura RS, Goldstein MG, Prochaska JO, Velicer W. Integrating individual and public health perspectives for treatment of tobacco dependence under managed health care: A combined stepped-care and matching model. Ann Behav Med 1996;18(4):290-304. [Medline] [CrossRef]
    10. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health 1999 Sep;89(9):1322-1327 [FREE Full text] [Medline]
    11. Stead LF, Lancaster T, Perera R. Telephone counselling for smoking cessation (Cochrane Review). Cochrane Database Syst Rev 2006;3 CD002850. [Medline]
    12. Zhu SH, Anderson CM, Tedeschi GJ, Rosbrook B, Johnson CE, Byrd M, et al. Evidence of real-world effectiveness of a telephone quitline for smokers. N Engl J Med 2002 Oct 3;347(14):1087-1093 [FREE Full text] [Medline] [CrossRef]
    13. Cobb NK, Graham AL, Bock BC, Papandonatos G, Abrams DB. Initial evaluation of a real-world Internet smoking cessation system. Nicotine Tob Res 2005 Apr;7(2):207-216. [Medline] [CrossRef]
    14. Etter JF. Comparing the efficacy of two Internet-based, computer-tailored smoking cessation programs: a randomized trial. J Med Internet Res 2005;7(1):e2 [FREE Full text] [Medline] [CrossRef]
    15. Strecher VJ, Shiffman S, West R. Randomized controlled trial of a web-based computer-tailored smoking cessation program as a supplement to nicotine patch therapy. Addiction 2005 May;100(5):682-688. [Medline] [CrossRef]
    16. Swartz LHG, Noell JW, Schroeder SW, Ary DV. A randomised control study of a fully automated internet based smoking cessation programme. Tob Control 2006 Feb;15(1):7-12 [FREE Full text] [Medline] [CrossRef]
    17. ; NIH State-of-the-Science Panel. National Institutes of Health State-of-the-Science conference statement: tobacco use: prevention, cessation, and control. Ann Intern Med 2006 Dec 5;145(11):839-844 [FREE Full text] [Medline]
    18. ; National Tobacco Cessation Collaborative. Innovations in Building Consumer Demand for Tobacco Cessation Products and Services. Washington, DC: Academy for Educational Development; 2007.   URL: http://www.rwjf.org/files/publications/other/InnovationsinBuildingConsumerDemand.pdf [WebCite Cache]
    19. Grilli R, Ramsay C, Minozzi S. Mass media interventions: effects on health services utilisation. Cochrane Database Syst Rev 2002;1 CD000389. [Medline]
    20. Ranney L, Melvin C, Lux L, McClain E, Morgan L, Lohr KN. Tobacco Use: Prevention, Cessation, and Control. Research Triangle Park, NC: RTI International; June 2006. AHRQ Publication No. 06-E015 . [Medline]
    21. Hopkins DP, Briss PA, Ricard CJ, Husten CG, Carande-Kulis VG, Fielding JE, et al; Task Force on Community Preventive Services. Reviews of evidence regarding interventions to reduce tobacco use and exposure to environmental tobacco smoke. Am J Prev Med 2001 Feb;20(2 Suppl):16-66. [Medline] [CrossRef]
    22. McDonald PW. Population-based recruitment for quit-smoking programs: an analytic review of communication variables. Prev Med 1999 Jun;28(6):545-557. [Medline] [CrossRef]
    23. Graham AL, Bock BC, Cobb NK, Niaura R, Abrams DB. Characteristics of smokers reached and recruited to an internet smoking cessation trial: a case of denominators. Nicotine Tob Res 2006 Dec;8 Suppl 1(1):S43-S48. [Medline] [CrossRef]
    24. Madden M. Internet penetration and impact. Washington, DC: Pew Internet & American Life Project; 2006.   URL: http://www.pewinternet.org/pdfs/PIP_Internet_Impact.pdf [WebCite Cache]
    25. Fox S. Digital divisions. Washington, DC: Pew Internet & American Life Project; 2005.   URL: http://www.pewinternet.org/pdfs/PIP_Digital_Divisions_Oct_5_2005.pdf [WebCite Cache]
    26. ; US Department of Commerce. A nation online: how Americans are expanding their use of the Internet. Washington, DC: US Department of Commerce; 2002.   URL: http://www.ntia.doc.gov/ntiahome/dn/nationonline_020502.htm [WebCite Cache]
    27. ; Pew Internet & American Life Project. Demographics of Internet Users. Washington, DC: Pew Internet & American Life Project; 2007.   URL: http://www.pewinternet.org/trends/User_Demo_6.15.07.htm [WebCite Cache]
    28. Fox S. Health information online. Washington, DC: Pew Internet & American Life Project; 2005.   URL: http://www.pewinternet.org/PPF/r/156/report_display.asp [WebCite Cache]
    29. Glasner J. Flashy, targeted ads fuel boom. Wired. 2004 Apr 28.   URL: http://www.wired.com/techbiz/media/news/2004/04/63251?currentPage=2 [WebCite Cache]
    30. Holahan C. Advertising goes off the radio. Business Week. 2006 Dec 7.   URL: http://www.businessweek.com/technology/content/dec2006/tc20061207_485162.htm [WebCite Cache]
    31. ; Faultline. Internet advertising shoots past estimates. The Register. 2006 Sep 29.   URL: http://www.theregister.co.uk/2006/09/29/internet_advertising_booms/ [WebCite Cache]
    32. Graham AL, Milner P, Saul J, Dreher M, Pfaff L. Improving the impact of cessation treatments by boosting consumer demand. 2007 Presented at: Society of Behavioral Medicine Annual Meeting; March 21-24, 2007.
    33. Regan K. Online advertising continues rapid growth. E-Commerce Times. 2005 Sep 27.   URL: http://www.ecommercetimes.com/story/46381.html [WebCite Cache]
    34. Walker J. Outsell survey predicts strong growth in online marketing. DM News. 2006 Feb 14.   URL: http://www.dmnews.com/cms/dm-news/search-marketing/35704.html [WebCite Cache]
    35. Bowen AM, Horvath K, Williams ML. A randomized control trial of Internet-delivered HIV prevention targeting rural MSM. Health Educ Res 2007 Feb;22(1):120-127 [FREE Full text] [Medline] [CrossRef]
    36. Bowen A, Williams M, Horvath K. Using the internet to recruit rural MSM for HIV risk assessment: sampling issues. AIDS Behav 2004 Sep;8(3):311-319. [Medline] [CrossRef]
    37. Bull SS, Lloyd L, Rietmeijer C, McFarlane M. Recruitment and retention of an online sample for an HIV prevention intervention targeting men who have sex with men: the Smart Sex Quest Project. AIDS Care 2004 Nov;16(8):931-943. [Medline] [CrossRef]
    38. Klausner JD, Levine DK, Kent CK. Internet-based site-specific interventions for syphilis prevention among gay and bisexual men. AIDS Care 2004 Nov;16(8):964-970. [Medline] [CrossRef]
    39. Rhodes SD, Diclemente RJ, Yee LJ, Hergenrather KC. Factors associated with testing for hepatitis C in an internet-recruited sample of men who have sex with men. Sex Transm Dis 2001 Sep;28(9):515-520. [Medline] [CrossRef]
    40. Feil EG, Noell J, Lichtenstein E, Boles SM, McKay HG. Evaluation of an Internet-based smoking cessation program: lessons learned from a pilot study. Nicotine Tob Res 2003 Apr;5(2):189-194. [Medline] [CrossRef]
    41. Gordon JS, Akers L, Severson HH, Danaher BG, Boles SM. Successful participant recruitment strategies for an online smokeless tobacco cessation program. Nicotine Tob Res 2006 Dec;8 Suppl 1(1):S35-S41. [Medline] [CrossRef]
    42. Etter JF, Perneger TV. A comparison of cigarette smokers recruited through the Internet or by mail. Int J Epidemiol 2001 Jun;30(3):521-525 [FREE Full text] [Medline] [CrossRef]
    43. An LC, Hennrikus DJ, Perry CL, Lein EB, Klatt C, Farley DM, et al. Feasibility of Internet health screening to recruit college students to an online smoking cessation intervention. Nicotine Tob Res 2007 Jan;9 Suppl 1(1):S11-S18. [Medline] [CrossRef]
    44. McClure JB, Greene SM, Wiese C, Johnson KE, Alexander G, Strecher V. Interest in an online smoking cessation program and effective recruitment strategies: results from Project Quit. J Med Internet Res 2006;8(3):e14 [FREE Full text] [Medline] [CrossRef]
    45. Koo M, Skinner H. Challenges of internet recruitment: a case study with disappointing results. J Med Internet Res 2005;7(1):e6 [FREE Full text] [Medline] [CrossRef]
    46. Enge E. The tarot of search engines: demographic data divining. Search Engine Watch. 2007 Oct 10.   URL: http://searchenginewatch.com/showPage.html?page=3627252 [WebCite Cache]
    47. Cobb NK, Graham AL. Characterizing Internet searchers of smoking cessation information. J Med Internet Res 2006;8(3):e17 [FREE Full text] [Medline] [CrossRef]
    48. Kerner J, Rimer B, Emmons K. Introduction to the special section on dissemination: dissemination research and research dissemination: how can we close the gap? Health Psychol 2005 Sep;24(5):443-446. [Medline] [CrossRef]
    49. Shiffman S, Brockwell SE, Pillitteri JL, Gitchell JG. Individual differences in adoption of treatment for smoking cessation: demographic and smoking history characteristics. Drug Alcohol Depend 2008 Jan 11;93(1-2):121-131. [Medline] [CrossRef]
    50. Shiffman S, Di Marino ME, Sweeney CT. Characteristics of selectors of nicotine replacement therapy. Tob Control 2005 Oct;14(5):346-355 [FREE Full text] [Medline] [CrossRef]
    51. ; Centers for Disease Control and Prevention (CDC). Tobacco use among adults—United States, 2005. MMWR Morb Mortal Wkly Rep 2006 Oct 27;55(42):1145-1148 [FREE Full text] [Medline]
    52. Patten CA, Petersen LR, Brockman TA, Gerber T, Offord KP, Ebbert JO, et al. Development of a telephone-based intervention for support persons to help smokers quit. Psychol Health Med 2008 Jan;13(1):17-28. [Medline] [CrossRef]
    53. Mudde AN, de Vries H, Strecher VJ. Cost-effectiveness of smoking cessation modalities: comparing apples with oranges? Prev Med 1996;25(6):708-716. [Medline] [CrossRef]
    54. Shipley RH, Hartwell TD, Austin WD, Clayton AC, Stanley LC. Community stop-smoking contests in the COMMIT trial: relationship of participation to costs. Community Intervention trials. Prev Med 1995 May;24(3):286-292. [Medline] [CrossRef]
    55. McIntosh S, Ossip-Klein DJ, Spada J, Burton K. Recruitment strategies and success in a multi-county smoking cessation study. Nicotine Tob Res 2000 Aug;2(3):281-284. [Medline] [CrossRef]
    56. Boyle RG, Enstad C, Asche SE, Thoele MJ, Sherwood NE. Evaluating strategies and costs to recruit smokeless tobacco users. Addict Behav 2007 Dec;32(12):3088-3092. [Medline] [CrossRef]
    57. Harris KJ, Ahluwalia JS, Catley D, Okuyemi KS, Mayo MS, Resnicow K. Successful recruitment of minorities into clinical trials: The Kick It at Swope project. Nicotine Tob Res 2003 Aug;5(4):575-584. [Medline] [CrossRef]
    58. Glasgow RE, Green LW, Klesges LM, Abrams DB, Fisher EB, Goldstein MG, et al. External validity: we need to do more. Ann Behav Med 2006 Apr;31(2):105-108. [Medline] [CrossRef]
    59. Keppel G, Wickens TD. Design and Analysis: A Researcher's Handbook, 4th edition. Upper Saddle River, NJ: Prentice Hall; 2004:130-148.
    60. Collins LM, Murphy SA, Nair VN, Strecher VJ. A strategy for optimizing and evaluating behavioral interventions. Ann Behav Med 2005 Aug;30(1):65-73. [Medline] [CrossRef]

    Edited by S McIntosh, C Norman, P Selby; submitted 29.11.07; peer-reviewed by R Kennedy, K Cullen; comments to author 29.12.07; revised version received 24.04.08; accepted 19.08.08; published 15.12.08

    Copyright

    © Amanda L Graham, Pat Milner, Jessie E Saul, Lillian Pfaff. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 15.12.2008 (Corrected version published on 14.01.2009).  

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.