This paper is in the following e-collection/theme issue:

Infodemiology and Infoveillance (1273) Medicine 2.0: Social Media, Open, Participatory, Collaborative Medicine (1568) Infoveillance, Infodemiology, Digital Disease Surveillance, Infodemic Management (1012) LGBTQ Issues (415)

Published on in Vol 19, No 2 (2017): February

Perceptions of Menthol Cigarettes Among Twitter Users: Content and Sentiment Analysis

Perceptions of Menthol Cigarettes Among Twitter Users: Content and Sentiment Analysis

Perceptions of Menthol Cigarettes Among Twitter Users: Content and Sentiment Analysis

Authors of this article:

Shyanika W Rose1 Author Orcid Image ;   Catherine L Jo2 Author Orcid Image ;   Steven Binns3 Author Orcid Image ;   Melissa Buenger3 Author Orcid Image ;   Sherry Emery3 ;   Kurt M Ribisl2, 4 Author Orcid Image
Article Authors Cited by (27) Tweetations (32) Metrics

    Original Paper

    1The Schroeder Institute for Tobacco Research and Policy Studies at Truth Initiative, Washington, DC, United States

    2Department of Health Behavior, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States

    3Health Media Collaboratory, NORC at the University of Chicago, Chicago, IL, United States

    4Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States

    Corresponding Author:

    Shyanika W Rose, MA, PhD

    The Schroeder Institute for Tobacco Research and Policy Studies at Truth Initiative

    900 G Street, NW

    4th Floor

    Washington, DC, 20001

    United States

    Phone: 1 202 454 5917

    Fax:1 202 454 5555

    Email: srose@truthinitiative.org


    Background: Menthol cigarettes are used disproportionately by African American, female, and adolescent smokers. Twitter is also used disproportionately by minority and younger populations, providing a unique window into conversations reflecting social norms, behavioral intentions, and sentiment toward menthol cigarettes.

    Objective: Our purpose was to identify the content and frequency of conversations about menthol cigarettes, including themes, populations, user smoking status, other tobacco or substances, tweet characteristics, and sentiment. We also examined differences in menthol cigarette sentiment by prevalent categories, which allowed us to assess potential perceptions, misperceptions, and social norms about menthol cigarettes on Twitter. This approach can inform communication about these products, particularly to subgroups who are at risk for menthol cigarette use.

    Methods: Through a combination of human and machine classification, we identified 94,627 menthol cigarette-relevant tweets from February 1, 2012 to January 31, 2013 (1 year) from over 47 million tobacco-related messages gathered prospectively from the Twitter Firehose of all public tweets and metadata. Then, 4 human coders evaluated a random sample of 7000 tweets for categories, including sentiment toward menthol cigarettes.

    Results: We found that 47.98% (3194/6657) of tweets expressed positive sentiment, while 40.26% (2680/6657) were negative toward menthol cigarettes. The majority of tweets by likely smokers (2653/4038, 65.70%) expressed positive sentiment, while 91.2% (320/351) of nonsmokers and 71.7% (91/127) of former smokers indicated negative views. Positive views toward menthol cigarettes were predominant in tweets that discussed addiction or craving, marijuana, smoking, taste or sensation, song lyrics, and tobacco industry or marketing or tweets that were commercial in nature. Negative views toward menthol were more common in tweets about smoking cessation, health, African Americans, women, and children and adolescents—largely due to expression of negative stereotypes associated with these groups’ use of menthol cigarettes.

    Conclusions: Examinations of public opinions toward menthol cigarettes through social media can help to inform the framing of public communication about menthol cigarettes, particularly in light of potential regulation by the European Union, US Food and Drug Administration, other jurisdictions, and localities.

    J Med Internet Res 2017;19(2):e56

    doi:10.2196/jmir.5694

    Keywords

    tobacco products; menthol; smoking; social media; Twitter messaging; policy; public opinion 


    Menthol is a characterizing flavor that imparts a minty flavor and a cool sensation masking the harshness of cigarette smoke [1,2]. Menthol cigarettes comprised 31% of market share for cigarettes sold in the United States in 2012 [3]. Use of menthol versus nonmenthol cigarettes is higher among African American, female, younger, and lesbian, gay, bisexual, or transgender (LGBT) smokers [4-8]. For instance, among smokers, 84% of African Americans versus 24% of whites smoke menthol cigarettes [6], and adolescent (57%) and young adults (45%) use menthol cigarettes at higher rates than all ages of older smokers [8]. All of these groups have been targeted by tobacco industry menthol cigarette marketing [9,10].

    The US Food and Drug Administration (FDA) banned characterizing flavors in cigarettes except for menthol or tobacco flavor in 2009 [11]. Menthol was exempted pending further review. In 2011, the FDA’s Tobacco Products Science Advisory Committee (TPSAC) issued a report concluding that “Removal of menthol cigarettes would benefit public health in the United States” [12]. TPSAC and a subsequent FDA report [13] concluded that menthol cigarette use is likely associated with increased smoking initiation, increased levels of nicotine addiction, and reduced smoking cessation success, particularly among African Americans. Moreover, menthol cigarettes present the same disease risk as nonmenthol cigarettes [14], with smoking causing up to two-thirds of deaths in smokers [15]. The FDA has not yet decided on whether to ban menthol cigarettes [16]. However, other jurisdictions are moving forward with menthol cigarette bans and restrictions. Brazil became the first country to pass legislation banning menthol and flavors from tobacco products in 2012, but the ban has not yet taken effect [17]. In 2014, the city of Chicago enacted a ban on menthol and flavored tobacco product sales near schools. The European Union (EU) also banned menthol cigarettes with a 2020 implementation date [17]. In 2015, some Canadian provinces prohibited flavored and menthol cigarettes and tobacco sales [17].

    Understanding perceptions of menthol cigarettes given this changing global regulatory environment is critical to understanding how to best communicate to the general public about these products prior to widespread policy implementation. Perceptions of menthol cigarettes among both smokers and the general public may contribute to use [9,18-21]. A study of US adolescents and young adults found that endorsing promenthol cigarette beliefs (positive sentiment) was associated with intention to use menthol cigarettes among noncurrent menthol cigarette users and intention to use other tobacco products among current menthol cigarette smokers not currently using other products [22].

    Commonly reported positive perceptions of menthol cigarettes are that they are more cooling or refreshing than nonmenthol cigarettes [18,22], have a medicinal effect when the smoker is sick [18,23], and are part of African American culture or tradition [24]. Beliefs that menthol cigarettes are less harmful than nonmenthol cigarettes appear more common among African American smokers [18]. In negative sentiments, among current smokers, 22% believe that menthol cigarettes are more addictive, while 12.1% believe that menthol cigarettes are harder to quit smoking than nonmenthol cigarettes [21].

    Most studies of perceptions of menthol cigarettes have been conducted through surveys or focus groups [18,21,23-26]. Analyzing the amount and content of social media messages is a relatively new and promising way to gather information about health-related topics [27,28]. On Twitter, users can share 140-character messages called tweets with their followers and the general public. The forum is popular, with the number of daily tweets topping 500 million [29]. An estimated 23% of the US adult online population used Twitter in 2014 [30]. Twitter also reaches a global audience with an estimated 316 million active users worldwide [31].

    Used disproportionately by younger and racial and ethnic minority populations who also disproportionately use menthol cigarettes [30], Twitter may provide insight into use and perceptions of these products. Several studies have examined Twitter conversations about electronic cigarettes [32-36] and hookah [34,37]. However, to our knowledge, no study has examined Twitter conversations about menthol cigarettes. As in prior Twitter studies of tobacco, we used a content analysis approach [35-37] and coded specifically for sentiment [35,38] toward menthol cigarettes. Our purpose was to identify the content and frequency of conversations about menthol cigarettes, including themes, populations, user smoking status, other tobacco or substances, tweet characteristics (eg, song lyrics or pop culture references, commercial tweets), and sentiment. We also examined differences in menthol cigarette sentiment by prevalent categories, which allowed us to assess perceptions and potential misperceptions and social norms about menthol cigarettes on Twitter. This approach can inform communication about these products, particularly to subgroups who are at risk for menthol cigarette use.


    Design

    We conducted a search to define a longitudinal set of tweets related to menthol cigarettes between February 1, 2012 and January 31, 2013 (shown in Figure 1 [39]). This time period provides a year of data and covers a time period prior to regulatory action on menthol cigarettes globally.

    ‎
    Figure 1. Overall study design and process for collecting menthol-relevant tweets for coding and analysis.aData source: Internet Live Stats. HMC: Health Media Collaboratory.
    View this figure

    Data Source

    This observational study used data collected by the Health Media Collaboratory (HMC) [40]. The HMC accessed Twitter status updates through the Gnip PowerTrack Firehose (Gnip, Inc) [41], which prospectively collects all Tweets from public Twitter feeds.

    The HMC created two archives that collected all Twitter status updates containing the keywords “cig” or “cigarette” (known as the cigarette archive) or the keyword “smoking” (the smoking archive). We chose those keywords after an extensive process of precision testing of terms likely to obtain tobacco-related content (Health Media Collaboratory, Procedures Manual, unpublished, 2012). The Gnip PowerTrack collected the content of the tweet, metadata such as username (who made the tweet), date and time the update was made, and hashtags (user-generated descriptive tags).

    Keyword Searching

    At the time of our search for menthol cigarettes, the smoking archive had 32,588,116 tweets and the cigarette archive had 14,528,963. We identified an initial set of keywords including general terms, major menthol cigarette brands, slang terms, and common misspellings that we expected to generate relevant menthol cigarette-relevant content (see Table 1). We filtered the smoking and cigarette archives for each term, resulting in 133,485 tweets.

    Table 1. Keywords used to identify menthol cigarette-related tweets and assessment of relevance.
    KeywordsCigarette archiveSmoking archive

    		Number of tweets found% of relevant tweets in 100-tweet sample or all if <100 with keywordNumber of tweets found% of relevant tweets in 100-tweet sample or all if <100 with keyword
    General terms




    		Menthol22435a52a689793

    		Mentholated161964796 (n=45)

    		Menthols13881002956100
    Brands




    		Camel Crush1254100590100

    		Kool3061b35b7966b17b

    		Kools3451001101100

    		Newport12553882264598

    		Newports59851001570998

    		Salem4078b20b803b12b

    		Salems33b100 (n=33)9491 (n=86)

    		Skyline (Marlboro)174b28b617b5b
    Misspelling




    		Methol9896 (n=94)6195 (n=58)

    		Methols2396 (n=22)26100 (n=26)
    Slang




    		Newp12510032298

    		Newps132100307100

    		Port6972b1b7522a77a

    		Ports1565b26b5440100

    aTweets were subject to machine learning assessment.

    bTweets were dropped as having <40% relevant content. All other tweets were retained, as keyword precision tests were ≥80% menthol cigarette related based on relevance coding.

    Relevance Coding

    Once the searches were completed, 2 coders independently coded 100 randomly selected tweets from each keyword or all tweets if less than 100 for menthol relevance. We calculated a kappa statistic for each term to assess interrater reliability. For any term with at least .8 kappa score, one author (SWR) verified the coding and generated a measure of precision (percentage of identified tweets relevant to menthol cigarettes). For any keyword less than .8 kappa score, we coded another 100 tweets until we reached this level of interrater reliability. Of the 42 keywords searched, we achieved a kappa of at least .8 on the first attempt in 41 (98%) keywords.

    We used DiscoverText (Texifter, LLC), a cloud-based text analytic software with active machine learning algorithms, allowing human coders to “train” the computer on a coding schema using a selection of tweets. If the keyword generated less than 40% of relevant tweets from the 100-tweet sample, we dropped all tweets with that keyword. If a keyword generated 80% or more relevant tweets in the 100-tweet sample, we kept all tweets. If the keyword generated 40% to 80% relevant tweets, we used the machine learning to assign a probability of a given tweet being menthol cigarette relevant, validated the machine estimates using a second 100-tweet sample coded by human coders, and retained only tweets with greater than 0.8 probability of being menthol cigarette relevant based on the machine classification. Of the 29,957 tweets assessed by the classifier, we retained 68.37% (n=20,483).

    After merging and deduplicating these sets of tweets across archives and keywords, we ended with 94,627 unique tweets to include in content coding.

    Content Coding

    We developed a codebook (see Table 2 for brief description of codes; Multimedia Appendix 1 provides the broader codebook) for directed content analysis [42], building on empirically derived constructs but allowing for emergent categories in the following areas: themes, populations, other tobacco or substances, tweet characteristics, user smoking status, and sentiment toward menthol cigarettes.

    Table 2. Brief description of codes.
    CategoriesDefinitions
    Themes (topical content dealing with perceptions of menthol cigarettes)

    		Taste/sensationTaste, smell, or sensation (eg, cooling, minty, refreshing) of menthol cigarettes.

    		HealthPerceived health benefits or harms of menthol cigarettes, or beliefs about medicinal effects of menthol cigarette use.

    		CessationDesire or lack of desire to quit smoking menthol cigarettes; beliefs about whether menthol cigarettes are harder or easier to quit than nonmenthol cigarettes.

    		AddictionAddiction, cravings, or desire for their lack of menthol cigarettes, beliefs that menthol cigarettes are more or less addictive than nonmenthol cigarettes.

    		Smoking behaviorAct or process of smoking menthol cigarettes, including time or place of smoking.

    		Tobacco control policiesTobacco control policies or the impact of tobacco control policies.

    		Industry/marketingAdvertising, promotion, labeling, or packaging of menthol cigarettes, including references to tobacco companies and protobacco organizations.
    User smoking status (likely smoking status of the Twitter user)

    		SmokerUser writing tweet is likely to be a smoker.

    		Former smokerUser writing tweet is likely to be a former smoker.

    		NonsmokerUser writing tweet is likely to be a nonsmoker. Also use this code for tweets from antitobacco organizations.

    		UnknownCannot determine smoking status of user writing tweet.
    Tweet characteristics (additional information about tweets)

    		CommercialBranded promotional messages; URLs linking to commercial websites; usernames indicating affiliations with commercial sites; or the user’s Twitter page consisting only of promotional tweets.

    		Song lyrics/pop cultureTweets that are lyrics from songs about menthol cigarettes or pop culture references. This could be hashtags with an artist’s name or popular television shows.
    Other tobacco or substances (tweets mentioning use of other tobacco or other substances)

    		MarijuanaMentions of marijuana (eg, loud, blunt, weed, spliff, mary jane, wax).

    		AlcoholMentions of alcohol.

    		Cigars/little cigars and cigarillosMentions of cigars, little cigars or cigarillos, including blunts or specific brands.

    		HookahMentions of hookah, waterpipe, shisha, or narghile for smoking tobacco or brands.

    		Nicotine replacement therapyMentions of nicotine replacement therapy such as nicotine gum, patch, or lozenge, or specific brands.

    		E-cigaretteMentions of e-cigarettes, vaporizers, e-hookah, vape pens, etc, or of specific brands.

    		Smokeless/snusMentions of smokeless tobacco or snus (eg, dip, chew, snuff, spit) or specific brands.

    		Other tobacco or substancesWrite-in mentions of other tobacco products (eg, pipe, roll-your-own) or brands, or other drugs (eg, LSDa, cocaine).
    Populations (groups associated with menthol cigarette use and menthol cigarette marketing)

    		African AmericansAfrican Americans or African American culture, image, or tradition or references to specific African American individuals in relation to menthol cigarettes.

    		LGBTbLGBT populations or LGBT culture, image, or tradition or references to specific LGBT individuals in relation to menthol cigarettes.

    		WomenWomen and menthol cigarettes or references to specific women and menthol cigarettes.

    		Children/adolescentsChildren and adolescents, minors, or underage smokers (<18 years in the United States) and menthol cigarettes.

    		Other populationWrite-in references to populations of people, does not include job categories (eg, rappers).
    Sentiment (attitudes toward menthol cigarettes)

    		PositivePositive sentiment about menthol cigarettes.

    		NegativeNegative sentiment about menthol cigarettes.

    		NeutralEither no sentiment about menthol cigarette or mixed sentiments (both positive and negative) about menthol cigarettes.

    aLSD: lysergic acid diethylamide.

    bLGBT: lesbian, gay, bisexual, or transgender.

    We used the codebook to code a random sample of 7000 tweets weighted by prevalence of keywords in the menthol cigarette-relevant dataset. Thus, even tweets with low-prevalence keywords had a probability of being selected equal to their prevalence in the larger dataset. Retweets were coded the same as the original tweet. We coded the entire tweet content of modified retweets, but coded sentiment on the modification alone. Each tweet was coded with as many categories as were applicable.

    Next, 4 coders independently coded 500 tweets, reconciling after each 100 and clarifying the codebook, as needed, including adding or broadening codes. Coders also used “other” (write-in) responses to code for new categories that were not in the initial codebook. We added prevalent other categories to the codebook, and reviewed previously coded tweets for the presence of any applicable other categories. Once coders reached kappa of .8 reliability across raters and categories, individual coders coded the remaining tweets independently. Coders flagged unclear tweets, which were adjudicated by a second coder (SWR, CLJ, or MB). We excluded non-English language tweets and those that contained relevant keywords but were not about menthol cigarettes (eg, smoking on Newport Beach, or enjoying Newport, RI).

    Themes

    We identified potential themes and the topical content of the tweet related to perceptions of menthol cigarettes, based on prior research [18-21,43], and refined these themes during preliminary coding. For example, after preliminary coding, we added categories such as smoking behavior and tobacco industry marketing. We also broadened some categories that were not easily distinguishable in the open-ended tweet format compared with a closed-ended survey, for instance, collapsing medicinal effect and harm perceptions into a broader health category. Additionally, we derived one potential theme, African American image [18]) from research on a single subpopulation. We lacked information on user race/ethnicity, so we could not readily code information on users’ perception of menthol cigarettes and their cultural identity. Instead, to capture this concept, we coded references to several populations that may be associated with menthol cigarette use in a set of population codes (described below). These codes included the concept of image. Our final list of categories comprised taste or sensation, health, smoking behavior, cessation, addiction, tobacco control, tobacco industry and marketing, and other (low-prevalence categories written in by coders).

    Populations

    We coded menthol-related tweets if they specifically mentioned menthol cigarettes in relation to populations targeted by menthol marketing [9] and with a higher prevalence of menthol cigarette use [4,5]. Such populations included African Americans, LGBT populations, women, and children and adolescents. We also included an “other” category to capture other populations mentioned (eg, Latinos). Other groups were at low prevalence in the sample.

    Other Tobacco or Substances

    We coded tweets based on co-mentions of menthol cigarettes and alcohol, marijuana, other substances, or other tobacco products, including cigars, little cigars, cigarillos (including blunts), e-cigarettes, smokeless tobacco, and hookah. Perceptions of other tobacco and substances may interact with perceptions of menthol cigarettes and be associated with increased risk behaviors [44,45].

    Tweet Characteristics

    We coded 2 additional characteristics of tweets, including commercial versus noncommercial tweets based on a definition in a prior study (eg, branded promotional messages) [32]. Finally, we coded for whether the tweet included a song lyric or popular culture quotation (eg, a television show reference), a category that emerged from the data. We created lists of song lyrics with menthol cigarette references (eg, “Smoking mad Newports ’cause I’m due in court / For an assault that I caught in Bridgeport, New York”, from Everyday Struggle by The Notorious B.I.G.) and added them to the list as we identified new lyrics. After compiling a final list, we reviewed all coded tweets for known song lyrics.

    User Smoking Status

    We coded tweets for likely user smoking status (nonsmoker, former smoker, smoker, or unknown) because differences in perceptions of menthol cigarettes have been associated with smoking status in prior research [21]. Smokers were characterized by tweets discussing current cigarette smoking. Former smokers were characterized by tweets about past smoking or having quit smoking. Nonsmokers noted that they did not smoke or were opposed to smoking; antitobacco organization tweets were included. Users not mentioning their own smoking status in the tweet were coded as unknown.

    Sentiment

    We coded each tweet for sentiment toward menthol cigarettes. Sentiment categories were positive, negative, and neutral/unclear. If a tweet included both positive and negative sentiments (eg, wanting to quit menthols, but liking the taste), it was coded as neutral/unclear. Tweets mentioning actual smoking, or wanting or craving a menthol cigarette, without further comment were coded as positive toward menthol cigarettes.

    Analysis

    Of the 7000 coded tweets, we excluded 343 (4.90%) as being either non-English or irrelevant to cigarette smoking or menthol cigarettes, with 95.1% retrieval precision and 90.4% retrieval recall within the HMC archive [46], leaving an analytic sample of 6657 tweets.

    For these tweets, we provide univariate statistics of the frequency of tweets and provide qualitative narrative about frequent or notable content in each category. When examining differences in sentiment by other categories, we conducted chi-square tests to assess statistically significant differences in positive or negative sentiment toward menthol cigarettes.


    Frequency Analysis

    Table 3 shows the frequency of themes, populations, other tobacco or substances, tweet characteristics, user smoking status, and sentiment.

    Table 3. Frequency of menthol cigarette-relevant tweets by category (n=6657).
    Categoryn%
    Themes


    		Smoking398359.83

    		Taste/sensation167625.18

    		Addiction109716.48

    		Cessation5848.77

    		Health5718.58

    		Tobacco industry/marketing3905.86

    		Other theme2994.49

    		Tobacco control2954.43
    Population


    		African American74511.19

    		Women5878.82

    		Child/adolescents1311.97

    		Other population280.42

    		Lesbian, gay, bisexual, or transgender220.33
    Other tobacco or substances


    		Marijuana110416.58

    		Alcohol2213.32

    		Cigar/little cigars and cigarillos2183.27

    		Other substance590.89

    		E-cigarette380.57

    		Hookah100.15

    		Smokeless30.05
    Tweet characteristics


    		Song lyric/pop culture111816.79

    		Commercial911.37
    User smoking status


    		Smoker403860.66

    		Unknown214132.16

    		Nonsmoker3515.27

    		Former smoker1271.91
    Sentiment


    		Positive319447.98

    		Negative268040.26

    		Neutral/unclear78311.76
    Themes

    The majority of tweets about menthol cigarettes referenced smoking, taste, or sensation (eg, smell, coolness). About 17% referenced addiction (1097/6657), including explicitly discussing addiction, craving, or addiction-related behaviors such as chain smoking. All other themes—including cessation, health, tobacco industry and marketing, and tobacco control—were represented in fewer than 10% of the tweets coded. Tobacco control tweets (295/6657, 4.43%) included discussion of media campaigns or policy options including tax or price, minors’ access, smoke-free air laws, sales or marketing restrictions, or warning labels, or were tweets by tobacco control organizations. Fewer than 0.60% of tweets (40/6657) referenced a menthol cigarette ban; most were about potential EU action. Only 0.20% (13/6657) were by tobacco control organizations.

    Populations

    About 11% of tweets (745/6657) linked African Americans and menthol cigarette use. For African Americans, use of menthol cigarettes, especially Newport cigarettes, was viewed as linked with African American culture. This was particularly true for African American males. This linkage was viewed both positively (“@___: If you black and smoke cigarettes at least smoke Newports”) and negatively (“Why do black people have a fetish with Newport cigarettes?”). Stereotypical jokes or hashtags were also associated with this category (“#YouKnowYouBlack,” “#WaysToPissOffaBlackPerson”). Women were linked with menthol cigarettes in about 9% of tweets (587/6657). Linkage with menthol cigarettes was associated with negative attitudes toward women, such as the unattractiveness of women who smoke (“Hate when I see pretty girls smoking Newports, it really just ruins it”) or lack of class (“#ShesARatchetIf she smokes newports”). Few tweets referenced children and adolescents or LGBT populations.

    Other Tobacco or Substances

    Over 16% of tweets (1104/6657) referenced marijuana and menthol cigarettes. These tweets referenced co-use of marijuana and menthol, such as smoking a menthol cigarette to enhance the high of smoking marijuana, comparing excessive use of marijuana as similar to chain smoking menthol cigarettes, or assessing the relative harms or appeal of marijuana and menthol cigarettes. These tweets usually judged marijuana as less harmful and more appealing than menthol cigarettes. Fewer tweets (218/6657, 3.27%) focused on dual use of menthol cigarettes and cigar products such as Black and Mild or Swisher Sweets, or blunts used for smoking marijuana. Alcohol and menthol cigarettes were mentioned in 3.32% (221/6657) of the tweets and discussed smoking behavior and drinking. Other tobacco products were rarely mentioned in conjunction with menthol cigarettes.

    Tweet Characteristics

    Only 1.37% of tweets (91/6657) in the sample were commercial tweets, such as tweets offering links to coupons or discounts. Just under 17% of tweets (1118/6657) referencing menthol cigarettes were song lyrics or popular culture quotations (such as a game show sketch from Chappelle’s Show, “I Know Black People,” famously asking the question “Why do black people like menthol cigarettes?”). We identified 30 songs or quotations tweeted in the sample.

    User Smoking Status

    The majority of tweets were likely by smokers (4038/6657, 60.66%) or users with unknown status (2141/6657, 32.16%).

    Sentiment

    Sentiment toward menthol cigarettes in the tweets was mixed. Overall, 47.98% (3194/6657) expressed positive sentiment toward menthol cigarettes and 40.26% (2680/6657) of tweets expressed negative sentiment. The remainder were neutral or unclear.

    Sentiment Analysis

    Sentiment varied by category across themes, populations, other tobacco and substances, and tweet characteristics (omitting categories with <1% prevalence) Figure 2 shows. Based on a chi-square test, tweets coded as referencing themes of addiction (including concepts such as craving or desire for a menthol cigarette), smoking, taste or sensation, and industry or marketing; marijuana as an other substance; and tweet characteristics of commercial tweets and song lyrics were significantly more likely to be positive than negative toward menthol cigarettes. However, both smoking and taste or sensation themes had close to 40% negative sentiment. Positive smoking and taste sentiment included positive attributes of smoking (relaxing, relieving stress, taking smoke breaks) and enjoyment of menthol (pleasant minty taste, soothing or cooling sensation). Negative sentiment included negative mood (stress, anxiety, “bad nerves”), negative feelings about other people smoking (“#ItsNotCuteWhen you smoking ports <<<<”), or dislike of the taste or smell of menthol cigarettes (“Smoking a newport. #gross,” “I hate the scent of newports!! Cigarettes in general Smell terrible, but especially newports!”).

    Tweets referencing themes of cessation and health, and populations of women, children and adolescents, and African Americans were significantly more likely to be negative toward menthol cigarettes. Almost no cessation-related tweets noted proven quit methods such as the use of FDA-approved cessation aids, talking with a physician, or using a quitline [47]. Many noted plans to quit after smoking a last cigarette or pack, or asked for support for their quit attempt (“Today is my last day smoking cigarettes....waving good bye Newports! Wish me luck!!”). A few noted trying to quit by using an e-cigarette (14/6657 tweets). A small number referenced making a quit attempt in relation to the US Centers for Disease Control and Prevention’s Tips from Former Smokers campaign (“Seriously those commercials of the people with the hole in their throat made me quit smoking I haven’t had a newport in days”) [48]. Some also tried to quit by switching to a nonmenthol cigarette (“I need to get off menthols. I need to quit but if I start smoking something disgusting it may be easier.”).

    Most health tweets were negative, noting negative health consequences of smoking. However, positive tweets related to health expressed a misperception of menthol cigarettes as having medicinal use when sick (“Menthol cigarettes are my saviour with this cold”). We rarely found harm perceptions of menthol as less harmful than other cigarettes (“Oh natural menthol healthy cigarettes”), but the converse message that menthol was harmful was more prominent (“SMOKERS (menthol or nonmenthol) really WILL HAVE stroke. So better stop smoking.” “Menthol cigarettes? So they soothe your throat while giving you cancer? Kinda like being killed by a clown.”). Regarding populations, negative sentiment toward menthol cigarettes was driven by negative views of smoking among children and adolescents, women, and African American populations. Tweets referencing cigars, alcohol, and tobacco control had no significant differences between positive and negative sentiment toward menthol cigarettes.

    Among smokers, 65.70% (2653/4038) expressed positive sentiment toward menthol (“Listening to music and smoking a port so relaxed”) (Figure 3). Only 27.34% of smokers (1104/4038) reported negative sentiment toward cigarettes in general (“I cant be doin these menthols man.! Gotta Quit Smoking period. Maybe tomorrow”) or specifically toward menthol-type cigarettes or a menthol cigarette brand (“Had a mayfair menthol, its like smoking mouthwash”). Smoker conversations about menthol cigarettes were dominated by discussion of smoking behavior, addiction or craving, taste preference, and marijuana.

    Nonsmokers (320/351, 91.2%) held predominately negative sentiments about menthol cigarettes and smoking in general (“All the girls at my job be smoking them Newports and had the nerve to offer me one. No ma’am, never.”). Former smokers were generally negative about menthol (91/127, 71.7%) (“I remember when I used to be addicted to Newport cigs now the smell of cigarette smoke gives me a headache #happyiquit #cigsarenasty”). However, almost 30% (36/127, 28.4%) of former smokers were positive or ambivalent about menthol (“even though i quit smoking im tempted to try some marlboro menthol lights, i heard they stink less and are less harmful”).

    ‎
    Figure 2. Positive and negative sentiment toward menthol cigarettes by domains and categories (n=6657). LLC: little cigars and cigarillos. *Pearson chi-square comparison between positive and negative sentiment, significant at P<.05.
    View this figure
    ‎
    Figure 3. Tweets by smoker status and sentiment (n=6657).
    View this figure

    Principal Findings

    Tweets about menthol cigarettes were most frequently about themes of smoking, taste or sensation, and addiction; African American populations; marijuana as an other substance; or song lyrics or pop culture references. Menthol content on Twitter was also driven by smokers who were more positive than others about menthol cigarettes. A prior study of tobacco-relevant content on Twitter found that most tweets were about personal experiences of use [34]. Liking or disliking the taste or sensation of menthol cigarettes found in a quarter of the tweets and in prior research [18,23] are understandable reasons for smoking menthol rather than nonmenthol cigarettes.

    Additionally, Twitter users, particularly smokers, frequently mentioned marijuana and menthol cigarettes, and such tweets tended to be positive. This type of linkage has been found related to use of these products, with adolescent menthol smokers more likely to use marijuana in the past 30 days than nonmenthol smokers [49,50]. Similar to the effect of Twitter content on perceptions of the use of hookah [37] and marijuana [51], these positive views of menthol could normalize menthol cigarette use among the Twitter followers of these users.

    Discussion over Twitter focused on smokers’ concerns and tended to dwarf public health concerns, such as smoking cessation, health, and tobacco control. Some conversations about menthol cigarettes were cessation related but, as with other Twitter conversations about cessation, they lacked discussion of evidence-based strategies [52]. As in prior work, a small number of menthol smokers on Twitter may have perceived that switching to a nonmenthol cigarette is a good way to quit [26]. As in prior studies [18,53,54], we found that some smokers saw a medicinal effect of menthol cigarettes when they were sick. Studies have found that African American smokers may perceive health benefits of menthol or view menthol cigarettes as less harmful than nonmenthol cigarettes—beliefs that may interfere with quitting [14,18,20,23,24,26]. However, this view of menthol cigarettes as less harmful was not prevalent on Twitter and may reflect differences in broader population views of menthol. For instance, a national study of US smokers and nonsmokers found that 45.8% of adults believed that menthol and nonmenthol cigarettes were equally harmful; however, a sizable minority did not know whether menthol cigarettes were more or less harmful than nonmenthol cigarettes (40.8%) [21]. Few conversations on Twitter reflected concern for tobacco control policies. There was limited discussion about a menthol cigarette ban in the EU. After the TPSAC report in 2011 [12], but before an advanced notice of proposed rulemaking on menthol in cigarettes in 2013 [55], there was almost no Twitter discussion about a possible menthol cigarette ban in the United States or any other jurisdiction.

    Finally, tweets reflected linkage of menthol cigarettes with African American populations historically targeted by menthol marketing and that have higher use prevalence [4,56]. Prior work has identified this “African Americanization” through targeted marketing and financial support for African American organizations [56]. African American menthol smokers have recognized that they have been targeted by menthol cigarette advertising [26]. This linkage between menthol cigarettes and African Americans is also seen on Twitter and is characterized by negative sentiment toward menthol cigarettes. Unfortunately, this negative sentiment seems to be driven by negative stereotypes about African American smokers rather than by rejection of the targeted marketing of menthol cigarettes to African Americans.

    Strengths and Limitations

    The strengths of this study are that it included a full year of global Twitter data from the Firehose, representing the entire corpus, rather than a sampling of Twitter content. Limitations are that, because we drew menthol content only from existing smoking and cigarette datasets, we may have missed menthol cigarette-relevant Twitter content without those terms. Additionally, due to this limitation, our research cannot be generalized to all tweets. We could not use Kool and Salem brand names as keywords because they were not precise enough to characterize menthol cigarette-relevant conversations. Future research in this area should consider using the menthol cigarette keywords beyond these existing archives and also examine potential substitution of menthol cigarettes with menthol flavors of other tobacco products such as e-cigarettes or cigars. The study lacked information about demographic or geographic information of Twitter users to understand differences in perceptions. However, themes found in prior research about menthol cigarettes [18-21,43] were also found in this study, suggesting these perceptions may be shared broadly. Future research can focus more in-depth on discussion of menthol cigarettes related to different populations. Another limitation was the cross-sectional nature of our analysis. Though the analysis was appropriate given our interest in the overall frequency of content about menthol cigarettes in this time period, a longitudinal analysis could provide information about changes in perceptions of menthol cigarette Twitter content.

    Conclusion

    Our findings present a relatively new way of assessing public opinions of menthol cigarettes through Twitter messages. Most messages are generated by smokers who have more positive sentiment toward these harmful combustible products. Misperceptions of menthol cigarettes having medicinal effects are prevalent, and positive linkage with marijuana is common. Addressing these common misconceptions and denormalizing menthol cigarette use, particularly for African American smokers, could ultimately save lives. In the United States, a menthol cigarette ban would be estimated to avert over 600,000 deaths by 2050, almost one-third among African Americans [57]. Framing public communication about menthol cigarettes to denormalize use in both online and offline forums is especially critical in light of potential regulation by the FDA, the EU, other jurisdictions, and localities. Future analyses could also use Twitter to examine reaction to regulations restricting menthol cigarettes among likely smokers and nonsmokers.

    Acknowledgments

    SWR conceived of research leading to this paper, conducted the analysis, and drafted the manuscript. SWR, CLJ, SB, and MB coded the tweets. SE leads the parent study and KMR provided oversight for the study. All authors made significant contributions to article conceptualization and editing and approved the final draft.

    Funding for this study was provided by Tobacco Control in a Rapidly Changing Media Environment (U01CA154254) from the National Cancer Institute’s State and Community Tobacco Control Initiative. Additional support was provided by Truth Initiative for SWR’s time and the National Institute On Drug Abuse of the National Institutes of Health for CLJ’s effort (Award Number F31DA039609). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

    Conflicts of Interest

    During the preparation of this manuscript, KMR was a member of the TPSAC for the FDA Center for Tobacco Products. The views expressed in this paper are his and not those of the FDA. All other authors have no competing interests.

    ‎

    Multimedia Appendix 1

    Detailed study codebook.

    PDF File (Adobe PDF File), 501KB
    1. Carpenter CM, Wayne GF, Connolly GN. The role of sensory perception in the development and targeting of tobacco products. Addiction 2007 Jan;102(1):136-147. [CrossRef] [Medline]
    2. Dessirier JM, O'Mahony M, Carstens E. Oral irritant properties of menthol: sensitizing and desensitizing effects of repeated application and cross-desensitization to nicotine. Physiol Behav 2001 May;73(1-2):25-36. [Medline]
    3. Federal Trade Commission. Federal Trade Commission Cigarette Report for 2012. Washington, DC: US Federal Trade Commission; 2015.
    4. Caraballo RS, Asman K. Epidemiology of menthol cigarette use in the United States. Tob Induc Dis 2011;9 Suppl 1:S1 [FREE Full text] [CrossRef] [Medline]
    5. Fallin A, Goodin AJ, King BA. Menthol cigarette smoking among lesbian, gay, bisexual, and transgender adults. Am J Prev Med 2015 Jan;48(1):93-97 [FREE Full text] [CrossRef] [Medline]
    6. The NSDUH Report: Use of Menthol Cigarettes. Rockville, MD: Substance Abuse and Mental Health Services Administration, Office of Applied Studies; Nov 19, 2009.
    7. Giovino GA, Sidney S, Gfroerer JC, O'Malley PM, Allen JA, Richter PA, et al. Epidemiology of menthol cigarette use. Nicotine Tob Res 2004 Feb;6 Suppl 1:S67-S81. [CrossRef] [Medline]
    8. Giovino GA, Villanti AC, Mowery PD, Sevilimedu V, Niaura RS, Vallone DM, et al. Differential trends in cigarette smoking in the USA: is menthol slowing progress? Tob Control 2015 Jan;24(1):28-37. [CrossRef] [Medline]
    9. Anderson SJ. Marketing of menthol cigarettes and consumer perceptions: a review of tobacco industry documents. Tob Control 2011 May;20 Suppl 2:ii20-ii28 [FREE Full text] [CrossRef] [Medline]
    10. Washington HA. Burning love: big tobacco takes aim at LGBT youths. Am J Public Health 2002 Jul;92(7):1086-1095. [Medline]
    11. Family Smoking Prevention and Tobacco Control Act of 2009, HR 1256, 111th Cong, 1st Sess. 2009.   URL: https://www.gpo.gov/fdsys/pkg/PLAW-111publ31/pdf/PLAW-111publ31.pdf [accessed 2017-02-08] [WebCite Cache]
    12. Tobacco Products Scientific Advisory Committee. Menthol Cigarettes and Public Health: Review of the Scientific Evidence and Recommendations. Silver Spring, MD: U.S. Food and Drug Administration; 2011.   URL: http:/​/www.​fda.gov/​downloads/​AdvisoryCommittees/​CommitteesMeetingMaterials/​TobaccoProductsScientificAdvisoryCommittee/​UCM269697.​pdf [accessed 2017-02-08] [WebCite Cache]
    13. Food and Drug Administration. Preliminary scientific evaluation of the possible public health effects of menthol versus nonmenthol cigarettes. Silver Spring, MD: FDA; 2013.   URL: http:/​/www.​fda.gov/​downloads/​ScienceResearch/​SpecialTopics/​PeerReviewofScientificInformationandAssessments/​UCM361598.​pdf [accessed 2017-02-08] [WebCite Cache]
    14. Benowitz NL, Samet JM. The threat of menthol cigarettes to U.S. public health. N Engl J Med 2011 Jun 9;364(23):2179-2181. [CrossRef] [Medline]
    15. Banks E, Joshy G, Weber MF, Liu B, Grenfell R, Egger S, et al. Tobacco smoking and all-cause mortality in a large Australian cohort study: findings from a mature epidemic with current low smoking prevalence. BMC Med 2015;13:38 [FREE Full text] [CrossRef] [Medline]
    16. Siegel M. A lost opportunity for public health--the FDA advisory committee report on menthol. N Engl J Med 2011 Jun 9;364(23):2177-2179. [CrossRef] [Medline]
    17. Framework Convention Alliance. Canadian provinces first in world to ban menthol flavouring. 2015 Nov 16.   URL: http://www.fctc.org/fca-news/opinion-pieces/1328-canadian-provinces-first-to-ban-menthol-flavouring [accessed 2016-02-24] [WebCite Cache]
    18. Allen B, Cruz TB, Leonard E, Unger JB. Development and validation of a scale to assess attitudes and beliefs about menthol cigarettes among african american smokers. Eval Health Prof 2010 Dec;33(4):414-436. [CrossRef] [Medline]
    19. Wackowski OA, Delnevo CD, Lewis MJ. Risk perceptions of menthol cigarettes compared with nonmenthol cigarettes among New Jersey adults. Nicotine Tob Res 2010 Jul;12(7):786-790. [CrossRef] [Medline]
    20. Castro FG. Physiological, psychological, social, and cultural influences on the use of menthol cigarettes among Blacks and Hispanics. Nicotine Tob Res 2004 Feb;6 Suppl 1:S29-S41. [CrossRef] [Medline]
    21. Davis SP, McClave-Regan AK, Rock VJ, Kruger J, Garrett BE. Perceptions of menthol cigarette use among U.S. adults and adult smokers: findings from the 2009 HealthStyles survey. Nicotine Tob Res 2010 Dec;12 Suppl 2:S125-S135. [CrossRef] [Medline]
    22. Brennan E, Gibson L, Momjian A, Hornik RC. Are young people's beliefs about menthol cigarettes associated with smoking-related intentions and behaviors? Nicotine Tob Res 2015 Jan;17(1):81-90 [FREE Full text] [CrossRef] [Medline]
    23. Unger JB, Allen B, Leonard E, Wenten M, Cruz TB. Menthol and non-menthol cigarette use among Black smokers in Southern California. Nicotine Tob Res 2010 Apr;12(4):398-407. [CrossRef] [Medline]
    24. Allen B, Unger JB. Sociocultural correlates of menthol cigarette smoking among adult African Americans in Los Angeles. Nicotine Tob Res 2007 Apr;9(4):447-451. [CrossRef] [Medline]
    25. Kreslake JM, Wayne GF, Connolly GN. The menthol smoker: tobacco industry research on consumer sensory perception of menthol cigarettes and its role in smoking behavior. Nicotine Tob Res 2008 Apr;10(4):705-715. [CrossRef] [Medline]
    26. Richter P, Beistle D, Pederson L, O'Hegarty M. Small-group discussions on menthol cigarettes: listening to adult African American smokers in Atlanta, Georgia. Ethn Health 2008 Apr;13(2):171-182. [CrossRef] [Medline]
    27. Donelle L, Booth RG. Health tweets: an exploration of health promotion on twitter. Online J Issues Nurs 2012 Sep;17(3):4 [FREE Full text] [Medline]
    28. Lyles CR, López A, Pasick R, Sarkar U. “5 mins of uncomfyness is better than dealing with cancer 4 a lifetime”: an exploratory qualitative analysis of cervical and breast cancer screening dialogue on Twitter. J Cancer Educ 2013 Mar;28(1):127-133. [CrossRef] [Medline]
    29. Terdiman D. CNET news. 2012 Oct 26. Report: Twitter hits half a billion tweets a day   URL: http://www.cnet.com/news/report-twitter-hits-half-a-billion-tweets-a-day/ [accessed 2016-02-24] [WebCite Cache]
    30. Duggan M. Mobile messaging and social media. Washington, DC: Pew Research Center; 2015.   URL: http://www.pewinternet.org/files/2015/08/Social-Media-Update-2015-FINAL2.pdf [accessed 2017-02-09] [WebCite Cache]
    31. Statista. Leading social networks worldwide as of August 2015, ranked by number of active users (in millions). 2015 Nov 16.   URL: http://www.statista.com/statistics/272014/global-social-networks-ranked-by-number-of-users/ [accessed 2016-02-24] [WebCite Cache]
    32. Huang J, Kornfield R, Szczypka G, Emery SL. A cross-sectional examination of marketing of electronic cigarettes on Twitter. Tob Control 2014 Jul;23 Suppl 3:iii26-iii30 [FREE Full text] [CrossRef] [Medline]
    33. Kim AE, Hopper T, Simpson S, Nonnemaker J, Lieberman AJ, Hansen H, et al. Using Twitter data to gain insights into e-cigarette marketing and locations of use: an infoveillance study. J Med Internet Res 2015;17(10):e251 [FREE Full text] [CrossRef] [Medline]
    34. Myslín M, Zhu S, Chapman W, Conway M. Using Twitter to examine smoking behavior and perceptions of emerging tobacco products. J Med Internet Res 2013;15(8):e174 [FREE Full text] [CrossRef] [Medline]
    35. Cole-Lewis H, Pugatch J, Sanders A, Varghese A, Posada S, Yun C, et al. Social listening: a content analysis of e-cigarette discussions on Twitter. J Med Internet Res 2015;17(10):e243 [FREE Full text] [CrossRef] [Medline]
    36. Jo CL, Kornfield R, Kim Y, Emery S, Ribisl KM. Price-related promotions for tobacco products on Twitter. Tob Control 2016 Jul;25(4):476-479. [CrossRef] [Medline]
    37. Krauss MJ, Sowles SJ, Moreno M, Zewdie K, Grucza RA, Bierut LJ, et al. Hookah-related Twitter chatter: a content analysis. Prev Chronic Dis 2015;12:E121 [FREE Full text] [CrossRef] [Medline]
    38. McDaniel PA, Patzke H, Malone RE. Twitter users' reaction to a chain pharmacy's decision to end tobacco sales. Tob Induc Dis 2015;13:36 [FREE Full text] [CrossRef] [Medline]
    39. Internet Live Stats. Twitter usage statistics.: InternetLiveStats.com   URL: http://www.internetlivestats.com/twitter-statistics/#trend [accessed 2017-02-09] [WebCite Cache]
    40. Health Media Collaboratory.   URL: http://www.healthmediacollaboratory.org [accessed 2016-02-24] [WebCite Cache]
    41. Gnip. Boulder, CO: Gnip, Inc; 2016.   URL: https://gnip.com/ [accessed 2016-02-24] [WebCite Cache]
    42. Hsieh H, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res 2005 Nov;15(9):1277-1288. [CrossRef] [Medline]
    43. Winickoff JP, McMillen RC, Vallone DM, Pearson JL, Tanski SE, Dempsey JH, et al. US attitudes about banning menthol in cigarettes: results from a nationally representative survey. Am J Public Health 2011 Jul;101(7):1234-1236. [CrossRef] [Medline]
    44. Amonini C, Donovan RJ. The relationship between youth's moral and legal perceptions of alcohol, tobacco and marijuana and use of these substances. Health Educ Res 2006 Apr;21(2):276-286 [FREE Full text] [CrossRef] [Medline]
    45. Richter PA, Pederson LL, O'Hegarty MM. Young adult smoker risk perceptions of traditional cigarettes and nontraditional tobacco products. Am J Health Behav 2006;30(3):302-312. [CrossRef] [Medline]
    46. Kim Y, Huang J, Emery S. Garbage in, garbage out: data collection, quality assessment and reporting standards for social media data use in health research, infodemiology and digital disease detection. J Med Internet Res 2016;18(2):e41 [FREE Full text] [CrossRef] [Medline]
    47. Clinical Practice Guideline Treating Tobacco Use and Dependence 2008 Update Panel‚ Liaisons‚ and Staff. A clinical practice guideline for treating tobacco use and dependence: 2008 update. A U.S. Public Health Service report. Am J Prev Med 2008 Aug;35(2):158-176 [FREE Full text] [CrossRef] [Medline]
    48. Emery SL, Szczypka G, Abril EP, Kim Y, Vera L. Are you scared yet? Evaluating fear appeal messages in tweets about the tips campaign. J Commun 2014 Apr;64:278-295 [FREE Full text] [CrossRef] [Medline]
    49. Kong G, Singh N, Camenga D, Cavallo D, Krishnan-Sarin S. Menthol cigarette and marijuana use among adolescents. Nicotine Tob Res 2013 Dec;15(12):2094-2099 [FREE Full text] [CrossRef] [Medline]
    50. Azagba S, Sharaf MF. Binge drinking and marijuana use among menthol and non-menthol adolescent smokers: findings from the youth smoking survey. Addict Behav 2014 Mar;39(3):740-743. [CrossRef] [Medline]
    51. Cavazos-Rehg PA, Krauss M, Fisher SL, Salyer P, Grucza RA, Bierut LJ. Twitter chatter about marijuana. J Adolesc Health 2015 Feb;56(2):139-145. [CrossRef] [Medline]
    52. Prochaska JJ, Pechmann C, Kim R, Leonhardt JM. Twitter=quitter? An analysis of Twitter quit smoking social networks. Tob Control 2012 Jul;21(4):447-449 [FREE Full text] [CrossRef] [Medline]
    53. Klausner K. Menthol cigarettes and smoking initiation: a tobacco industry perspective. Tob Control 2011 May;20 Suppl 2:ii12-ii19 [FREE Full text] [CrossRef] [Medline]
    54. Truth Tobacco Documents Library. A study of smokers’ habits and attitudes with special emphasis on low tar and menthol cigarettes, volume I. Bates No:2040500265-2040500399. 1979.   URL: https://industrydocuments.library.ucsf.edu/tobacco/docs/ [accessed 2016-02-24] [WebCite Cache]
    55. Food and Drug Administration, Department of Health and Human Services. Menthol in cigarettes, tobacco products; request for comments. 21 CFR Part 1140 [Docket No. FDA-2013-N-0521]. Federal Register 2013 Jul 24;78(142):44484-44485 [FREE Full text]
    56. Gardiner PS. The African Americanization of menthol cigarette use in the United States. Nicotine Tob Res 2004 Feb;6 Suppl 1:S55-S65. [CrossRef] [Medline]
    57. Levy DT, Pearson JL, Villanti AC, Blackman K, Vallone DM, Niaura RS, et al. Modeling the future effects of a menthol ban on smoking prevalence and smoking-attributable deaths in the United States. Am J Public Health 2011 Jul;101(7):1236-1240. [CrossRef] [Medline]

    ‎
    EU: European Union
    FDA: Food and Drug Administration
    HMC: Health Media Collaboratory
    LGBT: lesbian, gay, bisexual, or transgender
    TPSAC: Tobacco Products Science Advisory Committee

    Edited by G Eysenbach; submitted 24.02.16; peer-reviewed by S Dunlop, M Gonzalez, P Shafer; comments to author 27.06.16; revised version received 21.08.16; accepted 30.01.17; published 27.02.17

    Copyright

    ©Shyanika W Rose, Catherine L Jo, Steven Binns, Melissa Buenger, Sherry Emery, Kurt M Ribisl. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 27.02.2017.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.