This paper is in the following e-collection/theme issue:

Infodemiology and Infoveillance (1317) Infoveillance, Infodemiology, Digital Disease Surveillance, Infodemic Management (1028) Medicine 2.0: Social Media, Open, Participatory, Collaborative Medicine (1602) Public (e)Health, Digital Epidemiology and Public Health Informatics (693) Information Seeking, Information Needs (450)

Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/44586, first published .
Analysis of Fluoride-Free Content on Twitter: Topic Modeling Study

Analysis of Fluoride-Free Content on Twitter: Topic Modeling Study

Analysis of Fluoride-Free Content on Twitter: Topic Modeling Study

Authors of this article:

Matheus Lotto1, 2 Author Orcid Image ;   Irfhana Zakir Hussain2, 3 Author Orcid Image ;   Jasleen Kaur2 Author Orcid Image ;   Zahid Ahmad Butt2 Author Orcid Image ;   Thiago Cruvinel1 Author Orcid Image ;   Plinio P Morita2, 4, 5, 6, 7 Author Orcid Image
Article Authors Cited by (4) Tweetations (9) Metrics

    Original Paper

    1Department of Pediatric Dentistry, Orthodontics and Public Health, Bauru School of Dentistry, University of São Paulo, Bauru, Brazil

    2School of Public Health Sciences, University of Waterloo, Waterloo, ON, Canada

    3Department of Data Science and Business Systems, School of Computing, College of Engineering and Technology, SRM Institute of Science and Technology, Kattankulathur, India

    4Research Institute for Aging, University of Waterloo, Waterloo, ON, Canada

    5Department of Systems Design Engineering, University of Waterloo, Waterloo, ON, Canada

    6eHealth Innovation, Techna Institute, University Health Network, Toronto, ON, Canada

    7Institute of Health Policy, Management, and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada

    Corresponding Author:

    Plinio P Morita, BEng, MSc, PhD

    School of Public Health Sciences

    University of Waterloo

    200 University Avenue West

    Waterloo, ON, N2L 3G1

    Canada

    Phone: 1 519 888 4567

    Email: plinio.morita@uwaterloo.ca


    Background: Although social media has the potential to spread misinformation, it can also be a valuable tool for elucidating the social factors that contribute to the onset of negative beliefs. As a result, data mining has become a widely used technique in infodemiology and infoveillance research to combat misinformation effects. On the other hand, there is a lack of studies that specifically aim to investigate misinformation about fluoride on Twitter. Web-based individual concerns on the side effects of fluoridated oral care products and tap water stimulate the emergence and propagation of convictions that boost antifluoridation activism. In this sense, a previous content analysis–driven study demonstrated that the term fluoride-free was frequently associated with antifluoridation interests.

    Objective: This study aimed to analyze “fluoride-free” tweets regarding their topics and frequency of publication over time.

    Methods: A total of 21,169 tweets published in English between May 2016 and May 2022 that included the keyword “fluoride-free” were retrieved by the Twitter application programming interface. Latent Dirichlet allocation (LDA) topic modeling was applied to identify the salient terms and topics. The similarity between topics was calculated through an intertopic distance map. Moreover, an investigator manually assessed a sample of tweets depicting each of the most representative word groups that determined specific issues. Lastly, additional data visualization was performed regarding the total count of each topic of fluoride-free record and its relevance over time, using Elastic Stack software.

    Results: We identified 3 issues by applying the LDA topic modeling: “healthy lifestyle” (topic 1), “consumption of natural/organic oral care products” (topic 2), and “recommendations for using fluoride-free products/measures” (topic 3). Topic 1 was related to users’ concerns about leading a healthier lifestyle and the potential impacts of fluoride consumption, including its hypothetical toxicity. Complementarily, topic 2 was associated with users’ personal interests and perceptions of consuming natural and organic fluoride-free oral care products, whereas topic 3 was linked to users’ recommendations for using fluoride-free products (eg, switching from fluoridated toothpaste to fluoride-free alternatives) and measures (eg, consuming unfluoridated bottled water instead of fluoridated tap water), comprising the propaganda of dental products. Additionally, the count of tweets on fluoride-free content decreased between 2016 and 2019 but increased again from 2020 onward.

    Conclusions: Public concerns toward a healthy lifestyle, including the adoption of natural and organic cosmetics, seem to be the main motivation of the recent increase of “fluoride-free” tweets, which can be boosted by the propagation of fluoride falsehoods on the web. Therefore, public health authorities, health professionals, and legislators should be aware of the spread of fluoride-free content on social media to create and implement strategies against their potential health damage for the population.

    J Med Internet Res 2023;25:e44586

    doi:10.2196/44586

    Keywords

    fluoride; health information; infodemiology; infoveillance; misinformation; social media; Twitter; oral care; healthy lifestyle; hygiene 


    Social media have increasingly gained popularity as platforms for individuals and communities to seek and share health information. In that regard, Twitter boasts an impressive user base of approximately 368 million monthly active individuals who share a common interest in discussing common health topics, such as COVID-19, cancer, influenza, mental health, vaccination, and smoking [1-7]. Although Twitter can be incredibly informative and engaging for health seekers, it can also be a breeding ground for misinformation [5]. In this context, misinformation indicates an umbrella term covering a range of false or misleading content, such as misinformation, mal-information, disinformation, fake news, and conspiracy theories [8-12].

    Although Twitter can contribute to spreading health falsehoods, it can also serve as a valuable tool for elucidating the social factors that contribute to the onset of negative beliefs. As a result, data mining has become a widely used technique in infodemiology and infoveillance research to combat misinformation effects [1,13,14]. For example, screening COVID-19 vaccine misinformation on Twitter helped to identify the health beliefs associated with the antivaccination movement, which contributed to a better understanding of the factors relating to the prevalence and severity of cases in different countries [15]. Moreover, the analysis of social media content can contribute to the development of artificial intelligence–based ecosystems to control the misinformation phenomenon [16,17]. Previously, content analysis on social media required manual characterization, but now, machine learning models can also be used to analyze large data sets.

    Since its introduction in 1942, multiple studies have consistently demonstrated the role of fluoride in reducing the prevalence and incidence of caries lesions [18]. There is robust evidence that fluoride interventions, including the fluoridation of tap water, the use of fluoride-containing oral care products, and professional fluoride application, promote favorable health outcomes [19-22]. The prevalence of dental caries has decreased drastically among people from communities exposed to these preventive, cost-effective measures [20,23]. One concern surrounding fluoride use is that overexposure, specifically during tooth development stages, increases the chance of dental fluorosis in children [24]. Thus, dentists recommend the adoption of safeguard measures for the storage and use of fluoride-containing products, such as keeping them in a secure place out of children’s reach, reducing the amount of toothpaste during tooth brushing, and avoiding fluoridated solutions with pleasant flavors [19,25]. This safety consideration, in conjunction with misinformation that fluoride causes neurological disorders, has flooded the internet with erroneous beliefs on the poisoning capacity of fluoride [26,27]. This spread of misinformation has contributed to a public refusal to use fluoride to control dental caries [16,28]. Specifically, a previous content analysis–driven study demonstrated that the term fluoride-free was frequently associated with antifluoridation interests on social media [16].

    In view of possible negative implications of web-based fluoride content, this study aimed to analyze “fluoride-free” tweets regarding their topics and frequency of publication over time.


    Ethical Considerations

    This study did not require institutional review board approval from the Council of Ethics in Human Research of the University of Waterloo because federal regulations do not apply to research using publicly available data that do not involve human subjects.

    Data Collection

    On June 5, 2022, the Twitter application programming interface [29] was used to extract 23,436 tweets published in English between May 2016 and May 2022 with the keyword “fluoride-free.” It followed the parameters of a prior study about fluoride-related misinformation on Instagram [16].

    Preprocessing of the Data Set

    The CSV file data set was uploaded and processed to enhance the quality of the tweets for subsequent analysis [30]. Initially, duplicate tweets were identified and eliminated, resulting in a data set containing 21,169 unique tweets. Next, tokenization was performed to break down the text into smaller units, such as individual words. Then, all tokens were converted to lowercase to ensure uniform treatment, irrespective of capitalization, and to prevent potential discrepancies in the analysis. Stop words were removed to eliminate common words that contribute little meaning to the analysis. This included articles (eg, “a,” “an,” and “the”), prepositions (eg, “on,” “in,” and “at”), and conjunctions (eg, “and,” “but,” and “or”). Additionally, unspecific or irrelevant words were removed, such as non-English characters, keywords, verbs, and digits. Lastly, punctuation marks, symbols, and special characters were eliminated to refine the data set further and ensure consistency in subsequent analysis.

    Furthermore, exploratory data preprocessing was performed to assess the impact of both the most frequent and rare words in the data set. Notably, term frequency filtering did not exhibit substantial improvements on latent Dirichlet allocation (LDA) topic modeling. Therefore, the decision was made to retain the most frequent and rare words to enhance the contextual relevance of the resulting topics (Multimedia Appendix 1).

    Data Analyses

    LDA topic modeling is an unsupervised machine learning probabilistic and word count–based algorithm used to effectively determine salient terms and extract emerging groups (topics) of a particular corpus (data set), including social media posts concerning health issues [31,32]. Even though this analysis does not provide a complete meaning of social media posts, it contributes to a good overview of their main issues [33]. Notably, a detailed description of the LDA model is provided elsewhere [34].

    The preprocessed 21,169 tweets were subjected to LDA topic modeling techniques using the Python-based Gensim and spaCy libraries in a Google Colaboratory interface to identify the salient terms and topics [31,32]. The number of ideal topics was defined according to the coherence score proposed by Nikolenko and colleagues [35].

    In this context, the coherence values were computed for K topics, where K ranged from 2 to 50, before eventually narrowing the consideration range down to 3 to 15 cases. Remarkably, higher coherence scores probabilistically represent better-quality topic modeling, facilitating the interpretation of outputs. An investigator (ML) validated the topic model with the highest coherence score by rating the model on the meaningfulness of its topics, how well publications within a single topic are related, and how publications of different topics are distinct.

    Facing the definition of the number of topics, the similarity between them was calculated through an intertopic distance map. It is a visualization of the issues in a bidimensional space, where the bubbles represent topics that emerged from the topic modeling analysis and are dimensionally proportional to the number of contained words. In this graph representation, the axes are based on 2 principal components to facilitate the interpretation of the distance between topics. Synthetically, the LDA algorithm uses a principal component analysis to reduce N-dimensional vectors to bidimensional vectors and achieve (x,y) coordinates.

    Moreover, the same investigator (ML) manually assessed a sample of tweets depicting each of the most representative word groups that determined specific issues. Lastly, additional data visualization was performed regarding the total count of each topic of fluoride-free record and its relevance over time, using Elastic Stack software through the Elasticsearch and Kibana features [36-38].


    To determine the underlying social issues surrounding the spread of fluoride-free content on Twitter, we applied topic modeling to identify patterns based on the frequency of keywords [29,30]. A higher coherence score is associated with better data quality and simplified output interpretation. The highest coherence value (0.543) occurred for 3 topics (Figure 1). This indicated that the Twitter posts contained 3 different fluoride-free–related topics.

    Using an intertopic distance map (Figure 2), we visualized the arrangement of topics based on the words they comprise. The analysis revealed a distance between the topics, confirming the identification of 3 distinct issues: “healthy lifestyle” (topic 1), “consumption of natural/organic oral care products” (topic 2), and “recommendations for using fluoride-free products/measures” (topic 3). In this sense, topic 1 was related to users’ concerns about leading a healthier lifestyle and the potential impacts of fluoride consumption, including its hypothetical toxicity. Complementarily, topic 2 was associated with users’ personal interests and perceptions of consuming natural and organic fluoride-free oral care products, whereas topic 3 was linked to users’ recommendations for using fluoride-free products (eg, switching from fluoridated toothpaste to fluoride-free alternatives) and measures (eg, consuming unfluoridated bottled water instead of fluoridated tap water), comprising the propaganda of dental products.

    ‎
    Figure 1. Coherence scores for distinct number of topics.
    ‎
    Figure 2. Intertopic distance map. The bubbles are denominated according to the number of the specific topic. PC: principal component.

    Table 1 summarizes the fluoride-free salient topics stratified according to the most frequent words, issues, and examples. It is important to note that some words appear in 2 topics, for example, “tooth” in topics 2 and 3. The homogeneity of the data set can explain this pattern since tweets were collected from a keyword that restricts the results to a specific theme. Moreover, some words per se do not directly represent the issue of the topic, such as “long” or “black” in topic 1 (healthy lifestyle). Thus, the context of tweets is essential to define the issue of emerging topics in both cases. As a result, the analysis of a sample of tweets from each topic was necessary to ensure the distinction between issues presented within the topics.

    To determine the frequency that each “fluoride-free” topic appears on Twitter, we calculated the percentage (Figure 3) and absolute count (Figure 4) of each topic over time. Topic 1 (healthy lifestyle) represents the largest share of tweets, whereas topics 2 (consumption of natural/organic oral care products) and 3 (recommendations for using fluoride-free products/measures) are similar in terms of their representation (Figure 3). Between 2016 and 2019, a gradual decline in “fluoride-free” tweets was observed, reaching <2000 tweets per year (Figure 4). Nonetheless, the number of tweets increased again from 2020 onward.

    The relevance of each topic was determined by the number of tweets over time. The points of each curve are separated by a 4-week interval (Figure 5). The number of tweets from topic 1 (healthy lifestyle) was higher than other topics, particularly in 2016, 2017, 2021, and 2022. The relevance of topics 2 (consumption of natural/organic oral care products) and 3 (recommendations for using fluoride-free products/measures) was similar over time, with a slight advantage for topic 2 in 2018.

    Table 1. Fluoride-free–related salient topics stratified according to the most frequent words, issues, and examples.
    TopicMost frequent wordsIssuesExamples
    1Natural, oil, product, vegan, organic, charcoal, people, black, care, kid, family, long, food, deodorant, good, and dentistHealthy lifestyle
    • “Chlorine free. Fluoride-free. We believe that a better you start with a better water.”
    • “Fluoride-free health products to support a healthy lifestyle”
    2Tooth, good, dental, low, health, paste, organic, people, Tom, well, aluminum, child, deodorant, cavity, year, and wayConsumption of natural/organic oral care products
    • “Sprouts has very good vegan lip balm, lotion, deodorant, natural oils, fluoride-free and all natural tooth paste etc.”
    • “Anybody know of a site that does that organic fluoride free toothpaste, aluminum free”
    3Tooth, Tom, decay, oil, state, week, health, Maine, dentist, new, deodorant, oral, low, whitening, cavity, safe, and dayRecommendations for using fluoride-free products/measures
    • “Fluoride does a body bad. Don‘t drink fluoride. I like to use Tom‘s fluoride-free toothpaste.”
    • “Tom’s of Maine natural fluoride-free baking soda toothpaste with propolis and myrrh”
    ‎
    Figure 3. Percentage of tweets related to each topic from latent Dirichlet allocation analysis over time. Green bars represent topic 1 (healthy lifestyle), blue bars represent topic 2 (consumption of natural/organic oral care products), and red bars represent topic 3 (recommendations for using fluoride-free products/measures).
    ‎
    Figure 4. Number of tweets related to each topic from latent Dirichlet allocation analysis over time. Green bars represent topic 1 (healthy lifestyle), blue bars represent topic 2 (consumption of natural/organic oral care products), and red bars represent topic 3 (recommendations for using fluoride-free products/measures). Note that the lower count observed in 2022 is relative to the partial data collection until May (less than half year).
    ‎
    Figure 5. The relevance of topics over time (2016-2022). Note that each point corresponds to a 4-week interval.

    Principal Findings

    The purpose of this study was to analyze the fluoride-free content on Twitter. Although studies have investigated fluoride-related content on Facebook, Instagram, and Twitter [16,28,39-42], to the best of our knowledge, this is the first study that focused on fluoride-free content on Twitter using topic modeling methods. The findings demonstrated that fluoride-free content found on Twitter mainly concerned a perceived healthy lifestyle, followed by the consumption of natural and organic oral care products and recommendations of fluoride-free products and measures. The outcomes are in accordance with previous studies [16,28,39-42]. We found that the interest in falsehoods gradually decreased between 2016 and 2019 and subsequently rose again from 2020 onward. The use of topic modeling analysis enabled the examination of a large Twitter data set, which would be difficult to achieve with traditional human-based analysis. In this sense, developing artificial intelligence–grounded systems capable of detecting and analyzing a massive volume of fluoride-related misinformation is essential.

    Despite a decline in “fluoride-free” tweets between 2016 and 2019, the antifluoridation movement has had a negative impact on dental public policies in English-speaking countries. This has led to some regions discontinuing community water fluoridation to meet specific demands of users, despite community-based intervention being a key factor in promoting oral health equity [43]. For example, in Canada, only approximately 39% of the population has access to fluoridated tap water, with uneven distribution across the country (71% living in Ontario vs 1.7% living in British Columbia) [44]. Research has shown that dental caries prevalence is significantly higher in areas where fluoridation has been discontinued. An observational study conducted on schoolchildren in Alberta found that dental caries prevalence in primary dentition (ie, deciduous teeth and baby teeth) was significantly higher in Calgary (64.8%; fluoridation cessation in 2011) compared to Edmonton (55.1%; still fluoridated) [45]. In contrast, oral care companies have developed fluoride-free products to meet consumers’ preferences [16,46]. Interestingly, the increase in “fluoride-free” tweets in 2020 coincided with the onset of the COVID-19 pandemic. The infodemic scenario during the pandemic has led to increased health information-seeking behavior among users, including dental-related issues [47,48].

    False health beliefs usually originate from the same mechanisms of accurate health beliefs, influenced by diverse cognitive, social, and affective drivers such as intuitive thinking (the absence of analytical thinking or deliberation), cognitive failures (neglecting or forgetting sources and evidence), illusory truth (familiarity, fluency, and cohesion), reliance on source cues (elites, in-group, and attractive), emotion (emotive content and emotional state), and worldview (personal views and partisanship) [49,50]. Notably, users tend to uncritically interact with posts associated with their health beliefs, reinforcing the genesis of echo chambers on social media [51,52]. This scenario propitiates the emergence of denialist groups, characterized by their high level of engagement with health misinformation publications. In this context, anti–community water fluoridation groups’ digital activity exceeds those of their counterparts by 60 times [40]. In addition, developing health beliefs have a significant association with lifestyle and impacts on its changes [53], which could explain the high demand for this topic in our study.

    Practical Implications

    The findings may contribute to elaborating educational public health actions regarding eHealth and mobile health solutions, aiding communities in avoiding antifluoridation content on social media. Likewise, these results can orient fact-checking agencies to promptly clarify deceitful web-based publications about fluoride to their audience, addressing the concerns of users to support fluoride-containing measures. For example, issues concerning fluoride overexposure must be clarified, reinforcing safeguard actions for storing and using fluoridated products in early childhood [19,25]. Certainly, the adoption of reliable web-based health information by users can enhance individual and shared decision-making, thus contributing to better health care outcomes [54,55]. In this context, government agencies and organizations should be aware of the importance of investments in measures designed to improve the acquisition of information by the population [56,57]. Moreover, artificial intelligence–based systems may support public health actions to mitigate the propagation of false fluoride content on the web. Specifically, these solutions can automatically label publications and down-promote them until an in-depth investigation by social media companies. With insight into the underlying social media issues surrounding antifluoridation content, health professionals can ensure adequate communication with their patients based on person-centered care principles [58]. Equally important, legislators must discuss resolutions to control the spread of misinformation, specifically the role and duties of users and social media managers. Since the antifluoridation movement is substantially present in contemporary society, fluoride refusal will frequently be reported in dental offices [28].

    Limitations

    This study has some limitations. First, we used only data from Twitter for the proposed analyses. As a result, the findings are influenced by platform characteristics (eg, limitation in the word count of posts), differentiating them from other social media. Despite that limitation, previous studies also focused on Twitter data to investigate health topics on social media because of the advantages relating to data collection and the number of active users [13,59]. Second, we collected the Twitter data set from a specific keyword, which may have limited the extrapolation of outcomes to all antifluoridation content. Nevertheless, we defined the search strategy and collected the data based on a previous fluoride misinformation study [16]. Third, although the results indicate the need to control information disorder on Twitter more effectively, it is improbable that the company will modify its policies in this area due to recent changes in ownership. Fourth, trend analysis did not consider the influence of possible platform-related confounders, such as the increase or decrease in the overall number of tweets on Twitter or changes in the content moderation policy over time. However, trend patterns are likely more related to users’ interest in fluoride-free content than Twitter’s characteristics. Lastly, these findings were based only on English-language tweets, influencing the screening of fluoride-free content by cultural and regional aspects. In contrast, falsehoods tend to be found in English since it is the most spoken language in the world.

    Conclusions

    The public concerns toward a healthy lifestyle, including the adoption of natural and organic oral care products, seem to be the main motivation of the recent increase of “fluoride-free” tweets, which can be boosted by the propagation of fluoride falsehoods noted on the web. Therefore, public health authorities, health professionals, and legislators should be aware of the spread of fluoride-free content on social media to create and implement strategies against their potential health damage for the population.

    Acknowledgments

    This work was supported by the São Paulo Research Foundation (grant #2021/10732-5). The authors are grateful to Twitter for granting the use of the Twitter application programming interface.

    Data Availability

    The data sets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Exploratory data preprocessing (term frequency filtering).

    PDF File (Adobe PDF File), 117 KB
    1. Boon-Itt S, Skunkan Y. Public perception of the COVID-19 pandemic on Twitter: sentiment analysis and topic modeling Study. JMIR Public Health Surveill. Nov 11, 2020;6(4):e21978. [FREE Full text] [CrossRef] [Medline]
    2. Chung JE. A smoking cessation campaign on Twitter: understanding the use of Twitter and identifying major players in a health campaign. J Health Commun. May 2016;21(5):517-526. [CrossRef] [Medline]
    3. McClellan C, Ali MM, Mutter R, Kroutil L, Landwehr J. Using social media to monitor mental health discussions - evidence from Twitter. J Am Med Inform Assoc. May 01, 2017;24(3):496-502. [FREE Full text] [CrossRef] [Medline]
    4. Pemmaraju N, Thompson MA, Mesa RA, Desai T. Analysis of the use and impact of Twitter during American Society of Clinical Oncology annual meetings from 2011 to 2016: focus on advanced metrics and user trends. J Oncol Pract. Jul 2017;13(7):e623-e631. [FREE Full text] [CrossRef] [Medline]
    5. Tsao S, MacLean A, Chen H, Li L, Yang Y, Butt ZA. Public attitudes during the second lockdown: sentiment and topic analyses using tweets from Ontario, Canada. Int J Public Health. Feb 21, 2022;67:1604658. [FREE Full text] [CrossRef] [Medline]
    6. Zhang Y, Lyu H, Liu Y, Zhang X, Wang Y, Luo J. Monitoring depression trends on Twitter during the COVID-19 pandemic: observational study. JMIR Infodemiology. Jul 18, 2021;1(1):e26769. [FREE Full text] [CrossRef] [Medline]
    7. Kobayashi R, Takedomi Y, Nakayama Y, Suda T, Uno T, Hashimoto T, et al. Evolution of public opinion on COVID-19 vaccination in Japan: large-scale Twitter data analysis. J Med Internet Res. Dec 22, 2022;24(12):e41928. [FREE Full text] [CrossRef] [Medline]
    8. Wardle C, Derakhshan D. Information disorder: toward an interdisciplinary framework for research and policy making. Council of Europe. Sep 27, 2017. URL: https://rm.coe.int/information-disorder-toward-an-interdisciplinary-framework-for-researc/168076277c [accessed 2023-06-14]
    9. Journalism, 'fake news' and disinformation: a handbook for journalism education and training. UNESCO. 2018. URL: https://en.unesco.org/fightfakenews [accessed 2023-06-14]
    10. Douglas KM, Uscinski JE, Sutton RM, Cichocka A, Nefes T, Ang CS, et al. Understanding conspiracy theories. Polit Psychol. Mar 20, 2019;40(S1):3-35. [CrossRef]
    11. Lim S. Academic library guides for tackling fake news: a content analysis. J Acad Librariansh. Sep 2020;46(5):102195. [CrossRef]
    12. Molina MD, Sundar SS, Le T, Lee D. “Fake news” is not simply false information: a concept explication and taxonomy of online content. Am Behav Sci. Oct 14, 2019;65(2):180-212. [CrossRef]
    13. Mavragani A. Infodemiology and infoveillance: scoping review. J Med Internet Res. Apr 28, 2020;22(4):e16206. [FREE Full text] [CrossRef] [Medline]
    14. Lyu JC, Han EL, Luli GK. COVID-19 vaccine-related discussion on Twitter: topic modeling and sentiment analysis. J Med Internet Res. Jun 29, 2021;23(6):e24435. [FREE Full text] [CrossRef] [Medline]
    15. Loomba S, de Figueiredo A, Piatek SJ, de Graaf K, Larson HJ. Measuring the impact of COVID-19 vaccine misinformation on vaccination intent in the UK and USA. Nat Hum Behav. Mar 05, 2021;5(3):337-348. [CrossRef] [Medline]
    16. Lotto M, Menezes TS, Zakir Hussain I, Tsao S, Butt ZA, Morita PP, et al. Characterization of false or misleading fluoride content on Instagram: infodemiology study. J Med Internet Res. May 19, 2022;24(5):e37519. [FREE Full text] [CrossRef] [Medline]
    17. Hussain A, Tahir A, Hussain Z, Sheikh Z, Gogate M, Dashtipour K, et al. Artificial intelligence-enabled analysis of public attitudes on Facebook and Twitter toward COVID-19 vaccines in the United Kingdom and the United States: observational study. J Med Internet Res. Apr 05, 2021;23(4):e26627. [FREE Full text] [CrossRef] [Medline]
    18. Dean HT, Arnold FAJ, Elvove E. Domestic water and dental caries: V. additional studies of the relation of fluoride domestic waters to dental caries experience in 4,425 White children, aged 12 to 14 years, of 13 cities in 4 states. Public Health Rep (1896-1970). Aug 7, 1942;57(32):1155-1179. [CrossRef]
    19. Walsh T, Worthington HV, Glenny A, Marinho VC, Jeroncic A. Fluoride toothpastes of different concentrations for preventing dental caries. Cochrane Database Syst Rev. Mar 04, 2019;3(3):CD007868. [FREE Full text] [CrossRef] [Medline]
    20. Whelton HP, Spencer AJ, Do LG, Rugg-Gunn AJ. Fluoride revolution and dental caries: evolution of policies for global use. J Dent Res. Jul 2019;98(8):837-846. [CrossRef] [Medline]
    21. Belotti L, Frazão P. Effectiveness of water fluoridation in an upper-middle-income country: a systematic review and meta-analysis. Int J Paediatr Dent. Jul 2022;32(4):503-513. [CrossRef] [Medline]
    22. Pitts NB, Zero DT, Marsh PD, Ekstrand K, Weintraub JA, Ramos-Gomez F, et al. Dental caries. Nat Rev Dis Primers. May 25, 2017;3(1):17030. [FREE Full text] [CrossRef] [Medline]
    23. Ladewig NM, Camargo LB, Tedesco TK, Floriano I, Gimenez T, Imparato JCP, et al. Management of dental caries among children: a look at the cost-effectiveness. Expert Rev Pharmacoecon Outcomes Res. Apr 09, 2018;18(2):127-134. [CrossRef] [Medline]
    24. Cutress TW, Suckling GW. Differential diagnosis of dental fluorosis. J Dent Res. Feb 1990;69 Spec No:714-20; discussion 721. [CrossRef] [Medline]
    25. Whitford GM. Acute toxicity of ingested fluoride. Monogr Oral Sci. 2011;22:66-80. [CrossRef] [Medline]
    26. Guth S, Hüser S, Roth A, Degen G, Diel P, Edlund K, et al. Toxicity of fluoride: critical evaluation of evidence for human developmental neurotoxicity in epidemiological studies, animal experiments and in vitro analyses. Arch Toxicol. May 2020;94(5):1375-1415. [FREE Full text] [CrossRef] [Medline]
    27. Miranda GHN, Alvarenga MOP, Ferreira MKM, Puty B, Bittencourt LO, Fagundes NCF, et al. A systematic review and meta-analysis of the association between fluoride exposure and neurological disorders. Sci Rep. Nov 22, 2021;11(1):22659. [FREE Full text] [CrossRef] [Medline]
    28. Eliacik BK. Topical fluoride applications related posts analysis on Twitter using natural language processing. Oral Health Prev Dent. Jan 07, 2021;19(1):457-464. [CrossRef] [Medline]
    29. Twitter API developer platform. Twitter. 2023. URL: https://developer.twitter.com/en/docs/twitter-api [accessed 2023-06-14]
    30. Morita PP, Zakir Hussain I, Kaur J, Lotto M, Butt ZA. Tweeting for Health Using Real-time Mining and Artificial Intelligence-Based Analytics: Design and Development of a Big Data Ecosystem for Detecting and Analyzing Misinformation on Twitter. J Med Internet Res. Jun 09, 2023;25:e44356. [FREE Full text] [CrossRef] [Medline]
    31. Asmussen CB, Møller C. Smart literature review: a practical topic modelling approach to exploratory literature review. J Big Data. Oct 19, 2019;6(1):93. [CrossRef]
    32. Xue J, Chen J, Chen C, Zheng C, Li S, Zhu T. Public discourse and sentiment during the COVID 19 pandemic: using latent Dirichlet allocation for topic modeling on Twitter. PLoS One. Sep 25, 2020;15(9):e0239441. [FREE Full text] [CrossRef] [Medline]
    33. Jockers ML, Mimno D. Significant themes in 19th-century literature. Poetics. Dec 2013;41(6):750-769. [CrossRef]
    34. Blei DM. Probabilistic topic models. Commun ACM. Apr 01, 2012;55(4):77-84. [CrossRef]
    35. Nikolenko SI, Koltcov S, Koltsova O. Topic modelling for qualitative studies. J Inf Sci. Jul 10, 2016;43(1):88-102. [CrossRef]
    36. Kibana: explore, visualize, discover data. Elastic. 2023. URL: https://www.elastic.co/kibana [accessed 2023-06-14]
    37. Elasticsearch: the official distributed search and analytics engine. Elastic. 2023. URL: https://www.elastic.co/elasticsearch [accessed 2023-06-14]
    38. Elasticsearch platform: find real-time answers at scale. Elastic. 2023. URL: https://www.elastic.co/ [accessed 2023-06-14]
    39. Mackert M, Bouchacourt L, Lazard A, Wilcox GB, Kemp D, Kahlor LA, et al. Social media conversations about community water fluoridation: formative research to guide health communication. J Public Health Dent. Jun 2021;81(2):162-166. [CrossRef] [Medline]
    40. Mertz A, Allukian M. Community water fluoridation on the internet and social media. J Mass Dent Soc. 2014;63(2):32-36. [Medline]
    41. Basch CH, Milano N, Hillyer GC. An assessment of fluoride related posts on Instagram. Health Promot Perspect. 2019;9(1):85-88. [FREE Full text] [CrossRef] [Medline]
    42. Oh HJ, Kim CH, Jeon JG. Public sense of water fluoridation as reflected on Twitter 2009-2017. J Dent Res. Jan 2020;99(1):11-17. [CrossRef] [Medline]
    43. McLaren L, Patterson SK, Faris P, Chen G, Thawer S, Figueiredo R, et al. Fluoridation cessation and oral health equity: a 7-year post-cessation study of grade 2 schoolchildren in Alberta, Canada. Can J Public Health. Dec 07, 2022;113(6):955-968. [FREE Full text] [CrossRef] [Medline]
    44. The state of community water fluoridation across Canada. Public Health Agency of Canada. 2018. URL: https:/​/www.​canada.ca/​en/​services/​health/​publications/​healthy-living/​community-water-fluoridation-across-canada-2017.​html [accessed 2023-06-14]
    45. McLaren L, Patterson SK, Faris P, Chen G, Thawer S, Figueiredo R, et al. Fluoridation cessation and children's dental caries: a 7-year follow-up evaluation of grade 2 schoolchildren in Calgary and Edmonton, Canada. Community Dent Oral Epidemiol. Oct 26, 2022;50(5):391-403. [FREE Full text] [CrossRef] [Medline]
    46. Brooks JK, Bashirelahi N, Reynolds MA. Charcoal and charcoal-based dentifrices: a literature review. J Am Dent Assoc. Sep 2017;148(9):661-670. [CrossRef] [Medline]
    47. Neely S, Eldredge C, Sanders R. Health information seeking behaviors on social media during the covid-19 pandemic among American social networking site users: survey study. J Med Internet Res. Jun 11, 2021;23(6):e29802. [FREE Full text] [CrossRef] [Medline]
    48. Rizzato VL, Lotto M, Lourenço Neto N, Oliveira TM, Cruvinel T. Digital surveillance: The interests in toothache-related information after the outbreak of COVID-19. Oral Dis. Nov 2022;28 Suppl 2:2432-2441. [FREE Full text] [CrossRef] [Medline]
    49. Ecker UKH, Lewandowsky S, Cook J, Schmid P, Fazio LK, Brashier N, et al. The psychological drivers of misinformation belief and its resistance to correction. Nat Rev Psychol. Jan 12, 2022;1(1):13-29. [CrossRef]
    50. Marsh E, Cantor A, Brashier N. Chapter three - believing that humans swallow spiders in their sleep: false beliefs as side effects of the processes that support accurate knowledge. Pschol Learn Motiv. 2016;64:93-132. [CrossRef]
    51. Kim A, Moravec PL, Dennis AR. Combating fake news on social media with source ratings: the effects of user and expert reputation ratings. J Manag Inf Syst. Aug 04, 2019;36(3):931-968. [CrossRef]
    52. Cinelli M, de Francisci Morales G, Galeazzi A, Quattrociocchi W, Starnini M. The echo chamber effect on social media. Proc Natl Acad Sci U S A. Mar 02, 2021;118(9):e2023301118. [FREE Full text] [CrossRef] [Medline]
    53. Mäntyselkä P, Kautiainen H, Miettola J. Beliefs and attitudes towards lifestyle change and risks in primary care - a community-based study. BMC Public Health. Aug 05, 2019;19(1):1049. [FREE Full text] [CrossRef] [Medline]
    54. Barber SK, Lam Y, Hodge TM, Pavitt S. Is social media the way to empower patients to share their experiences of dental care? J Am Dent Assoc. Jun 2018;149(6):451-459.e9. [CrossRef] [Medline]
    55. Lotto M, Strieder AP, Ayala Aguirre PE, Oliveira TM, Machado MAAM, Rios D, et al. Parental-oriented educational mobile messages to aid in the control of early childhood caries in low socioeconomic children: a randomized controlled trial. J Dent. Oct 2020;101:103456. [FREE Full text] [CrossRef] [Medline]
    56. Global strategy on digital health 2020-2025. World Health Organization. 2021. URL: https://apps.who.int/iris/handle/10665/344249 [accessed 2023-06-14]
    57. Norman CD, Skinner HA. eHealth literacy: essential skills for consumer health in a networked world. J Med Internet Res. Jun 16, 2006;8(2):e9. [FREE Full text] [CrossRef] [Medline]
    58. American Geriatrics Society Expert Panel on Person-Centered Care. Person-centered care: a definition and essential elements. J Am Geriatr Soc. Jan 02, 2016;64(1):15-18. [CrossRef] [Medline]
    59. Number of Twitter users worldwide from 2019 to 2024. Statista. 2023. URL: https://www.statista.com/statistics/303681/twitter-users-worldwide/ [accessed 2023-06-14]

    ‎
    LDA: latent Dirichlet allocation

    Edited by A Mavragani; submitted 24.11.22; peer-reviewed by C Remmel, R Weeks, R Kobayashi, C Eldredge; comments to author 29.01.23; revised version received 18.03.23; accepted 07.06.23; published 20.06.23.

    Copyright

    ©Matheus Lotto, Irfhana Zakir Hussain, Jasleen Kaur, Zahid Ahmad Butt, Thiago Cruvinel, Plinio P Morita. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 20.06.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.