Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/40057, first published .
Applications of Social Media and Digital Technologies in COVID-19 Vaccination: Scoping Review

Applications of Social Media and Digital Technologies in COVID-19 Vaccination: Scoping Review

Applications of Social Media and Digital Technologies in COVID-19 Vaccination: Scoping Review

Review

1School of Public Health, Fudan University, Shanghai, China

2Global Health Institute, Fudan University, Shanghai, China

3Department of Infectious Disease Epidemiology, London School of Hygiene & Tropical Medicine, London, United Kingdom

4Laboratory of Data Discovery for Health (D24H), Hong Kong Science Park, Hong Kong, SAR, China

*these authors contributed equally

Corresponding Author:

Zhiyuan Hou, PhD

School of Public Health

Fudan University

130 Dong’an Road

Shanghai, 200032

China

Phone: 86 21 33563935

Email: zyhou@fudan.edu.cn


Background: Social media and digital technologies have played essential roles in disseminating information and promoting vaccination during the COVID-19 pandemic. There is a need to summarize the applications and analytical techniques of social media and digital technologies in monitoring vaccine attitudes and administering COVID-19 vaccines.

Objective: We aimed to synthesize the global evidence on the applications of social media and digital technologies in COVID-19 vaccination and to explore their avenues to promote COVID-19 vaccination.

Methods: We searched 6 databases (PubMed, Scopus, Web of Science, Embase, EBSCO, and IEEE Xplore) for English-language articles from December 2019 to August 2022. The search terms covered keywords relating to social media, digital technology, and COVID-19 vaccines. Articles were included if they provided original descriptions of applications of social media or digital health technologies/solutions in COVID-19 vaccination. Conference abstracts, editorials, letters, commentaries, correspondence articles, study protocols, and reviews were excluded. A modified version of the Appraisal Tool for Cross-Sectional Studies (AXIS tool) was used to evaluate the quality of social media–related studies. The review was undertaken with the guidance of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews.

Results: A total of 178 articles were included in our review, including 114 social media articles and 64 digital technology articles. Social media has been applied for sentiment/emotion analysis, topic analysis, behavioral analysis, dissemination and engagement analysis, and information quality analysis around COVID-19 vaccination. Of these, sentiment analysis and topic analysis were the most common, with social media data being primarily analyzed by lexicon-based and machine learning techniques. The accuracy and reliability of information on social media can seriously affect public attitudes toward COVID-19 vaccines, and misinformation often leads to vaccine hesitancy. Digital technologies have been applied to determine the COVID-19 vaccination strategy, predict the vaccination process, optimize vaccine distribution and delivery, provide safe and transparent vaccination certificates, and perform postvaccination surveillance. The applied digital technologies included algorithms, blockchain, mobile health, the Internet of Things, and other technologies, although with some barriers to their popularization.

Conclusions: The applications of social media and digital technologies in addressing COVID-19 vaccination–related issues represent an irreversible trend. Attention should be paid to the ethical issues and health inequities arising from the digital divide while applying and promoting these technologies.

J Med Internet Res 2023;25:e40057

doi:10.2196/40057

Keywords



The COVID-19 pandemic has greatly accelerated the applications of social media and digital technologies. As a digital tool that allows real-time information sharing, social media has become a platform to not only voice public opinions, perceptions, and attitudes toward public health policies or events but also help governments and the public to exchange information in a timely manner [1]. However, it can lead to the spread of misinformation and disinformation [2], which may adversely affect public responses to the pandemic. At the same time, the application of digital technologies has facilitated the management and responses of the COVID-19 pandemic and other emerging infectious diseases in ways that are difficult to achieve manually [3,4].

The use of social media “big data” for public health surveillance and behavior monitoring is a rapidly growing field, allowing researchers to understand public attitudes and behaviors toward vaccines and other health issues [1,5,6]. Many previous studies have used data from social media platforms, such as Twitter and Facebook, to analyze COVID-19 vaccine acceptance and responses to the COVID-19 infodemic, vaccination-related misinformation, and rumors [1,7-10]. Several studies have also explored applications of digital technologies for controlling the COVID-19 pandemic, such as COVID-19 planning and tracking, screening for infection, contact tracing, and clinical management through artificial intelligence algorithms, blockchain, the Internet of Things (IoT), and big data analytics [3,4,11]. Many countries have launched mobile health (mHealth) apps to support COVID-19 vaccination services, such as vaccination certification and health monitoring [12,13].

Widespread distribution, acceptance, and uptake of COVID-19 vaccines are crucial for reducing severity and deaths due to infections. During the first year of global vaccination efforts, COVID-19 vaccines are estimated to have saved 19.8 million lives [14]. However, COVID-19 vaccination faces various challenges, including the formation of national or state-level vaccination strategies; community-wide vaccine storage, distribution, and delivery; and changes in public acceptance and confidence in vaccines. Social media and digital technologies have great potentials for applications in addressing these vaccination challenges, yet there is a lack of a literature review summarizing these applications. Our scoping review aimed to synthesize the global evidence on the applications of social media and digital technologies in COVID-19 vaccination. We documented the forms of digital tools, analysis techniques, application fields, and findings for COVID-19 vaccination that would benefit the advancement of COVID-19 vaccination and other future vaccination campaigns.


Data Search and Screening

The scoping review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) [15]. The PRISMA-ScR checklist is shown in Multimedia Appendix 1. We searched 6 peer-reviewed databases (PubMed, Scopus, Web of Science, Embase, EBSCO, and IEEE Xplore) for English articles published from December 1, 2019, to August 17, 2022. The search terms covered keywords relating to social media, digital technology, and COVID-19 vaccine, as shown in Table 1. The detailed search strategy for each database is shown in Multimedia Appendix 2.

Table 1. Literature search terms for the review.
CategoryKey search terms
Social media“social media,” “mass media,” “social networking,” “social network,” “internet,” “webcast,” “blogging,” “online community,” “online post,” “facebook,” “twitter,” “youtube,” “Instagram,” “weibo,” “wechat,” “tiktok,” “line,” “reddit,” “whatsapp,” “telegram,” “mobile application*,” “mobile app,” “chat bots”
Digital technology“digital,” “digital health,” “digital technology,” “digital platform*,” “big data,” “data sharing,” “cloud computing,” “block chain,” “artificial intelligence,” “AI,” “natural language,” “deep learning,” “machine learning,” “neural network,” “information technology,” “internet of thing*,” “IoT,” “crowdsourcing,” “telemedicine,” “telehealth,” “mhealth,” “mobile health,” “ehealth,” “telecommunication*,” “remote consultation,” “teleconsultation*,” “telesupport,” “telemonitoring”
COVID-19“COVID-19,” “covid,” “coronavirus,” “coronavirus disease 2019,” “2019-nCov,” “Severe acute respiratory syndrome coronavirus 2,” “sars-cov-2”
Vaccine“vaccin*,” “immunis*,” “immuniz*”
COVID-19 vaccine“COVID-19 vaccin*”

Two reviewers independently conducted initial screening for titles/abstracts and final screening for full texts to decide whether an article met the inclusion criteria. When discrepancies for included articles emerged, they carried out discussions together to reach a consensus. Articles were included if they provided original descriptions of the applications of social media or digital health technologies/solutions in COVID-19 vaccination. Specifically, original studies with original data or results referring to social media or digital tools/interventions for COVID-19 vaccination were included, and included studies covered experimental studies, cohort studies, case-control studies, observational studies (cross-sectional studies or surveys), case series/case studies, and description studies. The included studies involved at least one application of social media or digital tools/interventions in COVID-19 vaccination. We excluded studies that (1) investigated a non–COVID-19 vaccine, prevaccine development, or the COVID-19 pandemic instead of the COVID-19 vaccine; (2) did not investigate online media; and (3) did not focus on social media or digital technologies in COVID-19 vaccination. We also excluded the following study types: conference abstracts, editorials, letters, commentaries, correspondence articles, study protocols, and reviews.

Quality Assessment

Due to the significant variation in the quality of social media–related studies, we used a modified version of the Appraisal Tool for Cross-Sectional Studies (AXIS tool in Multimedia Appendix 3) to evaluate their quality [16]. Two reviewers conducted this quality assessment, and the risk of bias was presented as “low risk,” “some concerns,” or “high risk.” Articles with a score of 12 or above were identified as having a low risk of bias and kept for our review. Since there was no assessment tool applicable for digital technology–related studies and no significant differences were found in their quality, we did not assess the quality of the included digital technology articles.

Data Extraction and Analysis

For each included article, 2 researchers extracted data independently and discussed any discrepancies to reach a consensus. The extracted data included article information (title, first author, and journal), study period, study design, data sources, study population and sample size, information on social media (social media platforms, application domains, analysis technologies, and findings), information on digital technologies (names/types of digital technologies, application domains, and applications in detail), and future research/suggestions. The innovation features and generalizability of identified digital technologies/solutions were also evaluated and summarized. According to the report on digital technologies in health services from the Expert Panel on Effective Ways of Investing in Health (EXPH) [17], the innovation features of digital technologies/solutions could be supportive, complementing, innovative, or substitutive to existing/previous technologies. The generalizability covered the following 3 groups: not possible (strict bond to the context in which it was developed), local (scalability is limited to a local regional context), and global (no barriers to scalability for global adoption) [18].

This review was divided into the following 2 modules: applications of social media and applications of digital technologies/solutions in COVID-19 vaccination. After reviewing social media or digital technologies used in each article, we grouped their applications into several fields relating to COVID-19 vaccination and summarized these techniques and critical findings.

Patient and Public Involvement

Patients or the public were not involved in the design, conduct, reporting, or dissemination plans of our research.

Ethics Approval

Ethics approval was waived since this is a secondary analysis of published articles.


Included Articles

After the eligibility assessment, 178 articles were included in this review, including 114 studies on social media applications with a low risk of bias and 64 on digital technologies for COVID-19 vaccination (Figure 1).

Figure 1. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flowchart.
View this figure

Applications of Social Media in COVID-19 Vaccination

Social media applications in COVID-19 vaccination mainly involved Twitter (87/114), Facebook (10/114), and YouTube (9/114). The applications covered the following 5 aspects: sentiment/emotion analysis (70/114), topic analysis (53/114), behavioral analysis (3/114), dissemination and engagement analysis (9/114), and information quality analysis (7/114). Details of the included social media studies are presented in Multimedia Appendix 4.

Sentiment/Emotion Analysis

Seventy articles conducted sentiment/emotion analysis through social media applications to identify public sentiments and opinions toward COVID-19 vaccines. The approaches of sentiment analysis included lexicon-based approaches (n=40), machine learning approaches (n=19), hybrid methods (n=7), and manual coding classification (n=4). Forty studies applied the lexicon-based sentiment analysis method, using predefined lexicons annotated with sentiment polarities (eg, positive, negative, or neutral) to determine sentiments expressed in the parsed text [19-58]. TextBlob and VADER (Valence Aware Dictionary and Sentiment Reasoner) were 2 well-known rule-based lexical sentiment analyzers [19,25,26,33,37-41,43,44,46,49,51,53,56-58]. Moreover, 11 studies further predicted the emotion types expressed in the tweets [20,21,23,26,32,37,45,50,53,54,58], and 8 classified emotions as “trust, surprise, sadness, joy, anticipation, disgust, fear, and anger” using the National Research Council Sentiment Lexicon [20,23,32,37,45,50,54,58].

Nineteen sentiment analysis studies were based on machine learning, and they trained machine learning classifiers by annotating tweets in the data set [59-77]. Machine learning approaches used supervised classification algorithms to extract information regarding sentiment polarity. Classical machine learning models mainly included naïve Bayes, support vector machine, random forest, decision tree, and logistic regression [60,61,67,70,76]. Additional machine learning techniques for polarity classification were Microsoft Azure cognitive services, Amazon Web Services (AWS), and Baidu’s AipNLP [59,64,75]. Deep learning techniques mainly used convolutional neural networks, recurrent neural networks, bidirectional long short-term memory (LSTM), and Bidirectional Encoder Representations from Transformers [63,65,66,68,71,77].

Seven studies employed hybrid methods combining lexicons and machine learning for polarity classification [7,78-83]. Accuracy, precision, recall, and F1 score were typically used to evaluate the performance of classification models [61,68-70]. In terms of model performance, 3 studies showed that LSTM outperformed other classifiers [68,70,78].

These sentiment analysis studies showed that public sentiments were associated with real-time news, internet information, public health events, the number of COVID-19 cases, vaccine development, the pandemic, and announcements of political leaders or authorities [7,21,27,31,51,52,55,56,58,65]. Although public sentiments on COVID-19 vaccines varied significantly over time and geography [7,33,39], positive sentiments were more prevalent than negative ones regarding COVID-19 vaccines [7,19,20,22,25,29,33,41-44,46,47,51,57,60,62,65,70, 72,76,78,84,85], with trust and anticipation being the predominant emotions [20,23,32,37,50,54,58]. However, some other studies found that negative sentiments overwhelmed positive ones, with fear being the dominant emotion [53,59,64,66,71,73,79-82,86]. Positive sentiments were found to be mainly related to increased vaccine coverage, vaccine development, vaccination research, and health services [31,57,67,69], whereas negative sentiments were positively associated with increased COVID-19 cases, misinformation, conspiracy theories, and fear regarding vaccine safety [21,55]. Socioeconomically disadvantaged groups were more likely to hold polarized opinions on COVID-19 vaccines [22]. People with bad experiences during the pandemic were more likely to hold antivaccine opinions [22], whereas comments on posts from health media and hospitals had more positive attitudes [74]. Social media posts on Pfizer and Moderna vaccines appeared to be more positive than posts on COVID-19 vaccines from other manufacturers [24,77,83].

Topic Analysis

Fifty-three studies applied social media for topic analysis on COVID-19 vaccination. Topic analysis methods included latent Dirichlet allocation (LDA) topic modeling (n=24) [20,23,25,31,34,35,40,47,50,51,54-56,58,60,61,64,87-93], manual coding (n=17) [57,80,94-108], and other algorithms (n=12) [26,43,62,109-117]. Table 2 summarizes the provaccine and antivaccine topics on COVID-19 vaccines present on social media.

Topic analysis identified various attitudes and opinions toward COVID-19 and its vaccine, with main topics focusing on vaccination policy, vaccine development, vaccine administration and access, vaccination propaganda, vaccine efficacy and side effects, vaccine hesitancy, and conspiracy theories [26,43,47,50,55,61,64,90,100,101]. Vaccine objection and hesitancy were generally more prevalent than vaccine support [57], although opinion patterns differed by studies. Vaccine hesitancy mainly stemmed from safety concerns, mistrust in the government and pharmaceutical companies, lack of knowledge, conspiracy theories, skepticism about vaccine development and approval, vaccine ineffectiveness, and loss of freedom [20,25,43,55,56,87-89,93,96-98,100,106,111,112]. The dominant concerns regarding COVID-19 vaccines were safety issues and side effects, such as fear of death and allergic reactions to COVID-19 vaccines [56]. Pain, fever, and fatigue were the 3 most common adverse reactions reported by the public [109,117]. Antivaccine topics varied across social media platforms. For example, the activities of antivaxxers on Facebook and Twitter focused on distrust in the government and allegations regarding vaccination safety and effectiveness, while discussions on TikTok focused on individual freedom [105]. Topics on social media also changed over time. Liu et al found that the prevalence of tweets with positive behavioral intentions increased over time [93].

Additionally, public discussions were mainly driven by COVID-19 vaccine–related news, major social events, pandemic severity, and statements issued by authorities [23,26,34,51,58,87,89]. Regarding information sources, authoritative and reliable information disseminators, such as government agencies, major media outlets, and key opinion leaders, played massively influential roles in polarizing opinions, which can amplify or contain the spread of misinformation among target audiences. Positive discourses were more likely to interact with verified sources, such as news organizations, health professionals, and media/journalists, while negative discourses tended to interact with politicians and personal accounts [40,114].

Table 2. Provaccine and antivaccine topics from thematic analysis on social media articles.
Category and subcategoryExplanation
Provaccine

Safety and efficacyContent on confidence in the safety or efficacy of vaccines.

Positive attitudeContent reflecting positive attitudes toward vaccines and government measures. It includes viewing vaccination as an act of dismantling systemic racism, being positive about the development of vaccines and antivirals, and expressing concerns on the antivaccine movement.

Criticizing antivaccine beliefsContent that expresses support for vaccines by blaming antivaxxers. It includes accusing, ridiculing, and insulting antivaxxers for spreading falsehoods and misinformation.

PromotionContent that advocates infection control measures and touts the prior success of immunizations.
Antivaccine

Safety or effectiveness concernsContent that lacks confidence in the safety or efficacy of vaccines, such as fear of health hazards, side effects, allergic reactions, or death attributable to vaccines; skepticism about vaccine trials; and inability of vaccines to prevent COVID-19.

Vaccine alternativesContent that believes there are better immunization options than vaccines. It includes belief in God’s protection; protective behaviors, such as sunbathing, healthy eating, and exercise; and natural immunity from COVID-19 infection.

Morality and ethicsContent of vaccines offending liberty. It includes mandatory government policies, and loss of personal choice and freedom.

MisinformationContent that disseminates false information about side effects, and vaccine production and transport. It includes scientific misinformation directly contrary to vaccine research and political misinformation of untrue government interventions.

ConspiracyContent on scientific, political, or racial conspiracy theories. It includes deliberately created viruses, nonexistence of vaccines, microchips in vaccines, conflicts of interest between the government and pharmaceutical companies, genocide conspiracies, and right-wing politics.

Vaccine hesitancyContent refers to delay in acceptance or refusal of vaccination despite availability of vaccination services.
Behavioral Analysis

Three studies used social media to analyze behavioral intention and search behavior for COVID-19 vaccination [118-120]. Positive behavioral intention was influenced by reduced risk of infection, socioeconomic recovery, and normal life recovery. In contrast, negative behavioral intention was associated with misconceptions about vaccines and diseases, trust in natural immunity, distrust in the government and vaccines, and lack of knowledge [120]. Search interests regarding misinformation, generic information about vaccines, and availability of vaccines changed throughout the pandemic [118].

Dissemination and Engagement Analysis

Nine studies conducted dissemination and engagement analysis on social media regarding COVID-19 vaccination [19,51,106,114,121-125]. Social media engagement metrics included popularity based on the number of likes, commitment based on the number of comments, and virality based on the number of post shares. The betweenness centrality score is a traditional social network analysis technique used to discover the most influential users on social media [125]. Observing and analyzing the most attention-capturing tweets may help craft a better vaccine information policy. Compared to other social media platforms, Facebook was the most popular analyzed social media platform, followed by Twitter [106]. COVID-19 posts were more widely disseminated and showed more significant influence than non–COVID-19 posts [124]. Specifically, “antivaccine” groups were highly engaged in the COVID-19 vaccine discussion [121,122], and antivaccine sentiment was especially salient in the political right cluster [122]. Health care professionals had an essential role in supporting vaccine activities, and the highest active professional groups were pharmacists, nurses, physicians, and psychologists [125].

Information Quality Analysis

Seven studies assessed the reliability and quality of information about COVID-19 vaccination on social media according to the checklist and quality criteria for health information [125-131]. Reliability and credibility were assessed by the modified Health on the Net Foundation Code of Conduct (HONCode), and quality and reliability were evaluated according to DISCERN criteria. Studies showed that most videos were of high quality with good integrity, comprehensibility, relevance, depth, and accuracy of the information provided, and videos with factual information were higher in quality than those with nonfactual information [127,128,131]. Sources of high-quality videos were pharmaceutical companies, pharmacists, society organizations, and academics, while news provided a high percentage of low-quality videos [128]. COVID-19 vaccination FAQ websites provided quality information, but more effort should be taken to make the content more readable and to update the content [130]. The reputation, expertise, and presentation qualities of the authors were the main criteria for evaluating their credibility, while the credibility of antivaxxers as creators of vaccine-related information was very low [126].

Applications of Digital Technologies in COVID-19 Vaccination

Among the included 64 articles (Multimedia Appendix 5), there were 5 types of digital technologies: algorithms (33/64), blockchain (21/64), mHealth (10/64), IoT (4/64), and other technologies, including online tools, biometrics, cloud storage, and digital twin (5/64). Traditional mathematical models, machine learning, and deep learning algorithms were classified as algorithm technologies. Mobile apps and mobile tracking through mobile and wireless technologies were classified as mHealth [132]. Blockchain was regarded as an essential technology. Most digital technology studies did not mention the research design but described a digital technology/solution for a specific field in COVID-19 vaccination. The applications covered the following 6 fields of COVID-19 vaccination (Table 3): strategy of COVID-19 vaccination (9/64), distribution and delivery of COVID-19 vaccines (22/64), model prediction of COVID-19 vaccination (6/64), COVID-19 vaccination services (11/64), certification of COVID-19 vaccination (13/64), and postvaccination surveillance (3/64).

Table 3. Applications of digital technologies in COVID-19 vaccination.
Field of COVID-19 vaccinationAlgorithmBlockchainMobile healthInternet of Things (IoT)Others
Strategy of COVID-19 vaccination
  • XGBoost model [133,134]
  • Genetic algorithms [135,136]
  • Fuzzy logic system [137]
  • Random forest [134]
  • Logistic regression [134]
  • Long short-term memory [138]
  • Autoregressive Integrated Moving Average Model [138]
  • Reinforcement learning [139]
  • Disease propagation graph [140]
  • Spatial artificial intelligence [141]
N/AaN/AN/AN/A
Distribution and delivery of COVID-19 vaccines
  • No specifics [142,143]
  • Spatiogeographical model, minimum-cost flow problem, and self-designed scheduling algorithm [144]
  • Double Deep Q-Network, Advantage Actor Critic, Trust Region Policy Optimization, Actor-Critic using Kronecker-Factored Trust Region, and Linear Upper Confidence Bounds model [145]
  • Long short-term memory [146,147]
  • Gray Wolf Optimization [148]
  • Variable neighborhood search [148,149]
  • Whale Optimization Algorithm [149]
  • Artificial neural network and convolutional neural network [150]
  • Heuristic algorithm [151]
  • Machine learning [152]
  • Unsupervised self-organizing map, recurrent neural network, and Stochastic Mixture Density Network [147]
N/A
  • No specifics [142,143,162]
  • Software-Defined Networking-IoT model [163]
  • 5G-UAVCN [157]
  • 6G-eRLLC [161]
Model prediction of COVID-19 vaccination
  • Logistic regression [164]
  • Linear regression [165,166]
  • AdaBoost [164,167]
  • Boost classification [166]
  • Decision tree [164,165]
  • Random forest [164,166,167]
  • Long short-term memory [168,169]
  • DeepAR [169]
  • Support vector machine [165]
  • Autoregressive model [166]
  • Extra trees [167]
  • Gradient boosting [167]
  • XGBoost [167]
N/AN/AN/AN/A
COVID-19 vaccination services
  • AnyLogic model and a trained neural network [170]
  • Accelerated Dual Ascent [171]
  • Decreasing order-based algorithm, iterative random algorithm, and clustering algorithm [172]
  • K-means clustering [173]
N/A
  • App [174-177]
  • Personalized message/email [178]
N/A
  • Online tool [179]
  • Cloud storage [180]
  • Digital twin [177]
Certification of COVID-19 vaccination
  • Yolov5 deep learning model [181]
  • Dense convolutional networks [182]
  • Convolutional neural networks [183]
  • Ethereum [184-186]
  • Smart contract [184,187-189]
  • Hash algorithm [190]
  • Blockchain adaptor (Canis Major) [191]
  • Mobile phone app [186]
  • A digital Yellow Card on mobile phone [192]
N/A
Postvaccination surveillanceN/A
  • Smart contract [194]
  • Mobile app (Respon) [195]
  • Mobile app (vaxEffect@UniMiB) [196]
N/AN/A

aN/A: not applicable.

Strategy of COVID-19 Vaccination

Nine articles [133-141] explored the applications of digital technologies in the strategy of COVID-19 vaccination. Machine learning algorithms were mainly applied to this field to help governments formulate better vaccination strategies in different scenarios. These digital solutions supported and complemented previous technologies, and the main barriers to their promotion lay in their data sources.

Four articles [135,136,138,139] tested COVID-19 mitigation strategies and the best vaccination criteria to minimize the number of infections and deaths. The remaining 5 studies [133,134,137,140,141] focused on priority groups and areas for COVID-19 vaccination. The unified Hierarchical Priority Classification-XGBoost model represented a significant improvement in predicting priorities for COVID-19 vaccination [133]. The Susceptible-Infected-Recovered model and a disease propagation graph simulated the optimum distribution of COVID-19 vaccines based on contact tracing data from cellular networks and Bluetooth signals [140]. Spatial artificial intelligence and satellite imagery were used to identify the location of vulnerable populations and target vaccination populations [141].

Distribution and Delivery of COVID-19 Vaccines

Twenty-two articles [142-163] involved the applications of digital technologies in the distribution and delivery of COVID-19 vaccines. Blockchain and algorithms were the leading technologies used in this field to optimize the distribution of COVID-19 vaccines. The prominent innovation feature was to support the existing vaccine distribution system, and the biggest promotion obstacles were blockchain-related technical issues, health care infrastructure issues, and data source issues.

The current platforms failed to meet the various storage and delivery conditions for different brands of COVID-19 vaccines [197-199], and blockchain was increasingly used to monitor the whole process from production to delivery, and to ensure vaccine safety in the supply chain. The blockchain applications in this field included Ethereum [155,156] and smart contracts [156-161], which could manage the data on COVID-19 vaccine distribution and automate traceability. The Ethereum solution was a decentralized application platform built on blockchain technology at a low cost, and smart contracts were automatically executable and code-based transactions on the blockchain, which were secure enough to avoid possible attacks and vulnerabilities [155]. Blockchain combined with unmanned aerial vehicle communication networks can ensure transparency of the vaccine supply chain and mitigate security attacks [157,161]. Additionally, 11 studies [142-152] utilized algorithms, such as LSTM, machine learning regression, and artificial neural networks, to design optimal vaccine distribution strategies, monitor vaccine storage temperature, and address supply chain issues.

Model Prediction of COVID-19 Vaccination

Six articles [164-169] applied algorithms in the model prediction of COVID-19 vaccination. Five of them focused on the prediction of vaccination progress and vaccination coverage from a specific country to the global context [165-169]. These algorithms mainly complemented and supported existing algorithms, with no obvious barriers to promotion. Besides the prediction of vaccine coverage, machine learning algorithms were used to analyze data from the vaccine adverse event reporting system to predict the safety of different COVID-19 vaccines across age groups [164].

COVID-19 Vaccination Services

Eleven articles [170-180] aimed to improve the efficiency and quality of COVID-19 vaccination services through algorithms and mHealth apps, as a support or complement to current vaccination services. Technical issues, such as operator difficulty in adopting these technologies, hindered the promotion of these technologies.

During the pandemic, drive-through clinics had been proposed as one of the effective approaches for temporary mass COVID-19 vaccination [200,201]. Machine learning models can help quickly assess the potential output of and design a smart parking system for drive-through vaccination clinics [170,172]. Digital technologies were also used to examine the accessibility of vaccine registration websites to ensure that the disabled can independently schedule vaccination appointments [179], to develop a multilingual app to facilize people with limited local language skills [174], to schedule people at more suitable vaccination centers [171], to remind about the next vaccination date [176], and to provide personalized emails/messages for vaccination promotion [178].

Certification of COVID-19 Vaccination

Thirteen articles [181-193] applied blockchain, mHealth, algorithms, and biometric technologies for COVID-19 vaccination certification. Eight of these studies were considered innovative, but some digital solutions had technical barriers, transaction costs, and ethical barriers to promotion. Many countries promoted vaccination certification to enable individuals to return to normal life [202,203]. The COVID-19 vaccination certificate built on blockchain technology had the advantages of decentralization, interoperability, security, transparency, and antitampering. Biometric technologies, such as face recognition [181,183] and iris recognition [193], were used to identify vaccination status, where deep learning algorithms like the Yolov5 model and convolutional neural networks can help perform this process. However, the promotion of biometric technologies may face ethical and data privacy issues. An artificial intelligence bot was also developed to detect fake vaccine certificates [182].

Postvaccination Surveillance

Three articles [194-196] focused on postvaccination surveillance. Two studies monitored adverse events following immunization through user-initiated reports in mobile apps (Respon and vaxEffect@UniMiB) [195,196], and another study established a dynamic monitoring model on COVID-19 vaccine effectiveness through health code blockchain [194]. As an innovative digital solution, technology realization was the main barrier to rollout.


Principal Findings

Our review synthesized the global evidence on the applications of social media and digital technologies in COVID-19 vaccination. Social media has been applied to conduct sentiment/emotion analysis, topic analysis, behavioral analysis, dissemination and engagement analysis, and information quality analysis around COVID-19 vaccination. Sentiment/emotion analysis and topic analysis were the most dominant social media applications, while other applications were relatively few. Lexicon-based and machine learning approaches were developed to analyze massive textual data on social media. The development of digital technologies provided opportunities to determine the COVID-19 vaccination strategy, predict the vaccination process, optimize vaccine distribution and delivery, provide safe and transparent vaccination certificates, and perform postvaccination surveillance. The applied digital technologies included algorithms, blockchain, mHealth, IoT, and other technologies. Although these technologies have been successfully tried, there are still some barriers to their popularization.

We found that machine learning algorithms were widely applied in all 5 major COVID-19 vaccination fields, except postvaccination surveillance. Specifically, machine learning algorithms were applied to forecast the spread of the virus as well as the vaccination process [204], and an ensemble learning method with two or more learning algorithms could obtain better predictive performance than a single learning algorithm [205]. Blockchain was mainly used in vaccine distribution and vaccination certification, and mHealth, especially in the form of mobile apps, was a common technology in vaccination services, vaccination certification, and postvaccination surveillance. Blockchain technology was promoted owing to the security flaws and high costs of IoT [206,207]. As a blockchain platform, Ethereum [208] could execute smart contracts and be executed by all nodes in the peer-to-peer network. The Ethereum solution proposed by Musamih et al was generic and could be adapted to any type of vaccine tracing and monitoring program [155].

Although digital technologies had been applied to all aspects of COVID-19 vaccination and pandemic response [4], these digital predictions need to be verified for practicality in the real world. Digital technologies build a digital mirror of the real world to simulate the impact of various scenarios in virtual environments, which still need validation in the real world, namely digital twin [209]. Digital twin technology has been successfully used in many fields, including health care, and should also be used in vaccination [210,211]. Although the applications of digital technologies in addressing COVID-19 vaccination presented an irreversible trend and some technologies could be promoted for global adoption, most digital technologies still faced barriers to generalizability and scalability due to normative, legislative, ethical, or technical reasons [18]. For example, the adoption of blockchain involved technical issues, and the application of vaccination certification introduced ethical problems. Attention should be paid to legal and ethical issues when promoting these digital technologies.

Social media has been widely used to analyze public attitudes and behaviors during the COVID-19 pandemic [1], including vaccination attitudes and behaviors. In our review, most applications of social media in COVID-19 vaccination concentrated on content analysis, such as the sentiments expressed and the topics discussed on social media, but neglected the authenticity and reliability of relevant content in the context of “infodemic.” Social media analysis can help evaluate the information environment that the public is exposed to and its influences on vaccination. In the future, it is imperative to explore how to utilize social media platforms to intervene and increase the public’s willingness to undergo vaccination. Information released by authoritative institutions and professionals was generally of better quality than other sources, although there was limited evidence. The nature of social media contributes to celebrities and influencers having a tremendous amount of influence over what information is disseminated. More studies are warranted to assess the quality and reliability of information on social media [212] and how statements from the most influential people or institutions influence public attitudes toward vaccines.

During the COVID-19 epidemic, a considerable amount of COVID-19–related information is being spread through social media, resulting in an “infodemic” [213]. The endless stream of misinformation and rumors has led to negative public sentiments and irrational behaviors regarding the COVID-19 vaccine. Our review revealed that conversations about vaccine hesitancy were prevalent on social media, but tweets about vaccine advocacy and vaccine facts can improve public confidence. Moreover, information posted by authoritative social media users, such as governments and health professionals, can curb the spread of misinformation and consequently reduce vaccine hesitancy. In response to public concerns about vaccine safety and efficacy, and distrust in governments, the promotion of scientific data and the accuracy of the content on social media are critical to reduce negative public attitudes toward COVID-19.

The most used analysis techniques in social media studies were lexicon-based techniques and machine learning or deep learning techniques, which code and classify textual social media posts for analysis. A predefined lexicon can be used to code social media posts, and punctuation and negation need to be considered for its usage. TextBlob and VADER are 2 well-known lexicon-based techniques. Machine learning techniques can automatically analyze social media data by training classifiers through the annotation of a sampled data set, which significantly improves the accuracy and confidence of classification analysis. They have been increasingly used for social media analysis. The most used algorithms for machine learning were support vector machine and naïve Bayes, while the main deep learning algorithms were convolutional neural networks, recurrent neural networks, LSTM, and Bidirectional Encoder Representations from Transformers.

LDA topic modeling, an unsupervised machine learning algorithm, was widely used for clustering topics on social media. LDA has excellent performance in the traditional long text processing field, but its performance for short text is lacking [214]. As an unsupervised text classification algorithm based on the “bag-of-words model,” LDA may lead to the misclassification of short-text posts [215]. Nonnegative matrix factorization may produce higher-quality topics than LDA in short texts, and has been proven to be one of the most influential topic detection methods [216]. Furthermore, an improved Between Cluster-Balanced Iterative Reducing and Clustering using Hierarchies algorithm was proposed to reduce the number of classifications and provide a new model for topic discovery [214]. More effective algorithms are still needed for topic analysis in social media posts.

Limitations

Our review has certain limitations. First, all included articles were in English, which may lead to limitations in the results. Second, social media users were skewed to young people, potentially disproportionately excluding older people or people with poor access to the internet, which may lead to bias when extrapolating the study results. Third, there may be some deficiencies in the models or algorithms in digital technical articles. For example, although the unsupervised clustering method allowed the classification of data quickly, the specific meaning of each cluster was unavailable and the reasons behind the clusters and exceptions were unclear. Finally, since COVID-19 is an emerging infectious disease and it takes time for studies to be published, there may exist more grey literature or preprint studies. Grey literature was not included in our review, which may lead to incomplete results.

Conclusion

The applications of social media and digital technologies to address COVID-19 vaccination–related issues represent an irreversible trend. As a platform for public discourse, the prominent applications of social media were sentiment and topic analyses, and machine learning techniques were the most used technologies. It is warranted to review the accuracy and reliability of social media information and explore how to improve vaccination via social media. Digital technologies, such as machine learning algorithms and blockchain, have been widely applied to determine the COVID-19 vaccination strategy, predict the vaccination process, optimize vaccine distribution and delivery, provide safe and transparent vaccination certificates, and perform postvaccination surveillance. Attention should be paid to the ethical issues and health inequities arising from the digital divide while applying and promoting these technologies.

Acknowledgments

ZH acknowledges financial support from Merck Investigator Initiated Studies (61185). Leesa Lin’s work was supported by AIR@InnoHK administered by Innovation and Technology Commission. We thank Ying Zhang, Ying Tao, and Yuting Chen from the School of Public Health, Fudan University for helping with data collection. The funders had no role in the study design, data collection, data analysis, data interpretation, or writing of the report.

Authors' Contributions

ZH conceived the review. ZH, SZ, and XZ refined the search strategy. SZ and XZ searched for articles. SZ, XZ, YX, and JC screened and extracted the articles. SZ and XZ analyzed the data and wrote the first draft of the manuscript. ZH and LL revised the manuscript. ZH supervised the review process and prepared the final draft for submission. All authors read and approved the final manuscript.

Conflicts of Interest

ZH has received research grants from Merck. The other authors do not have any conflicts of interest to declare.

Multimedia Appendix 1

PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist.

DOCX File , 27 KB

Multimedia Appendix 2

Search strategy for the 6 peer-reviewed databases.

DOCX File , 28 KB

Multimedia Appendix 3

Scoring system for social media–based studies using the AXIS tool.

DOCX File , 23 KB

Multimedia Appendix 4

Characteristics, methods, and key findings of the included social media articles (n=114).

DOCX File , 59 KB

Multimedia Appendix 5

Characteristics, applications, innovation features, and generalizability of the included digital technology articles (n=64).

DOCX File , 45 KB

  1. Tsao S, Chen H, Tisseverasinghe T, Yang Y, Li L, Butt ZA. What social media told us in the time of COVID-19: a scoping review. The Lancet Digital Health 2021 Mar;3(3):e175-e194. [CrossRef]
  2. González-Padilla DA, Tortolero-Blanco L. Social media influence in the COVID-19 Pandemic. Int Braz J Urol 2020 Jul;46(suppl.1):120-124 [FREE Full text] [CrossRef] [Medline]
  3. Budd J, Miller BS, Manning EM, Lampos V, Zhuang M, Edelstein M, et al. Digital technologies in the public-health response to COVID-19. Nat Med 2020 Aug 07;26(8):1183-1192. [CrossRef] [Medline]
  4. Whitelaw S, Mamas MA, Topol E, Van Spall HGC. Applications of digital technology in COVID-19 pandemic planning and response. The Lancet Digital Health 2020 Aug;2(8):e435-e440 [FREE Full text] [CrossRef]
  5. Sinnenberg L, Buttenheim AM, Padrez K, Mancheno C, Ungar L, Merchant RM. Twitter as a Tool for Health Research: A Systematic Review. Am J Public Health 2017 Jan;107(1):e1-e8. [CrossRef] [Medline]
  6. Karafillakis E, Martin S, Simas C, Olsson K, Takacs J, Dada S, et al. Methods for Social Media Monitoring Related to Vaccination: Systematic Scoping Review. JMIR Public Health Surveill 2021 Feb 08;7(2):e17149 [FREE Full text] [CrossRef] [Medline]
  7. Hussain A, Tahir A, Hussain Z, Sheikh Z, Gogate M, Dashtipour K, et al. Artificial Intelligence-Enabled Analysis of Public Attitudes on Facebook and Twitter Toward COVID-19 Vaccines in the United Kingdom and the United States: Observational Study. J Med Internet Res 2021 Apr 05;23(4):e26627 [FREE Full text] [CrossRef] [Medline]
  8. Hou Z, Tong Y, Du F, Lu L, Zhao S, Yu K, et al. Assessing COVID-19 Vaccine Hesitancy, Confidence, and Public Engagement: A Global Social Listening Study. J Med Internet Res 2021 Jun 11;23(6):e27632 [FREE Full text] [CrossRef] [Medline]
  9. Griffith J, Marani H, Monkman H. COVID-19 Vaccine Hesitancy in Canada: Content Analysis of Tweets Using the Theoretical Domains Framework. J Med Internet Res 2021 Apr 13;23(4):e26874 [FREE Full text] [CrossRef] [Medline]
  10. Nuzhath T, Tasnim S, Sanjwal RK, Trisha NF, Rahman M, Mahmud SMF, et al. COVID-19 vaccination hesitancy, misinformation and conspiracy theories on social media: A content analysis of Twitter data. SocArXiv. 2020.   URL: https://osf.io/preprints/socarxiv/vc9jb/ [accessed 2022-11-25]
  11. Gunasekeran DV, Tseng RMWW, Tham Y, Wong TY. Applications of digital health for public health responses to COVID-19: a systematic scoping review of artificial intelligence, telehealth and related technologies. NPJ Digit Med 2021 Feb 26;4(1):40 [FREE Full text] [CrossRef] [Medline]
  12. Wang B, Ping Y. A comparative analysis of COVID-19 vaccination certificates in 12 countries/regions around the world: Rationalising health policies for international travel and domestic social activities during the pandemic. Health Policy 2022 Aug;126(8):755-762 [FREE Full text] [CrossRef] [Medline]
  13. Lee B, Ibrahim SA, Zhang T. Mobile Apps Leveraged in the COVID-19 Pandemic in East and South-East Asia: Review and Content Analysis. JMIR Mhealth Uhealth 2021 Nov 11;9(11):e32093 [FREE Full text] [CrossRef] [Medline]
  14. Watson OJ, Barnsley G, Toor J, Hogan AB, Winskill P, Ghani AC. Global impact of the first year of COVID-19 vaccination: a mathematical modelling study. The Lancet Infectious Diseases 2022 Sep;22(9):1293-1302. [CrossRef]
  15. Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med 2018 Oct 02;169(7):467-473 [FREE Full text] [CrossRef] [Medline]
  16. Downes MJ, Brennan ML, Williams HC, Dean RS. Development of a critical appraisal tool to assess the quality of cross-sectional studies (AXIS). BMJ Open 2016 Dec 08;6(12):e011458 [FREE Full text] [CrossRef] [Medline]
  17. Ricciardi W. Assessing the impact of digital transformation of health services: Opinion by the Expert Panel on Effective Ways of Investing in Health (EXPH). European Journal of Public Health 2019;29(Supplement_4):ckz185.769. [CrossRef]
  18. Golinelli D, Boetto E, Carullo G, Nuzzolese AG, Landini MP, Fantini MP. Adoption of Digital Technologies in Health Care During the COVID-19 Pandemic: Systematic Review of Early Scientific Literature. J Med Internet Res 2020 Nov 06;22(11):e22280 [FREE Full text] [CrossRef] [Medline]
  19. Mir AA, Rathinam S, Gul S. Public perception of COVID-19 vaccines from the digital footprints left on Twitter: analyzing positive, neutral and negative sentiments of Twitterati. LHT 2021 Oct 12;40(2):340-356. [CrossRef]
  20. Sutrave K, Godasu R, Liu J. Understanding the Public Sentiment and Discourse on COVID-19 Vaccine. AMCIS 2021 Proceedings. 2021.   URL: https://scholar.dsu.edu/cgi/viewcontent.cgi?article=1272&context=bispapers [accessed 2022-09-25]
  21. Combei C. A Mixed-method Corpus Approach to the COVID-19 Vaccination Debate. Lingue e Linguaggi. 2022.   URL: http://siba-ese.unisalento.it/index.php/linguelinguaggi/article/view/25619/0 [accessed 2022-11-16]
  22. Lyu H, Wang J, Wu W, Duong V, Zhang X, Dye TD, et al. Social media study of public opinions on potential COVID-19 vaccines: informing dissent, disparities, and dissemination. Intell Med 2022 Feb;2(1):1-12 [FREE Full text] [CrossRef] [Medline]
  23. Lyu JC, Han EL, Luli GK. COVID-19 Vaccine-Related Discussion on Twitter: Topic Modeling and Sentiment Analysis. J Med Internet Res 2021 Jun 29;23(6):e24435 [FREE Full text] [CrossRef] [Medline]
  24. Marcec R, Likic R. Using Twitter for sentiment analysis towards AstraZeneca/Oxford, Pfizer/BioNTech and Moderna COVID-19 vaccines. Postgrad Med J 2022 Jul 09;98(1161):544-550 [FREE Full text] [CrossRef] [Medline]
  25. Melton CA, Olusanya OA, Ammar N, Shaban-Nejad A. Public sentiment analysis and topic modeling regarding COVID-19 vaccines on the Reddit social media platform: A call to action for strengthening vaccine confidence. J Infect Public Health 2021 Oct;14(10):1505-1512 [FREE Full text] [CrossRef] [Medline]
  26. Monselise M, Chang C, Ferreira G, Yang R, Yang CC. Topics and Sentiments of Public Concerns Regarding COVID-19 Vaccines: Social Media Trend Analysis. J Med Internet Res 2021 Oct 21;23(10):e30765 [FREE Full text] [CrossRef] [Medline]
  27. Mudassir MA, Mor Y, Munot Y, Shankarmani R. Sentiment Analysis of COVID-19 Vaccine Perception Using NLP. 2021 Presented at: Third International Conference on Inventive Research in Computing Applications (ICIRCA); September 2-4, 2021; Coimbatore, India. [CrossRef]
  28. Mushtaq MF, Fareed MMS, Almutairi M, Ullah S, Ahmed G, Munir K. Analyses of Public Attention and Sentiments towards Different COVID-19 Vaccines Using Data Mining Techniques. Vaccines (Basel) 2022 Apr 22;10(5):661 [FREE Full text] [CrossRef] [Medline]
  29. Ong S, Pauzi MBM, Gan KH. Text Mining and Determinants of Sentiments towards the COVID-19 Vaccine Booster of Twitter Users in Malaysia. Healthcare (Basel) 2022 May 27;10(6):994 [FREE Full text] [CrossRef] [Medline]
  30. Akcan E, Sütütemiz N. Analysis of Brand Perceptions of Covid-19 Vaccines with Sentiment Analysis On Social Media. Pamukkale University Journal of Social Sciences Institute 2022(49):145-162 [FREE Full text] [CrossRef]
  31. Gottipati S, Guha D. Analysing Tweets on COVID-19 Vaccine: A Text Mining Approach. 2022 Presented at: 12th Annual Computing and Communication Workshop and Conference (CCWC); January 26-29, 2022; Las Vegas, NV, USA. [CrossRef]
  32. Gulati S. Decoding the global trend of “vaccine tourism” through public sentiments and emotions: does it get a nod on Twitter? GKMC 2021 Sep 09;71(8/9):899-915. [CrossRef]
  33. Liu S, Liu J. Public attitudes toward COVID-19 vaccines on English-language Twitter: A sentiment analysis. Vaccine 2021 Sep 15;39(39):5499-5505 [FREE Full text] [CrossRef] [Medline]
  34. Li T, Zeng Z, Sun J, Sun S. Using data mining technology to analyse the spatiotemporal public opinion of COVID-19 vaccine on social media. EL 2022 Jul 20;40(4):435-452. [CrossRef]
  35. Shah U, Biswas M, Dolaat K, Househ M, Shah Z, Alam T. Vaccine Rollout and Shift in Public Sentiment: Twitter-Based Surveillance Study. Stud Health Technol Inform 2022 Jun 06;290:704-708. [CrossRef] [Medline]
  36. Stella M, Vitevitch MS, Botta F. Cognitive Networks Extract Insights on COVID-19 Vaccines from English and Italian Popular Tweets: Anticipation, Logistics, Conspiracy and Loss of Trust. BDCC 2022 May 12;6(2):52. [CrossRef]
  37. Feizollah A, Anuar NB, Mehdi R, Firdaus A, Sulaiman A. Understanding COVID-19 Halal Vaccination Discourse on Facebook and Twitter Using Aspect-Based Sentiment Analysis and Text Emotion Analysis. Int J Environ Res Public Health 2022 May 21;19(10):6269 [FREE Full text] [CrossRef] [Medline]
  38. Bari A, Heymann M, Cohen R, Zhao R, Szabo L, Apas Vasandani S, et al. Exploring Coronavirus Disease 2019 Vaccine Hesitancy on Twitter Using Sentiment Analysis and Natural Language Processing Algorithms. Clin Infect Dis 2022 May 15;74(Suppl_3):e4-e9. [CrossRef] [Medline]
  39. Alam KN, Khan MS, Dhruba AR, Khan MM, Al-Amri JF, Masud M, et al. Deep Learning-Based Sentiment Analysis of COVID-19 Vaccination Responses from Twitter Data. Comput Math Methods Med 2021 Dec 2;2021:4321131-4321115 [FREE Full text] [CrossRef] [Medline]
  40. Daradkeh M. Analyzing Sentiments and Diffusion Characteristics of COVID-19 Vaccine Misinformation Topics in Social Media: A Data Analytics Framework. International Journal of Business Analytics (IJBAN) 2022;9(3):1-22 [FREE Full text] [CrossRef]
  41. Ali GGMN, Rahman MM, Hossain MA, Rahman MS, Paul KC, Thill J, et al. Public Perceptions of COVID-19 Vaccines: Policy Implications from US Spatiotemporal Sentiment Analytics. Healthcare (Basel) 2021 Aug 27;9(9):1110 [FREE Full text] [CrossRef] [Medline]
  42. Bi D, Kong J, Zhang X, Yang J. Analysis on Health Information Acquisition of Social Network Users by Opinion Mining: Case Analysis Based on the Discussion on COVID-19 Vaccinations. J Healthc Eng 2021;2021:2122095 [FREE Full text] [CrossRef] [Medline]
  43. Chandrasekaran R, Desai R, Shah H, Kumar V, Moustakas E. Examining Public Sentiments and Attitudes Toward COVID-19 Vaccination: Infoveillance Study Using Twitter Posts. JMIR Infodemiology 2022 Apr 15;2(1):e33909 [FREE Full text] [CrossRef] [Medline]
  44. Gautam M, Sahai N, Yadav AS, Tomar M. Sentiment Analysis about COVID-19 vaccine on Twitter data: Understanding Public Opinion. 2022 Presented at: 6th International Conference on Intelligent Computing and Control Systems (ICICCS); May 25-27, 2022; Madurai, India. [CrossRef]
  45. Greyling T, Rossouw S. Positive attitudes towards COVID-19 vaccines: A cross-country analysis. PLoS One 2022 Mar 10;17(3):e0264994 [FREE Full text] [CrossRef] [Medline]
  46. Huangfu L, Mo Y, Zhang P, Zeng DD, He S. COVID-19 Vaccine Tweets After Vaccine Rollout: Sentiment-Based Topic Modeling. J Med Internet Res 2022 Feb 08;24(2):e31726 [FREE Full text] [CrossRef] [Medline]
  47. Karami A, Zhu M, Goldschmidt B, Boyajieff HR, Najafabadi MM. COVID-19 Vaccine and Social Media in the U.S.: Exploring Emotions and Discussions on Twitter. Vaccines (Basel) 2021 Sep 23;9(10):1059 [FREE Full text] [CrossRef] [Medline]
  48. Luo C, Chen A, Cui B, Liao W. Exploring public perceptions of the COVID-19 vaccine online from a cultural perspective: Semantic network analysis of two social media platforms in the United States and China. Telemat Inform 2021 Dec;65:101712 [FREE Full text] [CrossRef] [Medline]
  49. Liew TM, Lee CS. Examining the Utility of Social Media in COVID-19 Vaccination: Unsupervised Learning of 672,133 Twitter Posts. JMIR Public Health Surveill 2021 Nov 03;7(11):e29789 [FREE Full text] [CrossRef] [Medline]
  50. Wang Y, Chen Y. Characterizing discourses about COVID-19 vaccines on Twitter: a topic modeling and sentiment analysis approach. Journal of Communication in Healthcare 2022 Mar 24:1-10. [CrossRef]
  51. Xie Z, Wang X, Jiang Y, Chen Y, Huang S, Ma H, et al. Public Perception of COVID-19 Vaccines on Twitter in the United States. medRxiv 2021 Oct 18:2021.10.16.21265097 [FREE Full text] [CrossRef] [Medline]
  52. Zhang Z, Feng G, Xu J, Zhang Y, Li J, Huang J, et al. The Impact of Public Health Events on COVID-19 Vaccine Hesitancy on Chinese Social Media: National Infoveillance Study. JMIR Public Health Surveill 2021 Nov 09;7(11):e32936 [FREE Full text] [CrossRef] [Medline]
  53. Zhang C, Xu S, Li Z, Liu G, Dai D, Dong C. The Evolution and Disparities of Online Attitudes Toward COVID-19 Vaccines: Year-long Longitudinal and Cross-sectional Study. J Med Internet Res 2022 Jan 21;24(1):e32394 [FREE Full text] [CrossRef] [Medline]
  54. Kwok SWH, Vadde SK, Wang G. Tweet Topics and Sentiments Relating to COVID-19 Vaccination Among Australian Twitter Users: Machine Learning Analysis. J Med Internet Res 2021 May 19;23(5):e26953 [FREE Full text] [CrossRef] [Medline]
  55. Shim J, Ryu K, Lee SH, Cho E, Lee YJ, Ahn JH. Text Mining Approaches to Analyze Public Sentiment Changes Regarding COVID-19 Vaccines on Social Media in Korea. Int J Environ Res Public Health 2021 Jun 18;18(12):6549 [FREE Full text] [CrossRef] [Medline]
  56. Praveen S, Ittamalla R, Deepak G. Analyzing the attitude of Indian citizens towards COVID-19 vaccine - A text analytics study. Diabetes Metab Syndr 2021 Mar;15(2):595-599 [FREE Full text] [CrossRef] [Medline]
  57. Yousefinaghani S, Dara R, Mubareka S, Papadopoulos A, Sharif S. An analysis of COVID-19 vaccine sentiments and opinions on Twitter. Int J Infect Dis 2021 Jul;108:256-262 [FREE Full text] [CrossRef] [Medline]
  58. Hu T, Wang S, Luo W, Zhang M, Huang X, Yan Y, et al. Revealing Public Opinion Towards COVID-19 Vaccines With Twitter Data in the United States: Spatiotemporal Perspective. J Med Internet Res 2021 Sep 10;23(9):e30854 [FREE Full text] [CrossRef] [Medline]
  59. Sufi FK, Razzak I, Khalil I. Tracking Anti-Vax Social Movement Using AI-Based Social Media Monitoring. IEEE Trans. Technol. Soc 2022 Dec;3(4):290-299. [CrossRef]
  60. Yan C, Law M, Nguyen S, Cheung J, Kong J. Comparing Public Sentiment Toward COVID-19 Vaccines Across Canadian Cities: Analysis of Comments on Reddit. J Med Internet Res 2021 Sep 24;23(9):e32685 [FREE Full text] [CrossRef] [Medline]
  61. Delcea C, Cotfas L, Crăciun L, Molănescu AG. New Wave of COVID-19 Vaccine Opinions in the Month the 3rd Booster Dose Arrived. Vaccines (Basel) 2022 May 31;10(6):881 [FREE Full text] [CrossRef] [Medline]
  62. Mourad A, Elbassuoni S. A large-scale analysis of COVID-19 tweets in the Arab region. Soc. Netw. Anal. Min 2022 Jul 02;12(1):Article number: 71. [CrossRef]
  63. Nezhad ZB, Deihimi MA. Analyzing Iranian opinions toward COVID-19 vaccination. IJID Reg 2022 Jun;3:204-210 [FREE Full text] [CrossRef] [Medline]
  64. Niu Q, Liu J, Kato M, Shinohara Y, Matsumura N, Aoyama T, et al. Public Opinion and Sentiment Before and at the Beginning of COVID-19 Vaccinations in Japan: Twitter Analysis. JMIR Infodemiology 2022 May 9;2(1):e32335 [FREE Full text] [CrossRef] [Medline]
  65. Pan Z, Zhou S, Sun N. Twitter Sentiment Analysis of COVID-19 Vaccine Based on BiLSTM with Attention Mechanism. 2022 Presented at: 4th International Conference on Advances in Computer Technology, Information Science and Communications (CTISC); April 22-24, 2022; Suzhou, China. [CrossRef]
  66. Portelli B, Scaboro S, Tonino R, Chersoni E, Santus E, Serra G. Monitoring User Opinions and Side Effects on COVID-19 Vaccines in the Twittersphere: Infodemiology Study of Tweets. J Med Internet Res 2022 May 13;24(5):e35115 [FREE Full text] [CrossRef] [Medline]
  67. Rahmanti AR, Chien C, Nursetyo AA, Husnayain A, Wiratama BS, Fuad A, et al. Social media sentiment analysis to monitor the performance of vaccination coverage during the early phase of the national COVID-19 vaccine rollout. Comput Methods Programs Biomed 2022 Jun;221:106838 [FREE Full text] [CrossRef] [Medline]
  68. Shahriar KT, Islam MN, Anwar MM, Sarker IH. COVID-19 analytics: Towards the effect of vaccine brands through analyzing public sentiment of tweets. Inform Med Unlocked 2022;31:100969 [FREE Full text] [CrossRef] [Medline]
  69. Aygun I, Kaya B, Kaya M. Aspect Based Twitter Sentiment Analysis on Vaccination and Vaccine Types in COVID-19 Pandemic With Deep Learning. IEEE J. Biomed. Health Inform 2022 May;26(5):2360-2369. [CrossRef]
  70. Khan IU, Aslam N, Chrouf S, Atef I, Merah I, AlMulhim L, et al. Computational Intelligence-Based Model for Exploring Individual Perception on SARS-CoV-2 Vaccine in Saudi Arabia. Comput Intell Neurosci 2022 Apr 6;2022:6722427-6722412 [FREE Full text] [CrossRef] [Medline]
  71. Lee SJ, Kishore S, Lim JY, Paas L, Ahn HS. Overwhelmed by Fear: Emotion Analysis of COVID-19 Vaccination Tweets. 2021 Presented at: 2021 IEEE Region 10 Conference (TENCON); December 7-10, 2021; Auckland, New Zealand. [CrossRef]
  72. Jang H, Rempel E, Roe I, Adu P, Carenini G, Janjua NZ. Tracking Public Attitudes Toward COVID-19 Vaccination on Tweets in Canada: Using Aspect-Based Sentiment Analysis. J Med Internet Res 2022 Mar 29;24(3):e35016 [FREE Full text] [CrossRef] [Medline]
  73. Jun J, Zain A, Chen Y, Kim S. Adverse Mentions, Negative Sentiment, and Emotions in COVID-19 Vaccine Tweets and Their Association with Vaccination Uptake: Global Comparison of 192 Countries. Vaccines (Basel) 2022 May 08;10(5):735 [FREE Full text] [CrossRef] [Medline]
  74. Xue H, Gong X, Stevens H. COVID-19 Vaccine Fact-Checking Posts on Facebook: Observational Study. J Med Internet Res 2022 Jun 21;24(6):e38423 [FREE Full text] [CrossRef] [Medline]
  75. Wang D, Zhou Y. The popularity of contradictory information about COVID-19 vaccine on social media in China. Comput Human Behav 2022 Sep;134:107320 [FREE Full text] [CrossRef] [Medline]
  76. Villavicencio C, Macrohon JJ, Inbaraj XA, Jeng J, Hsieh J. Twitter Sentiment Analysis towards COVID-19 Vaccines in the Philippines Using Naïve Bayes. Information 2021 May 11;12(5):204. [CrossRef]
  77. Amanatidis D, Mylona I, Kamenidou I, Mamalis S, Stavrianea A. Mining Textual and Imagery Instagram Data during the COVID-19 Pandemic. Applied Sciences 2021 May 09;11(9):4281. [CrossRef]
  78. Reshi AA, Rustam F, Aljedaani W, Shafi S, Alhossan A, Alrabiah Z, et al. COVID-19 Vaccination-Related Sentiments Analysis: A Case Study Using Worldwide Twitter Dataset. Healthcare (Basel) 2022 Feb 22;10(3):411 [FREE Full text] [CrossRef] [Medline]
  79. Niu Q, Liu J, Kato M, Nagai-Tanima M, Aoyama T. The Effect of Fear of Infection and Sufficient Vaccine Reservation Information on Rapid COVID-19 Vaccination in Japan: Evidence From a Retrospective Twitter Analysis. J Med Internet Res 2022 Jun 09;24(6):e37466 [FREE Full text] [CrossRef] [Medline]
  80. Roe C, Lowe M, Williams B, Miller C. Public Perception of SARS-CoV-2 Vaccinations on Social Media: Questionnaire and Sentiment Analysis. Int J Environ Res Public Health 2021 Dec 10;18(24):13028 [FREE Full text] [CrossRef] [Medline]
  81. Ansari MTJ, Khan NA. Worldwide COVID-19 Vaccines Sentiment Analysis Through Twitter Content. ELECTRON J GEN MED 2021;18(6):em329. [CrossRef]
  82. Gao H, Guo D, Wu J, Zhao Q, Li L. Changes of the Public Attitudes of China to Domestic COVID-19 Vaccination After the Vaccines Were Approved: A Semantic Network and Sentiment Analysis Based on Sina Weibo Texts. Front Public Health 2021 Nov 11;9:723015 [FREE Full text] [CrossRef] [Medline]
  83. Cepeda K, Jaiswal R. Sentiment Analysis on Covid-19 Vaccinations in Ireland using Support Vector Machine. 2022 Presented at: 33rd Irish Signals and Systems Conference (ISSC); June 9-10, 2022; Cork, Ireland. [CrossRef]
  84. Al-Zaman MS. An exploratory study of social media users’ engagement with COVID-19 vaccine-related content. F1000Res 2021 Jun 16;10:236. [CrossRef]
  85. Wang X, He R. Supporting Vaccination on TikTok During the COVID-19 Pandemic: Vaccine Beliefs, Emotions, and Comments. Front Psychol 2022 Jul 7;13:938377 [FREE Full text] [CrossRef] [Medline]
  86. Wang D, Lu J. How News Agencies' Twitter Posts on COVID-19 Vaccines Attract Audiences' Twitter Engagement: A Content Analysis. Int J Environ Res Public Health 2022 Feb 25;19(5):2716 [FREE Full text] [CrossRef] [Medline]
  87. Jiang LC, Chu TH, Sun M. Characterization of Vaccine Tweets During the Early Stage of the COVID-19 Outbreak in the United States: Topic Modeling Analysis. JMIR Infodemiology 2021 Sep 14;1(1):e25636 [FREE Full text] [CrossRef] [Medline]
  88. Ma P, Zeng-Treitler Q, Nelson SJ. Use of two topic modeling methods to investigate COVID vaccine hesitancy. In: Proceedings of the International Conferences ICT, Society, and Human Beings 2021; Web Based Communities and Social Media 2021; and e-Health 2021. 2021 Presented at: International Conferences ICT, Society, and Human Beings 2021; Web Based Communities and Social Media 2021; and e-Health 2021; July 20-23, 2021; Virtual p. 221-226. [CrossRef]
  89. Cotfas L, Delcea C, Gherai R. COVID-19 Vaccine Hesitancy in the Month Following the Start of the Vaccination Process. Int J Environ Res Public Health 2021 Oct 04;18(19):10438 [FREE Full text] [CrossRef] [Medline]
  90. Ginossar T, Cruickshank IJ, Zheleva E, Sulskis J, Berger-Wolf T. Cross-platform spread: vaccine-related content, sources, and conspiracy theories in YouTube videos shared in early Twitter COVID-19 conversations. Hum Vaccin Immunother 2022 Dec 31;18(1):1-13 [FREE Full text] [CrossRef] [Medline]
  91. Zhang J, Wang Y, Shi M, Wang X. Factors Driving the Popularity and Virality of COVID-19 Vaccine Discourse on Twitter: Text Mining and Data Visualization Study. JMIR Public Health Surveill 2021 Dec 03;7(12):e32814 [FREE Full text] [CrossRef] [Medline]
  92. Guntuku SC, Buttenheim AM, Sherman G, Merchant RM. Twitter discourse reveals geographical and temporal variation in concerns about COVID-19 vaccines in the United States. Vaccine 2021 Jul 05;39(30):4034-4038 [FREE Full text] [CrossRef] [Medline]
  93. Liu S, Li J, Liu J. Leveraging Transfer Learning to Analyze Opinions, Attitudes, and Behavioral Intentions Toward COVID-19 Vaccines: Social Media Content and Temporal Analysis. J Med Internet Res 2021 Aug 10;23(8):e30251 [FREE Full text] [CrossRef] [Medline]
  94. Laforet PE, Basch CH, Tang H. Understanding the content of COVID-19 vaccination and pregnancy videos on YouTube: An analysis of videos published at the start of the vaccine rollout. Hum Vaccin Immunother 2022 Nov 30;18(5):2066935 [FREE Full text] [CrossRef] [Medline]
  95. Bonnici L, Ma J. What are they saying? A speech act analysis of a vaccination information debate on Facebook. The Canadian Journal of Information and Library Science 2021;44(1):19-37. [CrossRef]
  96. Ngai CSB, Singh RG, Yao L. Impact of COVID-19 Vaccine Misinformation on Social Media Virality: Content Analysis of Message Themes and Writing Strategies. J Med Internet Res 2022 Jul 06;24(7):e37806 [FREE Full text] [CrossRef] [Medline]
  97. Baines A, Ittefaq M, Abwao M. #Scamdemic, #Plandemic, or #Scaredemic: What Parler Social Media Platform Tells Us about COVID-19 Vaccine. Vaccines (Basel) 2021 Apr 22;9(5):421 [FREE Full text] [CrossRef] [Medline]
  98. Fieselmann J, Annac K, Erdsiek F, Yilmaz-Aslan Y, Brzoska P. What are the reasons for refusing a COVID-19 vaccine? A qualitative analysis of social media in Germany. BMC Public Health 2022 Apr 27;22(1):846 [FREE Full text] [CrossRef] [Medline]
  99. Cruickshank I, Ginossar T, Sulskis J, Zheleva E, Berger-Wolf T. Content and Dynamics of Websites Shared Over Vaccine-Related Tweets in COVID-19 Conversations: Computational Analysis. J Med Internet Res 2021 Dec 03;23(12):e29127 [FREE Full text] [CrossRef] [Medline]
  100. Gao H, Zhao Q, Ning C, Guo D, Wu J, Li L. Does the COVID-19 Vaccine Still Work That "Most of the Confirmed Cases Had Been Vaccinated"? A Content Analysis of Vaccine Effectiveness Discussion on Sina Weibo during the Outbreak of COVID-19 in Nanjing. Int J Environ Res Public Health 2021 Dec 26;19(1):241 [FREE Full text] [CrossRef] [Medline]
  101. Hernández-García I, Gascón-Giménez I, Gascón-Giménez A, Giménez-Júlvez T. Information in Spanish on YouTube about Covid-19 vaccines. Hum Vaccin Immunother 2021 Nov 02;17(11):3916-3921 [FREE Full text] [CrossRef] [Medline]
  102. Khan ML, Malik A, Ruhi U, Al-Busaidi A. Conflicting attitudes: Analyzing social media data to understand the early discourse on COVID-19 passports. Technol Soc 2022 Feb;68:101830 [FREE Full text] [CrossRef] [Medline]
  103. Küçükali H, Ataç Ö, Palteki AS, Tokaç AZ, Hayran O. Vaccine Hesitancy and Anti-Vaccination Attitudes during the Start of COVID-19 Vaccination Program: A Content Analysis on Twitter Data. Vaccines (Basel) 2022 Jan 21;10(2):161 [FREE Full text] [CrossRef] [Medline]
  104. Li L, Zhou J, Ma Z, Bensi MT, Hall MA, Baecher GB. Dynamic assessment of the COVID-19 vaccine acceptance leveraging social media data. J Biomed Inform 2022 May;129:104054 [FREE Full text] [CrossRef] [Medline]
  105. Wawrzuta D, Klejdysz J, Jaworski M, Gotlib J, Panczyk M. Attitudes toward COVID-19 Vaccination on Social Media: A Cross-Platform Analysis. Vaccines (Basel) 2022 Jul 27;10(8):1190 [FREE Full text] [CrossRef] [Medline]
  106. Islam MS, Kamal AM, Kabir A, Southern DL, Khan SH, Hasan SMM, et al. COVID-19 vaccine rumors and conspiracy theories: The need for cognitive inoculation against misinformation to improve vaccine adherence. PLoS One 2021 May 12;16(5):e0251605 [FREE Full text] [CrossRef] [Medline]
  107. Thelwall M. Can Twitter give insights into international differences in Covid-19 vaccination? Eight countries’ English tweets to 21 March 2021. Profesional De La información 2021;30(3):e300311 [FREE Full text] [CrossRef]
  108. Scannell D, Desens L, Guadagno M, Tra Y, Acker E, Sheridan K, et al. COVID-19 Vaccine Discourse on Twitter: A Content Analysis of Persuasion Techniques, Sentiment and Mis/Disinformation. J Health Commun 2021 Jul 03;26(7):443-459. [CrossRef] [Medline]
  109. Jarynowski A, Semenov A, Kamiński M, Belik V. Mild Adverse Events of Sputnik V Vaccine in Russia: Social Media Content Analysis of Telegram via Deep Learning. J Med Internet Res 2021 Nov 29;23(11):e30529 [FREE Full text] [CrossRef] [Medline]
  110. Breeze R. Claiming Credibility in Online Comments: Popular Debate Surrounding the COVID-19 Vaccine. Publications 2021 Aug 06;9(3):34. [CrossRef]
  111. Boucher J, Cornelson K, Benham JL, Fullerton MM, Tang T, Constantinescu C, et al. Analyzing Social Media to Explore the Attitudes and Behaviors Following the Announcement of Successful COVID-19 Vaccine Trials: Infodemiology Study. JMIR Infodemiology 2021;1(1):e28800 [FREE Full text] [CrossRef] [Medline]
  112. Teng S, Jiang N, Khong KW. Using big data to understand the online ecology of COVID-19 vaccination hesitancy. Humanit Soc Sci Commun 2022 May 06;9(1):Article number: 158. [CrossRef]
  113. Baj-Rogowska A. Mapping of the Covid-19 Vaccine Uptake Determinants From Mining Twitter Data. IEEE Access 2021;9:134929-134944. [CrossRef]
  114. Hwang J, Su M, Jiang X, Lian R, Tveleneva A, Shah D. Vaccine discourse during the onset of the COVID-19 pandemic: Topical structure and source patterns informing efforts to combat vaccine hesitancy. PLoS One 2022 Jul 27;17(7):e0271394 [FREE Full text] [CrossRef] [Medline]
  115. Kumar N, Corpus I, Hans M, Harle N, Yang N, McDonald C, et al. COVID-19 vaccine perceptions in the initial phases of US vaccine roll-out: an observational study on reddit. BMC Public Health 2022 Mar 07;22(1):446 [FREE Full text] [CrossRef] [Medline]
  116. Lanyi K, Green R, Craig D, Marshall C. COVID-19 Vaccine Hesitancy: Analysing Twitter to Identify Barriers to Vaccination in a Low Uptake Region of the UK. Front Digit Health 2021;3:804855 [FREE Full text] [CrossRef] [Medline]
  117. Lian AT, Du J, Tang L. Using a Machine Learning Approach to Monitor COVID-19 Vaccine Adverse Events (VAE) from Twitter Data. Vaccines (Basel) 2022 Jan 11;10(1):103 [FREE Full text] [CrossRef] [Medline]
  118. Merrick E, Weissman JP, Patel SJ. Utilizing Google trends to monitor coronavirus vaccine interest and hesitancies. Vaccine 2022 Jun 26;40(30):4057-4063 [FREE Full text] [CrossRef] [Medline]
  119. Blane JT, Bellutta D, Carley KM. Social-Cyber Maneuvers During the COVID-19 Vaccine Initial Rollout: Content Analysis of Tweets. J Med Internet Res 2022 Mar 07;24(3):e34040-e34107 [FREE Full text] [CrossRef] [Medline]
  120. Liu S, Liu J. Understanding Behavioral Intentions Toward COVID-19 Vaccines: Theory-Based Content Analysis of Tweets. J Med Internet Res 2021 May 12;23(5):e28118 [FREE Full text] [CrossRef] [Medline]
  121. Olszowski R, Zabdyr-Jamróz M, Baran S, Pięta P, Ahmed W. A Social Network Analysis of Tweets Related to Mandatory COVID-19 Vaccination in Poland. Vaccines (Basel) 2022 May 10;10(5):750 [FREE Full text] [CrossRef] [Medline]
  122. Hagen L, Fox A, O'Leary H, Dyson D, Walker K, Lengacher CA, et al. The Role of Influential Actors in Fostering the Polarized COVID-19 Vaccine Discourse on Twitter: Mixed Methods of Machine Learning and Inductive Coding. JMIR Infodemiology 2022 Jun 30;2(1):e34231 [FREE Full text] [CrossRef] [Medline]
  123. Pascual-Ferrá P, Alperstein N, Barnett DJ. A Multi-platform Approach to Monitoring Negative Dominance for COVID-19 Vaccine-Related Information Online. Disaster Med Public Health Prep 2021 May 03:1-24 [FREE Full text] [CrossRef] [Medline]
  124. Kalichman S, Eaton L, Earnshaw V, Brousseau N. Faster than warp speed: early attention to COVD-19 by anti-vaccine groups on Facebook. J Public Health (Oxf) 2022 Mar 07;44(1):e96-e105 [FREE Full text] [CrossRef] [Medline]
  125. Herrera-Peco I, Jiménez-Gómez B, Peña Deudero JJ, Benitez De Gracia E, Ruiz-Núñez C. Healthcare Professionals' Role in Social Media Public Health Campaigns: Analysis of Spanish Pro Vaccination Campaign on Twitter. Healthcare (Basel) 2021 Jun 02;9(6):662 [FREE Full text] [CrossRef] [Medline]
  126. Savolainen R. Assessing the credibility of COVID-19 vaccine mis/disinformation in online discussion. Journal of Information Science 2021 Aug 19:016555152110406. [CrossRef]
  127. Li HO, Pastukhova E, Brandts-Longtin O, Tan MG, Kirchhof MG. YouTube as a source of misinformation on COVID-19 vaccination: a systematic analysis. BMJ Glob Health 2022 Mar 09;7(3):e008334 [FREE Full text] [CrossRef] [Medline]
  128. Kocyigit BF, Akyol A. YouTube as a source of information on COVID-19 vaccination in rheumatic diseases. Rheumatol Int 2021 Dec 25;41(12):2109-2115 [FREE Full text] [CrossRef] [Medline]
  129. Lentzen M, Huebenthal V, Kaiser R, Kreppel M, Zoeller JE, Zirk M. A retrospective analysis of social media posts pertaining to COVID-19 vaccination side effects. Vaccine 2022 Jan 03;40(1):43-51 [FREE Full text] [CrossRef] [Medline]
  130. Yeung AWK, Wochele-Thoma T, Eibensteiner F, Klager E, Hribersek M, Parvanov ED, et al. Official Websites Providing Information on COVID-19 Vaccination: Readability and Content Analysis. JMIR Public Health Surveill 2022 Mar 15;8(3):e34003 [FREE Full text] [CrossRef] [Medline]
  131. Zhao S, Zhang B, Chang X. iQiYi Video as a Source of Information on COVID-19 Vaccine: Content Analysis. Disaster Med Public Health Prep 2022 Mar 04:1-22 [FREE Full text] [CrossRef] [Medline]
  132. mHealth: New horizons for health through mobile technologies. WHO Africa.   URL: https://www.afro.who.int/publications/mhealth-new-horizons-health-through-mobile-technologie [accessed 2021-12-01]
  133. Romeo L, Frontoni E. A Unified Hierarchical XGBoost model for classifying priorities for COVID-19 vaccination campaign. Pattern Recognit 2022 Jan;121:108197 [FREE Full text] [CrossRef] [Medline]
  134. Couto RC, Pedrosa TMG, Seara LM, Couto CS, Couto VS, Giacomin K, et al. Covid-19 vaccination priorities defined on machine learning. Rev Saude Publica 2022 Mar 11;56:11 [FREE Full text] [CrossRef] [Medline]
  135. Sulis E, Terna P. An Agent-based Decision Support for a Vaccination Campaign. J Med Syst 2021 Sep 28;45(11):97 [FREE Full text] [CrossRef] [Medline]
  136. Hughes JA, Dube M, Houghten S, Ashlock D. Vaccinating a Population is a Programming Problem. 2020 Presented at: IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB); October 27-29, 2020; Via del Mar, Chile. [CrossRef]
  137. Lende M, Thaware U, Sharma R, Zade K, Makhijani R. Prioritization of Regions for Covid Vaccinations Using Fuzzy Logic. 2021 Presented at: 12th International Conference on Computing Communication and Networking Technologies (ICCCNT); July 6-8, 2021; Kharagpur, India. [CrossRef]
  138. Talan R, Rathee S, Gandhi R. Spatio-Temporal distribution characteristic of covid-19 vaccine using time series forecasting. 2022 Presented at: 12th International Conference on Cloud Computing, Data Science & Engineering (Confluence); January 27-28, 2022; Noida, India. [CrossRef]
  139. Trad F, El Falou S. Towards Using Deep Reinforcement Learning for Better COVID-19 Vaccine Distribution Strategies. 2022 Presented at: 7th International Conference on Data Science and Machine Learning Applications (CDMA); March 1-3, 2022; Riyadh, Saudi Arabia. [CrossRef]
  140. Jadidi MM, Moslemi P, Jamshidiha S, Masroori I, Mohammadi A, Pourahmadi V. Targeted Vaccination for COVID-19 Using Mobile Communication Networks. 2020 Presented at: 11th International Conference on Information and Knowledge Technology (IKT); December 22-23, 2020; Tehran, Iran. [CrossRef]
  141. Rocha T, Boitrago G, Mônica RB, Almeida D, Silva N, Silva D, et al. National COVID-19 vaccination plan: using artificial spatial intelligence to overcome challenges in Brazil. Cien Saude Colet 2021 May;26(5):1885-1898 [FREE Full text] [CrossRef] [Medline]
  142. Das AK, Bera B, Giri D. AI and Blockchain-Based Cloud-Assisted Secure Vaccine Distribution and Tracking in IoMT-Enabled COVID-19 Environment. IEEE Internet Things M 2021 Jun;4(2):26-32. [CrossRef]
  143. Jain R, Gawre SK. Monitoring and Control of COVID Vaccine Storage Temperature Using IoT and Machine Learning. 2022 Presented at: 2022 IEEE International Students' Conference on Electrical, Electronics and Computer Science (SCEECS); February 19-20, 2022; Bhopal, India. [CrossRef]
  144. Shukla S, Fressin F, Un M, Coetzer H, Chaguturu SK. Optimizing vaccine distribution via mobile clinics: a case study on COVID-19 vaccine distribution to long-term care facilities. Vaccine 2022 Jan 31;40(5):734-741 [FREE Full text] [CrossRef] [Medline]
  145. Wei X, Pu C, He Z, Liò P. Deep Reinforcement Learning-based Vaccine Distribution Strategies. 2021 Presented at: 2nd International Conference on Electronics, Communications and Information Technology (CECIT); December 27-29, 2021; Sanya, China. [CrossRef]
  146. Barajas M, Bhatkande S, Baskaran P, Gohel H, Pandey B. Advancing Deep Learning for Supply Chain Optimization of COVID-19 Vaccination in Rural Communities. 2021 Presented at: 10th IEEE International Conference on Communication Systems and Network Technologies (CSNT); June 18-19, 2021; Bhopal, India. [CrossRef]
  147. Davahli MR, Karwowski W, Fiok K. Optimizing COVID-19 vaccine distribution across the United States using deterministic and stochastic recurrent neural networks. PLoS One 2021 Jul 6;16(7):e0253925 [FREE Full text] [CrossRef] [Medline]
  148. Goodarzian F, Navaei A, Ehsani B, Ghasemi P, Muñuzuri J. Designing an integrated responsive-green-cold vaccine supply chain network using Internet-of-Things: artificial intelligence-based solutions. Ann Oper Res 2022 May 05:1-45 [FREE Full text] [CrossRef] [Medline]
  149. Kamran MA, Kia R, Goodarzian F, Ghasemi P. A new vaccine supply chain network under COVID-19 conditions considering system dynamic: Artificial intelligence algorithms. Socioecon Plann Sci 2022 Aug 08:101378 [FREE Full text] [CrossRef] [Medline]
  150. Kaur N, Hughes J, Chen J. VaxEquity: A Data-Driven Risk Assessment and Optimization Framework for Equitable Vaccine Distribution. 2022 Presented at: 56th Annual Conference on Information Sciences and Systems (CISS); March 9-11, 2022; Princeton, NJ, USA. [CrossRef]
  151. Markhorst B, Zver T, Malbasic N, Dijkstra R, Otto D, van der Mei R, et al. A Data-Driven Digital Application to Enhance the Capacity Planning of the COVID-19 Vaccination Process. Vaccines (Basel) 2021 Oct 15;9(10):1181 [FREE Full text] [CrossRef] [Medline]
  152. Meghla TI, Rahman MM, Biswas A, Hossain JT, Khatun T. Supply Chain Management with Demand Forecasting of Covid-19 Vaccine using Blockchain and Machine Learning. 2021 Presented at: 12th International Conference on Computing Communication and Networking Technologies (ICCCNT); July 6-8, 2021; Kharagpur, India. [CrossRef]
  153. Rathee G, Garg S, Kaddoum G, Jayakody DNK. An IoT-Based Secure Vaccine Distribution System through a Blockchain Network. IEEE Internet Things M 2021 Jun;4(2):10-15. [CrossRef]
  154. Akshita V, Dhanush JS, Dikshitha VA, Kumar VK. Blockchain Based Covid Vaccine Booking and Vaccine Management System. 2021 Presented at: 2nd International Conference on Smart Electronics and Communication (ICOSEC); October 7-9, 2021; Trichy, India. [CrossRef]
  155. Musamih A, Jayaraman R, Salah K, Hasan HR, Yaqoob I, Al-Hammadi Y. Blockchain-Based Solution for Distribution and Delivery of COVID-19 Vaccines. IEEE Access 2021;9:71372-71387. [CrossRef]
  156. Antal C, Cioara T, Antal M, Anghel I. Blockchain Platform For COVID-19 Vaccine Supply Management. IEEE Open J. Comput. Soc 2021;2:164-178. [CrossRef]
  157. Verma A, Bhattacharya P, Zuhair M, Tanwar S, Kumar N. VaCoChain: Blockchain-Based 5G-Assisted UAV Vaccine Distribution Scheme for Future Pandemics. IEEE J Biomed Health Inform 2022 May;26(5):1997-2007. [CrossRef] [Medline]
  158. Chauhan H, Gupta D, Gupta S, Singh A, Aljahdali HM, Goyal N, et al. Blockchain Enabled Transparent and Anti-Counterfeiting Supply of COVID-19 Vaccine Vials. Vaccines (Basel) 2021 Oct 25;9(11):1239 [FREE Full text] [CrossRef] [Medline]
  159. Chung HM. Blockchain-based Value Creation for Supply Chain in COVID-19 Drug Distribution. 2022 Presented at: 17th Iberian Conference on Information Systems and Technologies (CISTI); June 22-25, 2022; Madrid, Spain. [CrossRef]
  160. Rotbi MF, Motahhir S, El Ghzizal A. Blockchain Technology for a Safe and Transparent Covid-19 Vaccination. Journal of ICT Standardization 2022;10(2):125-144. [CrossRef]
  161. Verma A, Bhattacharya P, Saraswat D, Tanwar S, Kumar N, Sharma R. SanJeeVni: Secure UAV-Envisioned Massive Vaccine Distribution for COVID-19 Underlying 6G Network. IEEE Sensors J 2023 Jan 15;23(2):955-968. [CrossRef]
  162. Enriko IKA, Pramono S, Adrianto D, Alemuda F. COVID-19 Vaccine Distribution Tracking and Monitoring Using IoT. 2021 Presented at: 2021 International Conference on Green Energy, Computing and Sustainable Technology (GECOST); July 7-9, 2021; Miri, Malaysia. [CrossRef]
  163. Rahman A, Islam MJ, Karim MR, Kundu D, Kabir S. An Intelligent Vaccine Distribution Process in COVID-19 Pandemic through Blockchain-SDN Framework from Bangladesh Perspective. 2021 Presented at: 2021 International Conference on Electronics, Communications and Information Technology (ICECIT); September 14-16, 2021; Khulna, Bangladesh. [CrossRef]
  164. Sujatha R, Krishna B, Chatterjee J, Naidu P, Jhanjhi N, Charita C, et al. Prediction of Suitable Candidates for COVID-19 Vaccination. Intelligent Automation & Soft Computing 2022;32(1):525-541 [FREE Full text] [CrossRef]
  165. Ji Z. Vaccination Progress Prediction in the U.S., India, and Brazil by Machine learning models. 2022 Presented at: 3rd International Conference on Electronic Communication and Artificial Intelligence (IWECAI); January 14-16, 2022; Zhuhai, China. [CrossRef]
  166. Zhou X, Li Y. Forecasting the COVID-19 vaccine uptake rate: an infodemiological study in the US. Hum Vaccin Immunother 2022 Dec 31;18(1):2017216 [FREE Full text] [CrossRef] [Medline]
  167. Dutta S, Mukherjee U, Bandyopadhyay SK. Pharmacy Impact on Covid-19 Vaccination Progress Using Machine Learning Approach. JPRI 2021 Jul 24:202-217. [CrossRef]
  168. Bashir S, Rohail K, Qureshi R. LSTM-based Model for Forecasting of COVID-19 Vaccines in Pakistan. 2022 Presented at: 2nd International Conference on Artificial Intelligence (ICAI); March 30-31, 2022; Islamabad, Pakistan. [CrossRef]
  169. Hua F. Coverage Prediction of Novel Coronavirus Vaccine Based on Deep Learning Time Series Analysis. 2021 Presented at: International Conference on Computer Information Science and Artificial Intelligence (CISAI); September 17-19, 2021; Kunming, China. [CrossRef]
  170. Asgary A, Valtchev SZ, Chen M, Najafabadi MM, Wu J. Artificial Intelligence Model of Drive-Through Vaccination Simulation. Int J Environ Res Public Health 2020 Dec 31;18(1):268 [FREE Full text] [CrossRef] [Medline]
  171. Cabezas X, García S, Martin-Barreiro C, Delgado E, Leiva V. A Two-Stage Location Problem with Order Solved Using a Lagrangian Algorithm and Stochastic Programming for a Potential Use in COVID-19 Vaccination Based on Sensor-Related Data. Sensors (Basel) 2021 Aug 09;21(16):5352 [FREE Full text] [CrossRef] [Medline]
  172. Jemmali M. Intelligent algorithms and complex system for a smart parking for vaccine delivery center of COVID-19. Complex Intell Systems 2022 Oct 06;8(1):597-609 [FREE Full text] [CrossRef] [Medline]
  173. Kumar A, Ren J, Ornstein KA, Gliatto PM. Using Machine Learning to Efficiently Vaccinate Homebound Patients Against COVID-19: A Real-time Immunization Campaign. J Med Internet Res 2022 Jul 12;24(7):e37744 [FREE Full text] [CrossRef] [Medline]
  174. Noack EM, Schäning J, Müller F. A Multilingual App for Providing Information to SARS-CoV-2 Vaccination Candidates with Limited Language Proficiency: Development and Pilot. Vaccines (Basel) 2022 Feb 25;10(3):360 [FREE Full text] [CrossRef] [Medline]
  175. Batavia P, Gajera I, Gandhi S, Mody P, Korde S. Accessible Self-Care and Automated Indoor Navigation for COVID-19 Vaccination Centre. 2021 Presented at: 2nd Global Conference for Advancement in Technology (GCAT); October 1-3, 2021; Bangalore, India. [CrossRef]
  176. Demirel DY, Can Ö. ProvVacT: A Provenance Based mHealth Application for Tracking Vaccine History. 2021 Presented at: 45th Annual Computers, Software, and Applications Conference (COMPSAC); July 12-16, 2021; Madrid, Spain. [CrossRef]
  177. Pilati F, Tronconi R, Nollo G, Heragu SS, Zerzer F. Digital Twin of COVID-19 Mass Vaccination Centers. Sustainability 2021 Jul 01;13(13):7396. [CrossRef]
  178. Ford KL, West AB, Bucher A, Osborn CY. Personalized Digital Health Communications to Increase COVID-19 Vaccination in Underserved Populations: A Double Diamond Approach to Behavioral Design. Front Digit Health 2022 Apr 15;4:831093 [FREE Full text] [CrossRef] [Medline]
  179. Alismail S, Chipidza W. Accessibility evaluation of COVID-19 vaccine registration websites across the United States. J Am Med Inform Assoc 2021 Aug 13;28(9):1990-1995 [FREE Full text] [CrossRef] [Medline]
  180. Fuentes AF, Botero DF, Ramirez CT. A Covid-19 Vaccination Tracking and Control Platform in Santiago de Cali. In: Nesmachnow S, Hernández Callejo L, editors. Smart Cities. ICSC-Cities 2021. Communications in Computer and Information Science, vol 1555. Cham: Springer; 2022:178-191.
  181. Ajakwe SO, Akter R, Ahakonye LAC, Kim DS, Lee JM. Real-Time Monitoring of COVID-19 Vaccination Compliance: A Ubiquitous IT Convergence Approach. 2021 Presented at: 2021 International Conference on Information and Communication Technology Convergence (ICTC); October 20-22, 2021; Jeju Island, Republic of Korea. [CrossRef]
  182. Arif M, Shamsudheen S, Ajesh F, Wang G, Chen J. AI bot to detect fake COVID-19 vaccine certificate. IET Inf Secur 2022 Sep 11;16(5):362-372 [FREE Full text] [CrossRef] [Medline]
  183. Kanimozhi S, Arun N, Singh AM, Kumar SS, Tharanidharan T. Identification of Non-Vaccinated People Using Face Recognition Based on CNN. 2022 Presented at: 2022 International Conference on Applied Artificial Intelligence and Computing (ICAAIC); May 09-11, 2022; Salem, India. [CrossRef]
  184. Abubakar M, McCarron P, Jaroucheh Z, Al-Dubai A, Buchanan B. Blockchain-based Platform for Secure Sharing and Validation of Vaccination Certificates. 2021 Presented at: 14th International Conference on Security of Information and Networks (SIN); December 15-17, 2021; Edinburgh, United Kingdom. [CrossRef]
  185. Faroug A, Demirci M. Blockchain-Based Solutions for Effective and Secure Management of Electronic Health Records. 2021 Presented at: 2021 International Conference on Information Security and Cryptology (ISCTURKEY); December 2-3, 2021; Ankara, Turkey. [CrossRef]
  186. Eisenstadt M, Ramachandran M, Chowdhury N, Third A, Domingue J. COVID-19 Antibody Test/Vaccination Certification: There's an App for That. IEEE Open J. Eng. Med. Biol 2020;1:148-155. [CrossRef]
  187. De Moura Costa HJ, Da Costa CA, Da Rosa Righi R, Antunes RS, De Paz Santana JF, Leithardt VRQ. A Fog and Blockchain Software Architecture for a Global Scale Vaccination Strategy. IEEE Access 2022;10:44290-44304. [CrossRef]
  188. Lee HA, Wu W, Kung H, Udayasankaran JG, Wei Y, Kijsanayotin B, et al. Design of a Vaccine Passport Validation System Using Blockchain-based Architecture: Development Study. JMIR Public Health Surveill 2022 Apr 26;8(4):e32411 [FREE Full text] [CrossRef] [Medline]
  189. Mahamud S, Alvi ST. A Framework for Covid-19 Vaccine Management System Using Blockchain Technology. 2021 Presented at: 4th International Conference on Recent Trends in Computer Science and Technology (ICRTCST); February 11-12, 2022; Jamshedpur, India. [CrossRef]
  190. Khan D, Hashmani MA, Jung LT, Junejo AZ. Blockchain Enabled Track-and-Trace Framework for Covid-19 Immunity Certificate. 2022 Presented at: 2nd International Conference on Computing and Information Technology (ICCIT); January 25-27, 2022; Tabuk, Saudi Arabia. [CrossRef]
  191. Loss S, Singh HP, Cacho N, Lopes F. Using FIWARE and Blockchain in Post Pandemic Vaccination Scenario. 2021 Presented at: Third International Conference on Blockchain Computing and Applications (BCCA); November 15-17, 2021; Tartu, Estonia. [CrossRef]
  192. Wilson S. A digital “Yellow Card” for securely recording vaccinations using Community PKI certificates. 2020 Presented at: 2020 IEEE International Symposium on Technology and Society (ISTAS); November 12-15, 2020; Tempe, AZ, USA. [CrossRef]
  193. Lupu C, Turcu CO, Ventuneac C, Găitan VG. The Vaccine’s QR Code is in Your Eyes. International Journal of Computer Science and Network Security 2022;22(4):595-602. [CrossRef]
  194. Wang T, Li C, Li H, Li Z. Urban monitoring, evaluation and application of COVID-19 listed vaccine effectiveness: a health code blockchain study. BMJ Open 2022 Jul 13;12(7):e057281 [FREE Full text] [CrossRef] [Medline]
  195. Yamazaki S, Watanabe K, Okuda Y, Urushihara M, Koshikawa H, Chiba H, et al. Adverse effect investigation using application software after vaccination against SARS-CoV-2 for healthcare workers. J Infect Chemother 2022 Jun;28(6):791-796 [FREE Full text] [CrossRef] [Medline]
  196. Di Filippo M, Avellone A, Belingheri M, Paladino ME, Riva MA, Zambon A, et al. A Mobile App Leveraging Citizenship Engagement to Perform Anonymized Longitudinal Studies in the Context of COVID-19 Adverse Drug Reaction Monitoring: Development and Usability Study. JMIR Hum Factors 2022 Nov 04;9(4):e38701 [FREE Full text] [CrossRef] [Medline]
  197. Pfizer-BioNTech Fact Sheets and FAQs: Health Care Provider Materials - Fact sheet for healthcare providers administering vaccine (vaccination providers): Emergency use authorization (EUA) of the Pfizer-Biontech COVID-19 vaccine to prevent coronavirus disease 2019 (COVID-19). FDA.   URL: https:/​/www.​fda.gov/​emergency-preparedness-and-response/​coronavirus-disease-2019-covid-19/​pfizer-biontech-covid-19-vaccines#additional [accessed 2022-12-05]
  198. Moderna COVID-19 Vaccine Fact Sheets and FAQs: Health Care Provider Materials - Fact sheet for healthcare providers administering vaccine (vaccination providers): Emergency use authorization (EUA) of the Moderna COVID-19 vaccine to prevent coronavirus disease 2019 (COVID-19). FDA.   URL: https:/​/www.​fda.gov/​emergency-preparedness-and-response/​coronavirus-disease-2019-covid-19/​moderna-covid-19-vaccines#additional [accessed 2022-12-05]
  199. Zhang Y, Zeng G, Pan H, Li C, Hu Y, Chu K, et al. Safety, tolerability, and immunogenicity of an inactivated SARS-CoV-2 vaccine in healthy adults aged 18–59 years: a randomised, double-blind, placebo-controlled, phase 1/2 clinical trial. The Lancet Infectious Diseases 2021 Feb;21(2):181-192. [CrossRef]
  200. Weiss EA, Ngo J, Gilbert GH, Quinn JV. Drive-through medicine: a novel proposal for rapid evaluation of patients during an influenza pandemic. Ann Emerg Med 2010 Mar;55(3):268-273. [CrossRef] [Medline]
  201. Gupta A, Evans GW, Heragu SS. Simulation and optimization modeling for drive-through mass vaccination – A generalized approach. Simulation Modelling Practice and Theory 2013 Sep;37:99-106. [CrossRef]
  202. Voo TC, Reis AA, Thomé B, Ho CW, Tam CC, Kelly-Cirino C, et al. Immunity certification for COVID-19: ethical considerations. Bull. World Health Organ 2020 Dec 01;99(2):155-161. [CrossRef]
  203. Resuming our transition towards COVID resilience. Ministry of Health of Singapore.   URL: https://www.moh.gov.sg/news-highlights/details/resuming-our-transition-towards-covid-resilience [accessed 2021-12-03]
  204. Gambhir E, Jain R, Gupta A, Tomer U. Regression Analysis of COVID-19 using Machine Learning Algorithms. 2020 Presented at: 2020 International Conference on Smart Electronics and Communication (ICOSEC); September 10-12, 2020; Trichy, India. [CrossRef]
  205. Polikar R. Ensemble based systems in decision making. IEEE Circuits Syst. Mag 2006;6(3):21-45. [CrossRef]
  206. Zhang Y, Nakanishi R, Sasabe M, Kasahara S. Combining IOTA and Attribute-Based Encryption for Access Control in the Internet of Things. Sensors (Basel) 2021 Jul 26;21(15):5053 [FREE Full text] [CrossRef] [Medline]
  207. Hu J, Reed MJ, Al-Naday M, Thomos N. Hybrid Blockchain for IoT-Energy Analysis and Reward Plan. Sensors (Basel) 2021 Jan 05;21(1):305 [FREE Full text] [CrossRef] [Medline]
  208. Wood G. Ethereum: A secure decentralised generalised transaction ledger. GitHub.   URL: https://ethereum.github.io/yellowpaper/paper.pdf [accessed 2022-11-26]
  209. Fuller A, Fan Z, Day C, Barlow C. Digital Twin: Enabling Technologies, Challenges and Open Research. IEEE Access 2020;8:108952-108971. [CrossRef]
  210. Bruynseels K, Santoni de Sio F, van den Hoven J. Digital Twins in Health Care: Ethical Implications of an Emerging Engineering Paradigm. Front Genet 2018;9:31 [FREE Full text] [CrossRef] [Medline]
  211. Tao F, Cheng J, Qi Q, Zhang M, Zhang H, Sui F. Digital twin-driven product design, manufacturing and service with big data. Int J Adv Manuf Technol 2017 Mar 16;94(9-12):3563-3576. [CrossRef]
  212. The Lancet. COVID-19: fighting panic with information. The Lancet 2020 Feb;395(10224):537. [CrossRef]
  213. Mheidly N, Fares J. Leveraging media and health communication strategies to overcome the COVID-19 infodemic. J Public Health Policy 2020 Dec 21;41(4):410-420 [FREE Full text] [CrossRef] [Medline]
  214. Wang A, Zhang J. Topic discovery method based on topic model combined with hierarchical clustering. 2020 Presented at: 5th Information Technology and Mechatronics Engineering Conference (ITOEC); June 12-14, 2020; Chongqing, China. [CrossRef]
  215. Zhou X, Song Y, Jiang H, Wang Q, Qu Z, Zhou X, et al. Comparison of Public Responses to Containment Measures During the Initial Outbreak and Resurgence of COVID-19 in China: Infodemiology Study. J Med Internet Res 2021 Apr 05;23(4):e26518 [FREE Full text] [CrossRef] [Medline]
  216. Chen Y, Zhang H, Liu R, Ye Z, Lin J. Experimental explorations on short text topic mining between LDA and NMF based Schemes. Knowledge-Based Systems 2019 Jan;163:1-13. [CrossRef]


IoT: Internet of Things
LDA: latent Dirichlet allocation
LSTM: long short-term memory
mHealth: mobile health
PRISMA-ScR: Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews
VADER: Valence Aware Dictionary and Sentiment Reasoner


Edited by A Mavragani; submitted 03.06.22; peer-reviewed by Z Han, S Lin; comments to author 25.07.22; revised version received 18.12.22; accepted 13.01.23; published 10.02.23

Copyright

©Shujie Zang, Xu Zhang, Yuting Xing, Jiaxian Chen, Leesa Lin, Zhiyuan Hou. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 10.02.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.