Research Letter
Abstract
Using a rapid response web-based survey, we identified gaps in public understanding of the Centers for Disease Control and Prevention’s messaging about the pause in use of the Johnson & Johnson–Janssen COVID-19 vaccine and estimated changes in vaccine hesitancy using counterfactual questions.
J Med Internet Res 2024;26:e41559doi:10.2196/41559
Keywords
Introduction
On April 13, 2021, the Centers for Disease Control and Prevention (CDC) and Food and Drug Administration recommended a pause in use of the Johnson & Johnson (J&J)–Janssen COVID-19 vaccine due to 6 reports of cerebral venous sinus thrombosis in recently vaccinated individuals [
]. The announcement of the pause required development of a coordinated communication strategy under extreme time pressure and careful messaging by stakeholders to mitigate reduced public confidence in COVID-19 vaccines [ ]. Moreover, official communication efforts had to consider the potential influence of already widespread misinformation about the vaccines on attitudes toward the pause [ , ]. In this survey study, we evaluated understanding and impressions of the CDC’s public web-based information about the J&J-Janssen pause among unvaccinated US adults.Methods
Web-Based Survey About J&J-Janssen Pause
We administered the web-based survey to two cohorts of US adults recruited through Prolific between April 19-21, 2021 (cohort A), and April 21-23, 2021 (cohort B). Both cohorts were assembled using convenience sampling of unvaccinated adults. To obtain information about a population that especially needed targeted vaccine communication, the first cohort was restricted to individuals expressing neutral or negative sentiments about COVID-19 vaccines. The survey design and recruitment strategy are described in
; the survey questions are provided in and .Ethical Considerations
The study was approved by Harvard University’s Committee on the Use of Human Subjects (IRB20-2089), and participants agreed to a consent statement on the first page of the survey. Participants were paid US $2 for taking the survey. All study data were collected anonymously.
Results
A total of 271 and 286 participants were included in cohorts A and B, respectively (demographic characteristics listed in
). Across participants, the median number of correct responses to the comprehension questions was 6 in both cohort A (IQR 1.5; range 0-7) and cohort B (IQR 1.0; range 1-7). The total number of correct responses was negatively associated with intention not to seek vaccination in both cohort A (odds ratio 0.61, 95% CI 0.45-0.82; P=.001) and cohort B (odds ratio 0.48, 95% CI 0.31-0.74; P=.001; ). Although a majority of participants rated the passages as “clear and easy to read” (cohort A: n=229, 84.5%; cohort B: n=243, 85%), fewer indicated that they would be likely to share them on social media (cohort A: n=53, 19.6%; cohort B: n=75, 26.3%).The web page mentioned “a small number of reports” of cerebral venous sinus thrombosis in individuals who received the J&J-Janssen vaccine. When asked to guess a specific number, 188 (69.4%) and 133 (46.5%) respondents in cohorts A and B, respectively, estimated 100 or more cases, at least an order of magnitude higher than the actual value; 176 (64.9%) and 128 (44.8%) respondents in cohorts A and B, respectively, estimated 10 or more deaths after vaccination (
).Responding to a counterfactual question, 127 (46.9%) and 139 (48.6%) participants in cohorts A and B, respectively, indicated that the pause reduced their confidence in the J&J-Janssen vaccine’s safety (
). Most participants reported no change in their confidence in COVID-19 vaccines’ safety in general (cohort A: n=182, 67.2%; cohort B: n=194, 67.8%) or intention to receive the Pfizer-BioNTech or Moderna vaccine (cohort A: n=206, 76%; cohort B: n=211, 73.8%).Characteristics | Cohort A (n=271), n (%) | Cohort B (n=286), n (%) | |||
Age (years) | |||||
18-29 | 119 (43.9) | 145 (50.7) | |||
30-49 | 116 (42.8) | 111 (38.9) | |||
≥50 | 36 (13.3) | 30 (10.5) | |||
Gender | |||||
Female | 144 (53.1) | 136 (47.6) | |||
Male | 124 (45.8) | 144 (50.3) | |||
Nonbinary, transgender, or other | 3 (1.1) | 6 (2.1) | |||
Ethnicity: Hispanic or Latinx | 54 (20.0) | 39 (13.6) | |||
Racea | |||||
Asian | 29 (10.7) | 96 (33.6) | |||
Black or African American | 70 (25.8) | 37 (12.9) | |||
White | 160 (59.0) | 139 (48.6) | |||
Otherb | 27 (10.0) | 28 (9.8) | |||
Educational attainment | |||||
Less than high school diploma | 3 (1.1) | 6 (2.1) | |||
High school diploma or equivalent | 54 (19.9) | 46 (16.1) | |||
Some college or associate’s degree | 102 (37.6) | 106 (37.1) | |||
Bachelor’s degree | 81 (29.9) | 102 (35.7) | |||
Graduate or professional degree | 31 (11.4) | 26 (9.1) | |||
Political partisanship | |||||
Democratic (including leaners) | 81 (29.9) | 150 (52.4) | |||
Republican (including leaners) | 91 (33.6) | 42 (14.7) | |||
Independent or other | 99 (36.5) | 94 (32.9) | |||
Geography | |||||
Rural area | 41 (15.1) | 35 (12.2) | |||
Suburban or urban area | 230 (84.9) | 251 (87.8) | |||
Intention to receive vaccine | |||||
Definitely will not | 71 (26.2) | 29 (10.1) | |||
Probably will not | 68 (25.1) | 17 (5.9) | |||
Undecided | 54 (19.9) | 29 (10.1) | |||
Definitely or probably will | 78 (28.8) | 211 (73.8) | |||
Comprehension questionsc | |||||
Reason for pause | 259 (95.6) | 280 (97.9) | |||
Causal relationship between vaccine and side effect | 196 (72.3) | 215 (75.2) | |||
Affected population | 234 (86.3) | 248 (86.7) | |||
Safety of mRNA vaccines | 214 (79.0) | 250 (87.4) | |||
Revaccination of J&J-Janssen recipients | 164 (60.5) | 189 (66.1) | |||
Symptom monitoring for J&J-Janssen recipients | 180 (66.4) | 121 (42.3) | |||
Rescheduling of canceled appointments | 192 (70.8) | 229 (80.1) | |||
Comprehension scored | |||||
7 | 62 (22.9) | 43 (15.0) | |||
6 | 80 (29.5) | 119 (41.6) | |||
5 | 61 (22.5) | 59 (20.6) | |||
4 | 33 (12.2) | 38 (13.3) | |||
3 | 24 (8.9) | 18 (6.3) | |||
0-2 | 11 (4.1) | 9 (3.1) | |||
Self-reported impressions of passagee | |||||
Accurate and should be trusted | 119 (43.9) | 198 (69.2) | |||
High-quality evidence | 110 (40.6) | 180 (62.9) | |||
Clear and easy to read | 229 (84.5) | 243 (85.0) | |||
Understandable | 229 (84.5) | 251 (87.8) | |||
Requiring great effort to understand | 58 (21.4) | 69 (24.1) | |||
Other people would want to read | 173 (63.8) | 172 (60.1) | |||
Would share on social media | 53 (19.6) | 75 (26.2) |
aParticipants could select more than one option.
bIncludes participants who selected “American Indian or Alaska Native,” “Native Hawaiian or Other Pacific Islander,” or “Another option not listed here.”
cNumber of participants who gave the correct answer to each question.
dNumber of participants who gave the indicated number of correct answers across all questions.
eNumber of participants who answered “Strongly agree” or “Agree” about each description on a 6-point Likert scale.
Discussion
In our web-based survey about the CDC’s messaging around the J&J-Janssen vaccine pause, many respondents overestimated the number of case reports that prompted the pause, often by several orders of magnitude. Since verbal descriptors are elastic concepts that can be misinterpreted, grounding them with numbers can reduce variability in risk perception and promote informed decision-making [
].Respondents also expressed reduced confidence in the safety of the J&J-Janssen vaccine, highlighting the potential danger of conveying piecemeal information about risk during a pandemic response [
]. Encouragingly, the reduced confidence did not extend to mRNA COVID-19 vaccines, consistent with previous findings that overall vaccine hesitancy remained stable following the pause [ ]. These results were obtained using the counterfactual format, which is less susceptible to overestimating shifts in beliefs than the change format ( ). The negative association between understanding of the passage and self-reported vaccine hesitancy suggests that more targeted messaging may have been useful to promote vaccine confidence [ , ].Consistent with uncertainty management theory [
], individuals likely viewed the pause in different ways, leading to a spectrum of emotional responses and changes in behavior. Despite being a safety precaution, the pause introduced new uncertainties requiring effective management through clear and consistent messaging, highlighting the balance that must be maintained between fostering trust and preventing unnecessary alarm [ ]. Given the limitations of the deficit model of scientific communication [ ], just providing technically correct information is insufficient for effective communication during public health crises. Instead, attention should be given to the accessibility of information across diverse socioeconomic groups, in line with the knowledge gap hypothesis [ ], and to countering misinformation by providing easy-to-use official guidance [ , ].The study is limited by the convenience sampling strategy; the participants recruited were not representative of the US population as a whole, and the findings should not be generalized to other contexts. Since the study was conducted on the web, individuals with lower internet and health literacy may have been excluded.
Acknowledgments
We thank Vasudha Mishra, MBBS, for assistance with graphic design. This work was supported by a CoronaVirusFacts Alliance Grant from the Poynter Institute, a Harvard Data Science Fellowship, and the Institute of Collaborative Innovation at the University of Macau.
Data Availability
The data sets generated during this study are available from the corresponding author upon reasonable request.
Conflicts of Interest
None declared.
Additional information about survey methodology.
PDF File (Adobe PDF File), 99 KBSurvey administered to cohort A.
PDF File (Adobe PDF File), 107 KBSurvey administered to cohort B.
PDF File (Adobe PDF File), 99 KBSupplemental tables about survey questions and ordinal logistic regression analysis.
PDF File (Adobe PDF File), 90 KBReferences
- Karron RA, Key NS, Sharfstein JM. Assessing a rare and serious adverse event following administration of the Ad26.COV2.S vaccine. JAMA. Jul 22, 2021;325(24):2445-2447. [CrossRef] [Medline]
- Wood S, Schulman K. Beyond politics—promoting Covid-19 vaccination in the United States. N Engl J Med. Mar 18, 2021;384(7):e23. [CrossRef] [Medline]
- Lee JJ, Kang K, Wang MP, Zhao SZ, Wong JYH, O'Connor S, et al. Associations between COVID-19 misinformation exposure and belief with COVID-19 knowledge and preventive behaviors: cross-sectional online study. J Med Internet Res. Dec 13, 2020;22(11):e22205. [FREE Full text] [CrossRef] [Medline]
- Ginossar T, Cruickshank IJ, Zheleva E, Sulskis J, Berger-Wolf T. Cross-platform spread: vaccine-related content, sources, and conspiracy theories in YouTube videos shared in early Twitter COVID-19 conversations. Hum Vaccin Immunother. Dec 31, 2022;18(1):1-13. [FREE Full text] [CrossRef] [Medline]
- Edwards A, Elwyn G, Mulley A. Explaining risks: turning numerical data into meaningful pictures. BMJ. May 06, 2002;324(7341):827-830. [FREE Full text] [CrossRef] [Medline]
- Hsieh YL, Rak S, SteelFisher GK, Bauhoff S. Effect of the suspension of the J&J COVID-19 vaccine on vaccine hesitancy in the United States. Vaccine. Jan 24, 2022;40(3):424-427. [FREE Full text] [CrossRef] [Medline]
- Miller M, Castrucci BC. Changing the COVID-19 conversation: it's about language. JAMA Health Forum. Mar 01, 2021;2(2):e210020. [FREE Full text] [CrossRef] [Medline]
- Mishra V, Dexter JP. Comparison of readability of official public health information about COVID-19 on websites of international agencies and the governments of 15 countries. JAMA Netw Open. Aug 03, 2020;3(8):e2018033. [FREE Full text] [CrossRef] [Medline]
- Brashers D. Communication and uncertainty management. J Commun. 2001;51(3):477-497. [CrossRef]
- Petersen MB, Bor A, Jørgensen F, Lindholt MF. Transparent communication about negative features of COVID-19 vaccines decreases acceptance but increases trust. Proc Natl Acad Sci U S A. Jul 20, 2021;118(29):e2024597118. [FREE Full text] [CrossRef] [Medline]
- Reincke CM, Bredenoord AL, van Mil MH. From deficit to dialogue in science communication: the dialogue communication model requires additional roles from scientists. EMBO Rep. Oct 03, 2020;21(9):e51278. [FREE Full text] [CrossRef] [Medline]
- Lind F, Boomgaarden HG. What we do and don’t know: a meta-analysis of the knowledge gap hypothesis. Ann Int Commun Assoc. May 09, 2019;43(3):210-224. [CrossRef]
Abbreviations
CDC: Centers for Disease Control and Prevention |
J&J: Johnson & Johnson |
Edited by A Mavragani; submitted 25.08.22; peer-reviewed by M Graham, T Ginossar, A Scherer; comments to author 25.01.23; revised version received 26.05.23; accepted 29.12.23; published 01.04.24.
Copyright©Vishala Mishra, Joseph P Dexter. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 01.04.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.