Published on in Vol 26 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/41559, first published .
Response of Unvaccinated US Adults to Official Information About the Pause in Use of the Johnson & Johnson–Janssen COVID-19 Vaccine: Cross-Sectional Survey Study

Response of Unvaccinated US Adults to Official Information About the Pause in Use of the Johnson & Johnson–Janssen COVID-19 Vaccine: Cross-Sectional Survey Study

Response of Unvaccinated US Adults to Official Information About the Pause in Use of the Johnson & Johnson–Janssen COVID-19 Vaccine: Cross-Sectional Survey Study

Authors of this article:

Vishala Mishra1 Author Orcid Image ;   Joseph P Dexter2, 3, 4 Author Orcid Image

Research Letter

1Department of Biostatistics and Bioinformatics, Duke University School of Medicine, Durham, NC, United States

2Data Science Initiative, Harvard University, Allston, MA, United States

3Department of Human Evolutionary Biology, Harvard University, Cambridge, MA, United States

4Institute of Collaborative Innovation, University of Macau, Taipa, Macao

*all authors contributed equally

Corresponding Author:

Joseph P Dexter, PhD

Data Science Initiative

Harvard University

Science and Engineering Complex 1.312-10

150 Western Avenue

Allston, MA, 02134

United States

Phone: 1 8023381330

Email: jdexter@fas.harvard.edu


Using a rapid response web-based survey, we identified gaps in public understanding of the Centers for Disease Control and Prevention’s messaging about the pause in use of the Johnson & Johnson–Janssen COVID-19 vaccine and estimated changes in vaccine hesitancy using counterfactual questions.

J Med Internet Res 2024;26:e41559

doi:10.2196/41559

Keywords



On April 13, 2021, the Centers for Disease Control and Prevention (CDC) and Food and Drug Administration recommended a pause in use of the Johnson & Johnson (J&J)–Janssen COVID-19 vaccine due to 6 reports of cerebral venous sinus thrombosis in recently vaccinated individuals [1]. The announcement of the pause required development of a coordinated communication strategy under extreme time pressure and careful messaging by stakeholders to mitigate reduced public confidence in COVID-19 vaccines [2]. Moreover, official communication efforts had to consider the potential influence of already widespread misinformation about the vaccines on attitudes toward the pause [3,4]. In this survey study, we evaluated understanding and impressions of the CDC’s public web-based information about the J&J-Janssen pause among unvaccinated US adults.


Web-Based Survey About J&J-Janssen Pause

We administered the web-based survey to two cohorts of US adults recruited through Prolific between April 19-21, 2021 (cohort A), and April 21-23, 2021 (cohort B). Both cohorts were assembled using convenience sampling of unvaccinated adults. To obtain information about a population that especially needed targeted vaccine communication, the first cohort was restricted to individuals expressing neutral or negative sentiments about COVID-19 vaccines. The survey design and recruitment strategy are described in Multimedia Appendix 1; the survey questions are provided in Multimedia Appendices 2 and 3.

Ethical Considerations

The study was approved by Harvard University’s Committee on the Use of Human Subjects (IRB20-2089), and participants agreed to a consent statement on the first page of the survey. Participants were paid US $2 for taking the survey. All study data were collected anonymously.


A total of 271 and 286 participants were included in cohorts A and B, respectively (demographic characteristics listed in Table 1). Across participants, the median number of correct responses to the comprehension questions was 6 in both cohort A (IQR 1.5; range 0-7) and cohort B (IQR 1.0; range 1-7). The total number of correct responses was negatively associated with intention not to seek vaccination in both cohort A (odds ratio 0.61, 95% CI 0.45-0.82; P=.001) and cohort B (odds ratio 0.48, 95% CI 0.31-0.74; P=.001; Multimedia Appendix 4). Although a majority of participants rated the passages as “clear and easy to read” (cohort A: n=229, 84.5%; cohort B: n=243, 85%), fewer indicated that they would be likely to share them on social media (cohort A: n=53, 19.6%; cohort B: n=75, 26.3%).

The web page mentioned “a small number of reports” of cerebral venous sinus thrombosis in individuals who received the J&J-Janssen vaccine. When asked to guess a specific number, 188 (69.4%) and 133 (46.5%) respondents in cohorts A and B, respectively, estimated 100 or more cases, at least an order of magnitude higher than the actual value; 176 (64.9%) and 128 (44.8%) respondents in cohorts A and B, respectively, estimated 10 or more deaths after vaccination (Figure 1).

Responding to a counterfactual question, 127 (46.9%) and 139 (48.6%) participants in cohorts A and B, respectively, indicated that the pause reduced their confidence in the J&J-Janssen vaccine’s safety (Figure 1). Most participants reported no change in their confidence in COVID-19 vaccines’ safety in general (cohort A: n=182, 67.2%; cohort B: n=194, 67.8%) or intention to receive the Pfizer-BioNTech or Moderna vaccine (cohort A: n=206, 76%; cohort B: n=211, 73.8%).

Table 1. Characteristics and responses of participants who completed the web-based surveys about the Johnson & Johnson (J&J)–Janssen vaccine pause.
CharacteristicsCohort A (n=271), n (%)Cohort B (n=286), n (%)
Age (years)

18-29119 (43.9)145 (50.7)

30-49116 (42.8)111 (38.9)

≥5036 (13.3)30 (10.5)
Gender

Female144 (53.1)136 (47.6)

Male124 (45.8)144 (50.3)

Nonbinary, transgender, or other3 (1.1)6 (2.1)
Ethnicity: Hispanic or Latinx54 (20.0)39 (13.6)
Racea

Asian29 (10.7)96 (33.6)

Black or African American70 (25.8)37 (12.9)

White160 (59.0)139 (48.6)

Otherb27 (10.0)28 (9.8)
Educational attainment

Less than high school diploma3 (1.1)6 (2.1)

High school diploma or equivalent54 (19.9)46 (16.1)

Some college or associate’s degree102 (37.6)106 (37.1)

Bachelor’s degree81 (29.9)102 (35.7)

Graduate or professional degree31 (11.4)26 (9.1)
Political partisanship

Democratic (including leaners)81 (29.9)150 (52.4)

Republican (including leaners)91 (33.6)42 (14.7)

Independent or other99 (36.5)94 (32.9)
Geography

Rural area41 (15.1)35 (12.2)

Suburban or urban area230 (84.9)251 (87.8)
Intention to receive vaccine

Definitely will not71 (26.2)29 (10.1)

Probably will not68 (25.1)17 (5.9)

Undecided54 (19.9)29 (10.1)

Definitely or probably will78 (28.8)211 (73.8)
Comprehension questionsc

Reason for pause259 (95.6)280 (97.9)

Causal relationship between vaccine and side effect196 (72.3)215 (75.2)

Affected population234 (86.3)248 (86.7)

Safety of mRNA vaccines214 (79.0)250 (87.4)

Revaccination of J&J-Janssen recipients164 (60.5)189 (66.1)

Symptom monitoring for J&J-Janssen recipients180 (66.4)121 (42.3)

Rescheduling of canceled appointments192 (70.8)229 (80.1)
Comprehension scored

762 (22.9)43 (15.0)

680 (29.5)119 (41.6)

561 (22.5)59 (20.6)

433 (12.2)38 (13.3)

324 (8.9)18 (6.3)

0-211 (4.1)9 (3.1)
Self-reported impressions of passagee

Accurate and should be trusted119 (43.9)198 (69.2)

High-quality evidence110 (40.6)180 (62.9)

Clear and easy to read229 (84.5)243 (85.0)

Understandable229 (84.5)251 (87.8)

Requiring great effort to understand58 (21.4)69 (24.1)

Other people would want to read173 (63.8)172 (60.1)

Would share on social media53 (19.6)75 (26.2)

aParticipants could select more than one option.

bIncludes participants who selected “American Indian or Alaska Native,” “Native Hawaiian or Other Pacific Islander,” or “Another option not listed here.”

cNumber of participants who gave the correct answer to each question.

dNumber of participants who gave the indicated number of correct answers across all questions.

eNumber of participants who answered “Strongly agree” or “Agree” about each description on a 6-point Likert scale.

Figure 1. Self-reported attitude changes and estimated cases and deaths. J&J: Johnson & Johnson.

In our web-based survey about the CDC’s messaging around the J&J-Janssen vaccine pause, many respondents overestimated the number of case reports that prompted the pause, often by several orders of magnitude. Since verbal descriptors are elastic concepts that can be misinterpreted, grounding them with numbers can reduce variability in risk perception and promote informed decision-making [5].

Respondents also expressed reduced confidence in the safety of the J&J-Janssen vaccine, highlighting the potential danger of conveying piecemeal information about risk during a pandemic response [3]. Encouragingly, the reduced confidence did not extend to mRNA COVID-19 vaccines, consistent with previous findings that overall vaccine hesitancy remained stable following the pause [6]. These results were obtained using the counterfactual format, which is less susceptible to overestimating shifts in beliefs than the change format (Multimedia Appendix 1). The negative association between understanding of the passage and self-reported vaccine hesitancy suggests that more targeted messaging may have been useful to promote vaccine confidence [7,8].

Consistent with uncertainty management theory [9], individuals likely viewed the pause in different ways, leading to a spectrum of emotional responses and changes in behavior. Despite being a safety precaution, the pause introduced new uncertainties requiring effective management through clear and consistent messaging, highlighting the balance that must be maintained between fostering trust and preventing unnecessary alarm [10]. Given the limitations of the deficit model of scientific communication [11], just providing technically correct information is insufficient for effective communication during public health crises. Instead, attention should be given to the accessibility of information across diverse socioeconomic groups, in line with the knowledge gap hypothesis [12], and to countering misinformation by providing easy-to-use official guidance [6,7].

The study is limited by the convenience sampling strategy; the participants recruited were not representative of the US population as a whole, and the findings should not be generalized to other contexts. Since the study was conducted on the web, individuals with lower internet and health literacy may have been excluded.

Acknowledgments

We thank Vasudha Mishra, MBBS, for assistance with graphic design. This work was supported by a CoronaVirusFacts Alliance Grant from the Poynter Institute, a Harvard Data Science Fellowship, and the Institute of Collaborative Innovation at the University of Macau.

Data Availability

The data sets generated during this study are available from the corresponding author upon reasonable request.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Additional information about survey methodology.

PDF File (Adobe PDF File), 99 KB

Multimedia Appendix 2

Survey administered to cohort A.

PDF File (Adobe PDF File), 107 KB

Multimedia Appendix 3

Survey administered to cohort B.

PDF File (Adobe PDF File), 99 KB

Multimedia Appendix 4

Supplemental tables about survey questions and ordinal logistic regression analysis.

PDF File (Adobe PDF File), 90 KB

  1. Karron RA, Key NS, Sharfstein JM. Assessing a rare and serious adverse event following administration of the Ad26.COV2.S vaccine. JAMA. Jul 22, 2021;325(24):2445-2447. [CrossRef] [Medline]
  2. Wood S, Schulman K. Beyond politics—promoting Covid-19 vaccination in the United States. N Engl J Med. Mar 18, 2021;384(7):e23. [CrossRef] [Medline]
  3. Lee JJ, Kang K, Wang MP, Zhao SZ, Wong JYH, O'Connor S, et al. Associations between COVID-19 misinformation exposure and belief with COVID-19 knowledge and preventive behaviors: cross-sectional online study. J Med Internet Res. Dec 13, 2020;22(11):e22205. [FREE Full text] [CrossRef] [Medline]
  4. Ginossar T, Cruickshank IJ, Zheleva E, Sulskis J, Berger-Wolf T. Cross-platform spread: vaccine-related content, sources, and conspiracy theories in YouTube videos shared in early Twitter COVID-19 conversations. Hum Vaccin Immunother. Dec 31, 2022;18(1):1-13. [FREE Full text] [CrossRef] [Medline]
  5. Edwards A, Elwyn G, Mulley A. Explaining risks: turning numerical data into meaningful pictures. BMJ. May 06, 2002;324(7341):827-830. [FREE Full text] [CrossRef] [Medline]
  6. Hsieh YL, Rak S, SteelFisher GK, Bauhoff S. Effect of the suspension of the J&J COVID-19 vaccine on vaccine hesitancy in the United States. Vaccine. Jan 24, 2022;40(3):424-427. [FREE Full text] [CrossRef] [Medline]
  7. Miller M, Castrucci BC. Changing the COVID-19 conversation: it's about language. JAMA Health Forum. Mar 01, 2021;2(2):e210020. [FREE Full text] [CrossRef] [Medline]
  8. Mishra V, Dexter JP. Comparison of readability of official public health information about COVID-19 on websites of international agencies and the governments of 15 countries. JAMA Netw Open. Aug 03, 2020;3(8):e2018033. [FREE Full text] [CrossRef] [Medline]
  9. Brashers D. Communication and uncertainty management. J Commun. 2001;51(3):477-497. [CrossRef]
  10. Petersen MB, Bor A, Jørgensen F, Lindholt MF. Transparent communication about negative features of COVID-19 vaccines decreases acceptance but increases trust. Proc Natl Acad Sci U S A. Jul 20, 2021;118(29):e2024597118. [FREE Full text] [CrossRef] [Medline]
  11. Reincke CM, Bredenoord AL, van Mil MH. From deficit to dialogue in science communication: the dialogue communication model requires additional roles from scientists. EMBO Rep. Oct 03, 2020;21(9):e51278. [FREE Full text] [CrossRef] [Medline]
  12. Lind F, Boomgaarden HG. What we do and don’t know: a meta-analysis of the knowledge gap hypothesis. Ann Int Commun Assoc. May 09, 2019;43(3):210-224. [CrossRef]


CDC: Centers for Disease Control and Prevention
J&J: Johnson & Johnson


Edited by A Mavragani; submitted 25.08.22; peer-reviewed by M Graham, T Ginossar, A Scherer; comments to author 25.01.23; revised version received 26.05.23; accepted 29.12.23; published 01.04.24.

Copyright

©Vishala Mishra, Joseph P Dexter. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 01.04.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.