This paper is in the following e-collection/theme issue:

Theme Issue: The New Digital Normal in Health and Medicine (33) Quality/Credibility of eHealth Information and Trust Issues (492) Public Health (163) Infoveillance, Infodemiology, Digital Disease Surveillance, Infodemic Management (1015)

Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/42528, first published .
Assessing the Effect of Nonvisual Information Factors in Pandemic-Related Video Communication: Randomized Controlled Between-Subjects Experiment

Assessing the Effect of Nonvisual Information Factors in Pandemic-Related Video Communication: Randomized Controlled Between-Subjects Experiment

Assessing the Effect of Nonvisual Information Factors in Pandemic-Related Video Communication: Randomized Controlled Between-Subjects Experiment

Authors of this article:

Daniel Adrian Lungu1 Author Orcid Image ;   Jo Røislien1 Author Orcid Image ;   Siv Hilde Berg1 Author Orcid Image ;   Ionica Smeets2 Author Orcid Image ;   Marie Therese Shortt1 Author Orcid Image ;   Henriette Thune1 Author Orcid Image ;   Kolbjørn Kallesten Brønnick1 Author Orcid Image
Article Authors Cited by (1) Tweetations (4) Metrics

    Original Paper

    1SHARE – Centre for Resilience in Healthcare, Department of Quality and Health Technology, Faculty of Health Sciences, University of Stavanger, Stavanger, Norway

    2Science Communication and Society, Institute of Biology, Leiden University, Leiden, Netherlands

    Corresponding Author:

    Daniel Adrian Lungu, PhD

    SHARE – Centre for Resilience in Healthcare, Department of Quality and Health Technology

    Faculty of Health Sciences

    University of Stavanger

    PO Box 8600

    Stavanger, 4036

    Norway

    Phone: 47 91532327

    Email: daniel.a.lungu@uis.no


    Background: Videos have been an important medium for providing health and risk communication to the public during the COVID-19 pandemic. Public health officials, health care professionals, and policy makers have used videos to communicate pandemic-related content to large parts of the population. Evidence regarding the outcomes of such communication, along with their determinants, is however limited.

    Objective: The aim of this study was to test the impact of nonvisual information factors of video communication on 4 outcomes: trust, comprehension, intentions, and behavior.

    Methods: Twelve short health communication videos related to pandemics were produced and shown to a large sample of participants, applying a randomized controlled between-subjects design. Three factors were included in the creation of the videos: the topic (exponential growth, handwashing, and burden of pandemics on the health care system), the source (expert and nonexpert), and a call to action (present or absent). Participants were randomly assigned to 1 video intervention, and 1194 valid replies were collected. The data were analyzed using factorial ANOVA.

    Results: The 3 pandemic-related topics did not affect trust, comprehension, intentions, or behavior. Trust was positively influenced by an expert source (2.5%), whereas a nonexpert source instead had a positive effect on the proxy for behavior (5.7%) compared with the expert source. The inclusion of a call to action had a positive effect on both trust (4.1%) and comprehension (15%).

    Conclusions: Trust and comprehension in pandemic-related video communication can be enhanced by using expert sources and by including a call to action, irrespective of the topic being communicated. Intentions and behavior appear to be affected to a small extent by the 3 factors tested in this study.

    International Registered Report Identifier (IRRID): RR2-10.2196/34275

    J Med Internet Res 2023;25:e42528

    doi:10.2196/42528

    Keywords

    video communication; COVID-19; trust; comprehension; intentions; behavior; visual; pandemic; risk; communication; policy; behavior; effect; video; experiment 


    Background

    Videos have been an important medium for providing health and risk communication to the public during the COVID-19 pandemic [1,2]. Public health officials, health care professionals, and policy makers have used videos to communicate pandemic-related content to large parts of the population. However, pandemic health communication videos made by health authorities have been found to lack in creativity and have limited reach [3]. Although research has identified certain traits of successful health communication, sparse research exists on the association between video features and the outcomes of such communication [4].

    The modified Integrated-Change Model [4,5] highlights how the 4 dimensions of health communication outcome (emotion, awareness, motivation, and action) are influenced by both factors related to the communication (eg, design of message and choice of source) and factors inherent in the receiver (eg, biological and psychological factors). Although the latter factors are important when creating effective and targeted communication, they cannot be manipulated by the communication creators. The information factors, however, can. How effectful it is to tweak these factors is largely unknown.

    This study addresses the research gap regarding the effect of nonvisual information factors on communication outcomes. The aim of the study is to assess the effect of 3 aspects of the messenger (source) and the message (topic and call to action) on the outcomes (trust, comprehension, intentions, and behavior) of pandemic video communication. Therefore, the source, topic, and call to action are the independent variables, whereas trust, comprehension, intentions, and behavior are the dependent variables of our study. The rationale for the choice of variables is described in the following paragraphs.

    Messenger and Source Factors

    The source refers to the origin of the information being communicated. This can be an expert source (eg, research organizations, universities, and government departments) or a nonexpert one (eg, colleagues, friends, and word of mouth). Although expert sources are constituted in some regularized or legal manner in relation to the user, nonexpert sources have no such basis [6]. The choice of presenter used in a video is found to be an important factor in gaining viewers’ trust [7]. Trust in scientists and health experts is generally high [8,9], and health authorities often use field experts as presenters [3]. Nevertheless, scientists and field experts are frequently used as presenters in public communication, despite generally being untrained in mass media communication [10].

    Message Factors

    Although the messenger is important, tailored message topics are considered the core of health communication. It is through messages we construct, modify, and maintain meanings of health with the audience [11-13]. Messages influence both individuals and groups, and through societal influence, messages are capable of changing norms and policies [14,15]. To succeed with health communication, tailored messages are needed [12,13,16-18].

    During the response phase of the recent COVID-19 pandemic, the importance of washing hands, understanding rapid spread and exponential growth, and the potentially negative impact of several infected people on the capacity of health care systems were among the topics communicated to the population.

    The importance of washing hands was highlighted by the World Health Organization both through developing guidance [19] and in press conferences during the early stage of the pandemic [20,21]. Multiple research articles later contributed to reiterating the role of handwashing in infection prevention [22,23].

    The potential for extreme growth in cases of a pandemic is linked to the mathematical phenomenon of exponential growth. Exponential growth is fiercely difficult to communicate [24]. Yet, exponential growth and the accompanying basic reproduction number have been among the most common metrics used by policy makers and scientists to communicate whether the spread of COVID-19 is increasing or decreasing in magnitude. The reproduction number has been used frequently by policy makers and scientists to communicate about the COVID-19 pandemic to the public and to make decisions regarding issues such as mandatory social distancing, use of face masks, and lockdowns [25].

    The number of hospitalized patients with COVID-19 challenged the capacity of hospitals to admit patients and deliver care. This was the case worldwide, for acute and intensive care beds, both for patients with COVID-19 and those without COVID-19. Standard health care operations were put at risk, and in some cases, elective and planned surgical activity was postponed because of this lack of capacity [26-29]. Capacity constraints were at the core of the discussion also in Norway, and policy makers tried to openly communicate this to the public, with the aim of providing explanations for the reasoning behind restrictive measures [30].

    Health communication strives to support and empower rather than convince the public [31]. Providing people with fact-based information, which helps them make informed choices, is considered the gold standard [32,33]. Authorities may however seek to recommend people to follow recommendations in a crisis situation, not merely informing the public [34]. Yet, being too persuasive could reduce compliance and public trust [34]. A call to action has been suggested as a further means for changing people’s behavior [35,36]. Calls to action are used in marketing to tell or encourage prospects and website or social media users what to do with the information they have been presented with. To be effective, calls to action should be valuable, easy to use, prominent, and action oriented [37].

    Outcomes

    Generally, we want our health communication to affect the receiver in one way or another, be it to understand something (eg, exponential growth) or to do something (eg, to wash hands).

    Trust has been shown to influence self-reported intention to act upon health advice [38-40]. People tend to have trust in health care professionals as spokespersons and information sources in public health emergencies [40], and research on pandemics has shown that trust in formal sources has been associated with more accurate pandemic risk knowledge and self-protective behavior [41].

    Comprehension refers to the ability to understand the information and to incorporate it into one’s knowledge. Several barriers and facilitators to comprehension have been identified. They can be classified into 3 categories: patient-specific, physician-specific, and other factors [42,43]. Health literacy is the most frequently indicated determinant of comprehension of health information [44-47], whereas other determinants include printed-versus-digital information [48], message complexity [49], and use of illustrations [50].

    Intentions go beyond mere knowing [51-55]. In order to define our behavioral outcome measures, we relied on the Theory of Planned Behavior that links beliefs to behavior [51]. More specifically, it states that the 3 main components of beliefs—attitude, subjective norms, and perceived behavioral control—define intentions. Consequently, the theory affirms that intentions are the most adjacent proxy of human social behavior. Intentions have been a main outcome investigated during the recent COVID-19 pandemic: intentions to vaccinate [56-58], to self-isolate [59], to keep the social distance, and to follow the “stay at home” policy [60,61].

    Although intentions may be a proxy of behavior, the limitations of intentions as a predictor of behavior have long been debated by international literature [62,63]. Although the public’s intentions are highly valuable for public health practitioners and policy makers, Sheeran and Webb [64] analyzed the intention-behavior gap and concluded that realization from intentions into action occurs in approximately 50% of the time. This rate appears to be influenced by the quality of the intention, the nature of the goal, and the basis and properties of intention.


    Design

    This study applies Berlo’s communication process model to behavioral theories [65]. The model defines communication as a process involving 4 key elements: a source, a message, a channel, and a receiver. On the basis of these elements, we conducted group discussions within the COVCOM (Creating Effective, Evidence-Based Video Communication of Public Health Science) research project team regarding the most salient factors to pandemic communication [66], and we decided to explore 3 key features of pandemic video communication: messenger or source, message, and message tone. Although the channel (video) and the receiver (study participants from the public) were defined, the source and the content and tone of the message were manipulated and tested.

    The messenger or source had 2 categories: expert and nonexpert. Although the same actor was used for all videos, the messenger or source was manipulated by using text over image on the bottom left of the screen, introducing the presenter with name and profession. In the expert case, he was introduced as an infectious disease field expert, whereas in the nonexpert one, he was represented as a salesman.

    The topic had 3 categories: exponential growth, handwashing, and the impact of pandemics on the health care system. The selection of topics was made based on the results of an interview study of expert opinions performed by our research group, and that identified exponential growth, handwashing, and the effect of a pandemic on the health care system as key topics to be communicated [31]. Although other topics could have been relevant to study as well, time and resources constraints led us to choose the 3 most relevant ones.

    The message tone differed by the inclusion, or not, of a call to action at the end, thus having 2 categories: present (Y) or absent (N). In the version without a call to action, the video merely explained the topic, whereas in the version containing a call to action, a final motivational message calling to an individual and collective action to defeat pandemics was included at the end.

    The 3 variables were modeled as factors in a full factorial between-subjects randomized controlled experiment. Communication is not a series of independent factors but rather the combination of multiple interwoven factors, and a factorial design was thus adopted to incorporate the possibility of interaction between the 3 features under study.

    Therefore, the experiment used a 2 × 3 × 2 full factorial design. An overview is presented in Table 1.

    Table 1. Overview of the factorial design of the experiment.
    TopicaCall to action, n

    		1. Present2. Absent

    		1. Expert2. Nonexpert1. Expert2. Nonexpert
    1. Exponential growth111112121122
    2. Handwashing211212221222
    3. Impact of pandemics on the health care system311312321322

    aThe 3-digit code denotes all 12 individual combinations of the 3 experimental factors.

    Video Creation

    A professional scriptwriter was hired to create 12 scripts covering both the 3 different topics and the variations dictated by the factorial design. After 2 rounds of revision, the scripts were approved by both the researchers and the writer.

    Based on the scripts, 12 videos were produced in collaboration with the department for development of digital learning resources of the University of Stavanger. To avoid confounding factors, all other variables besides the experimental ones were controlled for: the same professional actor was used to shoot all videos, wearing the same clothing (white shirt and dark gray suit), placed in front of a neutral gray background (Figure 1). All videos were of approximately the same length (range 00:54-01:25). Videos are stored in the OpenScience repository of the University of Stavanger [67].

    ‎
    Figure 1. Thumbnail of one of the videos (expert source—infectious diseases specialist).

    Participants

    Participants were recruited among the members of the Norwegian Air Ambulance Foundation (NAAF), one of the partners of the COVCOM project [66]. An a priori power analysis assuming a 1-way ANOVA with 12 groups, a medium effect size (f) of 0.25, and 95% statistical power revealed that the minimum sample size was 35 participants per arm, 420 in total. From previous experiences, response rates of the NAAF members were lower than 10%, even with reminders. Therefore, we adopted a conservative approach and invited 12,000 people to participate, so that a response rate of 3.5% would be sufficient to reach the minimum sample size. The 12,000 people who were invited were randomly assigned to 1 of the 12 video interventions, with the criteria of having balanced groups in terms of age distribution, female-male proportion, and geographical distribution. Members received an invitation email with a short description and a link to an external page to participate.

    Among the invited participants, 54% (6480/12,000) were male and age ranged from 18 to 90 (median 64.8, IQR 58-73) years.

    Data Collection and Management

    The data collection phase was managed by the NAAF’s IT infrastructure. Their familiarity of members with the sender’s email address would reduce the risk of emails being misdirected to the spam folder and complied with the General Data Protection Regulation and the national regulations of not sharing information about members with another organization. The data collection lasted from June 1, 2021, through June 9, 2021.

    Emails sent to the NAAF members contained 1 of the 12 videos, and a link leading to 1 of the 12 surveys created on the SurveyMonkey platform. The data collection was anonymous by enabling this option in SurveyMonkey, and therefore the IP addresses of respondents were not collected. The email addresses were used only for the invitation and were not linked to the collected responses. No personal or sensitive information was asked of respondents.

    Each response has been attributed a unique identifier, and collected responses were stored in a separate database unlinked from the NAAF members’ database. In order to leave open the opportunity to conduct a longitudinal study with a follow-up after 12 months, respondents were asked to digit their email address in case they wanted to participate further.

    Ethical Considerations

    The legal department of the NAAF confirmed that the study is compliant with the General Data Protection Regulation and national regulations, and as no personal or sensitive data were collected or processed, approval from the Norwegian Centre for Research Data or from the Ethical Committee was not necessary.

    Measures

    The questionnaire contained questions on the following outcome measures: comprehension, trust, past and future intentions, and a proxy for behavior. Comprehension was measured by 1 close-ended question regarding the content of the video (4 alternatives, of which 1 was correct). Trust was measured through a 2-item 5-point Likert scale developed by Sillence et al [40]. The scale intends to measure trust in web-based health information and advice, and it is suitable for the aim of the study as participants are receiving web-based health information and advice. Intentions were measured by one 6-point Likert scale item. The proxy for behavior consisted of a question asking participants to fill in their email addresses in order to be further part of a pandemic research project. The questionnaire also included sociodemographic characteristics of respondents: age, gender, education level, income level, and whether they live in a big city, a town, or rurally. The questionnaire further contained attention checks and the Belief in Science Scale [68] to define a baseline of the level of scientific belief of respondents. The Belief in Science Scale is a measurement tool of attitudes toward science, where science shares similarities with religion in terms of the comforting role it plays in individuals’ lives.

    The complete questionnaire (both in English and Norwegian) is available in Multimedia Appendix 1.

    Data Analysis

    The data analysis was conducted using standard factorial design statistics to analyze main effects and interaction effects using between-groups variance analysis (factorial ANOVA). Main effects and all interactions between the 3 video factors were investigated. Pairwise comparisons were performed, and the Bonferroni correction was used to control for the family-wise error rate. The analysis was performed in RStudio (Posit). P values below .05 were considered statistically significant.


    From the 12,000 emails sent, we collected 1194 complete replies, corresponding to a response rate of 9.97%. After removing 2 responses that failed the attention checks, a total of 1192 valid responses were included for analysis. As the aim of the study was to compare video factors by assigning participants randomly to 1 of the 12 video versions, and randomization was performed after inclusion, the relatively low response rate is not a limitation.

    For the full factorial design, with its 12 combinatorial possibilities, the number of respondents in each factorial combination ranged from 93 (7.80%) to 109 (9.14%) of the 1192 valid responses.

    Regarding the topic, 412 (34.56%) respondents watched a video about exponential growth, 383 (32.13%) watched a video about handwashing, and 397 (33.31%) watched a video about the burden of the pandemic on the health care system. A total of 605 (50.75%) of respondents watched a video with an expert messenger or source, and 587 (49.25%) watched a video with a nonexpert one. A total of 621 (52.10%) respondents watched a video with a call to action, and 571 (47.90%) watched a video without one. An overview of outcome measures by video version is presented in Table 2.

    Table 2. Outcome results by video version.
    VersionTrust 1-6, mean (SD)Comprehension 0-1, mean (SD)Intentions 1-6, mean (SD)Behavior 0-1, mean (SD)
    1115.26 (0.59)0.78 (0.42)5.44 (0.59)0.32 (0.47)
    1125.38 (0.63)0.77 (0.42)5.50 (0.59)0.20 (0.40)
    1215.44 (0.57)0.72 (0.45)5.65 (0.48)0.32 (0.47)
    1225.50 (0.65)0.78 (0.42)5.54 (0.63)0.29 (0.45)
    2115.09 (0.90)0.81 (0.40)5.61 (0.57)0.35 (0.48)
    2125.29 (0.54)0.81 (0.40)5.64 (0.62)0.28 (0.45)
    2215.33 (0.64)0.80 (0.40)5.56 (0.52)0.37 (0.49)
    2225.53 (0.50)0.99 (0.10)5.52 (0.50)0.32 (0.47)
    3115.51(0.60)0.82 (0.39)5.67 (0.49)0.28 (0.45)
    3125.20 (0.66)0.47 (0.50)5.51 (0.59)0.34 (0.48)
    3215.35 (0.78)0.56 (0.50)5.61 (0.49)0.27 (0.45)
    3225.49 (0.62)0.98 (0.14)5.48 (0.56)0.27 (0.45)
    Total5.37 (0.65)0.78 (0.41)5.56 (0.56)0.30 (0.46)

    Trust was generally high, with a mean value of 5.37 on a 1-6–point scale. There was little variation between the groups, with a range of 5.09 to 5.53. Comprehension was measured as the percentage of correct answers and therefore ranges between 0 and 1, where 1 is equal to 100%. The mean value of the sample was 0.78, with significant between-groups variation: only 47% of respondents who watched video version 312 understood the information, whereas for version 222, almost all respondents (99%) comprehended it. Intentions to follow pandemic recommendations were high (mean value of 5.56 on a 1-6 scale), with little between-groups variation (range 5.44-5.67). The measured proxy for behavior was generally low (mean 0.30), with some between-groups variation (range 0.20-0.37).

    An overview of the results of the factorial ANOVA is presented in Table 3.

    Table 3. Results from factorial ANOVA.
    VariableOutcomes
    ComprehensionTrustIntentionsBehavior
    Effect, estimate (CI) or F test (df)aP valueEffect estimate (CI) or F test (df)P valueEffect estimate (CI) or F test (df)P valueEffect estimate (CI) or F test (df)P value
    Topic0.090.090.070.48
    Action0.150 (0.105-0.195)<.001b0.207 (0.133-0.280)<.0010.560.55
    Source0.240.127 (0.053-0.201).0010.220.057 (0.005-0.110).03
    Topic × Action48.115 (2)a<.0010a.590a.0530a.71
    Topic × Source0a.740a.470a.380a.47
    Action × Source0a.960a.380a.440a.25
    Topic × Action × Source0a.470a.870a.270a.57

    aF test (df) values used.

    bItalicized P values represent significance P<.05.

    The model yielded statistically significant results for the main effect of call to action (P<.001) and the interaction effect between call to action and topic (P<.001) on comprehension. The pairwise comparison showed a statistically significant (P<.001) effect difference of call to action on comprehension. The difference was 0.15, meaning that including a call to action led to an increase of 15% on comprehension.

    The analysis showed a statistically significant main effect of call to action (P<.001) and source (P=.001) on trust, whereas none of the interaction effects were statistically significant. The pairwise comparison showed a statistically significant (P<.001) effect difference of call to action on trust. The difference was 0.207 on a scale of 5, meaning that including a call to action led to an increase of 4.14% on trust. The pairwise comparison showed a statistically significant (P=.001) effect of source on trust. The difference was 0.127, meaning that an expert source led to an increase of 2.54% on trust compared with a nonexpert one.

    The analysis did not show any statistically significant main effect of the topic on one of the outcomes, and no significant interaction effect was revealed either.

    The analysis showed a statistically significant main effect of the source (P=.03) on behavior, whereas none of the interaction effects were statistically significant. The pairwise comparison showed a statistically significant (P=.03) effect of 0.057, meaning that an informal source led to an increase of 5.7% on behavior with respect to a formal source. The effect of the duration of the video (minimum 0:54, maximum 1:25) was not statistically significant (P>.3) for all outcomes.


    Principal Findings

    Effective mass communication is key during a critical event like a worldwide pandemic. When used right, video is an effective medium for reaching out to large portions of the public. While the importance of visual and creative means in reach was demonstrated for COVID-19 pandemic–related videos [3], there was less evidence regarding nonvisual elements. This study demonstrates the effects of various nonvisual information factors on 4 different outcomes of pandemic video communication: trust, comprehension, intention, and behavior. Some of the findings support existing evidence, whereas others provide novel insights for the understanding of the effectiveness of pandemic video communication.

    Principal Results

    Trust is key in any communication [69-71], thus also during a pandemic where believing that the government acts in your best interest or not is at stake [72]. The topic being communicated did not have any effect on trust. However, whether the message comes from an expert or nonexpert did have an effect on trust. The positive effect of a formal expert source on trust is aligned with international literature [7,73]. Although relatively small (2.54%), the effect is yet relevant as the source was manipulated only by the means of a simple text over in the video introducing the presenter. All other variables were kept unchanged, for example, the presenter, attire, background, setting, use of props, and style of language. Manipulating all these factors could in sum contribute to a considerable increase in trust.

    The inclusion of a call to action at the end of the message also increased trust. The inclusion of a call to action may impact the level of cognitive processing by leading to elaborations, which might increase the feeling of knowing and hence trust. Notably, the use of a call to action is not unproblematic, seen from a health communication perspective. Multiple papers comment on the importance of being neutral when handing over information so that recipients can make informed choices—“strive to inform, never persuade” [74]. According to Oxman et al [34], persuasion should be seen as a continuum from information to coercion. A call to action involves recommending people how to behave based on explicit reasons, which is at the noncoercive end of the continuum. Notably, the call to action increased trust, and our results thus indicate that health science communication might afford to be somewhat more instructional than previously believed [75,76].

    Comprehension, on the other hand, was not significantly affected by whether the source was a formal field expert or a nonexpert. This is in line with previous works regarding the source as a potential determinant of comprehension [77-79]. Further, we did not find any effect of the topic on comprehension. The comprehension score was relatively high (78% correctly understood the message conveyed) with little differences between the 3 topics, indicating that people find the topics equally and relatively easy to understand. The inclusion of a call to action, however, led to an increase in comprehension by 15%. This can be explained by the role that calls to action have in motivation and in turn by the relationship between motivation and comprehension [80]. Therefore, the call to action may have triggered listeners’ motivation and increased their comprehension of pandemic health communication.

    As with comprehension, intention to follow the pandemic recommendations was not influenced by whether the source was a field expert or a nonexpert. More surprisingly, however, although the inclusion of a call to action increased comprehension, it did not increase intention. Although the factorial ANOVA showed a main effect of the topic of intentions to follow recommendations, the pairwise comparisons did not yield any statistically significant difference between the 3 topics. That is, none of the investigated variables were found to have an effect on intention.

    As the intended outcome of health communication during a public health crisis like a pandemic is often not merely informing the public but also wanting them to act in a certain way in order to reduce risk for themselves and society, some of our findings might come across as depressing. Greater intention to follow pandemic recommendations was expected if the communication comes from an infectious diseases specialist with respect to a sales consultant. Furthermore, also the inclusion of a call to action was expected to lead to greater intention to follow recommendations. Both these factors increase trust in our experiment, but, alas, not intention. On the other hand, we observed little variation in the data, along with a ceiling effect. The mean value for intention to follow the recommendations was 5.56 on a 1-6 scale, with a group mean ranging from 5.44 to 5.67 (high to low ratio equal to 1.04). The small variation in the data might hide the investigated effects. Further research in different contexts is encouraged.

    As with intention, neither the topic nor the inclusion of a call to action had a significant impact on behavior. As behavior is a “harder” outcome than mere intentions, this comes as no surprise. The source, however, had a statistically significant impact on behavior, with the nonexpert source leading to an increase of 5.7% in the number of people who decided to fill in their email addresses in order to continue being part of the pandemic research project. Although this can be explained by a higher identification of participants with a nonexpert source compared with a field expert, this finding requires careful interpretation. First, as opposed to the high mean for intention, the mean for behavior was relatively low (0.30 on a 0-1–point scale), with a group mean ranging from 0.20 to 0.37. Second, the proxy used to measure behavior—asking participants to fill in their email address to receive updates and advice—might be inaccurate in measuring the desired construct. As most indirect measures, caution is required in drawing conclusions. The literature is scarce in this point. A recent literature review revealed that only a handful of studies assessing the association between health communication and actual behavior have been carried out [4]. More research in this field is thus needed.

    Limitations

    Our study comes with a few limitations in addition to the proxy for behavior addressed in the discussion. The scales used to measure subjective comprehension and intentions are made of a limited number of items and therefore might not be specific enough to be able to measure the desired construct. Moreover, the research was performed in Norwegian and with Norwegian participants. Norway is a high-trust society, and therefore findings might be context-specific and not generalizable to other countries. Moreover, participants are members of the NAAF—a nonprofit organization delivering advanced lifesaving medical treatment and supported by more than 300,000 members. As the sample used in this study comprised the NAAF members, it cannot be considered a random sample and therefore might not be representative of the general population in terms of education and age distribution. These limitations, along with the little variation and ceiling effects observed for some variables, open a research opportunity for scholars worldwide.

    Conclusions

    The source, topic, and call to action showed mixed effects on the outcomes of pandemic video communication. Comprehension and trust were positively impacted by using an expert source (ie, an infectious disease field expert), as opposed to a nonexpert source (ie, a sales consultant), and by including a call to action, irrespective of the topic. Adding a recommendation for how to behave in addition to the explicit reasons for doing so does not erode people’s trust. These findings are relevant for public health communicators and policy makers who need citizens to comprehend and trust messages conveyed to them. At the same time, the same nonvisual information factors (source, topic, and call to action) had limited or no effect on the intention to follow pandemic recommendations and behavior for the participants to this study. Further research should focus on what determines people to follow public health recommendations and behave accordingly in a time of a crisis.

    Acknowledgments

    The COVID Communication: Fighting a Pandemic through Translating Science project has received funding from the Trond Mohn Foundation (under grant agreement number TMS2020TMT10) and the University of Stavanger. The authors acknowledge the Norwegian Air Ambulance Foundation and their members for their valuable contribution to this study.

    Data Availability

    All videos are stored in the OpenScience repository of the University of Stavanger [67].

    Authors' Contributions

    This study was conducted by an interdisciplinary team of researchers. DAL and KKB conceived the study, discussed the methodological approach, and analyzed the data. DAL drafted the initial manuscript. All the authors (JR, SHB, IS, MTS, and HT) provided critical feedback on the manuscript and approved the final version.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Questionnaire in English and Norwegian.

    DOCX File , 24 KB
    Multimedia Appendix 2

    CONSORT checklist.

    PDF File (Adobe PDF File), 97 KB
    1. Lazris A, Rifkin E. Utilizing Effective Risk Communication in COVID-19: Highlighting the BRCT Internet. Cham, Switzerland. Springer International Publishing; 2021.
    2. Abrams EM, Greenhawt M. Risk communication during COVID-19. J Allergy Clin Immunol Pract. 2020;8(6):1791-1794. [FREE Full text] [CrossRef] [Medline]
    3. Shortt MT, Smeets I, Wiig S, Berg SH, Lungu DA, Thune H, et al. Shortcomings in public health authorities’ videos on COVID-19: limited reach and a creative gap. Front Commun. 2021;6:764220. [FREE Full text] [CrossRef]
    4. Lungu DA, Røislien J, Wiig S, Shortt MT, Ferrè F, Berg SH, et al. The role of recipient characteristics in health video communication outcomes: scoping review. J Med Internet Res. 2021;23(12):e30962. [FREE Full text] [CrossRef] [Medline]
    5. de Vries H. An integrated approach for understanding health behavior; the i-change model as an example. Psychol Behav Sci Int J. 2017;2(2):555-585. [FREE Full text] [CrossRef]
    6. Kaye D. Sources of information, formal and informal. Manag Decis. 1995;33(5):13-15. [CrossRef]
    7. Welbourne DJ, Grant WJ. Science communication on YouTube: factors that affect channel and video popularity. Public Underst Sci. 2016;25(6):706-718. [CrossRef] [Medline]
    8. Matta S, Rogova N, Luna-Cortés G. Investigating tolerance of uncertainty, COVID-19 concern, and compliance with recommended behavior in four countries: the moderating role of mindfulness, trust in scientists, and power distance. Pers Individ Dif. 2022;186:111352. [FREE Full text] [CrossRef] [Medline]
    9. Kossowska M, Szwed P, Czarnek G. Ideology shapes trust in scientists and attitudes towards vaccines during the COVID-19 pandemic. Group Process Intergroup Relat. 2021;24(5):720-737. [CrossRef]
    10. Erviti MC. Producing science online video. In: León B, Bourk M, editors. Communicating Science and Technology Through Online Video. 1st Edition. New York. Routledge; 2018;28-40.
    11. Cho H. Health Communication Message Design: Theory and Practice. Thousand Oaks, CA. SAGE Publications; 2012;277.
    12. Noar SM, Harrington NG, Aldrich RS. The role of message tailoring in the development of persuasive health communication messages. Ann Int Commun Assoc. 2016;33(1):73-133. [CrossRef]
    13. Rimer BK, Kreuter MW. Advancing tailored health communication: a persuasion and message effects perspective. J Commun. 2006;56(suppl 1):S184-S201. [CrossRef]
    14. Hornik RC. Public Health Communication: Evidence for Behavior Change. Mahwah, NJ. Lawrence Erlbaum Associates Publishers; 2002.
    15. Yanovitzky I, Stryker J. Mass media, social norms, and health promotion efforts: a longitudinal study of media effects on youth binge drinking. Commun Res. 2001;28(2):208-239. [FREE Full text] [CrossRef]
    16. Bekalu MA, Bigman CA, McCloud RF, Lin LK, Viswanath K. The relative persuasiveness of narrative versus non-narrative health messages in public health emergency communication: evidence from a field experiment. Prev Med. 2018;111:284-290. [FREE Full text] [CrossRef] [Medline]
    17. Ratcliff CL, Jensen JD, Scherr CL, Krakow M, Crossley K. Loss/gain framing, dose, and reactance: a message experiment. Risk Anal. 2019;39(12):2640-2652. [CrossRef] [Medline]
    18. Smit ES, Zeidler C, Resnicow K, de Vries H. Identifying the most autonomy-supportive message frame in digital health communication: a 2x2 between-subjects experiment. J Med Internet Res. 2019;21(10):e14074. [FREE Full text] [CrossRef] [Medline]
    19. Infection prevention and control during health care when coronavirus disease (‎COVID-19)‎ is suspected or confirmed: interim guidance, 12 July 2021. World Health Organization. 2021. URL: https://apps.who.int/iris/handle/10665/342620 [accessed 2022-03-29]
    20. WHO Director-General's opening remarks at the media briefing on COVID-19—1 April 2020. World Health Organization. 2022. URL: https:/​/www.​who.int/​director-general/​speeches/​detail/​who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19---1-april-2020 [accessed 2022-03-29]
    21. WHO Director-General's opening remarks at the media briefing on COVID-19—16 March 2020. World Health Organization. URL: https:/​/www.​who.int/​director-general/​speeches/​detail/​who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19---16-march-2020 [accessed 2022-03-29]
    22. Gillebaart M, Ybema JF, de Ridder DTD. Make it a habit: how habit strength, goal importance and self-control predict hand washing behaviour over time during the COVID-19 pandemic. Psychol Health. 2022;37(12):1528-1546. [FREE Full text] [CrossRef] [Medline]
    23. Biehl SC, Schmidmeier M, Wechsler TF, Kroczek LOH, Mühlberger A. Widespread recommendations can change our habits of hand-washing and physical distance during the COVID-19 pandemic. Clin Psychol Eur. 2021;3(1):e3061. [FREE Full text] [CrossRef] [Medline]
    24. Berg SH, Shortt MT, Thune H, Røislien J, O'Hara JK, Lungu DA, et al. Comprehending and acting on pandemic health risk information differently: a qualitative study using the mental models' approach. Research Square. URL: https:/​/assets.​researchsquare.com/​files/​rs-952613/​v1/​35213f7d-a8a8-45e1-99c3-bd706d7e6a5c.​pdf?c=1667835498 [accessed 2023-06-22]
    25. Adam D. A guide to R—the pandemic's misunderstood metric. Nature. 2020;583(7816):346-348. [CrossRef] [Medline]
    26. Carenzo L, Costantini E, Greco M, Barra FL, Rendiniello V, Mainetti M, et al. Hospital surge capacity in a tertiary emergency referral centre during the COVID-19 outbreak in Italy. Anaesthesia. 2020;75(7):928-934. [FREE Full text] [CrossRef] [Medline]
    27. Sen-Crowe B, Sutherland M, McKenney M, Elkbuli A. A closer look into global hospital beds capacity and resource shortages during the COVID-19 pandemic. J Surg Res. 2021;260:56-63. [FREE Full text] [CrossRef] [Medline]
    28. Duque D, Morton DP, Singh B, Du Z, Pasco R, Meyers LA. Timing social distancing to avert unmanageable COVID-19 hospital surges. Proc Natl Acad Sci U S A. 2020;117(33):19873-19878. [FREE Full text] [CrossRef] [Medline]
    29. Leite H, Lindsay C, Kumar M. COVID-19 outbreak: implications on healthcare operations. TQM J. 2020;33(1):247-256. [CrossRef]
    30. Christensen T, Lægreid P. The whole-of-government approach to public sector reform. Public Adm Rev. 2007;67(6):1059-1066. [CrossRef]
    31. Berg SH, Shortt MT, Røislien J, Lungu DA, Thune H, Wiig S. Key topics in pandemic health risk communication: a qualitative study of expert opinions and knowledge. PLoS One. 2022;17(9):e0275316. [FREE Full text] [CrossRef] [Medline]
    32. Quick BL, Considine JR. Examining the use of forceful language when designing exercise persuasive messages for adults: a test of conceptualizing reactance arousal as a two-step process. Health Commun. 2008;23(5):483-491. [CrossRef] [Medline]
    33. Dysart-Gale D. Communication models, professionalization, and the work of medical interpreters. Health Commun. 2005;17(1):91-103. [CrossRef] [Medline]
    34. Oxman AD, Fretheim A, Lewin S, Flottorp S, Glenton C, Helleve A, et al. Health communication in and out of public health emergencies: to persuade or to inform? Health Res Policy Syst. 2022;20(1):28. [FREE Full text] [CrossRef] [Medline]
    35. Zepernick D, Schouenborg K, Lindegaard S, Jensen M. Communication Handbook: Changing Consumer Behaviour Towards Increased Prevention of Textile Waste. Copenhagen. Nordisk Ministerråd; 2014.
    36. Krajina A. Interpretation of online consumer behaviour from the consumer neuroscience perspective—cross generational study. MUNI. 2019. URL: https://www.muni.cz/en/research/publications/1536856 [accessed 2022-05-27]
    37. Halligan B, Shah D. Inbound Marketing, Revised and Updated: Attract, Engage, and Delight Customers Online. New York. John Wiley & Sons; 2014.
    38. Harris PR, Sillence E, Briggs P. Perceived threat and corroboration: key factors that improve a predictive model of trust in internet-based health information and advice. J Med Internet Res. 2011;13(3):e51. [FREE Full text] [CrossRef] [Medline]
    39. Sheng X, Simpson PM. Health care information seeking and seniors: determinants of internet use. Health Mark Q. 2015;32(1):96-112. [CrossRef] [Medline]
    40. Sillence E, Blythe JM, Briggs P, Moss M. A revised model of trust in internet-based health information and advice: cross-sectional questionnaire study. J Med Internet Res. 2019;21(11):e11125. [FREE Full text] [CrossRef] [Medline]
    41. Communicating risk in public health emergencies: A WHO guideline for emergency risk communication (ERC) policy and practice. 2017. URL: https://apps.who.int/iris/bitstream/handle/10665/259807/9789241550208-eng.pdf?sequence=2 [accessed 2023-06-22]
    42. Ector GICG, Hermens RPMG, Blijlevens NMA. Filling the gaps of patient information and comprehension. Curr Opin Oncol. 2020;32(4):262-268. [FREE Full text] [CrossRef] [Medline]
    43. Lukoschek P, Fazzari M, Marantz P. Patient and physician factors predict patients' comprehension of health information. Patient Educ Couns. 2003;50(2):201-210. [FREE Full text] [CrossRef] [Medline]
    44. Powers BJ, Trinh JV, Bosworth HB. Can this patient read and understand written health information? JAMA. 2010;304(1):76-84. [CrossRef] [Medline]
    45. Alberti TL, Morris NJ. Health literacy in the urgent care setting: what factors impact consumer comprehension of health information? J Am Assoc Nurse Pract. 2017;29(5):242-247. [FREE Full text] [CrossRef] [Medline]
    46. Mazor KM, Roblin DW, Williams AE, Greene SM, Gaglio B, Field TS, et al. Health literacy and cancer prevention: two new instruments to assess comprehension. Patient Educ Couns. 2012;88(1):54-60. [FREE Full text] [CrossRef] [Medline]
    47. Diviani N, van den Putte B, Giani S, van Weert JC. Low health literacy and evaluation of online health information: a systematic review of the literature. J Med Internet Res. 2015;17(5):e112. [FREE Full text] [CrossRef] [Medline]
    48. Estey A, Musseau A, Keehn L. Comprehension levels of patients reading health information. Patient Educ Couns. 1991;18(2):165-169. [FREE Full text] [CrossRef]
    49. Walsh TM, Volsko TA. Readability assessment of internet-based consumer health information. Respir Care. 2008;53(10):1310-1315. [FREE Full text] [Medline]
    50. Liu CJ, Kemper S, McDowd J. The use of illustration to improve older adults' comprehension of health-related information: is it helpful? Patient Educ Couns. 2009;76(2):283-288. [FREE Full text] [CrossRef] [Medline]
    51. Ajzen I. From intentions to actions: a theory of planned behavior. In: Kuhl J, Beckmann J, editors. Action Control: From Cognition to Behavior. Berlin Heidelberg. Springer; 1985;11-39.
    52. Armitage CJ, Conner M. Social cognition models and health behaviour: a structured review. Psychol Health. 2000;15(2):173-189. [CrossRef]
    53. Hagger MS, Luszczynska A. Implementation intention and action planning interventions in health contexts: state of the research and proposals for the way forward. Appl Psychol Health Well Being. 2014;6(1):1-47. [CrossRef] [Medline]
    54. Rogers RW. A protection motivation theory of fear appeals and attitude change1. J Psychol. 1975;91(1):93-114. [CrossRef] [Medline]
    55. Rosenstock IM. Historical origins of the health belief model. Health Educ Monogr. 1974;2(4):328-335. [CrossRef]
    56. Callaghan T, Moghtaderi A, Lueck JA, Hotez P, Strych U, Dor A, et al. Correlates and disparities of intention to vaccinate against COVID-19. Soc Sci Med. 2021;272:113638. [FREE Full text] [CrossRef] [Medline]
    57. Rhodes A, Hoq M, Measey MA, Danchin M. Intention to vaccinate against COVID-19 in Australia. Lancet Infect Dis. 2021;21(5):e110. [FREE Full text] [CrossRef] [Medline]
    58. Ruiz JB, Bell RA. Predictors of intention to vaccinate against COVID-19: results of a nationwide survey. Vaccine. 2021;39(7):1080-1086. [FREE Full text] [CrossRef] [Medline]
    59. Farooq A, Laato S, Islam AKMN. Impact of online information on self-isolation intention during the COVID-19 pandemic: cross-sectional study. J Med Internet Res. 2020;22(5):e19128. [FREE Full text] [CrossRef] [Medline]
    60. Hagger MS, Smith SR, Keech JJ, Moyers SA, Hamilton K. Predicting social distancing intention and behavior during the COVID-19 pandemic: an integrated social cognition model. Ann Behav Med. 2020;54(10):713-727. [FREE Full text] [CrossRef] [Medline]
    61. Sumaedi S, Bakti IGMY, Rakhmawati T, Widianti T, Astrini NJ, Damayanti S, et al. Factors influencing intention to follow the “stay at home” policy during the COVID-19 pandemic. Int J Health Gov. 2020;26(1):13-27. [FREE Full text] [CrossRef]
    62. Dekker J. Theories in behavioral medicine. Int J Behav Med. 2008;15(1):1-3. [CrossRef] [Medline]
    63. Sheeran P. Intention—behavior relations: a conceptual and empirical review. Eur Rev Soc Psychol. 2002;12(1):1-36. [CrossRef]
    64. Sheeran P, Webb TL. The intention-behavior gap. Soc Pers Psychol Compass. 2016;10(9):503-518. [CrossRef]
    65. Stead BA. Berlo's communication process model as applied to the behavioral theories of Maslow, Herzberg, and Mcgregor. Acad Manage J. 1972;15(3):389-394. [CrossRef]
    66. Røislien J, O'Hara JK, Smeets I, Brønnick K, Berg SH, Shortt MT, et al. Creating effective, evidence-based video communication of public health science (COVCOM Study): protocol for a sequential mixed methods effect study. JMIR Res Protoc. 2022;11(3):e34275. [FREE Full text] [CrossRef] [Medline]
    67. COVCOM videos. URL: https://doi.org/10.18710/EZQR78 [accessed 2023-06-22]
    68. Farias M, Newheiser AK, Kahane G, de Toledo Z. Scientific faith: belief in science increases in the face of stress and existential anxiety. J Exp Soc Psychol. 2013;49(6):1210-1213. [FREE Full text] [CrossRef] [Medline]
    69. Weingart P, Guenther L. Science communication and the issue of trust. J Sci Commun. 2016;15(5):C01. [FREE Full text] [CrossRef]
    70. Engdahl E, Lidskog R. Risk, communication and trust: towards an emotional understanding of trust. Public Underst Sci. 2014;23(6):703-717. [CrossRef] [Medline]
    71. Butler JK, Cantrell RS. Communication factors and trust: an exploratory study. Psychol Rep. 2016;74(1):33-34. [CrossRef]
    72. Uslaner E. Democracy and governance: can government policies influence generalized trust. In: Stolle D, Hooghe M, editors. Generating Social Capital: Civil Society and Institutions in Comparative Perspective. New York. Palgrave Macmillan US; 2003;171-190.
    73. Hocevar KP, Metzger M, Flanagin AJ. Source Credibility, Expertise, and Trust in Health and Risk Messaging Internet. Oxford Research Encyclopedia of Communication. 2017. URL: https:/​/oxfordre.​com/​communication/​view/​10.1093/​acrefore/​9780190228613.001.0001/​acrefore-9780190228613-e-287 [accessed 2022-05-02]
    74. Blastland M, Freeman ALJ, van der Linden S, Marteau TM, Spiegelhalter D. Five rules for evidence communication. Nature. 2020;587(7834):362-364. [CrossRef] [Medline]
    75. Quinn SC, Parmer J, Freimuth VS, Hilyard KM, Musa D, Kim KH. Exploring communication, trust in government, and vaccination intention later in the 2009 H1N1 pandemic: results of a national survey. Biosecur Bioterror. 2013;11(2):96-106. [FREE Full text] [CrossRef] [Medline]
    76. World Health Organization. Regional Office for Europe. Vaccination and trust: how concerns arise and the role of communication in mitigating crises. World Health Organization. 2017. URL: https://apps.who.int/iris/handle/10665/343299 [accessed 2022-08-19]
    77. Brian B, Paul C, Ronald C. Evidence-Based Health Communication. United Kingdom. McGraw-Hill Education; 2006.
    78. Dutta-Bergman MJ. Primary sources of health information: comparisons in the domain of health attitudes, health cognitions, and health behaviors. Health Commun. 2004;16(3):273-288. [CrossRef] [Medline]
    79. Harvey K, Koteyko N. Exploring Health Communication: Language in Action. London. Routledge; 2012.
    80. Mohseni Takaloo N, Ahmadi MR. The effect of learners’ motivation on their reading comprehension skill: a literature review. Int J Res Engl Educ. 2017;2(3):10-21.

    ‎
    COVCOM: Creating Effective, Evidence-Based Video Communication of Public Health Science
    NAAF: Norwegian Air Ambulance Foundation

    Edited by T Leung; submitted 07.09.22; peer-reviewed by PJ Schulz, K Na; comments to author 16.02.23; revised version received 09.03.23; accepted 26.05.23; published 23.08.23.

    Copyright

    ©Daniel Adrian Lungu, Jo Røislien, Siv Hilde Berg, Ionica Smeets, Marie Therese Shortt, Henriette Thune, Kolbjørn Kallesten Brønnick. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 23.08.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.