This paper is in the following e-collection/theme issue:

Participatory Medicine & E-Patients (764) Information Seeking, Information Needs (448) Anxiety and Stress Disorders (1027) Innovations and Technology in Cancer Care (412) Consumer & Patient Education and Shared-Decision Making (655) Emotional, Social, Psychological Support for Cancer (193) Patient Education for Cancer (143) Speech and Phonetics in Verbal Protocols (Think Aloud, Recall, and Explanation Tasks) (92)

Published on in Vol 23, No 7 (2021): July

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/23670, first published .
The Influence of Online Health Information Seeking Before a Consultation on Anxiety, Satisfaction, and Information Recall, Mediated by Patient Participation: Field Study

The Influence of Online Health Information Seeking Before a Consultation on Anxiety, Satisfaction, and Information Recall, Mediated by Patient Participation: Field Study

The Influence of Online Health Information Seeking Before a Consultation on Anxiety, Satisfaction, and Information Recall, Mediated by Patient Participation: Field Study

Authors of this article:

Melanie de Looper1 Author Orcid Image ;   Julia C M van Weert1 Author Orcid Image ;   Barbara C Schouten1 Author Orcid Image ;   Sifra Bolle2 Author Orcid Image ;   Eric H J Belgers3 Author Orcid Image ;   Eric H Eddes4 Author Orcid Image ;   Ellen M A Smets5 Author Orcid Image
Article Authors Cited by (12) Tweetations (8) Metrics

    Original Paper

    1Amsterdam School of Communication Research, University of Amsterdam, Amsterdam, Netherlands

    2Minddistrict, Amsterdam, Netherlands

    3Zuyderland Medical Center, Sittard-Geleen, Netherlands

    4Deparment of Surgery, Deventer Hospital, Deventer, Netherlands

    5Department of Medical Psychology, Amsterdam UMC, Amsterdam Public Health, Amsterdam, Netherlands

    Corresponding Author:

    Melanie de Looper, MSc

    Amsterdam School of Communication Research

    University of Amsterdam

    Nieuwe Achtergracht 166

    Amsterdam, 1018 WV

    Netherlands

    Phone: 31 630274301

    Email: m.delooper@uva.nl


    Background: Today, many cancer patients engage in online health information seeking (OHIS). However, little is known about how patients differ in their OHIS levels. In addition, OHIS might influence patient participation during a consultation with a physician, which might mediate the effects on patient outcomes.

    Objective: The aim of this study is twofold: first, to provide insight into which personal characteristics and psychosocial factors affect patients’ OHIS levels and, second, to test the hypothesis that the effects of OHIS on patient outcomes are mediated by patient participation during the consultation.

    Methods: Patient participation was operationalized in terms of patients’ absolute word count; the relative contribution of the patient, compared with the health care provider; and the number of questions and assertions expressed during the consultation. The patient outcomes measured were anxiety after the consultation, satisfaction with the consultation, and information recall. Participants in this study were patients recently diagnosed with colorectal cancer recruited from 6 hospitals in the Netherlands (n=90). Data were collected using questionnaires and audio-recorded consultations of patients with health care providers before their surgery.

    Results: The results showed that younger patients, higher educated patients, patients with a monitoring coping style, and patients who experienced more cancer-related stress engaged more in OHIS. In turn, OHIS was related to patient participation in terms of the patient’s absolute word count but not to the relative contribution to the consultation or expressing questions and assertions. We did not find a relation between OHIS and anxiety and OHIS and recall mediated by patient participation. However, we found that patients’ absolute word count significantly mediated the positive association between OHIS and patients’ satisfaction with the consultation.

    Conclusions: Results indicate positive implications of OHIS for patients’ care experience and, therefore, the importance of helping patients engage in OHIS. However, the results also suggest that OHIS is only successful in increasing a single aspect of patient participation, which might explain the absence of relations with anxiety and recall. The results suggest that more beneficial effects on patient outcomes may be achieved when health care providers support patients in OHIS.

    J Med Internet Res 2021;23(7):e23670

    doi:10.2196/23670

    Keywords

    online health seeking; patients; aging; patient participation; memory; anxiety; patient reported outcomes; consultation; health communication; cancer 


    Background

    Today, the internet hosts a growing body of easily accessible cancer-related information [1]. In line with this, cancer patients increasingly engage in online health information seeking (OHIS) [2,3] about their illness and treatment [4]. OHIS about one’s health or medical condition can contribute to feeling informed, which has been positively associated with patient outcomes [5]. For instance, better informed patients score higher on affective outcomes, for example, they are more satisfied with their treatment [6-9] and feel less anxious [5,10,11]. Moreover, OHIS can positively influence cognitive outcomes, such as better information recall [12,13].

    Although patients generally seek web-based health information [14-16], it can be argued that the extent to which they engage in OHIS is associated with individual differences based on demographics or psychosocial characteristics [17,18]. For instance, experiencing feelings of anxiety or stress regarding a medical diagnosis can result in more information needs [19] and information seeking to cope with them [20].

    Previous research did not look at the whole path from individual differences to OHIS and, in turn, patient outcomes but mainly focused on either predictors of OHIS in terms of demographics and psychosocial factors [21-24] or outcomes of OHIS [5,25-27]. More specifically, research that looked into the effects of OHIS did not take into account what happens between OHIS and patient outcomes in terms of consultations with health care providers [5,25]. This is a noteworthy omission because patients often engage in OHIS in preparation for consultations [15,16,28], which can result in a better informed and more empowered patient who feels comfortable in taking on an active role in consultations with health care providers [9,27,29]. In turn, this may lead to more active patient participation during consultations [9,30], for example, by patients expressing more concerns and asking more questions [31].

    Subsequently, patient participation can positively influence factors related to the quality of care, such as satisfaction with the consultation and understanding of health information provided [32]. In addition, researchers found that patient participation is related to lower anxiety [33], increased satisfaction [34-36], and improved information recall [13,37]. However, knowledge about whether and how the effects of OHIS on these outcomes are mediated by patient participation during consultation is lacking. Therefore, the aim of this study is to examine the demographic and psychosocial factors that can predict OHIS and how OHIS, in turn, influences patient outcomes via patient participation during consultations.

    Predictors of OHIS

    Cancer patients vary in the extent to which they seek online health information. The Comprehensive Model of Information Seeking is one of the most widely adopted models to discuss factors that could influence health information seeking [22]. In this model, demographics and psychosocial factors are seen as important determinants of how much an individual is inclined to search for health information.

    Demographics

    In general, studies show that demographics such as age, education level, and gender correlate with OHIS [16]. However, results are ambiguous. For example, some have shown that younger individuals seek more online health information than older individuals [16,38-40], whereas others find that older adults tend to seek more information online than their younger counterparts [41] or find no correlations with OHIS at all [42]. Frailty, or “the risk for adverse outcomes due to losses in different domains of functioning” [43], is found to be related to a decline in patients’ self-management abilities, more so than chronological aging. Therefore, the level of frailty, also called biological age, might better predict a patient’s ability to engage in OHIS than chronological age. In addition, several studies have shown that females seek online health information more frequently than males [16,38,40,44], whereas other studies show no associations between OHIS and gender [41,42]. With respect to education level, there is some evidence that higher educated individuals seek more online health information than lower educated individuals [44]; however, other studies show no such associations [20,42,45]. Finally, the tendency to search for health information online can also differ according to one’s degree of health literacy or “the ability to perform basic reading and numerical tasks required to function in the health care environment” [46]. As described in a review study, some studies show limited evidence that people with low health literacy search less frequently for health information online, compared with people with high health literacy, whereas other studies show no differences in OHIS based on health literacy [47].

    Psychosocial Factors

    In addition to demographics, OHIS can also be explained by patients’ psychosocial characteristics such as their degree of stress or anxiety and strategies to cope with such feelings. Higher levels of fear and anxiety in cancer patients have both been associated with the tendency to avoid cancer-related information [28,48] and with increased information needs [49]. Seeking relevant health information online might help patients to deal with the feelings of anxiety, and some patients feel relieved or comforted by the information they find online [45,50]. However, cancer patients differ in their need for cancer-related information [48], based on how they cope with a health threat. Some patients prefer only a very limited amount of information (blunting coping style), whereas others prefer as much information as possible (monitoring coping style) [51-56]. As the results are inconsistent, more research is needed, resulting in research question (RQ) 1:

    • RQ 1: Are cancer patients’ demographic characteristics (ie, age, gender, education level, frailty, and health literacy) and psychosocial characteristics (ie, anxiety, cancer-related stress, and information-seeking coping style) related to OHIS?

    Direct Relation of OHIS and Patient Participation

    Patient Participation

    OHIS may potentially better equip patients to participate in consultations with health care providers [57-59]. Actively participating in such consultations reflects patients’ ability and willingness to express their needs, concerns, preferences, and expectations [32]. According to the linguistic model of patient participation in care, patients need a certain repertoire of informational resources to actively communicate during medical consultations [32]. Patients with sufficient knowledge about a topic or terminology related to the topic will discuss health issues more easily with their providers [60]. Therefore, the knowledge a patient possesses, which might be gained because of OHIS, influences a patient’s ability to actively communicate and is an important factor in patient participation [29,32,61].

    In addition, providing patients with an opportunity to gather information and seeking online health information can empower patients by giving them the feeling that they are better prepared for their consultations, thereby making them confident enough to actively participate during consultations [9,29]. A recent review showed that gathering online health information before a consultation resulted in patients feeling more self-assured and empowered during consultations [9].

    In conclusion, seeking health information online can prepare patients for interactions with health care providers by increasing knowledge and feelings of empowerment and might, therefore, be a crucial predictor of patient participation. Therefore, we argue that more OHIS leads to greater patient participation during a consultation with a health care provider, resulting in hypothesis 1 (H1):

    • H1: OHIS is positively related to cancer patients’ participation during a medical consultation.

    Indirect Relation of OHIS and Patient Outcomes: The Mediating Role of Patient Participation

    Both OHIS and patient participation are believed to be important independent factors that influence affective and cognitive patient outcomes [6,62]. OHIS most likely influences these outcomes via patient participation because it can increase patients’ illness-related knowledge and feelings of empowerment, leading to more patient participation [32]. Active patient participation can, in turn, positively affect factors that indicate quality of care [32]. Indeed, studies have found that patient participation results in less anxiety [6,33], more satisfaction [34-36], and better information recall [13,37].

    Anxiety

    OHIS can positively influence emotional well-being in general, for example, by making the patient feel less stressed [5] and less anxious [10-12]. OHIS can also help patients gain knowledge about their illness [30], making them feel more empowered to discuss certain topics during consultations [9], which, in turn, can lower their stress and feelings of anxiety. If patients experience feelings of anxiety beforehand, or because of OHIS, actively participating during the consultation gives them a chance to discuss their issues with the health care provider, which might help decrease their anxiety.

    On the other hand, in some cases, OHIS can increase feelings of worry and anxiety [27,63]. Patients can experience confusion because of seeking health information [27,30], which can result in feeling less comfortable to participate and act more reserved during consultations. If a patient already feels anxious because of seeking online health information and does not actively participate during consultations, the health care provider may not be able to adequately address the patient’s anxiety. As a result, their anxiety may remain or increase even further. In line with this, we argue that the effect of OHIS on anxiety is mediated by patient participation during medical consultations (Figure 1), resulting in hypothesis 2a (H2a):

    • H2a: Patient participation mediates the effect of OHIS on anxiety and stress after consultation.
    ‎
    Figure 1. Theoretical model. H1: hypothesis 1; H2: hypothesis 2; RQ1: research question 1.
    View this figure
    Satisfaction

    Generally, better informed patients are more satisfied with their health care processes [6,7,12,64]. Russ et al [8] found that patients who sought online health information were more satisfied with the information provided by the provider during a consultation when compared with patients who did not seek online health information.

    A reason for this increase in satisfaction can be that seeking online health information before a consultation gives the patient a feeling of being prepared for the consultation [9]. Online information can help patients anticipate the discussion of certain topics during consultations or to consider possible treatments that will be proposed [65]. Knowing what to expect during the consultation can result in more active participation, including the expression of questions or expectations. These can subsequently be addressed by the health care provider, resulting in greater satisfaction with the consultation. In line with this, patients are more satisfied when providers are supportive of their search for online health information [66,67]. Therefore, it can be argued that OHIS leads to more satisfied patients through increased patient participation.

    However, as discussed before, OHIS can also cause confusion, thereby inhibiting active patient participation. As a result, issues relevant to a patient may not be addressed, in which case the patient can feel disappointed and less satisfied with the consultation. Accordingly, research has shown that when the online findings do not match with the information discussed during consultation, for example, regarding diagnosis or treatment options, this can result in a less satisfied patient [68]. Therefore, we argue that the effect of OHIS on satisfaction with a consultation is mediated by patient participation (Figure 1), resulting in hypothesis 2b (H2b):

    • H2b: Patient participation mediates the effect of OHIS on satisfaction with a consultation.
    Recall

    When patients engage in OHIS before a consultation and this leads to more participation during the consultation, this is likely to improve the recall of the information discussed [13,37,69-71]. One reason for the positive association between OHIS, participation, and recall is that repetition of the same information can improve information recall [72,73]. When patients search for online health information before the consultation and discuss the same information during the consultation by actively participating, this leads to a repetition in exposure to that information. In addition, exposure to a first piece of information can prime the interest for a second similar piece of information [74]. As this double exposure to the same kind of information stimulates deeper information processing, it is expected to positively influence information recall [75,76].

    It can also be argued that patients who participate more actively during the consultation by asking more questions and expressing more concerns will receive more information from health care providers and are also more likely to understand the rationale and recommendations of the provider [32]. Moreover, actively participating patients are more involved and, therefore, process the information they receive during the consultations in an active manner. This active, deeper processing of information can result in better information recall [77]. Thus, we argue that the effect of OHIS on recall of the information provided during the consultation is mediated by patient participation (Figure 1), leading to hypothesis 2c (H2c):

    • H2c: Patient participation mediates the effect of OHIS on information recall.

    Design

    A study was conducted in 6 Dutch hospitals among newly diagnosed colorectal cancer patients. All patients received the standard procedure of care provided by the hospitals without any alterations. All newly diagnosed patients who planned to undergo surgery were approached to participate in the study. Health care providers (surgeons and specialized nurses) and patients signed an informed consent form. Study participants received a consultation with a surgeon or specialized nurse in preparation for their surgery. This consultation was audio-recorded, transcribed, and content coded. Data were collected using questionnaires before and after the consultation.

    This study was registered with Trialregister.nl (NTR5919) and was approved by the Review Board of the Amsterdam School of Communication Research (2017-PC-7979) and the medical ethical review boards of the hospitals that participated in the study (METC-nr: 13-061). The data collected to answer the RQs and hypotheses for this study were part of a larger investigation including multiple measurement moments.

    Procedure and Participants

    Participants included newly diagnosed colorectal cancer patients; those who had planned to undergo surgery, possibly in combination with other treatment and had sufficient command of the Dutch language, were able to read, and had no cognitive impairment according to their medical record (eg, dementia); and those who had provided written informed consent.

    Once the consultation with the surgeon was scheduled, a specialized nurse or medical secretary asked the patients if they wanted to receive study information. Patients who agreed to being contacted about this study were approached, approximately 3 days before the consultation, by the study coordinator via phone to explain what study participation would entail. Consenting patients received additional information and the first online questionnaire at time point 1 (T1) via email. Patients were asked to complete the first questionnaire 1 day before the consultation.

    The scheduled consultation was recorded at time point 2a (T2a), and 2 days thereafter at time point 2b (T2b), the patients received the second questionnaire partly via email, including standard questions that were the same for all patients. Patients were also contacted via telephone 2 to 3 days after the consultation at time point 2c (T2c) by the research assistant or researcher to assess recall using recall questions that were tailored to the consultation.

    The final sample consisted of 90 patients, as seen by 23 health care providers (surgeons and specialized nurses) in 6 Dutch hospitals. During the study, 346 patients were reported to be suitable for participation by the specialized nurses or medical secretaries of the hospitals. A total of 285 patients were successfully approached to participate in the study. The other 61 patients either did not meet the inclusion criteria or could not be reached because of organizational or technical difficulties. Of the 285 patients who were successfully approached, 119 consented to participate in the study. As 29 of the consenting patients did not fill out the first questionnaire before the consultation, a total of 90 patients were included in the final analyses. Between the first and the following questionnaires, a number of patients dropped out, resulting in 72 consultation recordings, 67 responses on T2b, and 63 responses on T2c. More details about the dropout process are shown in Figure 2.

    ‎
    Figure 2. Flowchart of inclusion and dropout. T1: time point 1; T2a: time point 2a; T2b: time point 2b.
    View this figure

    Measures T1

    Demographics

    Sociodemographic information was obtained in the first questionnaire with questions regarding age, gender, education level, living situation, and internet use. A total of 3 categories were formed for education level (low, middle, and high). In addition, hospital records were used to obtain medical information about diagnoses and treatments of patients.

    Frailty

    Frailty was measured using the Groningen Frailty Indicator [43]. This scale contains 15 items about physical functioning (mobility, multiple health problems, fatigue, and vision or hearing problems), cognitive functioning, social functioning, and psychological functioning (feelings of depression or anxiety). The total score could range from 0 to 15; however, in this study, patients scored from 0 to 11 (mean 2.80, SD 2.45), with a higher score indicating more frailty [43].

    Health Literacy

    A 3-item questionnaire was used to measure health literacy [46]. The items addressed one’s ability to obtain and read medical information and to fill out medical forms on a 5-point scale (α=.62). The total score ranged from 1 to 5, with a higher score indicating higher health literacy (mean 4.26, SD 0.71).

    Anxiety (Preconsultations)

    Anxiety was measured at T1 using the short Dutch version of the State Trait Anxiety Inventory [10,78]. Patients rated the degree to which they were currently experiencing anxiety on a 4-point scale ranging from 1 (not at all) to 4 (very much). Higher scores on the scale indicate higher levels of anxiety. Patients scored on average 1.95 (SD 0.55), with scores ranging from 1 to 3.67. Cronbach alpha was good (α=.82).

    Cancer-Related Stress

    Cancer-related stress was measured at T1, with a subscale of the Dutch version of the Impact of Events Scale [79,80], comprising 7 items (α=.84). Participants rated the items on a 4-point Likert scale (1=not at all, 2=rarely, 3=sometimes, 4=often), with a higher score indicating higher levels of cancer-related stress. Scores ranged from 1 to 3.71, and patients scored an average of 2.03 (SD 0.70).

    Coping Style

    Coping style was measured using the adapted shortened version of the Threatening Medical Situation Inventory at T1 [81,82]. The scale consists of 3 items measuring monitoring intentions regarding the patients’ medical situation. Items addressed intentions to (1) look for information within the threatening situation, (2) go deeply into the situation by reading about it, and (3) get information from the health care provider (α=.82). Participants responded to the statements with answer options ranging from 1 (not at all applicable to me) to 5 (very much applicable to me) and scored an average of 3.46 (SD 1.07), with a higher score indicating higher monitoring intentions.

    OHIS

    On the basis of previous research [20], patients were asked to indicate on a 5-point Likert scale how often they had used the internet to seek information about their illness or treatment options before the consultation (T1). The answer options were 1 (did not use), 2 (used very little), 3 (used sometimes), 4 (used regularly), and 5 (used often). Patients on average scored 2.23 (SD 1.32).

    Measures T2a

    Patient Participation

    The audiotaped consultations were transcribed and manually coded by a research assistant using 3 measures to represent patient participation. This operationalization is in line with the methods used in previous research [83-86]. First, the absolute contribution of the patient to the consultation was measured using the patient’s absolute word count. Second, the relative contribution of the patient was measured by calculating the ratio of the number of words used by the patients compared with the number of words used by the health care provider. For these 2 measures, the coding process involved counting all the words used by the patient and the health care provider [83,84]. Third, the number of questions and assertions expressed by the patient during the consultation was coded using a codebook developed based on the method described by Street and Millay [32] (the complete codebook is given in Multimedia Appendix 1). A total of 10% (9/90) of the data set was double-coded by a second independent coder, resulting in acceptable intercoder reliability (κ=0.764; P<.001).

    Measures T2b

    Anxiety (Postconsultation)

    Anxiety was measured postconsultation (T2b) in the same manner as in the preconsultation (T1). Patients on average scored 1.80 (SD 0.66). Cronbach alpha was good (α=.86).

    Satisfaction With the Consultation

    To measure patient satisfaction with the consultation (T2b), the 5-item Patient Satisfaction Questionnaire was used [87]. Items addressed the following: the extent to which the patient was satisfied in terms of needs that were met by the surgeon, if the patient felt actively involved during the consultation, the information received during the consultation, the emotional support received during the consultation, and the interaction during the consultation in general (α=.80) [84]. All the answer options ranged from 1 (not satisfied at all) to 5 (completely satisfied), and patients scored an average of 4.39 (SD 0.58).

    Measures T2c

    Information Recall

    To measure information recall, the Netherlands Patient Information Recall Questionnaire (NPIRQ) [88] was used to compose the questions. The correct answers to the questions were (parts of) statements provided by the surgeon during the consultation. Therefore, the answers were literally derived from the transcribed consultations. Answers provided by the patients were scored as 0 (not recalled), 1 (partially recalled), and 2 (completely recalled). If the patient did not recall the information, there were 2 other answer option: “this information was not discussed” and “this information was discussed, but I can't remember the details,” both resulting in a score of 0 [88].

    In line with the NPIRQ guidelines, a sum score was constructed by calculating the percentage of the obtained recall score (range 6%-100%) relative to the maximum achievable score (2-26 points), with higher scores indicating better recall. Patients scored an average of 60% (SD 0.19). A total of 10% of the cases (7/63) were double-coded by 2 independent coders to check intercoder reliability (mean κ=0.71; P<.001) [89].

    Statistical Analyses

    The analyses are based on a 2-step process. First, the correlations between demographic and psychosocial variables and outcome variables were tested. The variables that significantly correlated with the outcome measures at a significance level of .10 were selected for follow-up analyses as control variables. Second, multivariate regression analyses were carried out to test whether demographic variables (age, gender, and education level) and psychosocial factors (frailty, coping style, stress, and anxiety before the consultation) were related to OHIS (RQ1) and if OHIS was related to patient participation (number of words used by the patient during the consultation, relative contribution a patient had in the consultation in terms of the word count ratio, and number of questions and assertions expressed; H1). For the mediation effects in H2a, H2b, and H2c, regression analyses using an SPSS macro allowing for mediation, (PROCESS model 4) [90] were conducted. In addition, to determine whether the relation between OHIS and the outcome variables differed depending on clustering within health care providers, multilevel analyses were carried out if the dependent variable correlated with health care providers [91].


    Sample

    The age of patients included in the final analyses ranged from 39 to 88 years (mean 69.93, SD 9.93), and about two-thirds of the patients were male (59/90, 66%). Half of the patients (45/90, 50%) had a medium level of education. Patients’ health literacy was relatively high (mean 4.25, SD 0.71), and they were not frail on average (mean 2.80, SD 2.45). Almost half of the patients (41/90, 46%) indicated that they did not use the internet, 12% (11/90) used the internet very little, 21% (19/90) used the internet sometimes, 16% (14/90) used the internet regularly, and 6% (5/90) used the internet often before the consultation. Nonresponse analyses revealed that participants did not differ compared with nonparticipants regarding gender (F1,309=2.92; P=.09) but were on average significantly younger (mean 69.75, SD 9.93) than patients who did not wish to participate (mean 73.15, SD 10.30; F1,297=7.24; P=.008). The background information of the participants is presented in Table 1.

    Table 1. Sample characteristics.
    Background variablesaPatients
    Demographic information (n=90), mean (SD)

    		Age (years)69.93 (9.93)
    Gender (n=90), n (%)

    		Male59 (66)

    		Female31 (34)
    Education level (n=88), n (%)

    		Low24 (27)

    		Medium45 (51)

    		High19 (22)
    Health background information (n=90), mean (SD)

    		Health literacyb4.25 (0.71)

    		Frailtyc2.80 (2.45)
    Psychosocial information (n=90), mean (SD)

    		Coping styled3.46 (1.07)
    Online health information seeking behavior (n=90), n (%)

    		Never41 (46)

    		Very little11 (12)

    		Sometimes19 (21)

    		Regularly14 (16)

    		Often5 (6)

    aAll cells add up to 100% owing to missing data.

    bA higher score indicates higher levels of health literacy (maximum range 1-5; reported range 1-5).

    cA higher score indicates higher frailty (maximum range 0-15; reported range 0-11).

    dA higher score indicates a higher information-monitoring coping style (maximum range 1-5; reported range 1-5).

    Patient Participation

    Recorded consultations (n=72) lasted between 4 minutes 26 seconds and 46 minutes 40 seconds, with an average duration of 20 minutes 19 seconds (SD 7.47 minutes). The number of words spoken during these consultations ranged from 488 to 6824 words (mean 2657, SD 1307.89). Patients spoke a minimum of 29 words and a maximum of 1347 words (mean 472.57, SD 295.46), whereas health care providers spoke at least 386 words and at the most 5124 words (mean 1998.83, SD 991.93). Patients scored a relative contribution to the consultation of 19.12% (472.57/2471.4) on average, ranging from 3.4% to 43.5% (SD 8.20); therefore, the ratio of health care providers ranged from 56.5% to 96.6%, with an average of 80.8% (SD 8.20).

    A total of 69 patients asked at least one question, and 55 patients expressed at least one assertion. The number of questions ranged from 1 to 35 per consultation (mean 6.44, SD 6.36), and the number of assertions ranged from 1 to 10 per consultation (mean 2.30, SD 1.92). This resulted in a total number of questions and assertions ranging from 1 to 37 (mean 7.96, SD 7.03).

    Predictors of OHIS

    Demographics

    Correlation analyses showed that age was negatively related to OHIS (r=−0.29; P=.005), suggesting that an increase in age was associated with less OHIS. Education level and OHIS were positively correlated (r=0.37; P<.001), suggesting that higher educated patients engage more in OHIS. No significant correlations were found between OHIS and gender (r=0.01; P=.91), frailty (r=−0.10; P=.35), and health literacy (r=0.15; P=.14; Table 2).

    Table 2. Correlation matrix.
    Variable1.2.3.4.5.6.7.8.9.10.11.12.13.14.15.16.17.
    1. Age—a















    2. Genderb0.021—














    3. Education levelc−0.0570.038—













    4. Health literacy0.0390.0740.220*—












    5. Frailty−0.157−0.002−0.183−0.295**—











    6. Anxiety (preconsultation)−0.286**−0.016−0.113−0.0410.461**—










    7. Cancer-related stress−0.294**−0.156−0.02−0.0450.2030.554**—









    8. Coping style−0.205*−0.0990.231*0.112−0.1150.0130.198—








    9. Health care provider0.096−0.172−0.275**−0.097−0.1620.1190.109−0.061—







    10. consultation time−0.0430.079−0.056−0.076−0.250*0.0880.060.1270.509**—






    11. Online health information seeking−0.289**0.0120.369**0.151−0.0960.1830.361**0.453**−0.10.143—





    12. Patient participation word count−0.061−0.229*0.0990.02−0.1310.1420.0820.336**0.392**0.525**0.326**—




    13. Patient participation relative contribution−0.074−0.1030.0860.0770.1110.039−0.0030.168−0.062−0.1560.220.574**—



    14. Patient participation questions and utterances0.065−0.258*0.147−0.076−0.0340.1470.1140.2230.285*0.330**0.1760.633**0.295**—


    15. Anxiety (postconsultation)−0.067−0.231*−0.144−0.1240.435**0.601**0.511**0.1520.085−0.0310.238*0.1870.1660.278*—

    16. Satisfaction0.134−0.200−0.174−0.044−0.151−0.169−0.121−0.1270.2270.141−0.1910.086−0.1780.005−0.360**—
    17. Recall−0.1050.0210.080−0.1260.0730.1500.161−0.1760.0810.0610.0160.2080.1390.040−0.0180.345**—

    aNot applicable.

    bGender was dummy coded into 1=female and 2=male.

    cEducation was dummy coded into 1=low, 2=medium, and 3=high.

    *P<.05, **P<.01, ***P<.001.

    Psychosocial Factors

    In addition, correlation analyses showed that cancer-related stress was positively correlated with OHIS (r=0.36; P<.001), implying that higher stress levels can result in more OHIS. There was a marginally significant positive correlation between anxiety before the consultation and OHIS (r=0.18; P=.08), suggesting that patients who report higher anxiety levels might engage more in OHIS. Regarding coping style, a positive correlation was found (r=0.45; P<.001), meaning patients with higher levels of monitoring coping style engaged more in OHIS (Table 2).

    Regression Analyses

    To test whether these variables predict OHIS, a regression analysis was conducted, including all possible predictors that significantly correlated with OHIS (age, education level, cancer-related stress, anxiety before the consultation, and coping style). The results showed that education level (B=0.54; P=.002), cancer-related stress (B=0.48; P=.02), and coping style (B=0.41; P=.001) were positively associated with OHIS. Thus, higher educated patients, patients experiencing more cancer-related stress, and patients with higher levels of a monitoring coping style more frequently engaged in OHIS. There was no relation between age and OHIS (B=−0.01; P=.24) and between anxiety before the consultation and OHIS (B=0.08; P=.74) based on the multivariate regression. To answer RQ1, education level, cancer-related stress, and coping style are positively related to OHIS.

    Relation Between OHIS and Patient Participation During the Consultation (n=71)

    The correlation analyses showed that gender was significantly related to the number of words used by the patient (r=−0.23; P=.005) and the number of questions and assertions expressed by the patient (r=−0.26; P=.003), suggesting that males used fewer words and expressed fewer questions and assertions than females. Coping style was also positively related to the number of words used by the patient (r=0.37; P=.004), indicating that patients with a more monitoring coping style used more words (Table 2). There were no significant correlations between the other variables and the number of words used, the relative contribution of a patient in the consultation in terms of the word count ratio, or the number of questions and assertions expressed by the patient.

    Regression analyses were carried out to test the relation between OHIS and patient participation outcomes. On the basis of the correlation analyses, gender and coping style were included as control variables for the regression analyses regarding the number of words used by the patient and gender was included as the control variable for the regression regarding the number of questions and assertions expressed. No variables were included as control variables in the regression regarding relative contribution of the patient.

    Results showed OHIS was positively related to the number of words used by the patient during the consultation (B=50.58; P=.02), when controlling for gender and coping style. The relation between OHIS and the relative contribution of the patient a patient had in the consultation in terms of the word count ratio was also significant (B=1.99; P=.02). OHIS was not related to the number of questions and assertions expressed (B=0.74; P=.26), when controlling for gender. In other words, patients who engaged more in OHIS used more words during the consultation and had a larger relative contribution to the conversation but did not express more questions and assertions. Regarding H1, we can conclude that OHIS is associated with some, albeit not all, indicators of patient participation during consultations.

    Relation Between OHIS and Anxiety, Satisfaction, and Recall, Mediated by Patient Participation

    The correlation analyses (n=90) showed that gender (r=−0.23; P=.005), frailty (r=−0.44; P<.001), anxiety before the consultation (r=−0.60; P<.001), and cancer-related stress (r=−0.51; P<.001) were significantly related to anxiety after the consultation. Gender was also significantly related to the number of words used by the patient (r=−0.23; P=.005) and the number of questions and assertions expressed by the patient (r=−0.26; P=.003), whereas coping style was also positively related to the number of words used by the patient (r=0.37; P=.004; Table 2). These variables were included as control variables in the regression analyses regarding anxiety after the consultation. Health care provider was only significantly related to satisfaction with the information (r=−0.23; P=.005). However, multilevel analyses showed the relation between OHIS and satisfaction was not dependent on health care provider (F1,4=−0.04; P=.35). There were no significant correlations between the other variables and satisfaction with the information or information recall. Therefore, no control variables were included in the regression analyses regarding satisfaction and recall.

    Anxiety (n=64)

    When controlling for gender, frailty, anxiety before the consultation, and cancer-related stress, OHIS was not related to anxiety after the consultation (B=0.07; P=.17). Regarding patient participation, the number of words used by the patient B=−0.01 P=.44), the relative contribution of the patient in terms of the word count ratio (B=0.01; P=.14), and the number of questions and assertions expressed by the patient (B=0.01; P=.66) were also not related to anxiety after the consultation. There was no significant mediation of OHIS on anxiety after the consultation via the number of words used by the patient, relative contribution of the patient to the consultation, or the number of questions and assertions (Table 3); thus, H2a must be rejected.

    Table 3. Mediation analyses.
    RelationsBaSE95% CI valuest test (df)P value
    Direct effect of OHISb
    On word countc68.974027.886113.1535 to 124.79452.4734 (5,58).02
    On word count ratiod1.99180.84730.2958 to 3.68792.3508 (5,58).02
    On questions and assertionse0.73490.6469−0.5601 to 2.0991.1360 (5,58).26
    On anxiety 0.06660.0517−0.0369 to 0.17011.2890 (8,55).20
    On satisfaction −0.10290.0560−0.2149 to 0.0091−0.18377 (4,59).07
    On recall −0.02030.0189−0.0581 to 0.0175−1.0747 (4,58).29
    Direct effects on anxiety
    Of word count−0.00030.0003−0.0009 to 0.0004−0.7810 (8,55).44
    Of word count ratio0.01410.0096−0.0051 to 0.03331.4679 (8,55).15
    Of questions and assertions0.00510.0117−0.0184 to 0.02860.4365 (8,55).66
    Indirect effects of OHIS on anxiety
    Mediated by word count−0.01740.0231−0.0385 to 0.0549N/AfN/A
    Mediated by word count ratio0.02800.0219−0.0196 to 0.0694N/AN/A
    Mediated by questions and assertions0.00380.0162−0.0470 to 0.0225N/AN/A
    Direct effects on satisfaction
    Of word count0.00080.00040.0001 to 0.00152.2207 (4,59).03
    Of word count ratio−0.02230.0109−0.0442 to 0.0005−2.0487 (4,59).04
    Of questions and assertions−0.00870.0139−0.0365 to 0.0191−0.6246 (4,59).53
    Indirect effects of OHIS on satisfaction
    Mediated by word count0.05290.02830.0053 to 0.1158N/AN/A
    Mediated by word count ratio−0.03190.0254−0.0925 to 0.0068N/AN/A
    Mediated by questions and assertions−0.00680.0162−0.0268 to 0.0416N/AN/A
    Direct effects on recall
    Of word count0.00020.00010.0000 to 0.00041.6737 (4,58).10
    Of word count ratio0.00040.0036−0.0068 to 0.00760.1033 (4,58).92
    Of questions and assertions−0.00250.0047−0.0119 to 0.0069−0.5359 (4,58).59
    Indirect effects of OHIS on recall
    Mediated by word count−0.01310.0091−0.0029 to 0.0333N/AN/A
    Mediated by word count ratio−.00040.0051−0.0092 to 0.0127N/AN/A
    Mediated by questions and assertions−0.00150.0043−0.0084 to 0.0101N/A N/A

    aB: Standardized β.

    bOHIS: online health information seeking.

    cNumber of words used by the patient.

    dRelative contribution of the patient in terms of words used by the patient compared with words used by the health care provider.

    eNumber of questions and assertions expressed by the patient.

    fN/A: not applicable.

    Satisfaction (n=64)

    OHIS was marginally negatively related to satisfaction with the consultation directly (B=−0.10; P=.07), suggesting that the more a patient engaged in OHIS, the less satisfied the patient was with the consultation. The number of words used by the patient was positively related to satisfaction with the consultation (B=0.0008; P=.03), meaning the more words a patient used, the more satisfied a patient was. The relative contribution of the patient to the consultation in terms of the word count ratio was negatively related to satisfaction (B=−0.02; P=.05), suggesting that the higher the relative contribution of the patients (and therefore automatically the lower the contribution of the health care provider), the less satisfied the patient was. There was no significant relation between the number of questions and assertions expressed by the patient and satisfaction (B=−0.01; P=.54). The indirect relation between OHIS and satisfaction, based on the number of words used by the patient, was also significant (B=0.05; 95% CI 0.0053-0.1158). This means that patients who engaged in OHIS used more words during the consultations, which, in turn, was positively related to more satisfaction with the consultation. Therefore, H2b is partly supported.

    Recall

    The analyses showed no significant correlation between OHIS and information recall (B=−0.02; P=.28). In addition, there was no significant relation between the number of words used by the patient (B=0.00; P=.10), the relative contribution of the patient to the consultation (B=0.01; P=.92), the number of questions and assertions expressed (r=−0.01; P=.59), and information recall. In addition, there was no significant mediation of OHIS on information recall via 1 of the patient participation measures (Table 3). This implies that H2c must be rejected.


    Review of Findings

    The aim of this study is twofold. First, this study examined which demographic and psychosocial factors could predict OHIS of newly diagnosed cancer patients. Second, we investigated how OHIS subsequently relates to patient participation during consultations and how this, in turn, affects patients’ anxiety, satisfaction, and information recall. Regarding demographic factors, the results showed that patients with higher levels of education were more inclined to engage in OHIS. With respect to psychosocial factors, higher levels of cancer-related stress are associated with more OHIS, and patients with a monitoring coping style also engage more in OHIS. In turn, OHIS was positively related to patient participation in terms of the number of words used by the patient during the consultation and the relative contribution of the patient in the consultation but not to the number of questions and assertions expressed.

    The negative direct relation between OHIS and satisfaction shows that more OHIS leads to lower patient satisfaction. In addition, the number of words used by the patient was related to higher levels of satisfaction with the consultation, whereas the relative contribution of the patient in the consultation was related to lower levels of satisfaction. The results also showed a positive indirect relation between OHIS and satisfaction via the number of words used by the patient, meaning that patients who engaged more in OHIS used more words during the consultation, which, in turn, was positively related to satisfaction with the consultation. On the basis of these results, it can be concluded that OHIS can lead to both more and less satisfaction with the consultation, depending on the mediation of the number of words used by the patient.

    Our results indicate that not all patients engage in OHIS. In particular, lower educated patients search less for health information online. This is in line with previous research in which education has been shown to positively influence OHIS [92]. Therefore, concerns raised almost 20 years ago by Lenhart et al [31,93] regarding the digital divide still appear to be valid. As our findings suggest that OHIS is related to patient participation and satisfaction with the consultation, it can be seen as problematic that a group of patients still does not engage in OHIS.

    Our results show different relations between the different measures of patient participation and OHIS. First, our results seem to suggest that patients who engage in OHIS are inclined to use more words during the consultation, which, in turn, results in greater satisfaction with the consultation. This mediation may occur regardless of the reaction of the health care providers. However, satisfaction with the consultation might also be influenced by the interplay between the patient and health care provider. For example, patient participation can elicit a response in the health care provider, for example, discussing more information during consultations [94-96]. On the other hand, the health care provider may disregard the patient’s input, which is more in line with studies that have shown health care providers to insufficiently meet the patient’s needs [93-95]. If the relative contribution of the patient is higher, it could mean that even though the patient uses more words, the health care provider does not respond to the patient’s input. This could explain why an increase in the relative contribution of the patient to the consultation is related to a decrease in satisfaction with the consultation.

    Second, the undemonstrated relation between OHIS and the expression of questions and assertions contradicts previous research, suggesting that OHIS facilitates patients to express their needs and concerns [97-99]. One reason for this could be that online health content is often incorrect, incomplete, and biased [97] and is usually experienced by patients as difficult to comprehend [97-99]. If patients engage in OHIS but find information that confuses them, this might inhibit their expression of questions or assertions. In particular, if patients do not feel empowered and confident during the consultation, they might ask fewer questions and express less assertions. It might also be possible that patients did not find the right information to support them in asking questions or expressing assertions or that OHIS fulfilled patients’ information needs and already answered questions patients had. This could have resulted in patients asking fewer questions during consultations. On the other hand, finding ambiguous information online could also lead to confusion resulting in patients asking more questions during the consultation. We swiftly examined the content of the transcripts to obtain a better understanding of the differences in relations between OHIS and the separate indicators of patient participation. The transcripts showed that patients who used more words but did not express more questions and assertions mostly engaged in small talk and discussed side issues unrelated to their ongoing situation. This implies that patients who are more active in OHIS are also more active during consultations in terms of using more words; however, the information they found online did not seem to empower them enough to express treatment-related questions or assertions.

    We expected that OHIS would result in less anxiety after the consultation (H2a), via more patient participation, but our results did not support this. The fact that OHIS did not influence the expression of questions and assertions might explain why we also did not find an indirect relation between OHIS and anxiety via patient participation, as feelings of anxiety could not be partly dismantled by discussing them with the health care provider.

    The aforementioned line of reasoning may also explain why OHIS did not lead to better information recall, indirectly via patient participation. By not expressing questions or assertions, but just talking more about other subjects, more information was added to the consultation. The amount of information this added to the consultation could have overshadowed the most important information about the diagnosis and treatment. Previous research has shown that the amount of information discussed during a consultation can negatively influence recall of the information discussed [88].

    Strengths

    This study is, to the best of our knowledge, the first to show a significant mediation of OHIS on satisfaction with the consultation via patient participation. Established models regarding the influence of OHIS on patient participation mainly focused on the ways in which patient participation can be increased by OHIS, for example, by increasing knowledge and feelings of empowerment [62], or how patient participation can influence patient outcomes [31,84,93]. Our findings help to connect and extend these models by linking these 2 processes together, considering both the influence of OHIS on patient participation and the relation between patient participation and patient outcomes.

    A distinguishing feature of this study was the participants. Including newly diagnosed cancer patients is challenging because of the emotional burden the patients face. Therefore, another strength of this study is that we succeeded in collecting these data in a vulnerable population. The fact that this is a multicenter study, with participating patients being treated in 1 of 6 Dutch hospitals, made inclusion of the patients even harder. Although this is beneficial for the external validity of the study, differences occurred in the recruitment process between the hospitals and inclusion was more troubled in some hospitals than in others, resulting in varying inclusion rates between hospitals.

    Limitations and Future Research

    First, patient participation was operationalized using only quantitative measures. Therefore, we could only draw conclusions based on the quantity of patient participation and not on the quality of patient participation. Future research should also qualitatively address patient participation during consultations to gain more insight into the content of patient participation. In addition, only the utterances of the patients were analyzed. The utterances of health care providers were only included in terms of relative contribution to the consultation but not in terms of content. As it seems plausible that patients’ communication is dependent on the interplay between the partakers in that consultation [31,84,92], it is advisable to analyze the behavior of all parties taking part in the consultation in future research. In addition, only behavioral measures were used in this study to measure patient participation. Adding measures of perceived participation would be a valuable addition and is, therefore, recommended for future research.

    A limitation that could have influenced the relations with information recall is that in this study, the number of recall questions was based on the amount of information the patient received from the health care provider during the consultation. This means that the more information was provided, the more recall questions the patient had to answer. The amount of information is known to be negatively related to the ability to correctly recall this information [100,101], and a higher number of questions can mean a higher chance of making mistakes. The researchers of this study deliberately chose to tailor the recall questions to the consultations of each separate patient because asking a fixed set of recall questions meant asking questions about topics that were not discussed with the patient, which was seen as unethical. Researchers can decide on asking a maximum number of questions per topic in the case of long consultations.

    Finally, as our results show that OHIS does not lead to expressing questions or utterances, we encourage researchers to further investigate the effects of other types of online health information, such as online tools specifically developed and offered to patients. Previous research has shown that online health information developed and offered to a specific patient population, including preparatory tools such as question prompt lists or information tailored to a patient’s situation, can be effective in increasing patient participation [99,100].

    Practically, as we see a relation between some measures of patient participation and satisfaction, but not all, this study shows the importance of providing patients with the right tools to search for online health information that stimulates participation by means of expressing questions and utterances during consultations. In particular, because OHIS can also increase worry and confusion [27,30,63], health care providers are advised to guide patients with clear instructions on how to search for information online. For example, hospitals could provide patients with flyers, including information about which websites are reliable and which websites are not.

    Conclusions

    This study showed that younger patients, higher educated patients, patients who experience more cancer-related stress, and patients with a monitoring coping style are more likely to engage in OHIS. OHIS is positively related to the patient’s absolute contribution during a consultation, which, in turn, results in the patient being more satisfied with the consultation. The results are an important addition to established models regarding the influence of OHIS.

    Acknowledgments

    The authors would like to thank all health care providers who participated in this study: Dr Bosker, Dr Liem, Dr Talsma, and Dr Torrenga from Deventer Hospital; Dr Steup, Dr Brouwers, Dr Boutkan, Dr Bastiaanse, and Dr Gooike from Haga Hospital; Dr Welten, Dr Hulsewe, Dr van Bastelaar, Dr Stoot, Dr Jansen, Dr Teuwen, Dr Sosef, and Dr Van Esser from Zuyderland Medical Center; Ms Koet and Ms Hoogendoorn from Albert Schweitzer Hospital; and Dr Fransen from Laurentius Hospital. In addition, the authors would like to thank all research assistants who helped with the data collection: Romy Koopsen, Chrissy Ooteman, Sanne Tamboer, Lisa van der Burg, Monique Alblas, Esther van der Woude, Manon Eggink, Laura Welbergen, Rodienne Kramers, Hasina Nezami, Jeresa Willems, Lisa Numeijer, Nikki Sunnen, Amber Sibbing, Max Tanaka, Nina Mollee, Hang Nguyen, Yayla Ilksoy, Maartje van Will, Nena van Ruiten, Sabine Bijvoet, Job Schipper, and Larissa de Looper.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Codebook of patient participation.

    PDF File (Adobe PDF File), 159 KB

    References

    1. McHugh SM, Corrigan M, Morney N, Sheikh A, Lehane E, Hill ADK. A quantitative assessment of changing trends in internet usage for cancer information. World J Surg 2011 Feb 23;35(2):253-257. [CrossRef] [Medline]
    2. Basch EM, Thaler HT, Shi W, Yakren S, Schrag D. Use of information resources by patients with cancer and their companions. Cancer 2004 Jun 01;100(11):2476-2483 [FREE Full text] [CrossRef] [Medline]
    3. Castleton K, Fong T, Wang-Gillam A, Waqar MA, Jeffe DB, Kehlenbrink L, et al. A survey of internet utilization among patients with cancer. Support Care Cancer 2011 Aug 18;19(8):1183-1190. [CrossRef] [Medline]
    4. Barnes LLB, Khojasteh JJ, Wheeler D. Cancer information seeking and scanning: sources and patterns. Health Educ J 2017 Oct 25;76(7):853-868. [CrossRef]
    5. Jiang S, Street RL. Pathway linking internet health information seeking to better health: a moderated mediation study. Health Commun 2017 Aug;32(8):1024-1031. [CrossRef] [Medline]
    6. Street RL, Makoul G, Arora NK, Epstein RM. How does communication heal? Pathways linking clinician-patient communication to health outcomes. Patient Educ Couns 2009 Mar;74(3):295-301. [CrossRef] [Medline]
    7. Weiss SM, Wengert PA, Martinez EM, Sewall W, Kopp ERN. Patient satisfaction with decision-making for breast cancer therapy. Ann Surg Oncol 1996 May;3(3):285-289 [FREE Full text] [CrossRef]
    8. Russ H, Giveon SM, Catarivas MG, Yaphe J. The effect of the Internet on the patient-doctor relationship from the patient's perspective: a survey from primary care. Isr Med Assoc J 2011 Apr;13(4):220-224 [FREE Full text] [Medline]
    9. Tan SSL, Goonawardene N. Internet health information seeking and the patient-physician relationship: a systematic review. J Med Internet Res 2017 Jan 19;19(1):e9 [FREE Full text] [CrossRef] [Medline]
    10. Marteau TM, Kidd J, Cuddeford L, Walker P. Reducing anxiety in women referred for colposcopy using an information booklet. Br J Health Psychol 1996;1(12):181-189. [CrossRef]
    11. Lambert SD, Loiselle CG. Health information seeking behavior. Qual Health Res 2007 Oct;17(8):1006-1019. [CrossRef] [Medline]
    12. Nguyen MH, Smets EMA, Bol N, Bronner MB, Tytgat KMAJ, Loos EF, et al. Fear and forget: how anxiety impacts information recall in newly diagnosed cancer patients visiting a fast-track clinic. Acta Oncologica 2018 Sep 28;58(2):182-188. [CrossRef]
    13. Richard C, Glaser E, Lussier MT. Communication and patient participation influencing patient recall of treatment discussions. Health Expect 2017 Aug 21;20(4):760-770 [FREE Full text] [CrossRef] [Medline]
    14. Feathers A, Yen T, Yun L, Strizich G, Swaminath A. Internet searches about therapies do not impact willingness to accept prescribed therapy in inflammatory bowel disease patients. Dig Dis Sci 2016 Apr 10;61(4):1013-1020. [CrossRef] [Medline]
    15. Abdul-Muhsin H, Tyson M, Raghu S, Humphreys M. The informed patient: an analysis of information seeking behavior and surgical outcomes among men with benign prostatic hyperplasia. Am J Mens Health 2017 Jan 08;11(1):147-153 [FREE Full text] [CrossRef] [Medline]
    16. Fox S, Duggan M. Health online 2013. Pew Research Center. 2013.   URL: http://www.pewinternet.org/wp-content/uploads/sites/9/media/Files/Reports/PIP_HealthOnline.pdf [accessed 2018-12-23] [WebCite Cache]
    17. Johnson JD, Donohue WA, Atkin CK, Johnson S. A comprehensive model of information seeking. Sci Commun 2016 Aug 18;16(3):274-303. [CrossRef]
    18. Johnson JD. Factors Distinguishing Regular Readers of Breast Cancer Information in Magazines. Women & Health 1997 Sep;26(1):7-27. [CrossRef]
    19. Posma ER, van Weert JCM, Jansen J, Bensing JM. Older cancer patients' information and support needs surrounding treatment: an evaluation through the eyes of patients, relatives and professionals. BMC Nurs 2009 Jan 19;8:1 [FREE Full text] [CrossRef] [Medline]
    20. Muusses LD, van Weert JCM, van Dulmen S, Jansen J. Chemotherapy and information-seeking behaviour: characteristics of patients using mass-media information sources. Psychooncology 2012 Sep 13;21(9):993-1002. [CrossRef] [Medline]
    21. Baumann E, Czerwinski F, Reifegerste D. Gender-specific determinants and patterns of online health information seeking: results from a Representative German Health Survey. J Med Internet Res 2017 Apr 04;19(4):e92 [FREE Full text] [CrossRef] [Medline]
    22. Johnson JD, Meischke H. A comprehensive model of cancer-related information seeking applied to magazines. Human Comm Res 1993 Mar;19(3):343-367. [CrossRef]
    23. Hartoonian N, Ormseth SR, Hanson ER, Bantum EO, Owen JE. Information-seeking in cancer survivors: application of the comprehensive model of information seeking to HINTS 2007 data. J Health Commun 2014 Apr 17;19(11):1308-1325. [CrossRef] [Medline]
    24. Van Stee SK, Yang Q. Online Cancer Information Seeking: Applying and Extending the Comprehensive Model of Information Seeking. Health Commun 2018 Dec 30;33(12):1583-1592. [CrossRef] [Medline]
    25. Lee CJ, Zhao X, Pena-y-Lillo M. Theorizing the pathways from seeking and scanning to mammography screening. Health Commun 2016 Jun 18;31(1):117-128. [CrossRef] [Medline]
    26. Sanders R, Linn AJ. A mixed method study investigating the impact of talking about patients' internet use on patient-reported outcomes. J Health Commun 2018;23(9):815-823. [CrossRef] [Medline]
    27. Linn AJ, van Weert JCM, Gebeyehu BG, Sanders R, Diviani N, Smit EG, et al. Patients' online information-seeking behavior throughout treatment: the impact on medication beliefs and medication adherence. Health Commun 2019 Nov 27;34(12):1461-1468. [CrossRef] [Medline]
    28. Bol N, Linn AJ, Smets EMA, Verdam MGE, van Weert JCM. Tailored communication for older patients with cancer: Using cluster analysis to identify patient profiles based on information needs. J Geriatr Oncol 2020 Jul;11(6):944-950 [FREE Full text] [CrossRef] [Medline]
    29. Castro EM, Van Regenmortel T, Vanhaecht K, Sermeus W, Van Hecke A. Patient empowerment, patient participation and patient-centeredness in hospital care: a concept analysis based on a literature review. Patient Educ Couns 2016 Dec;99(12):1923-1939. [CrossRef] [Medline]
    30. Anderson JG, Rainey MR, Eysenbach G. The impact of CyberHealthcare on the physician-patient relationship. J Med Syst 2003 Feb;27(1):67-84. [CrossRef] [Medline]
    31. Street RL, Gordon HS, Ward MM, Krupat E, Kravitz RL. Patient participation in medical consultations: why some patients are more involved than others. Med Care 2005 Oct;43(10):960-969. [CrossRef] [Medline]
    32. Street RLJ, Millay B. Analyzing patient participation in medical encounters. Health Commun 2001;13(1):61-73. [CrossRef] [Medline]
    33. Clayman ML, Bylund CL, Chewning B, Makoul G. The impact of patient participation in health decisions within medical encounters. Med Decis Making 2015 Nov 19;36(4):427-452. [CrossRef]
    34. Arora NK. Interacting with cancer patients: the significance of physicians' communication behavior. Soc Sci Med 2003 Sep;57(5):791-806. [CrossRef] [Medline]
    35. Epstein RM, Street RL. Patient-centered communication in cancer care: promoting healing and reducing suffering. National Cancer Institute. 2007.   URL: https://cancercontrol.cancer.gov/sites/default/files/2020-06/pcc_monograph.pdf [accessed 2021-03-01]
    36. Jackson JL. Communication about symptoms in primary care: impact on patient outcomes. J Altern Complement Med 2005 Dec;11 Suppl 1(supplement 1):S51-S56. [CrossRef] [Medline]
    37. Dillon PJ. Assessing the influence of patient participation in primary care medical interviews on recall of treatment recommendations. Health Commun 2012 Jan;27(1):58-65. [CrossRef] [Medline]
    38. Manierre MJ. Gaps in knowledge: tracking and explaining gender differences in health information seeking. Soc Sci Med 2015 Mar;128:151-158. [CrossRef] [Medline]
    39. Ayers SL, Kronenfeld JJ. Chronic illness and health-seeking information on the internet. Health (London) 2007 Jul;11(3):327-347. [CrossRef] [Medline]
    40. van Weert JCM, Bolle S, Muusses LD. Age and age-related differences in internet usage of cancer patients. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). LNCS(PART 3). Switzerland: Springer; 2014:403-414.
    41. Rice RE. Influences, usage, and outcomes of internet health information searching: multivariate results from the Pew surveys. Int J Med Inform 2006 Jan;75(1):8-28. [CrossRef] [Medline]
    42. Renahy E, Parizot I, Chauvin P. Determinants of the frequency of online health information seeking: results of a web-based survey conducted in France in 2007. Inform Health Soc Care 2010 Jan 19;35(1):25-39 [FREE Full text] [CrossRef] [Medline]
    43. Schuurmans H, Steverink N, Lindenberg S, Frieswijk N, Slaets JPJ. Old or frail: what tells us more? J Gerontol A Biol Sci Med Sci 2004 Sep 01;59(9):962-965. [CrossRef] [Medline]
    44. Myrick JG, Willoughby JF. Educated but anxious: how emotional states and education levels combine to influence online health information seeking. Health Informatics J 2019 Sep 21;25(3):649-660 [FREE Full text] [CrossRef] [Medline]
    45. Lorence DP, Park H, Fox S. Assessing health consumerism on the web: a demographic profile of information-seeking behaviors. J Med Syst 2006 Aug 29;30(4):251-258. [CrossRef] [Medline]
    46. Chew LD, Bradley KA, Boyko EJ. Brief questions to identify patients with inadequate health literacy. Fam Med 2004 Sep;36(8):588-594 [FREE Full text] [Medline]
    47. Anker AE, Reinhart AM, Feeley TH. Health information seeking: a review of measures and methods. Patient Educ Couns 2011 Mar;82(3):346-354. [CrossRef] [Medline]
    48. Leydon GM, Boulton M, Moynihan C, Jones A, Mossman J, Boudioni M, et al. Cancer patients' information needs and information seeking behaviour: in depth interview study. Br Med J 2000 Apr 01;320(7239):909-913 [FREE Full text] [CrossRef] [Medline]
    49. Eastin MS, Guinsler NM. Worried and wired: effects of health anxiety on information-seeking and health care utilization behaviors. Cyberpsychol Behav 2006 Aug;9(4):494-498. [CrossRef] [Medline]
    50. Fox S. Online health search 2006. Pew Research Center. 2006.   URL: https://www.pewresearch.org/internet/2006/10/29/online-health-search-2006/ [accessed 2021-03-01]
    51. Miller SM. Monitoring and blunting: validation of a questionnaire to assess styles of information seeking under threat. J Pers Soc Psychol 1987;52(2):345-353. [CrossRef]
    52. Rood JAJ, Van Zuuren FJ, Stam F, van der Ploeg T, Huijgens PC, Verdonck-de Leeuw IM. Cognitive coping style (monitoring and blunting) and the need for information, information satisfaction and shared decision making among patients with haematological malignancies. Psychooncology 2015 May 21;24(5):564-571. [CrossRef] [Medline]
    53. Timmermans LM, van der Maazen RWM, Leer JWH, Kraaimaat FW. Palliative or curative treatment intent affects communication in radiation therapy consultations. Psychooncology 2006 Aug;15(8):713-725. [CrossRef] [Medline]
    54. Ong LML, Visser MR, Van Zuuren FJ, Rietbroek RC, Lammes FB, De Haes JC. Cancer patients’ coping styles and doctor-patient communication. Psycho-Oncology 2001 Mar;8(2):155-166. [CrossRef]
    55. Muris P, van Zuuren FJ, de Vries S. Monitoring, blunting and situational anxiety: a laboratory study on coping with a quasi-medical stressor. Pers Individ Differ 1994 Mar;16(3):365-372. [CrossRef]
    56. Case DO, Andrews JE, Johnson JD, Allard SL. Avoiding versus seeking: the relationship of information seeking to avoidance, blunting, coping, dissonance, and related concepts. J Med Libr Assoc 2005 Jul;93(3):353-362 [FREE Full text] [Medline]
    57. Dedding C, van Doorn R, Winkler L, Reis R. How will e-health affect patient participation in the clinic? A review of e-health studies and the current evidence for changes in the relationship between medical professionals and patients. Soc Sci Med 2011 Jan;72(1):49-53. [CrossRef] [Medline]
    58. Hashimoto H, Fukuhara S. The influence of locus of control on preferences for information and decision making. Patient Educ Couns 2004 Nov;55(2):236-240. [CrossRef] [Medline]
    59. Shuyler KS, Knight KM. What are patients seeking when they turn to the internet? Qualitative content analysis of questions asked by visitors to an orthopaedics Web site. J Med Internet Res 2003 Oct 10;5(4):e24 [FREE Full text] [CrossRef] [Medline]
    60. Street RL, Voigt B, Geyer C, Manning T, Swanson GP. Increasing patient involvement in choosing treatment for early breast cancer. Cancer 1995 Dec 01;76(11):2275-2285. [CrossRef]
    61. Sahlsten MJM, Larsson IE, Sjöström B, Plos KAE. An analysis of the concept of patient participation. Nurs Forum 2008 Jan;43(1):2-11. [CrossRef] [Medline]
    62. Street RLJ. Communication in medical encounters: an ecological perspective. In: The Routledge Handbook of Health Communication. Oxfordshire, United Kingdom: Routledge; 2003:A.
    63. Baumgartner SE, Hartmann T. The role of health anxiety in online health information search. Cyberpsychol Behav Soc Netw 2011 Oct;14(10):613-618. [CrossRef] [Medline]
    64. Fogel J, Albert SM, Schnabel F, Ditkoff BA, Neugut AI. Internet use and social support in women with breast cancer. Health Psychol 2002;21(4):398-404. [CrossRef]
    65. Czaja R, Manfredi C, Price J. The determinants and consequences of information seeking among cancer patients. J Health Commun 2003 Nov;8(6):529-562. [CrossRef]
    66. Bylund CL, Gueguen JA, D'Agostino TA, Li Y, Sonet E. Doctor-patient communication about cancer-related internet information. J Psychosoc Oncol 2010 Feb 22;28(2):127-142 [FREE Full text] [CrossRef] [Medline]
    67. Hay MC, Cadigan RJ, Khanna D, Strathmann C, Lieber E, Altman R, et al. Prepared patients: internet information seeking by new rheumatology patients. Arthritis Rheum 2008 Apr 15;59(4):575-582 [FREE Full text] [CrossRef] [Medline]
    68. Ahluwalia S, Murray E, Stevenson F, Kerr C, Burns J. ‘A heartbeat moment’: qualitative study of GP views of patients bringing health information from the internet to a consultation. Br J Gen Pract 2010 Feb 01;60(571):88-94. [CrossRef]
    69. Harrington J. Improving patients' communication with doctors: a systematic review of intervention studies. Patient Educ Couns 2004 Jan;52(1):7-16. [CrossRef]
    70. van Weert JCM, Jansen J, Spreeuwenberg PM, van Dulmen S, Bensing JM. Effects of communication skills training and a Question Prompt Sheet to improve communication with older cancer patients: a randomized controlled trial. Crit Rev Oncol Hematol 2011 Oct;80(1):145-159. [CrossRef] [Medline]
    71. Sansoni JE, Grootemaat P, Duncan C. Question Prompt Lists in health consultations: a review. Patient Educ Couns 2015 Jun 03;98(12):1454-1464. [CrossRef] [Medline]
    72. Kreps GL. Online information and communication systems to enhance health outcomes through communication convergence. Hum Commun Res 2017 Jun 30;43(4):518-530. [CrossRef]
    73. Watson PWB, McKinstry B. A systematic review of interventions to improve recall of medical advice in healthcare consultations. J R Soc Med 2009 Jun;102(6):235-243 [FREE Full text] [CrossRef] [Medline]
    74. Voorveld HAM, Neijens PC, Smit EG. Opening the black box: Understanding cross-media effects. J Market Comm 2011 Apr;17(2):69-85. [CrossRef]
    75. Dijkstra M. An experimental investigation of synergy effects in multiple-media advertising campaigns. 2002.   URL: https:/​/research.​tilburguniversity.edu/​en/​publications/​an-experimental-investigation-of-synergy-effects-in-multiple-medi [accessed 2021-03-01]
    76. Epstein S. Integration of the cognitive and the psychodynamic unconscious. Am Psychol 1994;49(8):709-724. [CrossRef]
    77. Petty RE, Cacioppo JT. The elaboration likelihood model. In: Advances in Experimental Social Psychology. Amsterdam: Elsevier; 1986:123-205.
    78. van der Bij AK, de Weerd S, Cikot RJ, Steegers EA, Braspenning JC. Validation of the dutch short form of the state scale of the Spielberger State-Trait Anxiety Inventory: considerations for usage in screening outcomes. Community Genet 2003 Oct 17;6(2):84-87. [CrossRef] [Medline]
    79. Pieterse A, van Dulmen S, Ausems M, Schoemaker A, Beemer F, Bensing J. QUOTE-gene(ca): development of a counselee-centered instrument to measure needs and preferences in genetic counseling for hereditary cancer. Psychooncology 2005 May;14(5):361-375. [CrossRef] [Medline]
    80. van der Ploeg E, Mooren TTM, Kleber RJ, van der Velden PG, Brom D. Construct validation of the Dutch version of the impact of event scale. Psychol Assess 2004 Mar;16(1):16-26. [CrossRef] [Medline]
    81. Bronner MB, Nguyen MH, Smets EM, van de Ven AWH, van Weert JCM. Anxiety during cancer diagnosis: Examining the influence of monitoring coping style and treatment plan. Psychooncology 2018 Feb 26;27(2):661-667. [CrossRef] [Medline]
    82. van Zuuren FJ, de Groot KI, Mulder NL, Peter M. Coping with medical threat: an evaluation of the Threatening Medical Situations Inventory (TMSI). Pers Individ Differ 1996 Jul;21(1):21-31. [CrossRef]
    83. Schinkel S, Van Weert JCM, Kester JAM, Smit EG, Schouten BC. Does Media Use Result in More Active Communicators? Differences Between Native Dutch and Turkish-Dutch Patients in Information-Seeking Behavior and Participation During Consultations With General Practitioners. J Health Commun 2015 Aug 14;20(8):910-919. [CrossRef] [Medline]
    84. Zandbelt LC, Smets EM, Oort FJ, Godfried MH, de Haes HC. Patient participation in the medical specialist encounter: does physicians' patient-centred communication matter? Patient Educ Couns 2007 Mar;65(3):396-406. [CrossRef] [Medline]
    85. Ford S, Hall A, Ratcliffe D, Fallowfield L. The Medical Interaction Process System (MIPS): an instrument for analysing interviews of oncologists and patients with cancer. Soc Sci Med 2000 Feb;50(4):553-566. [CrossRef]
    86. Russell RL, Stiles WB. Categories for classifying language in psychotherapy. Psychol Bull 1979;86(2):404-419. [CrossRef]
    87. Blanchard CG, Ruckdeschel JC, Fletcher BA, Blanchard EB. The impact of oncologists' behaviors on patient satisfaction with morning rounds. Cancer 1986 Jul 15;58(2):387-393. [CrossRef]
    88. Jansen J, Butow PN, van Weert JCM, van Dulmen S, Devine RJ, Heeren TJ, et al. Does age really matter? Recall of information presented to newly referred patients with cancer. J Clin Oncol 2008 Nov 20;26(33):5450-5457. [CrossRef] [Medline]
    89. Hayes AF, Krippendorff K. Answering the call for a standard reliability measure for coding data. Commun Methods Meas 2007 Apr;1(1):77-89. [CrossRef]
    90. Hayes A. Integrating mediation and moderation analysis: fundamentals using PROCESS.   URL: https://statisticalhorizons.com/seminars/public-seminars/medmodlecture [accessed 2021-03-01]
    91. Hox JJ, Moerbeek M, van de Schoot R. Multilevel analysis: techniques and applications. New York: Routledge; 2017.
    92. Lenhart A, Horrigan JB, Horrigan L. Re-visualizing the digital divide as a digital spectrum (2003). IT & Society. 2003.   URL: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.177.1405 [accessed 2021-03-01]
    93. Cegala DJ, Street RL, Clinch CR. The impact of patient participation on physicians' information provision during a primary care medical interview. Health Commun 2007 May 22;21(2):177-185. [CrossRef] [Medline]
    94. Fallowfield L, Jenkins V. Current concepts of communication skills training in oncology. Recent Results Cancer Res 2006;168:105-112. [CrossRef] [Medline]
    95. Hack TF, Degner LF, Parker PA, SCRN Communication Team. The communication goals and needs of cancer patients: a review. Psychooncology 2005 Oct;14(10):831-845. [CrossRef] [Medline]
    96. Puts MTE, Papoutsis A, Springall E, Tourangeau AE. A systematic review of unmet needs of newly diagnosed older cancer patients undergoing active cancer treatment. Support Care Cancer 2012 Jul;20(7):1377-1394. [CrossRef] [Medline]
    97. Diviani N, van den Putte B, Giani S, van Weert JCM. Low health literacy and evaluation of online health information: a systematic review of the literature. J Med Internet Res 2015 May 07;17(5):e112 [FREE Full text] [CrossRef] [Medline]
    98. Flanagin AJ, Metzger MJ. Perceptions of internet information credibility. Journal Mass Commun Q 2016 Jun 25;77(3):515-540. [CrossRef]
    99. Langille M, Bernard A, Rodgers C, Hughes S, Leddin D, van Zanten SV. Systematic review of the quality of patient information on the internet regarding inflammatory bowel disease treatments. Clin Gastroenterol Hepatol 2010 Apr;8(4):322-328. [CrossRef] [Medline]
    100. Brandes K, Linn AJ, Butow PN, van Weert JCM. The characteristics and effectiveness of Question Prompt List interventions in oncology: a systematic review of the literature. Psychooncology 2015 Mar 31;24(3):245-252. [CrossRef] [Medline]
    101. Epstein RM, Duberstein PR, Fenton JJ, Fiscella K, Hoerger M, Tancredi DJ, et al. Effect of a patient-centered communication intervention on oncologist-patient communication, quality of life, and health care utilization in advanced cancer: the VOICE randomized clinical trial. JAMA Oncol 2017 Jan 01;3(1):92-100. [CrossRef] [Medline]

    ‎
    H1: Hypothesis 1
    H2a: Hypothesis 2a
    H2b: Hypothesis 2b
    H2c: Hypothesis 2c
    NPIRQ: Netherlands Patient Information Recall Questionnaire
    OHIS: online health information seeking
    RQ: research question
    T1: Time point 1
    T2a: Time point 2a
    T2b: Time point 2b
    T2c: Time point 2c

    Edited by R Kukafka; submitted 19.08.20; peer-reviewed by R Street, S LaValley; comments to author 10.10.20; revised version received 04.12.20; accepted 31.01.21; published 05.07.21

    Copyright

    ©Melanie de Looper, Julia C M van Weert, Barbara C Schouten, Sifra Bolle, Eric H J Belgers, Eric H Eddes, Ellen M A Smets. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 05.07.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.