This paper is in the following e-collection/theme issue:

Web-based and Mobile Health Interventions (3297) Registered Report (560) Patient-Reported Outcome Measures (PROMs) (288) Health Services Research in Oncology (35) Questionnaires and Research Instruments for Cancer Patients (17) Health Services Research (482) Health Care Quality and Health Services Research (271)

Published on in Vol 23, No 12 (2021): December

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/27886, first published .
Web-Based Return of Individual Patient-Reported Outcome Results Among Patients With Lymphoma: Randomized Controlled Trial

Web-Based Return of Individual Patient-Reported Outcome Results Among Patients With Lymphoma: Randomized Controlled Trial

Web-Based Return of Individual Patient-Reported Outcome Results Among Patients With Lymphoma: Randomized Controlled Trial

Authors of this article:

Simone Oerlemans1 Author Orcid Image ;   Lindy Paulina Johanna Arts1 Author Orcid Image ;   Jacobien M Kieffer2 Author Orcid Image ;   Judith Prins3 Author Orcid Image ;   Mels Hoogendoorn4 Author Orcid Image ;   Marjolein van der Poel5 Author Orcid Image ;   Ad Koster6 Author Orcid Image ;   Chantal Lensen7 Author Orcid Image ;   Wendy Bernadina Catharina Stevens8 Author Orcid Image ;   Djamila Issa9 Author Orcid Image ;   Johannes F M Pruijt9 Author Orcid Image ;   Margriet Oosterveld10 Author Orcid Image ;   René van der Griend11 Author Orcid Image ;   Marten Nijziel12 Author Orcid Image ;   Lidwine Tick13 Author Orcid Image ;   Eduardus F M Posthuma14, 15 Author Orcid Image ;   Lonneke V van de Poll-Franse1, 2, 16 Author Orcid Image
Article Authors Cited by (8) Tweetations (6) Metrics

    Original Paper

    1Department of Research and Development, Netherlands Comprehensive Cancer Organisation, Utrecht, Netherlands

    2Division of Psychosocial Research and Epidemiology, Netherlands Cancer Institute, Amsterdam, Netherlands

    3Department of Medical Psychology, Radboud University Medical Center, Nijmegen, Netherlands

    4Department of Hematology, Medical Center Leeuwarden, Leeuwarden, Netherlands

    5Department of Internal Medicine, Division of Hematology, GROW School for Oncology and Developmental Biology, Maastricht University Medical Centre, Maastricht, Netherlands

    6Department of Internal Medicine, VieCuri Medical Centre, Venlo/Venray, Netherlands

    7Department of Internal Medicine, Bernhoven Hospital, Uden, Netherlands

    8Department of Hematology, Radboud University Medical Center, Nijmegen, Netherlands

    9Department of Internal Medicine, Jeroen Bosch Hospital, 's-Hertogenbosch, Netherlands

    10Department of Internal Medicine, Canisius-Wilhelmina Hospital, Nijmegen, Netherlands

    11Department of Internal Medicine, Diakonessenhuis, Utrecht/Zeist, Netherlands

    12Department of Internal Medicine, Catharina Hospital, Eindhoven, Netherlands

    13Department of Internal Medicine, Máxima Medical Centre, Veldhoven, Netherlands

    14Department of Internal Medicine, Reinier de Graaf Group, Delft, Netherlands

    15Department of Internal Medicine, Leiden University Medical Center, Leiden, Netherlands

    16Center of Research on Psychological and Somatic disorders, Department of Medical and Clinical Psychology, Tilburg University, Tilburg, Netherlands

    *these authors contributed equally

    Corresponding Author:

    Simone Oerlemans, PhD

    Department of Research and Development

    Netherlands Comprehensive Cancer Organisation

    Godebaldkwartier 419, 3511 DT

    Utrecht

    Netherlands

    Phone: 31 088 234 60 00

    Email: s.oerlemans@iknl.nl


    Background: There has been a cultural shift toward patient engagement in health, with a growing demand from patients to access their results.

    Objective: The Lymphoma Intervention (LIVE) trial is conducted to examine the impact of return of individual patient-reported outcome (PRO) results and a web-based self-management intervention on psychological distress, self-management, satisfaction with information, and health care use in a population-based setting.

    Methods: Return of PRO results included comparison with age- and sex-matched peers and was built into the Patient-Reported Outcomes Following Initial Treatment and Long-Term Evaluation of Survivorship registry. The self-management intervention is an adaptation of a fully automated evidence-based intervention for breast cancer survivors. Patients with lymphoma who completed the web-based questionnaire were equally randomized to care as usual, return of PRO results, and return of PRO results plus self-management intervention. Patients completed questionnaires 9 to 18 months after diagnosis (T0; n=227), 4 months (T1; n=190), 12 months (T2; n=170), and 24 months (T3; n=98).

    Results: Of all invited patients, 51.1% (456/892) responded and web-based participants (n=227) were randomly assigned to care as usual (n=76), return of PRO results (n=74), or return of PRO results and access to Living with lymphoma (n=77). Return of PRO results was viewed by 76.7% (115/150) of those with access. No statistically significant differences were observed for psychological distress, self-management, satisfaction with information provision, and health care use between patients who received PRO results and those who did not (P>.05). Use of the self-management intervention was low (2/76, 3%), and an effect could therefore not be determined.

    Conclusions: Return of individual PRO results seems to meet patients’ wishes but had no beneficial effects on patient outcome. No negative effects were found when individual PRO results were disclosed, and the return of individual PRO results can therefore be safely implemented in daily clinical practice.

    Trial Registration: Netherlands Trial Register NTR5953; https://www.trialregister.nl/trial/5790

    International Registered Report Identifier (IRRID): RR2-10.1186/s13063-017-1943-2

    J Med Internet Res 2021;23(12):e27886

    doi:10.2196/27886

    Keywords

    lymphoma; patient-reported outcomes; return of individual results; randomized controlled trial; self-management 


    Background

    Patients with lymphoma are at risk of experiencing adverse effects of cancer and its treatment, such as fatigue, cognitive problems, and neuropathy [1-4]. In addition, up to a quarter experience persistent levels of anxiety, depressive symptoms, and fear [5], also known as psychological distress. Both symptoms and psychological distress may be exacerbated when information and supportive care are unavailable [6,7]. This may, in turn, lead to increased health care use [8]. Regular screening of physical and psychosocial symptoms using patient-reported outcomes (PROs) could increase awareness and recognition of symptoms and can contribute to their management [9-13].

    Since the past decade, there has been a cultural shift toward patient engagement in health, with a growing demand from patients to access their individual results [14-17]. Returning individual PRO results enables patients to monitor their functioning and create awareness of symptoms. Furthermore, it offers patients the opportunity to compare their scores with peers [15] to evaluate if their scores are normal and to incorporate this information into personal decision-making [16]. However, some clinicians have expressed reservations about disclosing PRO research results to patients, as it may cause patients to become more concerned and lead to increased health care use by patients and higher workload for clinicians. Therefore, it is important to investigate whether patients will be in a better or worse condition with their PRO results being disclosed and which patients wish to receive their PRO results.

    To improve health outcomes, subsequent steps such as self-management interventions are expected to be necessary in addition to monitoring and returning PRO results [18]. Self-management interventions intend to enhance patients’ knowledge and skills and empower them to play an active role in the management of their disease and its consequences [19,20]. Studies on the outcomes of self-management are mainly based on patients with solid cancers and are not consistent, with some randomized controlled trials (RCTs) showing no effects [21-23]. In addition, most self-management interventions are not specifically aimed at patients with lymphoma and are found to be effective among selected groups of patients. Little is known about the effects of such interventions in a population-based setting within an unselected group of patients.

    Objectives

    To investigate the effect of (1) return of individual PRO research results, including comparison with peers [24], and (2) a web-based self-management intervention Living with lymphoma, the Lymphoma Intervention (LIVE) trial was performed. The primary objective of the LIVE RCT was to examine the effects of return of PRO results to patients with or without access to Living with lymphoma on self-management, satisfaction with information, and psychological distress in a population-based setting of patients with lymphoma [24]. We hypothesized that those with access to the return of PRO results or access to LIVE would have higher levels of self-management and satisfaction with information and lower levels of psychological distress. On the basis of new insights that psychologically distressed patients reported increased health care use [8], we also investigated the effects of return of PRO results to patients with or without access to Living with lymphoma on health care use (secondary objective). Furthermore, we explored sociodemographic, clinical, and psychological differences between patients who viewed their individual PRO results and those who did not.


    Design and Participants

    This RCT was embedded in the population-based Patient-Reported Outcomes Following Initial Treatment and Long-Term Evaluation of Survivorship (PROFILES) registry [25]. PROFILES enables PRO data collection management and links PRO data to clinical data from the Netherlands Cancer Registry (NCR).

    Between October 2015 and February 2019, patients diagnosed with lymphoma (Hodgkin lymphoma, non-Hodgkin lymphoma, or chronic lymphocytic leukemia), as defined by the International Classification of Diseases for Oncology-3 codes [26], from 13 hospitals in the Netherlands were selected for participation 9 to 18 months after diagnosis. The NCR registers all newly diagnosed patients with cancer in the Netherlands within the first year after diagnosis and routinely collects detailed data on sociodemographic and clinical characteristics (eg, age and sex, date of diagnosis, cancer type, and primary treatment). Treating hemato-oncologists were asked to verify the eligibility of the patients. As we aimed to keep a population-based approach, we only defined a few exclusion criteria, such as presence of severe psychopathology or dementia, being in transition to terminal care, and not being able to complete a Dutch questionnaire. Patients were informed that completion of the web-based questionnaire resulted in RCT enrollment with automatic randomization to 1 of the 3 study arms. Paper respondents were not eligible for the RCT (as the return of PRO results and Living with lymphoma were web-based) and were observationally followed within the PROFILES lymphoma registry. A reminder mail was sent after 3 weeks. Respondents received follow-up questionnaires at 4 months (T1), 12 months (T2), and 24 months (T3) after the baseline questionnaire. More details about the study design, enrollment, and sample size calculation have previously been published in the research protocol [24]. The RCT was centrally and locally approved by a medical research ethics committee [24].

    Randomization

    Randomization was performed using block randomization to ensure a balance in sample size across arms over time [27]. Participants were equally randomized to (1) care as usual (CAU), (2) CAU plus return of PRO results, or (3) CAU plus return of PRO results and Living with lymphoma.

    Interventions Versus CAU

    Arm 1: CAU

    In arm 1, patients received CAU from their hemato-oncologists and oncology nurses. In general, they provided verbal information to their patients and provided leaflets regarding the diagnosis and treatment they received.

    Arm 2: Return of PRO Results

    In arms 2 and 3, in addition to CAU, individual PRO research results were disclosed to patients. This feedback was automatically generated after the completion of the questionnaire. On the basis of respect for autonomy, patients had the choice as to whether they wanted to receive the results [14] and could click on the feedback button for return of results.

    Detailed information about the return of PRO results (also known as PRO feedback) has been described elsewhere [15,24]. In short, individual research results on general health-related quality of life (HRQoL), physical, emotional, cognitive, and social functioning, fatigue, neuropathy, anxiety, and depressive symptoms were returned to patients [24]. Individual scores were integrated into graphical displays with colored bar charts [28,29]. Patients had the opportunity to compare their scores to mean scores of other patients with lymphoma and an age- and sex-matched normative population without cancer [30] to determine whether their scores were average or not. The colors of the bar charts were related to clinically relevantly mean differences of the evidence-based guidelines of the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire Organization [31] and considered average (amber); above average (green); or below average (red). Patients with above-average symptom scores were advised to contact their general practitioner.

    Arm 3: Return of PRO Results + Living With Lymphoma

    In addition to the return of PRO results, patients in arm 3 had access to a web-based self-management intervention—Living with lymphoma. A detailed description of Living with lymphoma has been described elsewhere [24]. Living with lymphoma, an adaptation of the evidence-based BREATH (Breast Cancer eHealth) intervention for breast cancer [32,33], was based on psychoeducation and cognitive behavioral therapy techniques to enhance patients’ knowledge and skills. The intervention also included a library with background and additional information on various subjects (eg, work, sexuality, lifestyle) and reference to additional health care services (eg, psychologists, physiotherapists). It was left to the discretion of the patients how and to what extent they used the intervention. The intervention was fully automated, nonguided, and delivered without professional therapist support.

    Measures

    Sociodemographic and Clinical Measures

    Sociodemographic characteristics (age and sex) and detailed clinical information (date of diagnosis, cancer type, and primary treatment) were obtained from the NCR. NCR data were available for both RCT participants and nonparticipants. Information on educational level and marital status was assessed in the questionnaire (data only available for RCT participants).

    Comorbidities at the time of questionnaire completion were assessed using an adapted version of the Self-Administered Comorbidity Questionnaire [34]. Patients were asked to identify comorbidities present within the past 12 months—heart disease, hypertension, arthritis, stroke, lung disease, diabetes, stomach disease, kidney disease, liver disease, anemia, thyroid disease, and rheumatoid arthritis. Positive responses were summed to a total score ranging from 0 to 12 (data only available for RCT participants).

    Psychological Measures

    Personality traits were assessed using the Big Five Inventory [35], a 44-item inventory for measuring the Big Five personality traits—neuroticism, extraversion, openness to experience, agreeableness, and conscientiousness. Items are scored on a 5-point scale. Scale scores were obtained by averaging all items for each trait and range from 0 to 5 [36].

    The 40-item Mental Adjustment to Cancer scale was used to assess adjustment to cancer in terms of coping strategies [37,38]. Items were grouped on five categories: Helplessness/Hopelessness, Anxious Preoccupation, Fighting Spirit, Fatalism, and Avoidance. Each item is rated on a 4-point scale. Scale scores were obtained by averaging all items of each strategy and range from 1 to 4. Higher scores represent higher endorsement of the coping strategy.

    Health-related quality of life was assessed using the 30-item Quality of Life Questionnaire from the European Organisation for Research and Treatment of Cancer [39]. This questionnaire includes five functional scales, three symptom scales, a global health and quality of life scale, and several single-item symptom measures. Items are scored on a 4-point Likert scale, except for the global health and quality of life scale that is scored on a 7-point linear analog scale. After linear transformation, all scales and single item measures range in score from 0 to 100. Higher scores on functional and health and quality of life scales indicate better functioning or HRQoL, whereas higher scores on symptom scales indicate more complaints.

    Self-management Skills

    Self-management skills were assessed using the Health Education Impact Questionnaire, which contains 40 items across 8 scales—positive and active engagement in life, health-directed activities, skill and technique acquisition, constructive attitudes and approaches, self-monitoring and insight, health service navigation, social integration and support, and emotional distress [40]. Each item was scored on a 4-point scale. Scale scores were obtained by averaging all items of each domain and ranged from 1 to 4. Higher scores indicate better status or self-management, except for emotional distress, in which higher scores indicate higher distress [40].

    Satisfaction With Information Provision

    Satisfaction with overall information provision was assessed using an adapted version of the 9-item Information Satisfaction Questionnaire [41]. Patients were also asked to rate their level of satisfaction with overall information on a scale that ranged from 1 (“very unsatisfied”) to 5 (“very satisfied”). In addition, information on patient information preferences was available. Patients were asked to categorize themselves into those who would like (1) all available information, (2) only positive information, and (3) only limited information about their disease. Finally, patients had to categorize themselves into those who would like (1) to be involved in the decision-making process about their disease, or (2) the physician to make the decisions.

    Psychological Distress

    Psychological distress was assessed using the 14-item Hospital Anxiety and Depression Scale [42]. Each item was rated on a 4-point scale ranging from 0 to 3. The sum score was obtained by adding all item scores and ranged from 0 to 42. Higher scores indicated higher levels of psychological distress [43]. Patients with a Hospital Anxiety and Depression Scale sum score ≥13 were categorized as psychologically distressed [44].

    Health Care Use

    Two open questions were asked to assess health care use: (1) “How often did you contact a general practitioner in the past 12 months?” and (2) “How often did you visit a medical specialist in the past 12 months?”

    Statistical Analyses

    Overview

    Sociodemographic and clinical characteristics between the three arms were compared using univariable analyses of variance and chi-square tests. If at least half of the items from a subscale were completed, the missing items were replaced by the average of those that were present for the participant.

    To model between-group differences in change from baseline (T0) to follow-up (T1-T3), mixed-effects models were used with an unstructured covariance structure and a restricted maximum likelihood solution [45]. A random intercept at the patient level was included to adjust for interdependency between repeated measures. The CAU-arm (arm 1) was assigned as the reference group. The P value for overall model effects was set at .05, and for specific contrasts at .01, lowering the risk of type I errors as a result of multiple testing. In the iterative process of variable selection, a priori selected covariates (age, sex, cancer type, and treatment) were removed from the model as they were nonsignificant and had no confounders. However, as those in the CAU arm seemed to be somewhat more often psychologically distressed (17/77, 22%) than patients in the return of results arm (9/74, 12%) and the arm with return of results and access to Living with lymphoma (8/76, 11%; P=.10; Table 1), we considered psychological distress as a confounding factor and adjusted for baseline psychological distress in analyses (when psychological distress was not the outcome variable). Group differences in mean change scores from baseline to follow-up were accompanied by Cohen effect size (ES). Cohen ES was calculated by dividing the difference in mean change scores between the control and intervention groups by the pooled baseline SD. An ES of 0.20 was considered small, 0.50 moderate, and 0.80 large [44,46]. All analyses were conducted on an intention-to-treat basis. All statistical analyses were performed using SAS version 9.4.

    Table 1. Baseline characteristics of participants according to randomized controlled trial (RCT) arm and of nonparticipants.

    		CAUa (n=77)Return of PROb results (n=74)Return of PRO results + living with lymphoma (n=76)P valuecTotal RCT participants (n=227)Nonparticipants (n=666)P valued
    Sociodemographiccharacteristics

    		Age at time of questionnaire (years), mean (SD)61.3 (12.9)60.0 (13.4)60.8 (14.0).8360.7 (13.4)65.3 (15.7)<.001

    		Sex, n (%).73

    		<.001


    		Male53 (68.8)55 (74.3)53 (69.7)
    		161 (70.9)377 (56.6)


    		Female24 (31.2)19 (25.7)23 (30.3)
    		66 (29.1)289 (43.4)

    		Educational levele, n (%).71

    		—g


    		Low1 (1.3)2 (2.7)3 (3.9)
    		6 (2.6)N/Af


    		Medium33 (42.9)38 (51.4)35 (46.1)
    		106 (46.7)N/A


    		High42 (54.5)34 (45.9)38 (50)
    		114 (50.2)N/A

    		Partner (yes), n (%)62 (80.5)65 (87.8)63 (82.9).46190 (83.7)N/A—
    Clinical characteristics

    		Months since diagnosis: mean (SD)14.0 (3.1)14.0 (3.6)13.9 (3.0).9414.0 (3.2)14.0 (3.5).80

    		Cancer type, n (%)


    		Hodgkin lymphoma10 (12.9)8 (10.8)9 (11.8).9927 (11.9)75 (11.3).95


    		NHL-HGh41 (53.2)41 (55.4)42 (55.3)
    		125 (55.1)359 (53.9)


    		NHL-LGi18 (23.4)19 (25.7)19 (25)
    		56 (24.7)169 (25.4)


    		CLLj8 (10.4)6 (8.1)6 (7.9)
    		19 (8.4)63 (9.5)

    		Primary treatment, n (%).10

    		.13


    		Active surveillance23 (29.9)18 (24.3)12 (15.8)
    		53 (23.3)199 (28.5)


    		Received active treatment52 (67.5)56 (75.7)64 (84.2)
    		172 (75.8)458 (68.8)


    		Chemotherapy37 (48.1)46 (62.2)54 (71.1)
    		137 (60.4)357 (54)


    		Radiotherapy5 (6.5)4 (5.4)3 (3.9)
    		12 (5.3)60 (8.1)


    		Stem cell transplantation8 (10.4)3 (4.1)3 (3.9)
    		14 (6.2)4 (0.6)


    		Other2 (2.6)3 (4.1)4 (5.3)
    		9 (3.9)37 (5.6)

    		Ann Arbor stage.81

    		.30


    		Stage I, n (%)6 (7.8)8 (10.8)15 (19.7)
    		29 (12.8)112 (16.8)


    		Stage II, n (%)8 (10.4)13 (17.6)15 (19.7)
    		36 (15.8)95 (14.3)


    		Stage III, n (%)11 (14.3)9 (12.2)10 (13.2)
    		30 (13.2)97 (14.6)


    		Stage IV, n (%)30 (38.9)30 (40.5)26 (34.2)
    		86 (37.9)194 (29.1)


    		Not determined (CLL) or missing, n (%)22 (28.6)14 (18.9)10 (13.2)
    		46 (20.3)168 (25.2)


    		Number of self-reported comorbidities: mean (SD)1.3 (1.2)1.2 (1.1)1.0 (1.0).221.1 (1.1)N/A
    Psychological characteristics, n (%)

    		Psychological distress17 (22.1)9 (12.2)8 (10.5).0934 (14.9)N/A—

    aCAU: care as usual.

    bPRO: patient-reported outcome.

    cReports comparisons between the intervention arms and the care as usual arm.

    dReports comparisons between randomized controlled trial participants and nonparticipants.

    eEducation levels were low=none or primary school; medium=lower general secondary education or vocational training; or high=preuniversity education or high-level vocational training or university.

    fN/A: not applicable.

    gNot available.

    hNHL-HG: high-grade non-Hodgkin lymphoma.

    iNHL-LG: low-grade non-Hodgkin lymphoma.

    jCLL: chronic lymphocytic leukemia.

    Power Calculation

    With more than 74 participants per study arm, the study had 90% power to detect an ES of 0.50 with a two-tailed P value set at .05 [47].


    Baseline Characteristics of RCT Participants

    In total, 1193 patients were selected from the NCR and 892 patients were invited to participate. Of these, 51.1% (456/892) participated, of which 25.7% (229/892) were excluded for the RCT as they completed the questionnaire on paper (CONSORT [Consolidated Standards of Reporting Trials] diagram; Figure 1).

    Overall, 25.4% (227/892) completed the web-based questionnaire and were included in the RCT. They were randomly assigned to CAU (control group; n=76), return of PRO results (n=74), or return of PRO results and access to Living with lymphoma (n=77). Completion rates of follow-up questionnaires were 84.1% (191/227) on T1, 74.9% (143/191) on T2, and 68.5% (98/143) on T3, and did not differ significantly among groups.

    Those who declined participation or completed the questionnaire on paper were analyzed as nonparticipants in this study. All participants provided written informed consent.

    RCT participants were younger than nonparticipants (60.7 vs 65.3 years; P<.001), and more often men (161/227, 70.9% vs 377/666, 56.6%; P<.001). RCT participants were on average 14.0 months after diagnosis (SD 3.2 months). The majority of RCT participants had a partner (190/227, 83.7%). Of the RCT participants, 75.8% (172/227) received active treatment, mostly chemotherapy (137/227, 60.4%), whereas 23.3% (53/227) were on active surveillance. The majority of patients had Ann Arbor stage IV disease at the time of diagnosis. Other baseline sociodemographic and clinical characteristics did not differ across groups (Table 1).

    ‎
    Figure 1. CONSORT (Consolidated Standards of Reporting Trials) flow diagram of the progress of the patients with lymphoma through the phases of the Lymphoma Intervention (LIVE) trial. CAU: care as usual (control group); NCR: Netherlands Cancer Registry; PRO: patient-reported outcome.
    View this figure

    The Living With Lymphoma Self-management Intervention

    The use of self-management intervention was very low (3/76, 4%). Therefore, the effects of Living with lymphoma could not be determined within this RCT and were not included in the results. The analyses were performed with the three original RCT arms to maintain a power of 90%.

    As we observed that adherence to Living with lymphoma intervention was very low one year after starting patient inclusion, research assistants sent an email for inquiry. A random sample of 5 patients who had access to the intervention and signed up were asked to respond without any obligation and were asked for their reasons for nonadherence. Two patients responded that they felt well and still had regular appointments with their hematologist, and therefore were not in need of an intervention:

    In the first place, I feel very well, both physically and mentally. Secondly, I have regular appointments with my treating haematologist. Furthermore, I do not always want to be confronted with my disease.
    [Male, 79 years]
    I am not really concerned about the fact that I have had cancer. I am in remission for one year now, and that is how I feel. Every three months, I still have checkup appointments, but other than that I live my life the way I did before I had cancer. I feel fine, I have no limitations, and therefore I do not need information about a disease from the past.
    [Male, 54 years]

    Return of Individual PRO Results

    No statistically significant differences were observed for psychological distress, self-management subscales, and satisfaction with information provision between patients who received their individual PRO results and those who did not (Table 2). In addition, the return of PRO results did not have a significant effect on health care use. As no significant overall group-by-time interaction was found for the outcome variables, we were not allowed to explore specific contrasts.

    Table 2. Between-group differences in mean change from baseline to follow-up.

    		T0T1T2T3Between-group difference, T0-T1Between-group difference, T0-T2Between-group difference, T0-T3

    		nValue, mean (SD)nValue, mean (SD)nValue, mean (SD)nValue, mean (SD)Value, mean change (SE)P valueValue, mean change (SE)P valueValue, mean change (SE)P value
    Psychological distress (HADSa total; P=.94b)

    		CAUc777.03 (7.10)626.98 (7.48)546.06 (6.09)346.94 (6.70)N/AdN/AN/AN/AN/AN/A

    		Return of PROe results746.59 (5.26)606.43 (6.21)536.18 (5.61)287.11 (8.26)0.04 (0.68).960.20 (0.71).77–0.71 (0.88).42

    		Return of PRO results + Living with lymphoma765.75 (5.04)645.78 (4.99)595.68 (5.62)355.34 (5.78)0.02 (0.67).980.12 (0.69).86–0.87 (0.83).30
    Self-management skills (HeiQ positive and active engagement in lifef; P=.52b)

    		CAU763.16 (0.52)623.15 (0.52)533.25 (0.49)343.16 (0.48)N/AN/AN/AN/AN/AN/A

    		Return of PRO results743.22 (0.46)622.23 (0.50)533.23 (0.51)293.17 (0.65)0.02 (0.07).81–0.11 (0.07).12–0.04 (0.09).66

    		Return of PRO results + Living with lymphoma763.22 (0.44)643.26 (0.52)593.22 (0.48)353.24 (0.41)0.07 (0.07).34–0.07 (0.07).330.02 (0.09).82
    HeiQ health-directed behavior (P=.80b)

    		CAU773.34 (0.62)623.28 (0.56)553.35 (0.64)343.16 (0.57)N/AN/AN/AN/AN/AN/A

    		Return of PRO results743.27 (0.53)623.29 (0.59)533.28 (0.49)293.19 (0.47)0.08 (0.09).330.00 (0.09).690.15 (0.11).19

    		Return of PRO results + Living with lymphoma763.22 (0.58)643.23 (0.65)593.26 (0.63)353.21 (0.66)0.09 (0.09).270.04 (0.09).970.12 (0.11).28
    HeiQ skill and technique acquisition (P=.90b)

    		CAU762.94 (0.53)622.97 (0.46)533.02 (0.49)343.05 (0.45)N/AN/AN/AN/AN/AN/A

    		Return of PRO results742.94 (0.44)612.98 (0.43)533.05 (0.49)293.04 (0.55)0.01 (0.08).88–0.00 (0.08).970.00 (0.10).96

    		Return of PRO results + Living with lymphoma762.97 (0.53)642.95 (0.50)582.98 (0.47)352.94 (0.40)-0.05 (0.07).53–0.05 (0.08).50–0.11 (0.09).22
    HeiQ constructive attitudes and approaches (P=.36b)

    		CAU763.26 (0.52)623.16 (0.51)553.31 (0.50)343.29 (0.47)N/AN/AN/AN/AN/AN/A

    		Return of PRO results743.27 (0.51)613.30 (0.49)533.35 (0.44)293.26 (0.60)0.13 (0.07).06–0.01 (0.07).930.03 (0.09).73

    		Return of PRO results + Living with lymphoma763.33 (0.43)643.30 (0.49)583.31 (0.45)353.34 (0.44)0.07 (0.07).28–0.06 (0.07).41–0.06 (0.09).52
    HeiQ self-monitoring and insight (P=.82b)

    		CAU773.08 (0.45)623.17 (0.32)553.15 (0.40)343.04 (0.53)N/AN/AN/AN/AN/AN/A

    		Return of PRO results743.05 (0.39)623.11 (0.40)533.13 (0.42)293.14 (0.35)0.06 (0.07).36–0.02 (0.07).780.09 (0.09).31

    		Return of PRO results + Living with lymphoma763.00 (0.42)643.05 (0.38)593.11 (0.39)353.05 (0.40)0.07 (0.07).300.02 (0.07).750.08 (0.08).33
    HeiQ health services navigation (P=.26b)

    		CAU763.30 (0.45)623.22 (0.44)553.30 (0.47)343.29 (0.42)N/AN/AN/AN/AN/AN/A

    		Return of PRO results743.28 (0.39)613.26 (0.40)533.38 (0.43)293.33 (0.44)0.06 (0.06).350.07 (0.07).300.04 (0.08).61

    		Return of PRO results + Living with lymphoma763.22 (0.49)643.19 (0.50)583.22 (0.41)353.15 (0.36)0.05 (0.06).400.02 (0.07).75–0.13 (0.08).11
    HeiQ social integration and support (P=.68b)

    		CAU763.15 (0.57)623.07 (0.54)553.12 (0.51)343.13 (0.50)N/AN/AN/AN/AN/AN/A

    		Return of PRO results743.12 (0.46)613.13 (0.50)533.15 (0.47)293.16 (0.41)0.06 (0.07).380.02 (0.07).820.04 (0.090).65

    		Return of PRO results + Living with lymphoma763.22 (0.47)643.20 (0.46)583.16 (0.49)353.19 (0.38)0.06 (0.07).38-0.02 (0.07).76–0.08 (0.09).33
    HeiQ emotional wellbeing (P=.90b)

    		CAU761.82 (0.62)621.88 (0.65)551.72 (0.55)341.80 (0.50)N/AN/AN/AN/AN/AN/A

    		Return of PRO results741.83 (0.52)621.82 (0.53)531.73 (0.53)291.88 (0.68)–0.06 (0.07).450.02 (0.08).76–0.02 (0.10).81

    		Return of PRO results + Living with lymphoma761.71 (0.48)641.72 (0.51)591.65 (0.49)351.64 (0.53)–0.05 (0.07).530.02 (0.08).82–0.08 (0.09).36
    Satisfaction with information provision (ISFg total information provision; P=.66b)

    		CAU763.86 (0.78)633.73 (0.79)573.88 (0.76)343.85 (0.82)N/AN/AN/AN/AN/AN/A

    		Return of PRO results743.91 (0.72)623.95 (0.71)534.02 (0.57)283.79 (0.79)0.19 (0.13).140.10 (0.13).44–0.01 (0.16).97

    		Return of PRO results + Living with lymphoma763.86 (0.80)653.68 (0.94)593.80 (0.76)353.80 (0.68)–0.02 (0.12).88–0.02 (0.13).850.02 (0.15).92
    Health care use (contacts with general practitioner in past 12 months; P=.17b)

    		CAU744.70 (3.92)633.16 (2.57)573.63 (4.51)343.38 (3.09)N/AN/AN/AN/AN/AN/A

    		Return of PRO results744.78 (4.17)624.40 (4.97)533.68 (5.27)294.90 (6.21)1.04 (0.66).11–0.15 (0.69).830.29 (0.85).73

    		Return of PRO results + Living with lymphoma764.89 (4.32)653.34 (3.25)593.17 (3.24)352.57 (3.00)–0.16 (0.65).81–0.97 (0.68).15–1.45 (0.82).08
    Contacts with medical specialist in past 12 months (P=.80b)

    		CAU7610.09 (6.27)637.00 (4.12)566.66 (5.92)345.44 (4.54)N/AN/AN/AN/AN/AN/A

    		Return of PRO results7410.42 (6.72)616.70 (4.73)535.70 (5.54)295.21 (5.84)–0.33 (1.10).77–1.20 (1.15).30–1.59 (1.41).26

    		Return of PRO results + Living with lymphoma7410.46 (7.18)637.30 (5.43)585.97 (3.79)355.26 (6.34)0.18 (1.10).87–1.05 (1.14).35–1.52 (1.36).26

    aHADS: Hospital Anxiety and Depression Scale (psychological distress subscale range, 0-42, with higher scores indicating more psychological distress).

    bP value of the overall time-by-group interaction.

    cCAU: care as usual (control group; reference category).

    dN/A: not applicable.

    ePRO: patient-reported outcome (T0, baseline assessment; T1, short-term follow-up assessment at 4 months postrandomization; T2, follow-up assessment at 12 months postrandomization; T3, follow-up assessment at 24 months postrandomization).

    fHeiQ: Health Education Impact Questionnaire (self-management ability subscales range, 0-4, with higher scores indicating higher levels of self-management ability).

    gISF: Information Satisfaction Questionnaire (information satisfaction subscale range, 0-5, with higher scores indicating more satisfaction with perceived information).

    Of the 150 patients who were randomized to arm 2 or 3 and had access to individual PRO results, 115 (76.7%) patients viewed their PRO results. The majority (79/115, 68.7%) viewed their PRO results more than once, and 16% (13/79) viewed it more than 5 times.

    Patients with lymphoma who viewed their PRO results were more recently diagnosed (13.6 vs 15.0 months; P=.03), had a more conscientious personality (3.8 vs 3.6; P=.01), and had a less fatalistic coping style than those who did not (2.1 vs 2.2; P=.02; Table 3). In addition, patients who did view their PRO results more often wished to receive all available information about the disease compared with those who did not (68/115, 59.1% vs 10/35, 29%; P=.004).

    Of those who viewed the PRO results, 91.3% (105/115) wished to compare their individual results to other patients with lymphoma and 80.8% (93/115) to a normative population without cancer. Only 7.8% (9/115) solely wanted to view their individual results.

    Table 3. Baseline characteristics of patients who viewed their individual patient-reported outcome (PRO) results and those who did not.

    		Those who viewed their PRO results (N=115)Those who did not view their PRO results (N=35)P valuea
    Sociodemographic characteristics

    		Age at time of questionnaire (years), mean (SD)60.1 (13.6)61.4 (14.0).64

    		Sex, n (%).93


    		Male83 (72.2)25 (71.4)


    		Female32 (27.8)10 (28.6)

    		Educational levelb, n (%).16


    		Low4 (3.5)1 (2.9)


    		Medium51 (44.3)22 (62.9)


    		High60 (52.2)12 (34.3)

    		Partner (yes), n (%)14 (12.2)8 (22.9).12
    Clinical characteristics

    		Months since diagnosis, mean (SD)13.6 (3.3)15.0 (3.3).03

    		Cancer type, n (%).21


    		Hodgkin lymphoma10 (8.7)7 (20)


    		NHL-HGc67 (58.3)16 (45.7)


    		NHL-LGd30 (26.1)8 (22.9)


    		CLLe8 (6.9)4 (11.4)

    		Treatment, n (%).63


    		Active treatment received91 (79.1)29 (82.9)


    		Active surveillance24 (20.9)6 (17.1)

    		Number of self-reported comorbidities, mean (SD)1.1 (1.1)1.1 (1.2).94
    Psychological characteristics

    		Personality, mean (SD)


    		Openness3.5 (0.6)3.4 (0.6).43


    		Conscientiousness3.8 (0.4)3.6 (0.5).01


    		Extraversion3.6 (0.6)3.5 (0.5).66


    		Agreeableness3.8 (0.4)3.7 (0.4).14


    		Neuroticism2.4 (0.6)2.4 (0.6).78

    		Coping strategies, mean (SD)


    		Fighting spirit3.0 (0.4)3.0 (0.4).47


    		Anxious preoccupation2.3 (0.4)2.2 (0.4).07


    		Helplessness or hopelessness1.6 (0.4)1.6 (0.5).87


    		Fatalism2.1 (0.4)2.2 (0.3).02


    		Avoidance1.7 (0.7)1.6 (0.6).47

    		Psychological distress (yes), n (%)101 (87.8)32 (91.4).56

    		Self-monitoring and insight, mean (SD)3.1 (0.4)2.9 (0.4).01

    		Satisfaction with information provision, mean (SD)3.9 (0.8)3.9 (0.7).76

    aP reports comparisons according to analysis of variance and chi-square tests.

    bEducational levels were defined as follows: low=none or primary school; medium=lower general secondary education or vocational training; or high=preuniversity education or high-level vocational training or university.

    cNHL-HG: high-grade non-Hodgkin lymphoma.

    dNHL-LG: low-grade non-Hodgkin lymphoma.

    eCLL: chronic lymphocytic leukemia.


    Principal Findings

    The results of this RCT demonstrated that patients were neither in a better nor in a worse situation when their individual PRO results were disclosed, as no effects of return of PRO results were found on psychological distress, self-management skills, and satisfaction with information provision. In addition, patients who received their PRO results did not report more contact with their general practitioner or medical specialist compared with those receiving CAU.

    Return of individual PRO research results seems to meet patients’ wishes, as the majority of those with access viewed their individual results, of whom two-thirds viewed it more than once. The possibility of comparing their scores with peers was most often chosen, indicating the importance of including normative data to place outcomes in perspective. Almost a quarter chose not to receive their results. Therefore, patients should have the choice as to whether they would like to receive their outcomes [14].

    We observed little statistical differences in characteristics of patients who did view their PRO results and those who did not. Patients who viewed their PRO results more frequently wanted to receive all available information about the disease compared with those who did not view their results. This is in line with the literature that patients with a monitoring (information seeking) coping style tend to benefit from more provided information, whereas patients with a blunting (information avoiding) coping style benefit from less information [48,49].

    There is increasing interest in integrating the collection of PROs in routine practice to enhance clinical care [50]. Weekly measurement of symptoms by patients during active treatment has proven to be effective, as 2 landmark studies on advanced solid tumors showed improvement in HRQoL and survival [51-53]. In our RCT, return of PRO results took place after treatment completion, including patients without advanced cancer stage, not specifically focusing on symptoms and was returned to patients only and not to their treating physician, which all may have contributed to differences in effects. With the continuing development of new and often expensive therapies for patients with cancer (eg, immunotherapy), further research and monitoring of the early onset and course of symptoms remains highly needed [54].

    We could not compare our results to the evidence-based BREATH intervention for breast cancer [32,33], the original web-based self-management intervention from which Living with lymphoma intervention was derived, as uptake in our RCT was too low to study the effect. With respect to the design of the study, it was our explicit intention to examine the uptake and effects of a self-management intervention (without personal contact with a therapist) in a population-based setting (where all patients were asked, and no screening took place) to evaluate if this would be a possibility to provide low-intensity care to the continuously growing group of cancer survivors. This may have contributed to the much lower uptake compared with that of BREATH. Therapist guidance may improve patient engagement with a self-management intervention [55]. An important aspect of engagement is self-efficacy, which is a central element of several therapies, such as behavior change theory and planned behavior as a health access approach.

    With respect to the Living with lymphoma intervention, we were not able to determine an effect as uptake was too low (3/76, 4%). Only 2 patients opened several components of the cognitive behavioral therapy parts, and various items from the library were viewed: Reliable information, Fatigue, Emotional counselling, and Nutrition and cancer, Exercise, Physical counselling, Sexuality, and Reintegration. As we observed that adherence was very low, we asked patients about reasons for nonadherence, and they indicated they felt well and still had regular appointments with their hematologist and therefore were not in need of an intervention. Furthermore, the majority of participants were men, and poor engagement in self-management was more common for men, as men may be more reluctant to seek help [56]. In addition, the timing of the intervention may not have been optimal, as participants were on average 14 months after diagnosis and patients appeared more receptive to interventions offered near diagnosis [57]. There is evidence that unguided self-management interventions could be more effective when targeted to those in the greatest need of an intervention, such as patients with low distress [32,58]. This might suggest that the need for intervention in our sample may be low and we may have not reached the right group, despite the invitation of a population-based sample and limited exclusion criteria.

    This is the first RCT to study the effect of the return of individual PRO results to patients with lymphoma or to patients with cancer in general. The strengths of this study include the design and linkage of PROs with clinical data from the NCR. Owing to the design of our RCT, within a population-based observational cohort, we had access to sociodemographic information about nonparticipants. This provides a unique opportunity to make clear statements about the representativeness of the sample. Participants of the RCT were younger, more often male, and more often highly educated [59]. Ideally, the RCT sample will be representative of the entire target population so that generalizations about the population can be made. More research is needed to understand why underrepresented patients were not reached and how they could be reached in the future.

    Conclusions

    In conclusion, the return of individual PRO results seems to meet patients’ wishes, even though it had no beneficial effects on patient outcomes; it did not have negative effects either. Therefore, we decided to include and implement the return of individual PRO results in the PROFILES registry. In addition, at this moment, the return of individual PRO results is extended to other cancer types, such as colorectal cancer, and is used in daily clinical practice. No conclusions could be drawn about the effectiveness of the self-management intervention because the uptake was too limited.

    Acknowledgments

    This randomized controlled trial was financially supported by the Jonker-Driessen Foundation. The Patient-Reported Outcomes Following Initial Treatment and Long-Term Evaluation of Survivorship registry was funded by an investment grant (480-08-009) of the Netherlands Organization for Scientific Research (The Hague, The Netherlands). Both funding agencies had no further role in study design; in the collection, analysis, and interpretation of data; in the writing of this paper; and in the decision to submit the paper for publication.

    Authors' Contributions

    SO was responsible for data collection, data analysis, and drafting of the manuscript. LPJA was responsible for patient recruitment, data collection, data analysis, and drafting of the manuscript. JMK was responsible for data analysis and contributed to the writing of this manuscript. JP designed the intervention that was originally developed for breast cancer patients and wrote the intervention content. MH, MVDP, AK, CL, WS, DI, JP, MO, RVDG, MN, LT, and EP were responsible for data collection and contributed to writing this manuscript. LVDPF was the project leader and was a major contributor in drafting this manuscript. All authors read and approved the final manuscript.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    CONSORT-eHEALTH checklist (V 1.6.1).

    PDF File (Adobe PDF File), 709 KB
    1. Behringer K, Goergen H, Müller H, Thielen I, Brillant C, Kreissl S, et al. Cancer-related fatigue in patients with and survivors of Hodgkin lymphoma: the impact on treatment outcome and social reintegration. J Clin Oncol 2016 Dec 20;34(36):4329-4337. [CrossRef] [Medline]
    2. Daniëls LA, Oerlemans S, Krol AD, Creutzberg CL, van DP. Chronic fatigue in Hodgkin lymphoma survivors and associations with anxiety, depression and comorbidity. Br J Cancer 2014 Feb 18;110(4):868-874 [FREE Full text] [CrossRef] [Medline]
    3. Oerlemans S, Mols F, Issa DE, Pruijt JH, Peters WG, Lybeert M, et al. A high level of fatigue among long-term survivors of non-Hodgkin's lymphoma: results from the longitudinal population-based PROFILES registry in the south of the Netherlands. Haematologica 2013 Mar;98(3):479-486 [FREE Full text] [CrossRef] [Medline]
    4. Williams AM, Zent CS, Janelsins MC. What is known and unknown about chemotherapy-related cognitive impairment in patients with haematological malignancies and areas of needed research. Br J Haematol 2016 Sep;174(6):835-846. [CrossRef] [Medline]
    5. Oerlemans S, Mols F, Nijziel MR, Zijlstra WP, Coebergh JW, van de Poll-Franse LV. The course of anxiety and depression for patients with Hodgkin's lymphoma or diffuse large B cell lymphoma: a longitudinal study of the PROFILES registry. J Cancer Surviv 2014 Dec;8(4):555-564. [CrossRef] [Medline]
    6. Faller H, Strahl A, Richard M, Niehues C, Meng K. The prospective relationship between satisfaction with information and symptoms of depression and anxiety in breast cancer: a structural equation modeling analysis. Psychooncology 2017 Nov;26(11):1741-1748. [CrossRef] [Medline]
    7. Faller H, Koch U, Brähler E, Härter M, Keller M, Schulz H, et al. Satisfaction with information and unmet information needs in men and women with cancer. J Cancer Surviv 2016 Feb;10(1):62-70. [CrossRef] [Medline]
    8. Arts LP, Oerlemans S, Tick L, Koster A, Roerdink HT, van de Poll-Franse LV. More frequent use of health care services among distressed compared with nondistressed survivors of lymphoma and chronic lymphocytic leukemia: results from the population-based PROFILES registry. Cancer 2018 Jul 15;124(14):3016-3024 [FREE Full text] [CrossRef] [Medline]
    9. Greenhalgh J. The applications of PROs in clinical practice: what are they, do they work, and why? Qual Life Res 2009 Feb;18(1):115-123. [CrossRef] [Medline]
    10. Kotronoulas G, Kearney N, Maguire R, Harrow A, Di DD, Croy S, et al. What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials. J Clin Oncol 2014 May 10;32(14):1480-1501. [CrossRef] [Medline]
    11. Snyder CF, Jensen R, Courtin SO, Wu AW, Website for Outpatient QOL Assessment Research Network. PatientViewpoint: a website for patient-reported outcomes assessment. Qual Life Res 2009 Sep;18(7):793-800 [FREE Full text] [CrossRef] [Medline]
    12. Valderas JM, Kotzeva A, Espallargues M, Guyatt G, Ferrans CE, Halyard MY, et al. The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature. Qual Life Res 2008 Mar;17(2):179-193. [CrossRef] [Medline]
    13. Velikova G, Booth L, Smith AB, Brown PM, Lynch P, Brown JM, et al. Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. J Clin Oncol 2004 Feb 15;22(4):714-724 [FREE Full text] [CrossRef] [Medline]
    14. Returning Individual Research Results to Participants: Guidance for a New Research Paradigm. Washington, DC: National Academies Press (US); 2018.
    15. Oerlemans S, Arts LP, Horevoorts NJ, van de Poll-Franse LV. "Am I normal?" The wishes of patients with lymphoma to compare their patient-reported outcomes with those of their peers. J Med Internet Res 2017 Aug 15;19(8):e288 [FREE Full text] [CrossRef] [Medline]
    16. Shalowitz DI, Miller FG. Disclosing individual results of clinical research: implications of respect for participants. JAMA 2005 Aug 10;294(6):737-740. [CrossRef] [Medline]
    17. Wong CA, Hernandez AF, Califf RM. Return of research results to study participants: uncharted and untested. JAMA 2018 Aug 07;320(5):435-436. [CrossRef] [Medline]
    18. Greenhalgh J, Long AF, Flynn R. The use of patient reported outcome measures in routine clinical practice: lack of impact or lack of theory? Soc Sci Med 2005 Feb;60(4):833-843. [CrossRef] [Medline]
    19. Barlow J, Wright C, Sheasby J, Turner A, Hainsworth J. Self-management approaches for people with chronic conditions: a review. Patient Educ Couns 2002;48(2):177-187. [Medline]
    20. McCorkle R, Ercolano E, Lazenby M, Schulman-Green D, Schilling LS, Lorig K, et al. Self-management: Enabling and empowering patients living with cancer as a chronic illness. CA Cancer J Clin 2011;61(1):50-62 [FREE Full text] [CrossRef] [Medline]
    21. Braamse AM, van Meijel B, Visser OJ, Boenink AD, Cuijpers P, Eeltink CE, et al. A randomized clinical trial on the effectiveness of an intervention to treat psychological distress and improve quality of life after autologous stem cell transplantation. Ann Hematol 2016 Jan;95(1):105-114 [FREE Full text] [CrossRef] [Medline]
    22. Foster C, Grimmett C, May CM, Ewings S, Myall M, Hulme C, et al. A web-based intervention (RESTORE) to support self-management of cancer-related fatigue following primary cancer treatment: a multi-centre proof of concept randomised controlled trial. Support Care Cancer 2016 Jun;24(6):2445-2453 [FREE Full text] [CrossRef] [Medline]
    23. Owen JE, Klapow JC, Roth DL, Shuster JL, Bellis J, Meredith R, et al. Randomized pilot of a self-guided internet coping group for women with early-stage breast cancer. Ann Behav Med 2005 Aug;30(1):54-64. [CrossRef] [Medline]
    24. Arts LP, van de Poll-Franse LV, van den Berg SW, Prins JB, Husson O, Mols F, et al. Lymphoma InterVEntion (LIVE) - patient-reported outcome feedback and a web-based self-management intervention for patients with lymphoma: study protocol for a randomised controlled trial. Trials 2017 Apr 28;18(1):199 [FREE Full text] [CrossRef] [Medline]
    25. van de Poll-Franse LV, Horevoorts N, van Eenbergen M, Denollet J, Roukema JA, Aaronson NK, Profiles Registry Group. The Patient Reported Outcomes Following Initial treatment and Long term Evaluation of Survivorship registry: scope, rationale and design of an infrastructure for the study of physical and psychosocial outcomes in cancer survivorship cohorts. Eur J Cancer 2011 Sep;47(14):2188-2194 [FREE Full text] [CrossRef] [Medline]
    26. Fritz A, Percy C, Jack A, Shanmugaratnam K, Sobin L, Parkin D, et al. International Classification of Diseases for Oncology. 3rd edition. Geneva: World Health Organisation; 2000.
    27. Kang M, Ragan BG, Park J. Issues in outcomes research: an overview of randomization techniques for clinical trials. J Athl Train 2008;43(2):215-221 [FREE Full text] [CrossRef] [Medline]
    28. Brundage M, Feldman-Stewart D, Leis A, Bezjak A, Degner L, Velji K, et al. Communicating quality of life information to cancer patients: a study of six presentation formats. J Clin Oncol 2005 Oct 1;23(28):6949-6956. [CrossRef] [Medline]
    29. Kuijpers W, Giesinger JM, Zabernigg A, Young T, Friend E, Tomaszewska IM, et al. Patients' and health professionals' understanding of and preferences for graphical presentation styles for individual-level EORTC QLQ-C30 scores. Qual Life Res 2016 Mar;25(3):595-604 [FREE Full text] [CrossRef] [Medline]
    30. van de Poll-Franse LV, Mols F, Gundy CM, Creutzberg CL, Nout RA, Verdonck-de Leeuw IM, et al. Normative data for the EORTC QLQ-C30 and EORTC-sexuality items in the general Dutch population. Eur J Cancer 2011 Mar;47(5):667-675. [CrossRef] [Medline]
    31. Cocks K, King MT, Velikova G, Martyn SM, Fayers PM, Brown JM. Evidence-based guidelines for determination of sample size and interpretation of the European Organisation for the Research and Treatment of Cancer Quality of Life Questionnaire Core 30. J Clin Oncol 2011 Jan 1;29(1):89-96. [CrossRef] [Medline]
    32. van den Berg SW, Gielissen MF, Custers JA, van der Graaf WT, Ottevanger PB, Prins JB. BREATH: web-based self-management for psychological adjustment after primary breast cancer--results of a multicenter randomized controlled trial. J Clin Oncol 2015 Sep 1;33(25):2763-2771. [CrossRef] [Medline]
    33. van den Berg SW, Gielissen MF, Ottevanger PB, Prins JB. Rationale of the BREAst cancer e-healTH [BREATH] multicentre randomised controlled trial: an internet-based self-management intervention to foster adjustment after curative breast cancer by decreasing distress and increasing empowerment. BMC Cancer 2012 Sep 07;12:394 [FREE Full text] [CrossRef] [Medline]
    34. Sangha O, Stucki G, Liang MH, Fossel AH, Katz JN. The Self-Administered Comorbidity Questionnaire: a new method to assess comorbidity for clinical and health services research. Arthritis Rheum 2003 Apr 15;49(2):156-163 [FREE Full text] [CrossRef] [Medline]
    35. Big Five Inventory. APA PsycTests. 1991.   URL: https://doi.apa.org/doiLanding?doi=10.1037%2Ft07550-000 [accessed 2021-09-14]
    36. McCrae R, Costa PT. Introduction to the empirical and theoretical status of the five-factor model of personality traits. In: Personality Disorders and the Five-Factor Model of Personality. Washington: American Psychological Association; 2013:15-27.
    37. Watson M, Greer S, Young J, Inayat Q, Burgess C, Robertson B. Development of a questionnaire measure of adjustment to cancer: the MAC scale. Psychol Med 1988 Feb;18(1):203-209. [CrossRef] [Medline]
    38. Braeken AP, Kempen GI, Watson M, Houben RM, Gils FC, Lechner L. Psychometric properties of the Dutch version of the Mental Adjustment to Cancer scale in Dutch cancer patients. Psychooncology 2010 Jul;19(7):742-749. [CrossRef] [Medline]
    39. Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst 1993 Mar 03;85(5):365-376. [CrossRef] [Medline]
    40. Osborne RH, Elsworth GR, Whitfield K. The Health Education Impact Questionnaire (heiQ): an outcomes and evaluation measure for patient education and self-management interventions for people with chronic conditions. Patient Educ Couns 2007 May;66(2):192-201. [CrossRef] [Medline]
    41. Thomas R, Kaminski E, Stanton E, Williams M. Measuring information strategies in oncology - developing an information satisfaction questionnaire. Eur J Cancer Care (Engl) 2004 Mar;13(1):65-70. [CrossRef] [Medline]
    42. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand 1983 Jun;67(6):361-370. [CrossRef] [Medline]
    43. Bjelland I, Dahl AA, Haug TT, Neckelmann D. The validity of the Hospital Anxiety and Depression Scale. An updated literature review. J Psychosom Res 2002 Feb;52(2):69-77. [CrossRef] [Medline]
    44. Singer S, Kuhnt S, Götze H, Hauss J, Hinz A, Liebmann A, et al. Hospital anxiety and depression scale cutoff scores for cancer patients in acute care. Br J Cancer 2009 Mar 24;100(6):908-912 [FREE Full text] [CrossRef] [Medline]
    45. Littell RC, Pendergast J, Natarajan R. Modelling covariance structure in the analysis of repeated measures data. Stat Med 2000 Jul 15;19(13):1793-1819. [CrossRef] [Medline]
    46. Norman GR, Sloan JA, Wyrwich KW. Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care 2003 May;41(5):582-592. [CrossRef] [Medline]
    47. Cohen J. Statistical Power Analysis for the Behavioral Sciences Second Edition. Hillsdale, NJ: Lawrence Erlbaum Associates; 1988.
    48. Miller SM. Monitoring versus blunting styles of coping with cancer influence the information patients want and need about their disease. Implications for cancer screening and management. Cancer 1995 Jul 15;76(2):167-177. [CrossRef] [Medline]
    49. de Rooij BH, Ezendam NP, Vos MC, Pijnenborg JM, Boll D, Kruitwagen RF, et al. Patients' information coping styles influence the benefit of a survivorship care plan in the ROGY care trial: new insights for tailored delivery. Cancer 2019 Mar 01;125(5):788-797 [FREE Full text] [CrossRef] [Medline]
    50. Basch E, Barbera L, Kerrigan CL, Velikova G. Implementation of patient-reported outcomes in routine medical care. Am Soc Clin Oncol Educ Book 2018 May 23;38:122-134 [FREE Full text] [CrossRef] [Medline]
    51. Basch E. Patient-reported outcomes: an essential component of oncology drug development and regulatory review. Lancet Oncol 2018 May;19(5):595-597. [CrossRef] [Medline]
    52. Basch E, Deal AM, Kris MG, Scher HI, Hudis CA, Sabbatini P, et al. Symptom monitoring with patient-reported outcomes during routine cancer treatment: a randomized controlled trial. J Clin Oncol 2016 Feb 20;34(6):557-565 [FREE Full text] [CrossRef] [Medline]
    53. Denis F, Basch E, Septans AL, Bennouna JM, Urban T, Dueck AC, et al. Two-year survival comparing web-based symptom monitoring vs routine surveillance following treatment for lung cancer. JAMA 2019 Jan 22;321(3):306-307 [FREE Full text] [CrossRef] [Medline]
    54. Thanarajasingam G, Minasian LM, Baron F, Cavalli F, De Claro RA, Dueck AC, et al. Beyond maximum grade: modernising the assessment and reporting of adverse events in haematological malignancies. Lancet Haematol 2018 Nov;5(11):e563-e598 [FREE Full text] [CrossRef] [Medline]
    55. Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther 2009;38(4):196-205. [CrossRef] [Medline]
    56. Galdas P, Fell J, Bower P, Kidd L, Blickem C, McPherson K, et al. The effectiveness of self-management support interventions for men with long-term conditions: a systematic review and meta-analysis. BMJ Open 2015 Mar 20;5(3):e006620 [FREE Full text] [CrossRef] [Medline]
    57. Brebach R, Sharpe L, Costa DS, Rhodes P, Butow P. Psychological intervention targeting distress for cancer patients: a meta-analytic study investigating uptake and adherence. Psychooncology 2016 Aug;25(8):882-890. [CrossRef] [Medline]
    58. Ugalde A, Haynes K, Boltong A, White V, Krishnasamy M, Schofield P, et al. Self-guided interventions for managing psychological distress in people with cancer - a systematic review. Patient Educ Couns 2017 May;100(5):846-857 [FREE Full text] [CrossRef] [Medline]
    59. Arts LP, Oerlemans S, Posthuma EF, Issa DE, Oosterveld M, van der Griend R, et al. Web-based self-management for patients with lymphoma: assessment of the reach of intervention of a randomized controlled trial. J Med Internet Res 2020 May 14;22(5):e17018 [FREE Full text] [CrossRef] [Medline]

    ‎
    BREATH: Breast Cancer eHealth
    CAU: care as usual
    CONSORT: Consolidated Standards of Reporting Trials
    ES: effect size
    HRQoL: health-related quality of life
    LIVE: Lymphoma Intervention
    NCR: Netherlands Cancer Registry
    PRO: patient-reported outcome
    PROFILES: Patient-Reported Outcomes Following Initial Treatment and Long-Term Evaluation of Survivorship
    RCT: randomized controlled trial

    Edited by R Kukafka; submitted 11.02.21; peer-reviewed by J Lehmann, M Ferrer, L Jibb; comments to author 08.05.21; revised version received 02.07.21; accepted 27.07.21; published 14.12.21

    Copyright

    ©Simone Oerlemans, Lindy Paulina Johanna Arts, Jacobien M Kieffer, Judith Prins, Mels Hoogendoorn, Marjolein van der Poel, Ad Koster, Chantal Lensen, Wendy Bernadina Catharina Stevens, Djamila Issa, Johannes F M Pruijt, Margriet Oosterveld, René van der Griend, Marten Nijziel, Lidwine Tick, Eduardus F M Posthuma, Lonneke V van de Poll-Franse. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 14.12.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.