This paper is in the following e-collection/theme issue:

Mobile Health (mhealth) (2939) Engagement with and Adherence to Digital Health Interventions, Law of Attrition (491) Participatory Medicine & E-Patients (773) mHealth for Symptom and Disease Monitoring, Chronic Disease Management (1399) Breast Cancer (206) Chemotherapy and Side Effects Management (59) Mobile Apps for Cancer Care and Cancer Prevention and Screening (206)

Published on in Vol 22, No 8 (2020): August

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/17058, first published .
Engagement in an Interactive App for Symptom Self-Management during Treatment in Patients With Breast or Prostate Cancer: Mixed Methods Study

Engagement in an Interactive App for Symptom Self-Management during Treatment in Patients With Breast or Prostate Cancer: Mixed Methods Study

Engagement in an Interactive App for Symptom Self-Management during Treatment in Patients With Breast or Prostate Cancer: Mixed Methods Study

Authors of this article:

Marie-Therése Crafoord1 Author Orcid Image ;   Maria Fjell1 Author Orcid Image ;   Kay Sundberg1 Author Orcid Image ;   Marie Nilsson1 Author Orcid Image ;   Ann Langius-Eklöf1 Author Orcid Image
Article Authors Cited by (54) Tweetations (8) Metrics

    Original Paper

    Division of Nursing, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden

    *these authors contributed equally

    Corresponding Author:

    Marie-Therése Crafoord, RN, BSc, MSc

    Division of Nursing

    Department of Neurobiology, Care Sciences and Society

    Karolinska Institutet

    Alfred Nobels Allé 23

    Stockholm, 14183

    Sweden

    Phone: 46 8524 837 49

    Email: marie-therese.crafoord@ki.se


    Related ArticleThis is a corrected version. See correction statement in: https://www.jmir.org/2021/10/e33140

    Background: Using mobile technology for symptom management and self-care can improve patient-clinician communication and clinical outcomes in patients with cancer. The interactive app Interaktor has been shown to reduce symptom burden during cancer treatment. It includes symptom assessment, an alert system for contact with health care professionals, access to self-care advice, and visualization of symptom history. It is essential to understand how digital interventions operate; one approach is to examine engagement by assessing usage and exploring user experiences. Actual usage in relation to the intended use—adherence—is an essential factor of engagement.

    Objective: This study aimed to describe engagement with the Interaktor app among patients with breast or prostate cancer during treatment.

    Methods: Patients from the intervention groups of two separate randomized controlled trials were included: patients with breast cancer receiving neoadjuvant chemotherapy (n=74) and patients with locally advanced prostate cancer receiving treatment with radiotherapy (n=75). The patients reported their symptoms daily. Sociodemographic and clinical data were obtained from baseline questionnaires and medical records. Logged data usage was retrieved from the server and analyzed descriptively and with multiple regression analysis. Telephone interviews were conducted with patients about their perceptions of using the app and analyzed using content analysis.

    Results: The median adherence percentage to daily symptom reporting was 83%. Most patients used the self-care advice and free text message component. Among the patients treated for breast cancer, higher age predicted a lower total number of free text messages sent (P=.04). Among the patients treated for prostate cancer, higher age (P=.01) and higher education level (P=.04), predicted an increase in total views on self-care advice, while higher comorbidity (P=.004) predicted a decrease in total views on self-care advice. Being married or living with a partner predicted a higher adherence to daily symptom reporting (P=.02). Daily symptom reporting created feelings of having continuous contact with health care professionals, being acknowledged, and safe. Being contacted by a nurse after a symptom alert was considered convenient and highly valued. Treatment and time-related aspects influenced engagement. Daily symptom reporting was perceived as particularly meaningful at the beginning of treatment. Requests were made for advice on diet and psychological symptoms, as well as for more comprehensive and detailed information as the patient progressed through treatment.

    Conclusions: Patient engagement in the interactive app Interaktor was high. The app promoted patient participation in their care through continuous and convenient contact with health care professionals. The predictive ability of demographic variables differed between patient groups, but higher age and a higher educational level predicted usage of specific app functions for both patient groups. Patients’ experience of relevance and interactivity influenced their engagement positively.

    J Med Internet Res 2020;22(8):e17058

    doi:10.2196/17058

    Keywords

    engagement; adherence; mHealth; mobile app; cancer supportive care; symptom management; usage metrics; breast cancer; prostate cancer 


    Treatments for cancer can lead to challenging symptoms, but most patients are managed as outpatients [1,2]. Patients’ own assessments of the occurrence and severity of symptoms and their concerns can inform and support health care professionals in identifying and assessing the potential risks associated with cancer treatment, leading to improved patient outcomes [3,4]. Interventions using mobile technology to support symptom monitoring and self-care among patients being treated for cancer have been shown to improve patient-clinician communication, improve symptom management and self-care ability, reduce symptom burden, and increase survival [4-6].

    Even though apps to support symptom management for patients with cancer have increased, few feature evidence-based content or have been tested in rigorous trials [7,8]. Moreover, only some include interactive components, such as support for self-care and communication with health care professionals and peers for immediate clinical management [7,9-12]. A key aspect of digital interventions is to understand how they operate and how they can be enhanced by assessment of usage and user experiences [13-17].

    We designed Interaktor, an interactive smartphone and tablet app, to support patient symptom management. The concepts of person-centered and participatory care inspired the development of the intervention [18,19]. The app is available in different versions tailored for patients during treatment for breast cancer, prostate cancer [20], and pancreatic cancer [21] and for older persons receiving home care [22]. The content of the different versions of the app was developed in an iterative process, which included reviews of literature focusing on symptoms and their management, clinical guidelines, interviews with patients, and interviews with health care professionals [21,23-25]. Detailed descriptions about the intervention outline and screenshots have been previously presented [20,26]. Interaktor includes four generic components: (1) Self-assessment through questions about symptoms and concerns, where patients report symptom occurrence, symptom frequency, and their distress level inspired by the Memorial Symptom Assessment Scale is a main component [27]. Patients also have the opportunity to report other symptoms with free text messages. The reports are immediately transferred via a secure server to health care professionals who can monitor patient reports in real time via a web interface. (2) A risk assessment model is included for symptoms that notifies nurses at the clinic by SMS text message when a high level of frequency or distress is reported for a symptom. There are two kinds of alerts: yellow and red. Yellow alerts require that a nurse contact the patient during the daytime, and red alerts require that a nurse contact the patient within 1 hour. (3) Evidence-based self-care advice and links to relevant webpages related to the assessed symptoms and other areas of concern are included. (4) Graphs showing reported symptom history for patients and health care professionals are also included. Interaktor can be used with Android and iOS, but the app is only available for research purposes. Logged data were stored on a separate secure server hosted by the health care company that developed the app.

    Studies suggest that patients undergoing treatment for cancer make use of and appreciate opportunities to report symptoms to health care professionals when they are at home [26,28,29]. Mobile technology for health (mHealth) to support self-management has been linked to positive outcomes regarding physical as well as psychological symptoms in the context of cancer care [30,31]. An early system for remote symptom management during cancer treatment included symptom assessments twice a day, tailored advice, and access to informational webpages [5]; the study [5] found that patients differed markedly in the number of reports made and all patients viewed the webpages. Furthermore, modest problems with the technology were described, and patients rated improvements in the communication process with hospital staff and their satisfaction with care [32]. Systems for remote symptom management during cancer treatment have since demonstrated high acceptance [33] as well as long-term feasibility [34]. Most have been web-based and have involved symptom assessments from a home computer or clinic tablet [4,6,33,35].

    Usage and user experiences of a web- or mobile-based intervention can be described by the concept of engagement [15]. Engagement is influenced by interconnected factors—some individual, such as demographics, skills, and understanding; some contextual, which include internet access and online environment; and some interventional, such as technical and design features [36]. Patients’ prior health behaviors and smartphone experience will affect how relevant and usable an intervention is perceived to be, which affects engagement, and persistent patient engagement is achieved if the intervention is perceived to be usable, relevant, helpful, and interactive [36]. Usage level compared to the intended usage is referred to as adherence [37]. The significance of adherence has gained increased recognition, since evidence has emerged that high levels of adherence positively correlate with improved outcomes [38]. However, within eHealth in general, levels of nonusage and dropout have been substantial, and achieving the desired level of patient adherence may be challenging [17]. Relating usage to intended use requires operationalization and rationalization [37]. Approaches to measuring adherence vary; reported methods include the number of log-ins, website exposure, and modules completed; these stem partly from diversity in the purpose and design of digital interventions but also demonstrate different views of the concept of adherence [38].

    High levels of adherence to symptom reporting during cancer treatment have been observed in relation to clinic visits, but there is a lack of large-scale studies examining how patients undergoing treatment for cancer adhere to and perceive symptom monitoring and reporting via a mobile app [7,9].

    Treatment for breast cancer consists of different approaches such as chemotherapy, surgery, and radiotherapy [39-41]. Chemotherapy can be administered as adjuvant after surgery, but in recent years, neoadjuvant chemotherapy, which is administered before surgery, has become more common [42]. Neoadjuvant chemotherapy is administered at the oncology clinic at different treatment intervals, depending on the cytotoxic drugs that are given [43]. Treatment for prostate cancer includes three main approaches: active surveillance, surgical treatment, and radiotherapy. These may be combined with antihormonal treatment. Radiotherapy for prostate cancer is administered every weekday at clinics [44]. In Sweden, patients remain at home between treatments. Patients with breast cancer undergoing neoadjuvant chemotherapy meet the physician before each treatment cycle, approximately every second or third week, depending on the chemotherapy regimen [43]. Patients with prostate cancer undergoing radiotherapy meet the physician before the start of radiotherapy and 6 months after completing radiotherapy [44]. Patients are assigned a contact nurse who is responsible for the patient’s care throughout the care chain and who the patient can contact during office hours in case of concerns related to the treatment [43,44]. Patients are also provided with telephone numbers for the oncology clinics, for making contact during office hours or during evenings, nights, and weekends.

    As most patients undergoing neoadjuvant chemotherapy for breast cancer or radiotherapy for prostate cancer are treated on an outpatient basis, partially self-reliant management of symptoms is necessary. Several studies show decreased symptom burden [24,45], that patients appreciate using Interaktor, and that they feel secure [21,26]. The app is currently being evaluated in two randomized controlled trials that include patients with breast cancer and prostate cancer, with the hypothesis that using the app will improve symptom management, reduce symptom burden, and increase cost-effectiveness through a reduced consumption of health care services in comparison to standard care alone [20].

    An understanding of how Interaktor is used and perceived, including the impacts of individual factors, is warranted in order to support the interpretation of the clinical effects of using the app during treatment [45]. Therefore, this study aimed to describe engagement with the Interaktor app among patients with breast and prostate cancer during their treatment.


    Overview

    This study included patients from the intervention groups of two separate randomized controlled trials: patients with breast cancer during neoadjuvant chemotherapy (ClinicalTrials.gov; NCT02479607) and patients with locally advanced prostate cancer during treatment with radiotherapy (ClinicalTrials.gov; NCT02477137). The study comprised logged data from patient reports and interviews with patients. Ethical approval was obtained from the Regional Ethical Review Board of Stockholm (registration no. 2013/1652-31/2 and 201712519-32).

    Setting and Sample

    The patients were consecutively recruited at two university hospitals in Stockholm, Sweden. Patients with breast cancer or prostate cancer undergoing neoadjuvant chemotherapy and radiotherapy, respectively, who were able to speak and understand Swedish, who were presumed cognitively able to use a mobile app for symptom reporting, who agreed to participate, and who signed a written informed consent form were eligible. Of the 75 patients in the breast cancer group, 1 patient had a change of treatment to surgery instead of neoadjuvant chemotherapy, and 1 patient withdrew their consent to participate in the interview. In the prostate cancer group, 58 patients of the 75 patients participated in the interviews, due to organizational circumstances and difficulties reaching the patients after their treatment had ended (Figure 1).

    ‎
    Figure 1. CONSORT diagram.
    View this figure

    Study Procedure

    Patients downloaded Interaktor onto their smartphone or tablet. Patients who did not own one were lent a smartphone by the research group (2 in the breast cancer group, 2 in the prostate cancer group). The patients also received an individual log-in for access to the content of the app. The patients received verbal and written instructions on how to use the app and were asked to report their symptoms daily on weekdays during treatment. Patients with breast cancer were asked to start using the app on their first day of neoadjuvant chemotherapy and continue until 2 weeks after treatment had ended—a total of approximately 18 weeks. Patients with prostate cancer started using the app on their first day of radiotherapy and continued until 3 weeks after treatment had ended—a total of approximately 9 weeks. All patients were informed that nurses at the clinic would survey and respond to alerts triggered on weekdays (8 AM to 4 PM). If patients needed support at other times of the day, they were instructed to contact the clinic according to the standard procedure. If a report had not been submitted before 2 PM, a notification was sent out to remind the patient to report. The breast cancer version of the app included a notification that was sent to the patient, suggesting the patient read self-care advice related to alerted symptoms. This function was not included in the prostate cancer version of the app.

    Data Collection

    Participant Data

    Sociodemographic data were obtained from baseline questionnaires. Clinical data and prevailing health status at the time of treatment start were collected from medical records. Health status was used to calculate the comorbidity score using the Charlson Comorbidity Index, which encompasses 19 medical conditions. Each condition has a score based on a relative risk of death within a year. The scores are totaled to yield the comorbidity score, with a range between 0 and 37. A higher value corresponds to greater comorbidity [46].

    Logged Data

    Data on app usage including symptom reports, triggered alerts, views of self-care advice, and free text messages sent, were made accessible to the researchers through encrypted Excel (2013; Microsoft Inc) files. At the time of the study, it was not possible for data on clicked links or viewed graphs to be logged for later retrieval.

    Interviews

    Telephone interviews were conducted with the patients shortly after the end of the use of the app, following a semistructured interview guide (Table 1) that we had developed, focusing primarily on usability, utility, and capturing participant feedback on the app (including all components). The interviews lasted between 10 and 20 minutes, during which the authors made notes of the answers in the template of the interview guide. Five of the patients with prostate cancer were individually interviewed in connection to more comprehensive interviews about participation in care. These interviews were recorded and transcribed verbatim, but only the text with respect to using the app was analyzed in this study.

    Table 1. Interview guide.

    		QuestionFollow-up question
    1What was it like to report in the app? (in general)Easy/difficult? Advantages/disadvantages?
    2What was it like to report your symptoms?Easy/difficult? Absence of symptom to report?


    		Relevant symptom questions and reporting frequency?
    3Have you used the self-care advice? (yes/no)If yes, your experience? Relevant self-care advice? Have you used the links?


    		If no, have you searched for information elsewhere?
    4How have you experienced that the technology has worked?The log-in procedure? Mobile coverage?
    5Have you used the graphs to follow your symptom history? (yes/no)If yes, in which way? How did you experience the graphs?


    		If no, why?
    6Were you called sometime by a nurse? (yes/no)If yes, was it after an alert?
    7How did you experience being called by a nurse after an alert?—
    8Is there anything else you want to add?Is there anything in the app that you have lacked?

    Statistical Analyses

    Data management was performed using Excel, and statistical analyses were carried out using SPSS statistical software (version 24.0; IBM Corp). Differences in demographic and clinical characteristics between the two groups were analyzed using two-tailed independent t test, Fischer exact test, and the chi-square test. Usage was analyzed with descriptive and inferential statistics on the variables reports sent, alerts triggered, self-care advice section views, and free text messages sent; group median values were calculated and are reported. The intended use was measured by daily symptom reporting during weekdays. Adherence to daily reporting was calculated as the number of weekday reports (excluding multiple daily reports) divided by the total number of reportable weekdays for each patient.

    Multiple regression analysis was conducted (using the enter method) to see if the independent variables (predictors) age, comorbidity, marital status, and education level predicted usage of the app. The usage variables (dependent variables) were adherence to daily reporting as intended, total number of alerts triggered, total views on self-care advice, and total number of free text messages sent. Since all of the usage variables were positively skewed, these were normalized using a natural logarithm transformation [47]. Level of significance was determined as P<.005.

    Qualitative Analysis

    The interview notes were analyzed by conventional content analysis [48]. First, two authors read the complete interview notes from each group (breast cancer and prostate cancer) individually, to grasp the entire data. Both authors compiled a data sheet for each group with the patients' answers. The data sheets were reviewed repeatedly, and initial codes were derived. Thereafter, all authors reviewed both sets of data sheets and codes. Due to substantial similarities of codes in the two groups (breast cancer and prostate cancer), one data set containing all coded responses (with credentials) was assembled. Subsequently, all text material were analyzed. In an iterative process, the codes were sorted based on similarity into subcategories and combined based on content into overarching categories. Some exemplifying quotes from the patients’ statements are presented in the Results section. During the analytical process, all authors met continually to discuss and come to a consensus.


    Sample Characteristics

    The patients’ sociodemographic (Table 2) and clinical data (Table 3) are presented below. Patients in the breast cancer group were significantly younger than the patients in the prostate cancer group (P<.001). Moreover, the patients in the breast cancer group had a statistically significant lower comorbidity score (P<.001) and a higher self-reported education level (P=.005).

    Table 2. Sociodemographic characteristics at baseline of patients with breast cancer and prostate cancer.
    CharacteristicsBreast cancer (n=74)Prostate cancer (n=75)Test statisticP value
    Age (in years), median (range)47 (27-73)72 (44-81)–15.127a<.001a
    Marital status, n (%)74 (100)71 (100)1.204 (2)b.57b

    		Married/cohabitant58 (78)53 (74)


    		Living apart3 (4)6 (9)


    		Single13 (18)12 (17)

    Highest education level, n (%)74 (100)71 (100)10.627 (2)c.005c

    		University50 (68)30 (42)


    		Secondary school18 (24)25 (35)


    		Primary school6 (8)16 (23)

    Occupation, n (%)74( 100)69 (100)61.330 (2)b<.001b

    		Working57 (77)22 (32)


    		Sick leave12 (16)0 (0)


    		Retired/unemployed5 (7)47 (68)

    aMann-Whitney U test.

    bFischer exact test (df).

    cChi-square (df).

    Table 3. Clinical characteristics at baseline of patients with breast cancer and prostate cancer.
    CharacteristicsBreast cancer (n=74)Prostate cancer (n=75)Test statisticP value
    Charlson Comorbidity Scale scorea, median (IQR)1.0 (1)3.0 (1)5082.5b<.001b
    PSAc (at start of treatment), median (range)N/Ad5.3 (0-53)

    Disease stage (TNMe), n (%)




    		T1N/A1 (1)


    		T1CN/A17 (23)


    		T2N/A11 (15)


    		T2AN/A1 (1)


    		T2BN/A7 (9)


    		T2CN/A7 (9)


    		T3N/A20 (27)


    		T3AN/A1 (1)


    		T3BN/A8 (11)


    		MissingN/A2 (3)

    Histologic grade (Elston-Ellis), n (%)




    		Intermediate grade 223 (31.1)N/A


    		High grade 341 (55.4)N/A


    		Unknown10 (13.5)N/A

    Tumor characteristicsf, n (%)




    		HER2+ ER+ PR+9 (12.2)N/A


    		HER2+ ER+ PR–7 (9.5)N/A


    		HER2+ ER– PR–13 (17.6)N/A


    		HER2– ER+ PR+16 (21.6)N/A


    		HER2– ER+ PR–7 (9.5)N/A


    		HER2– ER– PR+1 (1.4)N/A


    		Triple negative21 (28.4)N/A

    Proliferation rate (Ki-67), n (%)




    		≥ 20 %72 (97.3)N/A


    		< 20 %2 (2.7)N/A

    Type of chemotherapy, n (%)




    		Anthracyclines, alkylators3 (4.1)N/A


    		Anthracyclines, alkylators, taxanes37 (50.0)N/A


    		Anthracyclines, alkylators, antimetabolites, taxanes9 (12.2)N/A


    		Antimetabolites, alkylators2 (2.7)N/A


    		Taxanes11 (14.9)N/A


    		Taxanes, alkylators1 (1.4)N/A


    		Taxanes, trastuzumab emtansine2 (2.7)N/A


    		Trastuzumab emtansine9 (12.2)N/A

    Gleason score, median (range)N/A7 (6-9)

    Number of radiotherapy treatments, median (range)N/A25 (25-29)

    Number of neoadjuvant chemotherapy treatments, median (range)6.0 (2-15)N/A

    Antihormonal treatment, n (%)




    		YesN/A55 (73)


    		NoN/A20 (27)

    Treatment duration (in weeks), median (range)15 (3-26)5 (5-6)

    aA higher value corresponds to greater comorbidity; the score ranges between 0-37.

    bMann-Whitney U test.

    cPSA: Prostate-specific antigen.

    dN/A: not applicable.

    eTNM: Classification of malignant tumors.

    fBreast cancer cell human epidermal growth factor receptor (HER2), estrogen receptor (ER), and progesterone receptor (PR) status.

    Logged Data

    All patients reported with the app at least once during the study period. Due to differences in treatment schedules, the reporting period in the breast cancer group ranged from 22 to 183 days (median 106, IQR 7). The reporting period in the prostate cancer group ranged from 54 to 89 days (median 63, IQR 11). Median adherence in the breast cancer group was 83% (IQR 36%). In the prostate cancer group, the median adherence percentage was also 83% (IQR 34%). Graphs of adherence patterns over time show that the level of adherence remained stable over time, although it dropped somewhat after day 49 in the breast cancer group and day 39 in the prostate cancer group (Figure 2).

    ‎
    Figure 2. Adherence to symptom reporting over time.
    View this figure

    In the breast cancer group, 96% (71/74) of patients triggered at least one alert during the study period; in the prostate cancer group, 72% (54/75). Patients in the breast cancer group triggered a median of 7 alerts (IQR 21, range 1-210). In the prostate cancer group, the median number of alerts triggered was 2 (IQR 9, range 1-60). The distribution of yellow and red alerts was 86% yellow to 14% red in the breast cancer group and 90% yellow to 10% red in the prostate cancer group.

    Among patients in the breast cancer group, 100% (74/74) viewed self-care advice at least once. Patients in the breast cancer group viewed a median of 11 (IQR 15) self-care advice topics at least once during the study period, out of 17 self-care advice available. The total number of views was 1075, and 34% (362/1075) were views made after the patient was notified with the suggestion to read related self-care advice after an alert had been triggered. In the prostate cancer group, 87% (65/75) of patients viewed self-care advice at least once and the median number of various self-care advice topics viewed at least once was 5 (IQR 11) out of 16 self-care advice available. The total number of self-care advice views by patients in the prostate cancer group was 697.

    Most of the patients used the free text function at least once: 93% (69/74) in the breast cancer group and 75% (56/75) in the prostate cancer group. The free text messages were mainly about symptoms, requesting or declining contact, care-related information, and issues linked to the app or to reporting. There was a variation in how the function was used, some patients wrote short, condensed messages while some wrote longer, richer descriptions.

    Patient Characteristics as Predictors of App Usage

    In the breast cancer group none of the multiple regression models were statistically significant (Table 4). Higher age predicted a lower total number of free text messages sent (P=.04). In the prostate cancer group the multiple regression model showed that the total number of views on self-care advice was statistically significant (F4,70=3.811, P=.007, adjusted R2=.132) (Table 5). Higher age (P=.01) and higher education level (P=.04) predicted a higher total number of views of self-care advice. Higher comorbidity score predicted fewer self-care advice views (P=.004). Furthermore, being married or cohabitating predicted a higher adherence to daily symptom reporting (P=.02) (Table 5).

    Table 4. Multiple regression in patients with breast cancer (n=74).
    Dependent and independent variablesBaSEbβc95% CIP valuedAdje R2P valuef





    		LowerUpper


    Adherence to daily reporting as intended





    		<.001.72

    		Age–0.0060.010–.080–.027.015.56


    		Comorbidity0.0940.099.129–.103.291.35


    		Marital status0.0390.230.020–.420.497.87


    		Educational level0.2240.208.132–.191.639.29

    Total number of alerts





    		.038.16

    		Age–0.0270.015–.243–.056.003.07


    		Comorbidity–0.0870.140–.082–.367.193.54


    		Marital status–0.3870.326–.137–1.04.264.24


    		Educational level–0.1160.296–.046–.705.474.70

    Total views on self-care advice





    		<.001.46

    		Age–0.0070.011–.084–.028.015.54


    		Comorbidity–0.1010.102–.134–.303.102.33


    		Marital status0.1310.236.066–.340.603.58


    		Educational level0.0930.214.053–.334.520.66

    Total number of free text messages





    		.070.07

    		Age–0.0270.013–.295–.052–.001.04


    		Comorbidity0.0360.114.044–.191.264.75


    		Marital status–0.0300.271–.013–.571.511.91


    		Educational level0.3260.238.165–.149.800.18

    aB: unstandardized coefficient.

    bSE: standard error of the unstandardized coefficient.

    cβ: standardized coefficient.

    dP value for the independent variable.

    eAdj: adjusted for the multiple regression model.

    fP value for the multiple regression model.

    Table 5. Multiple Regression in patients with prostate cancer (n=75)
    Dependent and independent variablesBaSEbβc95% CIP valuedAdje R2P valuef




    		LowerUpper


    Adherence to daily reporting as intended





    		.027.21

    		Age–0.0010.015–.008–.030.028.96


    		Comorbidity0.0200.077.038–.134.173.80


    		Marital status0.4310.181.277.071.792.02


    		Educational level–0.0260.165–.018–.355.304.88

    Total number of alerts





    		< .001.66

    		Age–0.0110.026–.067–.062.040.66


    		Comorbidity0.0320.134.036–.236.300.81


    		Marital status0.4820.316.182–.1481.11.13


    		Educational level0.0820.289.033–.494.657.78

    Total views on self–care advice





    		.132.007

    		Age0.0570.022.368.013.101.01


    		Comorbidity–0.3470.116–.419–.579–.115.004


    		Marital status0.0190.273.008–.526.565.94


    		Educational level0.5310.250.232.0321.03.04

    Total number of free text messages





    		< .001.84

    		Age–0.0080.024–.052–.055.039.74


    		Comorbidity–0.0290.125–.035–.278.220.82


    		Marital status0.2290.293.094–.356.814.44


    		Educational level–0.1610.268–.071–.696.374.55

    aB: unstandardized coefficient.

    bSE: standard error of the unstandardized coefficient.

    cβ: standardized coefficient.

    dP value for the independent variable.

    eAdj: adjusted for the multiple regression model.

    fP value for the multiple regression model.

    Perceptions of Using the Interaktor App

    Overall

    Although all patients were enthusiastic about contributing to the study and to the evaluation and development of the app, some patients noted that they did not recall using the app in detail. Analysis of the interviews resulted in three overarching categories: user friendliness, interaction with the health care professionals, and support for self-care.

    User Friendliness

    Nearly all patients stated that the app was easy to use and that it took little time to learn how to use it. Few experienced technical problems.

    Reporting went quickly, and the app was described as a fast and comfortable way to get support and help. Most patients agreed that the app content was relevant and that the symptoms included in the app covered most symptoms they experienced during their treatment. Only some patients wanted to report symptoms that were not included in the app, such as headache and weight gain.

    Symptom reporting was often described as more meaningful and interesting in the beginning when symptoms were new and there was a feeling of apprehension and insecurity of what the treatment would entail. When symptoms had become a fact of everyday life, reporting them via the app daily did not always feel necessary. A few patients described daily symptom reporting as something they perceived as a negative reminder of illness, especially during times when they felt alright.

    It has been very easy and convenient….The app is easy to use….When you feel ill it is a security, but if you feel good it is a negative reminder that you are sick.
    [BI-10]

    Remembering to report symptoms was sometimes perceived as difficult, particularly when patients felt well. Incorporating or establishing a routine around reporting facilitated recollection, as did the automatic reminder notifications, which were greatly appreciated. Some patients requested the ability to adjust the reporting time according to personal preferences.

    In the breast cancer group, daily reporting could sometimes be stressful and difficult, especially when they felt ill or lacked energy; nevertheless, most patients considered reporting to be more necessary at those times. Furthermore, memory impairment was often described as linked to the cognitive side effects of treatment and some mentioned that graphs were difficult to interpret because the text was too small. In the prostate cancer group, some patients did not notice or use the self-care advice, links, or graphs due to lack of experience with mobile apps or due to forgetfulness. Patients suffering from comorbidities that had symptoms similar to the questions included in the app perceived reporting as difficult to answer, given the available responses.

    Interaction With Health Care Professionals

    Reporting symptoms generated a feeling of having continuous contact with health care professionals. It also created feelings of being safe, monitored, acknowledged, involved, and cared for. Most patients described being called by a nurse after an alert in positive terms and said it decreased the need for contacting the oncological clinic through other channels. They said that it was a great benefit to not have to call, leave a message on the answering machine, be put on hold, or have to search for the right phone number. On a few occasions, patients were not contacted after alerts.

    I felt safe reporting every day....It was excellent….I noticed, before logging off, that I would be called...A huge security….Having the app and a continuous access to help has made me feel better.
    [BI-44]

    In the breast cancer group, some patients expressed that alerts should be monitored and responded to around the clock, and several wanted the possibility to choose themselves whether a nurse should call them. Some preferred calling health care professionals, especially when they felt very ill. A small number of patients in the breast cancer group perceived themselves as nagging or bothering the nurses when alerts were triggered.

    Some patients indicated a wish to continue reporting after the trial period had ended. They described feelings of being alone when the treatment ended, and they no longer met their health care professionals regularly. At that time, the value of symptom reporting was perceived to increase.

    The free text function was generally appreciated and was perceived as useful for reporting additional symptoms and information to the nurse.

    Support for Self-Care

    The patients perceived the app as supportive during their treatments and described symptom reporting in terms of diary keeping. Reporting symptoms encouraged and supported reflection on their well-being and made patients more aware of symptoms and what they should observe for.

    A majority of the patients perceived the self-care advice as valuable, applicable, and informative, especially when a symptom first occurred. The self-care advice gave answers on how to perform self-care to relieve or manage symptoms for themselves. Reading the advice also gave them an idea of what was normal and what they should expect during treatment. There were requests to add more comprehensive information on psychological symptoms and dietary advice. The patients in the breast cancer group described the graphs as useful for comparing symptoms over time and detecting patterns in the symptoms related to the cytotoxic treatment intervals. This could facilitate the planning of activities and enable them to do things during days they felt well. The patients in the prostate cancer group often commented that the graphs enabled them to monitor their well-being by displaying when symptoms increased or decreased and also helped them discern that many days were trouble free.

    It was said about the symptom history graphs—

    It was fun to see that it was getting better… and it trailed with how you perceived to be feeling.
    [PI-187]
    I did not follow them….I want to move on….Now it is just forward ahead.
    [PI-143]

    The patients in the breast cancer group perceived the links as useful for gaining further or in-depth information and support. Patients in the prostate cancer group were more likely to describe the self-care advice, links, and graphs as superfluous when they experienced mild or less persistent symptoms.


    Principal Results

    The findings of this study show that the app was largely used as intended and appreciated by patients undergoing treatment for breast cancer and prostate cancer. The app gave the patients a feeling of assurance by offering a convenient method to contact their health care professionals and the security of being monitored via the symptom reports. Furthermore, the app promoted self-care by facilitating self-monitoring and learning about symptoms.

    In this study, adherence to daily symptom reporting in the app was 83%. This is high in comparison to a review [49] in which it was concluded that around half of participants in web-based health interventions for chronic conditions and lifestyle and mental health management adhered to the interventions. Plausible explanations for the high adherence to the Interaktor app are that the app was interactive and easily available on a smartphone or tablet when compared to a computer-based system. Previous research [49,50] shows that intervention characteristics such as intended usage frequency, updates, and persuasive design increase patients’ adherence to web-based interventions. Moreover, the app may reflect patients’ need for frequent, continuous contact with health care professionals during treatment for cancer [51].

    Most patients perceived the content of the Interaktor app as relevant, and the fact that Interaktor was developed in collaboration with patients and health care professionals is likely to have contributed to this result. Two previous studies [21,26] of the Interaktor app among patients treated for cancer yielded results in line with this study, both in terms of adherence levels above 80% and interviews revealing that patients appreciate and perceive the app as supportive in their symptom management.

    There was a temporal aspect to how patients perceived using the app. At the beginning of treatment, when the situation was new or they experienced a new symptom, daily symptom reporting was considered especially meaningful. Later, as patients became more experienced and familiar with their symptoms, some noted a lower inclination to report each day. Also, patients commented that after some time, as they acquired general knowledge about the disease and treatment, they felt a desire for more individualized and in-depth information than that contained in the app.

    The observation that memory impairment and feeling ill influenced engagement adversely contrasts with a study [52] that showed that increased use of a web-based symptom management system was predicted by higher levels of symptom distress among men with prostate cancer, and it may be of value to investigate the effect of symptom burden on app usage in future studies.

    The interviews indicated that some patients with comorbidities felt the need to add clarifications to responses available in the self-assessment form by free text. This finding warrants further study, considering the expanding community with multiple conditions, and it contrasts somewhat from the findings of a study [52] that showed that increased use of the system was associated with the absence of comorbidities.

    The findings described above are in line with a conceptual model where perceived credibility and personal relevance influence engagement [36]. This study accumulates existing evidence, which imply the need to develop cancer-supportive digital interventions that are interactive and tailored [53]. Tailoring can be performed by the individual patient before the intervention (pretailoring), by preference to promote autonomy (self-tailoring), and within-person as health status or needs evolve [54]. In future technological development of the app, it might be useful to integrate an option for the individual patient to add or exclude symptoms or concerns in the self-assessment component to make it more person-centered. Expanding the interactive features in Interaktor by adding or updating information as patients progress through treatment may also be a way to maintain and enhance patients' experience of personal relevance [36].

    The adjusted R2 values in the regression models in this study were low, indicating that none or only one predictor was correlated to each dependent variable. The only variable tested that predicted usage for both groups was age; higher age predicted a decrease of the total number of free text messages sent in the breast cancer group, while a higher age predicted more self-care advice views in the prostate cancer group. It has previously been suggested that demographic variables may be too broad to indicate usage motives and preferences for mHealth [55]. Higher education level predicted usage in the prostate cancer group, specifically, predicting a higher number of views of self-care advice. Furthermore, in the prostate cancer group, being married or cohabiting predicted higher adherence to daily reporting as intended than that of patients who were single. These findings are in line with theory as well as research suggesting that social support and education level influence the adoption and usage of web-based interventions [17,56]. Both social support and higher education level have been associated with a significant increase in engagement [15].

    In the breast cancer group, it was suggested by patients that they should be responsible for contacting health care professionals. This finding is noteworthy, as it pertains to patients’ sense of control and self-reliance. From the perspective of a review on person-centered participation [57], this may signify a patient with confidence in their own experience-based knowledge and expertise, voicing a willingness for increased responsibility and management of their care. This is an essential precondition if we are to achieve equality and partnership among health care professionals and patients, but it is always preceded by phases of dialogue, knowledge building, and information sharing [57]. Previous studies have demonstrated that being female, having a higher education level, and being younger are predictive for preferring a more active role in care [58,59].

    Strengths and Limitations

    Analysis of usage metrics enables a systematic assessment of, and insight into, patients’ exposure to and behavior throughout an intervention relating to frequency, depth, and breadth of use [17] but cannot disclose how use was perceived [60]. On the other hand, interviews or self-reports are associated with a risk of social desirability and challenges in communication, such as discrepancies in researcher and respondent terminology [60].

    To counteract the limitations of each method, a combination was used in this study. Below are two examples of findings that reinforce how relying on only one source of data to study engagement is not sufficient. In the interviews, patients described aspects that were perceived to influence their engagement, which were not visible in the logged data. Patients stated that remembering to report daily was sometimes difficult, and moreover, patients noted that daily symptom reporting was perceived as more meaningful in the beginning. But the logged data show that adherence to daily symptom reporting is high and stable throughout the time of the intervention as adherence patterns do not decrease markedly over time. Relying on either one of the methods would have resulted in a less comprehensive account of patient engagement.

    It may be a limitation that all the interviews took place after the intervention was completed and collecting data during the intervention as well as afterward may have added additional insights relating to usability and learning [61]. Symptom graphs and self-care advice features went undiscovered by a small number of patients in the significantly older prostate cancer group, indicating that enhanced patient training and further reviews of usability may be profitable in future studies. Research contributing to an understanding of how adherence can be promoted is starting to emerge [50,61,62]. However, a comparison of adherence levels between studies is debatable due to limited consistency in how adherence is reported [37,38]. The results of this study provide valuable knowledge, as it relates both to the patients’ actual usage versus intended use of the intervention and to how the patients thought about using it. The strength of this study consolidating investigations of two distinct patient groups is somewhat limited as the two versions of Interaktor slightly differed. The prostate cancer version of the app was developed and clinically trialed before the planning of this study and did not have the function that automatically prompted reading of specific self-care advice based on symptom reports. It is also a limitation that the use of links and graphs were not logged. Both are, in a sense, reflective of a learning curve in innovation research and will be taken into consideration in forthcoming studies.

    Conclusions

    High patient engagement in the Interaktor app was achieved. Using the app promotes self-care by facilitating self-monitoring and timely advice. Furthermore, it provides assurance through continuous and convenient contact with health care professionals.

    The study supports the notion that interactivity enhances patients’ feelings of personal relevance and thus increases engagement. The predictive ability of demographic variables differed between patient groups, but higher age and a higher educational level predicted the usage of specific app functions for both patient groups.

    Taken together, the findings suggest a role for the use of an interactive app, such as Interaktor, to promote patients' participation in their care. The findings may have relevance for outpatients undergoing other cancer treatments associated with a risk of toxicities.

    Acknowledgments

    The study was supported by grants from Karolinska Institutet; the Swedish Research Council; the Swedish Research Council for Health, Working Life and Welfare; the Swedish Cancer Foundation; the Kamprad Family Foundation for Entrepreneurship, Research and Charity; and the Cancer Research Funds of Radiumhemmet. The authors would like to thank the patients who participated in this study and the health care professionals at the oncology clinics who assisted us. We would also like to thank Health Navigator for technical support and collaboration, and Jan Kowalski, statistician, who provided expertise and support during the statistical analysis process.

    Conflicts of Interest

    None declared.

    1. McKenzie H, Hayes L, White K, Cox K, Fethney J, Boughton M, et al. Chemotherapy outpatients' unplanned presentations to hospital: a retrospective study. Support Care Cancer 2011 Jul;19(7):963-969. [CrossRef] [Medline]
    2. Lai XB, Ching SSY, Wong FKY. A qualitative exploration of the experiences of patients with breast cancer receiving outpatient-based chemotherapy. J Adv Nurs 2017 Oct;73(10):2339-2350. [CrossRef] [Medline]
    3. Hinami K, Alkhalil A, Chouksey S, Chua J, Trick WE. Clinical significance of physical symptom severity in standardized assessments of patient reported outcomes. Qual Life Res 2016 Sep;25(9):2239-2243. [CrossRef] [Medline]
    4. Basch E, Deal AM, Kris MG, Scher HI, Hudis CA, Sabbatini P, et al. Symptom monitoring with patient-reported outcomes during routine cancer treatment: a randomized controlled trial. J Clin Oncol 2016 Feb 20;34(6):557-565. [CrossRef] [Medline]
    5. Kearney N, McCann L, Norrie J, Taylor L, Gray P, McGee-Lennon M, et al. Evaluation of a mobile phone-based, advanced symptom management system (ASyMS) in the management of chemotherapy-related toxicity. Support Care Cancer 2009 Apr;17(4):437-444. [CrossRef] [Medline]
    6. Ruland CM, Andersen T, Jeneson A, Moore S, Grimsbø GH, Børøsund E, et al. Effects of an internet support system to assist cancer patients in reducing symptom distress: a randomized controlled trial. Cancer Nurs 2013;36(1):6-17. [CrossRef] [Medline]
    7. Rincon E, Monteiro-Guerra F, Rivera-Romero O, Dorronzoro-Zubiete E, Sanchez-Bocanegra CL, Gabarron E. Mobile phone apps for quality of life and well-being assessment in breast and prostate cancer patients: systematic review. JMIR Mhealth Uhealth 2017 Dec 04;5(12):e187 [FREE Full text] [CrossRef] [Medline]
    8. Giunti G, Giunta DH, Guisado-Fernandez E, Bender JL, Fernandez-Luque L. A biopsy of Breast Cancer mobile applications: state of the practice review. Int J Med Inform 2018 Feb;110:1-9 [FREE Full text] [CrossRef] [Medline]
    9. Warrington L, Absolom K, Conner M, Kellar I, Clayton B, Ayres M, et al. Electronic systems for patients to report and manage side effects of cancer treatment: systematic review. J Med Internet Res 2019 Jan 24;21(1):e10875 [FREE Full text] [CrossRef] [Medline]
    10. Osborn J, Ajakaiye A, Cooksley T, Subbe CP. Do mHealth applications improve clinical outcomes of patients with cancer? a critical appraisal of the peer-reviewed literature. Support Care Cancer 2020 Mar;28(3):1469-1479 [FREE Full text] [CrossRef] [Medline]
    11. Richards R, Kinnersley P, Brain K, McCutchan G, Staffurth J, Wood F. Use of mobile devices to help cancer patients meet their information needs in non-inpatient settings: systematic review. JMIR Mhealth Uhealth 2018 Dec 14;6(12):e10026 [FREE Full text] [CrossRef] [Medline]
    12. Boulos MNK, Brewer AC, Karimkhani C, Buller DB, Dellavalle RP. Mobile medical and health apps: state of the art, concerns, regulatory control and certification. Online J Public Health Inform 2014;5(3):229 [FREE Full text] [CrossRef] [Medline]
    13. Gomolin A, Lebouché B, Engler K, Vedel I. Optimizing smartphone intervention features to improve chronic disease management: A rapid review. Health Informatics J 2019 Dec 12:1460458219891377. [CrossRef] [Medline]
    14. Doherty K, Doherty G. Engagement in HCI. ACM Comput. Surv 2018 Jan 23;51(5):1-39. [CrossRef]
    15. Perski O, Blandford A, West R, Michie S. Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis. Transl Behav Med 2017 Jun;7(2):254-267 [FREE Full text] [CrossRef] [Medline]
    16. O'Brien HL, Toms EG. What is user engagement? A conceptual framework for defining user engagement with technology. J. Am. Soc. Inf. Sci 2008 Apr 28;59(6):938-955. [CrossRef]
    17. Eysenbach G. The law of attrition. J Med Internet Res 2005;7(1):e11 [FREE Full text] [CrossRef] [Medline]
    18. Olsson L, Jakobsson UE, Swedberg K, Ekman I. Efficacy of person-centred care as an intervention in controlled trials - a systematic review. J Clin Nurs 2013 Feb;22(3-4):456-465. [CrossRef] [Medline]
    19. Frank C, Asp M, Fridlund B, Baigi A. Questionnaire for patient participation in emergency departments: development and psychometric testing. J Adv Nurs 2011 Mar;67(3):643-651. [CrossRef] [Medline]
    20. Langius-Eklöf A, Crafoord M, Christiansen M, Fjell M, Sundberg K. Effects of an interactive mHealth innovation for early detection of patient-reported symptom distress with focus on participatory care: protocol for a study based on prospective, randomised, controlled trials in patients with prostate and breast cancer. BMC Cancer 2017 Jul 04;17(1):466 [FREE Full text] [CrossRef] [Medline]
    21. Gustavell T, Langius-Eklöf A, Wengström Y, Segersvärd R, Sundberg K. Development and feasibility of an interactive smartphone app for early assessment and management of symptoms following pancreaticoduodenectomy. Cancer Nurs 2018 Mar 27:e1-e10. [CrossRef] [Medline]
    22. Göransson C. Developing and evaluating an interactive app to support self-care among older persons receiving home care. Doctoral dissertation. In: Developing and evaluating an interactive app to support self-care among older persons receiving home care. Örebro: Örebro University; 2019.
    23. Blomberg K, Wengström Y, Sundberg K, Browall M, Isaksson A, Nyman MH, et al. Symptoms and self-care strategies during and six months after radiotherapy for prostate cancer - scoping the perspectives of patients, professionals and literature. Eur J Oncol Nurs 2016 Apr;21:139-145. [CrossRef] [Medline]
    24. Sundberg K, Wengström Y, Blomberg K, Hälleberg-Nyman M, Frank C, Langius-Eklöf A. Early detection and management of symptoms using an interactive smartphone application (Interaktor) during radiotherapy for prostate cancer. Support Care Cancer 2017 Feb 24:2195-2204. [CrossRef] [Medline]
    25. Gustavell T, Sundberg K, Frank C, Wengström Y, Browall M, Segersvärd R, et al. Symptoms and self-care following pancreaticoduodenectomy: perspectives from patients and healthcare professionals - Foundation for an interactive ICT application. Eur J Oncol Nurs 2017 Feb;26:36-41. [CrossRef] [Medline]
    26. Langius-Eklöf A, Christiansen M, Lindström V, Blomberg K, Hälleberg Nyman M, Wengström Y, et al. Adherence to report and patient perception of an interactive app for managing symptoms during radiotherapy for prostate cancer: descriptive study of logged and interview data. JMIR Cancer 2017 Oct 31;3(2):e18 [FREE Full text] [CrossRef] [Medline]
    27. Portenoy RK, Thaler HT, Kornblith AB, Lepore JM, Friedlander-Klar H, Kiyasu E, et al. The Memorial Symptom Assessment Scale: an instrument for the evaluation of symptom prevalence, characteristics and distress. Eur J Cancer 1994;30A(9):1326-1336. [Medline]
    28. Egbring M, Far E, Roos M, Dietrich M, Brauchbar M, Kullak-Ublick GA, et al. A mobile app to stabilize daily functional activity of breast cancer patients in collaboration with the physician: a randomized controlled clinical trial. J Med Internet Res 2016 Sep 06;18(9):e238 [FREE Full text] [CrossRef] [Medline]
    29. Beck SL, Eaton LH, Echeverria C, Mooney KH. SymptomCare@Home: developing an integrated symptom monitoring and management system for outpatients receiving chemotherapy. Comput Inform Nurs 2017 Oct;35(10):520-529 [FREE Full text] [CrossRef] [Medline]
    30. Escriva Boulley G, Leroy T, Bernetière C, Paquienseguy F, Desfriches-Doria O, Préau M. Digital health interventions to help living with cancer: a systematic review of participants' engagement and psychosocial effects. Psychooncology 2018 Dec;27(12):2677-2686. [CrossRef] [Medline]
    31. Hernandez Silva E, Lawler S, Langbecker D. The effectiveness of mHealth for self-management in improving pain, psychological distress, fatigue, and sleep in cancer survivors: a systematic review. J Cancer Surviv 2019 Feb;13(1):97-107. [CrossRef] [Medline]
    32. McCann L, Maguire R, Miller M, Kearney N. Patients' perceptions and experiences of using a mobile phone-based advanced symptom management system (ASyMS) to monitor and manage chemotherapy related toxicity. Eur J Cancer Care (Engl) 2009 Mar;18(2):156-164. [CrossRef] [Medline]
    33. Bock M, Moore D, Hwang J, Shumay D, Lawson L, Hamolsky D, et al. The impact of an electronic health questionnaire on symptom management and behavior reporting for breast cancer survivors. Breast Cancer Res Treat 2012 Aug;134(3):1327-1335. [CrossRef] [Medline]
    34. Judson TJ, Bennett AV, Rogak LJ, Sit L, Barz A, Kris MG, et al. Feasibility of long-term patient self-reporting of toxicities from home via the internet during routine chemotherapy. J Clin Oncol 2013 Jul 10;31(20):2580-2585 [FREE Full text] [CrossRef] [Medline]
    35. Berry DL, Hong F, Halpenny B, Partridge A, Fox E, Fann JR, et al. The electronic self report assessment and intervention for cancer: promoting patient verbal reporting of symptom and quality of life issues in a randomized controlled trial. BMC Cancer 2014;14:513 [FREE Full text] [CrossRef] [Medline]
    36. Short C, Rebar A, Plotnikoff R, Vandelanotte C. Designing engaging online behaviour change interventions: a proposed model of user engagement. Health Psychol Rev.: European Health Psychology Society; 2015.   URL: https://www.ehps.net/ehp/index.php/contents/issue/view/ehp.v17.i1/pdf_43 [accessed 2020-07-22]
    37. Sieverink F, Kelders SM, van GJE. Clarifying the concept of adherence to ehealth technology: systematic review on when usage becomes adherence. J Med Internet Res 2017 Dec 06;19(12):e402 [FREE Full text] [CrossRef] [Medline]
    38. Donkin L, Christensen H, Naismith SL, Neal B, Hickie IB, Glozier N. A systematic review of the impact of adherence on the effectiveness of e-therapies. J Med Internet Res 2011;13(3):e52 [FREE Full text] [CrossRef] [Medline]
    39. Early Breast Cancer Trialists' Collaborative Group (EBCTCG). Long-term outcomes for neoadjuvant versus adjuvant chemotherapy in early breast cancer: meta-analysis of individual patient data from ten randomised trials. Lancet Oncol 2018 Jan;19(1):27-39 [FREE Full text] [CrossRef] [Medline]
    40. Van de Wiel M, Dockx Y, Van den Wyngaert T, Stroobants S, Tjalma WAA, Huizing MT. Neoadjuvant systemic therapy in breast cancer: challenges and uncertainties. Eur J Obstet Gynecol Reprod Biol 2017 Mar;210:144-156. [CrossRef] [Medline]
    41. Swain SM. Chemotherapy: updates and new perspectives. Oncologist 2011;16 Suppl 1:30-39 [FREE Full text] [CrossRef] [Medline]
    42. Steenbruggen TG, van Ramshorst MS, Kok M, Linn SC, Smorenburg CH, Sonke GS. Neoadjuvant therapy for breast cancer: established concepts and emerging strategies. Drugs 2017 Aug;77(12):1313-1336. [CrossRef] [Medline]
    43. Nationellt vårdprogram bröstcancer. cancercentrum.se. Stockholm, Sweden: Regional cancercentrum i samverkan; 2020 May 21.   URL: https://www.cancercentrum.se/samverkan/cancerdiagnoser/brost/vardprogram/ [accessed 2019-01-30]
    44. Prostatacancer Nationellt vårdprogram (National Care Program Prostate Cancer). Regionala Cancercentrum i Samverkan. Stockholm, Sweden; 2020 Mar 03.   URL: https://www.cancercentrum.se/samverkan/cancerdiagnoser/prostata/vardprogram/ [accessed 2020-04-01]
    45. Fjell M, Langius-Eklöf A, Nilsson M, Wengström Y, Sundberg K. Reduced symptom burden with the support of an interactive app during neoadjuvant chemotherapy for breast cancer - A randomized controlled trial. Breast 2020 Jun;51:85-93 [FREE Full text] [CrossRef] [Medline]
    46. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis 1987;40(5):373-383. [Medline]
    47. Altman D. Practical statistics for medical research. London: Chapman and Hall; 1990:9780412276309.
    48. Hsieh H, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res 2005 Nov;15(9):1277-1288. [CrossRef] [Medline]
    49. Kelders SM, Kok RN, Ossebaard HC, Van GJEWC. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J Med Internet Res 2012;14(6):e152 [FREE Full text] [CrossRef] [Medline]
    50. Beatty L, Binnion C. A systematic review of predictors of, and reasons for, adherence to online psychological interventions. Int J Behav Med 2016 Dec;23(6):776-794. [CrossRef] [Medline]
    51. Waibel S, Henao D, Aller M, Vargas I, Vázquez M. What do we know about patients' perceptions of continuity of care? a meta-synthesis of qualitative studies. Int J Qual Health Care 2012 Feb;24(1):39-48. [CrossRef] [Medline]
    52. Børøsund E, Cvancarova M, Ekstedt M, Moore SM, Ruland CM. How user characteristics affect use patterns in web-based illness management support for patients with breast and prostate cancer. J Med Internet Res 2013;15(3):e34 [FREE Full text] [CrossRef] [Medline]
    53. Moradian S, Voelker N, Brown C, Liu G, Howell D. Effectiveness of internet-based interventions in managing chemotherapy-related symptoms in patients with cancer: a systematic literature review. Support Care Cancer 2018 Feb;26(2):361-374. [CrossRef] [Medline]
    54. Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med 2016 Nov;51(5):833-842. [CrossRef] [Medline]
    55. Rai A, Chen L, Pye J, Baird A. Understanding determinants of consumer mobile health usage intentions, assimilation, and channel preferences. J Med Internet Res 2013 Aug 02;15(8):e149 [FREE Full text] [CrossRef] [Medline]
    56. Ryan C, Bergin M, Wells JS. Theoretical perspectives of adherence to web-based interventions: a scoping review. Int J Behav Med 2017 Jul 20:17-29. [CrossRef] [Medline]
    57. Thórarinsdóttir K, Kristjánsson K. Patients' perspectives on person-centred participation in healthcare: a framework analysis. Nurs Ethics 2014 Mar;21(2):129-147. [CrossRef] [Medline]
    58. Florin J, Ehrenberg A, Ehnfors M. Clinical decision-making: predictors of patient participation in nursing care. J Clin Nurs 2008 Nov;17(21):2935-2944. [CrossRef] [Medline]
    59. Kolovos P, Kaitelidou D, Lemonidou C, Sachlas A, Sourtzi P. Patients’ perceptions and preferences of participation in nursing care. Journal of Research in Nursing 2016 Mar 08;21(4):290-303. [CrossRef]
    60. Lalmas M, O'Brien H, Yom-Tov E. Measuring User Engagement. Synthesis Lectures on Information Concepts, Retrieval, and Services 2014 Nov;6(4):1-132. [CrossRef]
    61. Alkhaldi G, Hamilton FL, Lau R, Webster R, Michie S, Murray E. The effectiveness of technology-based strategies to promote engagement with digital interventions: a systematic review protocol. JMIR Res Protoc 2015;4(2):e47 [FREE Full text] [CrossRef] [Medline]
    62. Beatty L, Kemp E, Binnion C, Turner J, Milne D, Butow P, et al. Uptake and adherence to an online intervention for cancer-related distress: older age is not a barrier to adherence but may be a barrier to uptake. Support Care Cancer 2017 Jun;25(6):1905-1914. [CrossRef] [Medline]

    ‎
    IQR: interquartile range
    mHealth: mobile technology for health

    Edited by C Gibbons, G Eysenbach; submitted 20.11.19; peer-reviewed by P Innominato, L McCann; comments to author 10.03.20; revised version received 05.05.20; accepted 20.05.20; published 10.08.20

    Copyright

    ©Marie-Therése Crafoord, Maria Fjell, Kay Sundberg, Marie Nilsson, Ann Langius-Eklöf. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 10.08.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.