Published on in Vol 23, No 6 (2021): June

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/27076, first published .
Co-designing a Lifestyle-Focused Text Message Intervention for Women After Breast Cancer Treatment: Mixed Methods Study

Co-designing a Lifestyle-Focused Text Message Intervention for Women After Breast Cancer Treatment: Mixed Methods Study

Co-designing a Lifestyle-Focused Text Message Intervention for Women After Breast Cancer Treatment: Mixed Methods Study

Original Paper

1Consumer Engagement and Codesign Research Hub, School of Health Sciences, Faculty of Medicine and Health, University of Sydney, Sydney, Australia

2Westmead Applied Research Centre, Faculty of Medicine and Health, University of Sydney, Sydney, Australia

3Prevention Research Collaboration, Charles Perkins Centre, University of Sydney, Sydney, Australia

4Department of Physiotherapy, Westmead Hospital, Sydney, Australia

5Westmead Breast Cancer Institute, Westmead Hospital, Sydney, Australia

6Department of Cardiology, Concord Repatriation General Hospital, Sydney, Australia

7Department of Cardiology, Westmead Hospital, Sydney, Australia

8George Institute for Global Health, University of New South Wales, Sydney, Australia

9Centre for Emotional Health, Department of Psychology, Macquarie University, Sydney, Australia

10Research Education Network, Western Sydney Local Health District, Sydney, Australia

Corresponding Author:

Anna Singleton, MSc, BSc(HonsI)

Consumer Engagement and Codesign Research Hub, School of Health Sciences

Faculty of Medicine and Health

University of Sydney

Level 6 Block K Westmead Hospital

Sydney, 2145

Australia

Phone: 61 288908181

Email: anna.singleton@sydney.edu.au


Background: Breast cancer is the most common cancer among women globally. Recovery from breast cancer treatment can be mentally and physically challenging. SMS text message programs offer a novel way to provide health information and support, but few programs are co-designed with consumer representatives.

Objective: This study aims to report the procedures and outcomes of a co-design process of a lifestyle-focused SMS text message program to support women’s mental and physical health after breast cancer treatment.

Methods: We followed an iterative mixed methods two-step process: (1) co-design workshop with consumers and health professionals and researchers to draft text messages and (2) evaluation of message content, which was scored (5-point Likert scale; 1=strongly disagree to 5=strongly agree) for ease of understanding, usefulness, and appropriateness, and readability (Flesch-Kincaid score). Additional free-text responses and semistructured interviews were coded into themes. Messages were edited or deleted based on the evaluations, with consumers’ evaluations prioritized.

Results: In step 1, co-designed text messages (N=189) were semipersonalized, and the main content themes were (1) physical activity and healthy eating, (2) medications and side effects, (3) mental health, and (4) general breast cancer information. In step 2, consumers (n=14) and health professionals and researchers (n=14) provided 870 reviews of 189 messages and found that most messages were easy to understand (799/870, 91.8%), useful (746/870, 85.7%), and appropriate (732/870, 84.1%). However, consumers rated 50 messages differently from health professionals and researchers. On the basis of evaluations, 37.6% (71/189) of messages were deleted, 36.5% (69/189) were edited, and 12 new messages related to fatigue, self-care, and cognition were created. The final 130 text messages had a mean 7.12 (SD 2.8) Flesch-Kincaid grade level and 68.9 (SD 15.5) ease-of-reading score, which represents standard reading ease.

Conclusions: Co-designing and evaluating a bank of evidence-based mental and physical health-themed text messages with breast cancer survivors, health professionals, and researchers was feasible and resulted in a bank of 130 text messages evaluated highly by participants. Some consumer evaluations differed from health professionals and researchers, supporting the importance of co-design.

J Med Internet Res 2021;23(6):e27076

doi:10.2196/27076

Keywords



Background

Breast cancer is the most commonly diagnosed cancer among women globally [1]. More than 2 million women finish active breast cancer treatment (ie, surgery, chemotherapy, or radiotherapy) yearly [1], and many experience treatment-related mental and physical health challenges [2,3]. The 2013 Breast Health Global Initiative consensus statement posits that access to posttreatment information and support should be allocated to all patients [3]. However, there are limited survivorship care services [3]. Existing services usually occur in person, during work hours, or far from home, which increases the financial burden [4] and limits accessibility. Moreover, these services are rarely co-designed with patients [5,6]. Accessible posttreatment health support programs are required.

The Importance of Consumer Co-design

Co-design is the process by which service providers and consumers collaborate to develop meaningful and creative solutions. The benefits of co-design include improved services, provider-consumer interactions, and consumer engagement and experiences [7]. The key to effective co-design is making end-users’ or consumers’ lived experiences central throughout the project’s lifespan [8] because it adds a unique and diverse perspective [8,9]. For example, citizen collaborators can be employed as active members of the research team from study conception to final dissemination [9]. Qualitative data suggest that access to posttreatment health information and support are among breast cancer survivors’ top priorities for service improvement [2,10]. Enlisting breast cancer survivors as co-designers for novel posttreatment services may help place survivors’ priorities at the forefront and strengthen the intervention’s impact.

Co-design and Mobile Health Interventions

Mobile health (mHealth) uses mobile devices such as mobile phones to deliver health services [11]. mHealth interventions delivered by text messages are the most accessible to patients, as they are inexpensive, do not require internet for delivery, and can be sent anytime and anywhere with mobile services [12]. Moreover, text message programs effectively deliver health education to patients [12,13] and are easily co-designed [14]. Co-designed text message programs improved health-promoting behaviors among patients with heart disease [13] and were cost-saving for the health care system compared with traditional delivery methods [15]. A 2015 systematic review revealed that there were no text message interventions for cancer survivors [16]; more recently, there is some evidence that breast cancer survivors find the delivery of health support via text messages acceptable [17,18] and effective for improving adherence to endocrine therapy tablets [19,20] or maintain weight loss [21]. However, no studies reported that the interventions were co-designed and most focused on physical health outcomes, not including mental health messages within the intervention. Therefore, co-designing a text message intervention with women who completed active breast cancer treatment may be an innovative solution to reduce barriers to posttreatment health information and support.

Objectives

This study aims to report the procedures and outcomes of a co-design process of a bank of evidence-based text messages to support women’s mental and physical health after breast cancer treatment. The co-designers were women who completed active breast cancer treatment (consumers and citizen collaborators), health professionals, and researchers. We hypothesize that consumers and citizen collaborators would add value by providing different inputs and evaluations regarding lived experience with breast cancer and the health care system compared with health professionals and researchers.


Study Design

A two-step mixed methods process [14] was used, including consumer representatives and a citizen collaborator (MH) as co-designers (Figure 1). Briefly, (step 1) an initial co-design workshop and (step 2) a structured qualitative text message evaluation and program refinement were conducted from June 2018 to March 2019 at the Westmead Breast Cancer Institute (WBCI), a major public breast cancer institute in New South Wales. WBCI resides within a large tertiary hospital in Western Sydney, Australia, serving a multicultural and diverse socioeconomic population (approximately 2.3 million people in 2016) [22]. The study was approved by the Western Sydney Local Health District Human Research Ethics Committee (AU RED HREC/18/WMEAD/281). All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Written or electronic informed consent was obtained from all the participants.

Figure 1. Study design, including a citizen collaborator throughout.
View this figure

Step 1: Co-design Workshop

The aim of step 1 was to work with consumer representatives, a citizen collaborator, health professionals, and researchers to develop the SMS text message program structure, content themes, and draft text message content.

Participants and Recruitment

Consumers were included if they had completed active breast cancer treatment (surgery, chemotherapy, or radiotherapy) within the past 5 years and did not have distant metastatic disease. Health professionals and researchers were eligible to participate if they were practicing health professionals (eg, medicine, allied health, or nursing) or active researchers with expertise in breast cancer or text message interventions. Consumers (n=3) from a local volunteer association, health professionals (n=8) from WBCI, and researchers (n=5) from 2 universities in Sydney, Australia, were invited via email to participate in a two-hour workshop to develop the program structure and message content. Those who agreed to attend were provided with further instructions regarding the workshop location. A citizen collaborator also reviewed the program structure and developed the message content. The citizen collaborator was aged 29 years, a White woman with lived experience with breast lumpectomy surgery, chemotherapy, radiotherapy, and 1 year of taking endocrine therapy tablets. The citizen collaborator assisted in developing the research idea and provided ongoing feedback throughout the program design.

Co-design Workshop

A two-hour interactive workshop was held on June 5, 2018. The workshop included a 15-minute presentation and semistructured discussion topics, such as the number of text messages delivered per week, if the delivery was one-way (no replies) or two-way (replies allowed), and message content themes. Time was also allocated to draft text message content. After the workshop, the health professionals drafted additional messages. The program structure and message content were discussed with the citizen collaborator before and after the workshop.

Theoretical Basis for Message Content

The text messages were developed based on the behavior change techniques taxonomy by Abraham and Michie [23], which includes the Bandura theory of social learning theory (social cognitive theory) and the information-motivation-behavioral skills model. The theories stipulate that providing information through education and motivation and observing others successfully complete behaviors can promote behavior change [24,25]. Moreover, assisting people in setting attainable goals and identifying barriers and strategies for overcoming barriers can facilitate goal achievement [24]. Table 1 provides examples of message content and corresponding behavior change techniques. In addition, researchers have found that people enjoy supportive personalized messages with a positive tone [26,27]. The messages were co-designed with these user satisfaction principles in mind, including achievable, practical tips and links to trustworthy websites and videos.

Table 1. Example of draft text message content and themes with corresponding behavior change techniques.
Behavior change techniqueExample text message contentMessage theme
Provide information about behavior-health link (IMBa)Fibre in fruit, veggies and wholegrain foods helps you feel full for longer, can improve blood sugars & lower cholesterol - so make sure there’s plenty of fibre in your diet!Nutrition
Provide information on consequences (TRAb, TPBc, SCogTd, or IMB)Research shows that consistent physical activity can help reduce antihormonal (endocrine) tablet side effects - so try to get moving every day but make sure to schedule time to rest!Medication adherence and side effects
Prompt intention formation (TRA, TPB, SCogT, or IMB)Sometimes we can do exercise without noticing - challenge yourself to park the car further away from the shops or your work so you get a few extra steps!Physical activity
Prompt barrier identification (SCogT)Side effects are the main reason why women stop taking their antihormonal (endocrine) tablets - Remember, [pref_name]e, your doctor has prescribed this medication to benefit your health and can help you if side effects are a problem.Medication adherence or side effects
Provide general encouragement (SCogT) Hi [pref_name], you are halfway through the EMPOWER-SMSf program – it’s wonderful that you’re taking a few moments each week to focus on your health and wellbeing - keep it up!General
Set graded tasks (SCogT)Sometimes getting started is the hardest part, [pref_name] - it can be easier to begin exercise at low intensity (walking, stretching) and gradually increase to moderate intensity (faster breathing rate but can still have a conversation)Physical activity
Provide instruction (SCogT)Physical activity is essential for your recovery - World Health Organization recommends at least 30mins of moderate-intensity activity 5days/week - click here for ideas: [insert link here]Physical activity
Model or demonstrate the behavior (SCogT) Some women experience tightness or restricted movement in their shoulder long after treatments have finished - if this is you, the BCIg shoulder care video may help: [insert link here]Physical activity
Prompt specific goal setting (CTh)Hi [pref_name], relaxation and self-care are important - try making a list of 3 things that help you relax so you can include them into your weekSocial or emotional well-being
Prompt self-monitoring of behaviorDo you have trouble sleeping? Consider keeping a sleep diary, it may help you understand what’s impacting your sleep, like TV, lights or stress - see an example here: [insert link here]General
Provide contingent rewards (OCi)Did you take your antihormonal (endocrine) tablet today, [pref_name]? If yes, well done! If not, don’t worry, just take it as soon as you remember - if it’s nearly time to take your next tablet, do not take two at the same time - 1 per day is enoughMedication adherence or side effects
Teach to use prompts or cues (OC)Usually, people serve too much food on a large plate - reducing your plate size can help limit portion sizes and avoid overeating! - [centre_name]Nutrition
Prompt practice (OC)Writing a list of 3 things you’re grateful for each week may change the way you feel – it’s also a nice way to reflect - [centre_name]Social or emotional well-being
Provide opportunities for social comparison (SCompT)Hi [pref_name], having a hard time talking about your breast cancer? Breast Cancer Network Australia has a great web-based forum, where you can read women’s questions and concerns, and you can pose questions, if you want. Here’s the link: onlinenetwork.bcna.org.auSocial or emotional well-being
Plan social support or social change (social support theories)Exercising with a friend can be fun & you can motivate each other - grab a friend and get moving or meet some new friends at a local walking group, find one near you here: [insert link here]Physical activity
Prompt self-talkPracticing positive self-talk is a good way to keep your mind healthy and improve your mood - not sure where to start? Click for more information: [insert link here]Social or emotional well-being
Relapse preventionMaking small changes can make a big difference when it comes to healthy eating - at restaurants look for simple switches like a baked potato instead of chips. Read more tips here: [insert link here]Nutrition
Stress management (stress theories)Mindfulness meditation can help to manage stress and improve mood by focusing on breathing and relaxation techniques - if you’d like to learn more, click here: [insert link here]Social or emotional well-being
Motivational interviewingRemember to be kind to yourself, [pref_name]! Think of 3 things you’re thankful that your body can doGeneral
Time managementTreat yourself to some you time, [pref_name] - whether it’s a walk, yoga or reading a good book, setting aside time in your diary or on your phone can make it easier to stick toSocial or emotional well-being

aIMB: information-motivation-behavioral skills model.

bTRA: theory of reasoned action.

cTPB: theory of planned behavior.

dSCogT: social cognitive theory.

e[pref_name] is a place holder for the auto-population of the participant’s preferred name.

fEMPOWER-SMS: A text message intervention to support women’s mental and physical health after breast cancer treatment.

gBCI: breast cancer institute.

hCT: control theory.

iOC: operant conditioning.

Medical Content of Messages

Medical content was based on personal experiences of health professionals and confirmed using Cancer Australia’s national guidelines for primary prevention of cancer [28], managing menopausal symptoms after breast cancer treatment [29], and emerging breast cancer survivorship literature and systematic reviews.

The authors reviewed all messages (AS, JR, SRP, and RR) before text message evaluation and refinement (step 2). The reasons for deletions were recorded.

Step 2: Text Message Evaluation and Refinement

The aim of step 2 was for consumers, a citizen collaborator, health professionals, and researchers to evaluate the quality of the text message content, refine the messages based on feedback, and evaluate the messages’ ease of reading.

Participants and Recruitment

Consumers (n=16), the citizen collaborator, and health professionals and researchers (n=14) from the WBCI and 2 universities were invited to participate. Consumers were recruited during a medical clinic for one-year postsurgery follow-up appointments. Consumers were approached by their physician if they were an adult (>18 years) woman and completed active breast cancer treatment within the past 3 years (could still be taking endocrine therapy treatment) and were able to provide written informed consent. Consumers were not approached if they had metastatic breast cancer or insufficient English skills to provide informed consent or read and evaluate text messages.

Health professionals and researchers were eligible to participate if they were practicing health professionals (eg, medicine, allied health, or nursing) or active researchers with expertise in breast cancer or text message interventions. Health professionals and researchers known to the research team were invited to participate via email and provided electronic consent via a web-based database.

Text Message Evaluation by Consumers and Health Professionals

A combination of feedback surveys and semistructured interviews were conducted to evaluate the message content. For the feedback surveys, each participant provided basic demographic information regarding age, sex, and expertise (lived experience or health professional or researcher), and then evaluated 32 draft text messages (maximum 15 min) presented as 1 to 2 sentences on paper in a private room (consumers) or via a password-protected web-based database (health professionals or researchers). Owing to time constraints, one health professional evaluated only 16 messages. Message content related to medication adherence and side effects were reviewed by consumers who reported taking endocrine therapy tablets previously or at the time of the study.

The feedback survey contained 4 questions for each draft text message, with three 5-point Likert scale (1=strongly disagree to 5=strongly agree) questions: “This message was easy to understand;” “The information provided in this message is useful;” “This message is appropriate for women with breast cancer” and one free-text response question, “Do you have any suggestions to improve this message?” The Likert scale questions were summarized by the number and percentage of consumers’ or health professionals and researchers’ evaluations that agreed or strongly agreed that the messages were easy to understand, useful, and appropriate. Internal consistency was found among the 3 questions (Cronbach α=.88); therefore, each message received a mean score out of 15 (5 points per question; strongly disagree=1 point, strongly agree=5 points), which was the total score provided by each participant divided by the number of participants that evaluated the message. The mean consumer versus health professional and researcher score was also calculated for each message. Researchers were guided by a mean score <12 out of 15 (<80%), indicating less preference for a message from participants. All message scores and free-text replies were reviewed in parallel to guide message edits or deletions. If consumers and health professionals or researchers’ ratings differed, priority was given to consumers’ evaluations.

Free-text consumer and health professional or researcher evaluations were collated for each message. The citizen collaborator evaluated all messages via free-text feedback. After completing the feedback survey, consumers were invited to brief (10-15 min) semistructured interviews that explored participants’ most and least liked text messages, suggestions for additional message themes, the appropriateness of the language within the messages (too complicated vs too simple), and whether a SMS text message program would have been helpful during the transition from hospital care to health self-management. The interviews were audio-recorded and transcribed verbatim. The free-text feedback and interview transcripts were open-coded using inductive thematic content analysis in NVivo 11 (QSR International) by 2 independent parallel coders (AS and RR). The researchers discussed codes until they reached an agreement on themes. The feedback survey results and interviews were used to inform message refinement (edits, deletions, or creation of new message content).

Evaluation of Readability

All messages were evaluated for readability using the Flesch-Kincaid ease-of-reading score and grade level, which are validated scores of content readability based on the number of words per sentence and syllables per word [30,31]. The Flesch readability score ranges from 0 to 100, with 0 being extremely difficult and 100 being extremely easy to read. Grade levels range from 1 to 12; grade 1 is the easiest, and grade 12 is the hardest to read. The characters and word counts of the text messages were also calculated.


Step 1: Co-design Workshop

Consumers (n=2) and health professionals and researchers (n=4; health psychologist, specialist breast cancer surgeon, physiotherapist and digital health researcher, and psychology researcher) attended the workshop. The group decided that the program would be one-way (no replies) as consumers did not want to feel pressure to reply. Our team’s previous research also showed that one-way messaging was well-liked by patients with heart disease and helped them feel supported [27]. Next, the group decided that the text messages would be delivered randomly 4 times per week, as consumers felt that 1-2 messages were too few to be useful but 6 or 7 would be annoying. In our previous research, 4 messages per week were found to be acceptable [27]. Unlike our team’s previous research, which only delivered messages on weekdays [14], the consumers desired messages to be delivered Monday-Saturday (maximum 1 message per day) because people may have more time to read messages on the weekend. Messages would be delivered at 9 AM, noon, 3 PM, or 6 PM to mimic the unpredictability of how a friend or family member would text and gain insights into future process evaluations as to what times are best. The team decided that 1 message per theme would be delivered per week in random order, as consumers indicated that a specific order was not required. The co-designed message content themes were (1) physical activity and healthy eating, (2) endocrine therapy tablet (medication) adherence and side effects, (3) social and emotional well-being, and (4) general breast cancer information. Moreover, participants wanted messages to contain links to trustworthy websites because it can be challenging to navigate cancer information on the web. It was also agreed that the program would be semipersonalized according to the participants’ preferred name or nickname, and there would be specific messages for participants taking endocrine therapy tablets because these tablets can cause challenging side effects and medication nonadherence [32].

A total of 274 messages were co-designed; 157 messages were drafted during the workshop, and 117 were created by the authors, including the citizen collaborator, after the workshop. The citizen collaborator’s content subtheme ideas included posttreatment financial support, difficulties returning to work (fatigue, treatment side effects, or cognitive load), and practical solutions for medication side effects. After revision of the messages by authors AS, JR, SRP, and RR, 189 co-designed messages remained for evaluation in step 2. Reasons for deletion included repetitive ideas or content (65/274, 24%), negative message tone (11/274, 4%), and message content not being relevant to breast cancer survivors (9/274, 4%)

Step 2: Text Message Content Evaluation

Participants

Consumers (14/16, 87.5%) and health professionals or researchers (14/14, 100%) completed the message evaluation; 2 consumers (2/16, 12.5%) did not return their surveys and were not included in the analyses. The mean age of consumers was 60 (SD 10) years, and the mean age of health professionals or researchers was 46 (SD 8) years. Most participants were White (12/14, 86% of consumers; 12/14, 86% of health professionals or researchers) women (14/14, 100% of consumers; 12/14, 86% of health professionals or researchers).

Consumer and Health Professional Evaluation

The 189 co-designed text messages were evaluated 870 times: 443 times by consumers, and 427 times by health professionals or researchers (mean 2.34 consumer and 2.26 health professional evaluations per message). Overall, participants agreed or strongly agreed that the messages were clear (799/870, 91.8%), useful (746/870, 85.7%), and appropriate (732/870, 84.1%). Most messages (156/189, 82.5%) received a mean score of ≥12 out of 15 from consumers (153/189, 80.9%) and health professionals (156/189, 82.5%). However, 50 messages received a different mean score from consumers versus health professionals or researchers; 25 were evaluated highly by consumers (mean score ≥12/15, 80%) but not health professionals or researchers, and the other 25 were evaluated poorly by consumers (mean score <12/15, 80%). Examples of discrepant evaluation scores and free-text feedback are presented in Table 2. The number of free-text responses was similar between health professionals (n=150) and consumers (n=156), suggesting that the media on which they conducted the surveys (in person vs on the web) did not bias the feedback. Free-text feedback themes from health professionals or researchers (n=14) focused on grammar, technical terms, and adding web links. Consumers’ (n=14) free-text feedback focused on personal experiences and increased positivity in messages.

Table 2. Example text messages and decisions based on discrepant consumers’ versus health professionals and researchers’ mean ratings (out of 15) and supporting feedback quotes.
Message themes and subthemesDecision
General breast cancer information

Returning to work


“Hi [preferred name], returning to work can be difficult - some women have found it helpful to openly discussing their needs and working arrangements with their managers so that everyone is on the same page”
  • Consumers’ mean rating 10/15 (67%): “Work were not helpful and sick leave all used up - refused flexible work and had to feel guilty. Head of [Human Resources] however was supportive, not line manager and above” (female, age 65 years)
  • Health professional and researchers’ mean rating 12/15 (80%): “wording change after managers ‘discussing’ to discuss eg: ‘so a plan can be made’ or just stop after managers” (female, age 62 years)

Deleted

Link to web-based breast cancer fact sheets or resources


“Did you know that the Breast Cancer Network Australia provides a variety of kits, booklets and fact sheets where you can find more information? Check it out: [insert link]”
  • Consumers’ mean rating 13.5/15 (90%): “helpful” (female, age 65 years)
  • Health professionals and researchers’ mean rating 11/15 (73%): “All patients with breast cancer get this information at the time of their diagnosis” (female, age 54 years)

Edited
Medication adherence and side effects

Hot flushes


“If you are experiencing hot flushes at night, give a cool shower right before bed a go and see if that helps!”
  • Consumers’ mean rating 12/15 (80%): “aware this is a side effect especially of hormonal treatment” (female, age 65 years)
  • Health professionals and researchers’ mean rating 10/15 (67%): “‘Have a cold shower’ I’m not sure that cold showers will be popular??” (Male, age 51 years); “‘Wording not good – suggest’...taking a cool shower just before going to bed might help’ or something similar” (female, age 54 years)

Deleted
Physical activity

Counting steps


“Apps, watches or other step counters can help with tracking your steps each day - The World Health Organisation recommends 10,000 steps per day. How many do you usually do [preferred name]?”
  • Consumers’ mean rating 11.5/15 (77%): “While the message is clear, I don’t think I need to receive it. Messages like these are not personal and supportive. Just that not everyone has apps, younger generation like my daughter does, with her fitbit she tracks steps. I don’t have one. A message like 30 mins (walking) of exercise 3-5x a week is recommended, how often do you exercise” (female, age 45 years)
  • Health professionals and researchers’ mean rating 15/15 (100%): “should there be a link [or] reasoning why useful for [Breast Cancer Institute] patient” (female, age 38 years)

Deleted. Consumer’s suggestion is referring to another message she evaluated, which is included in the final message bank.
Nutrition

Portion sizes


“Hey [preferred name], some people eat too much of a good thing. As a general rule - it\'s good to keep portion sizes around the size of your fist”
  • Consumers’ mean rating 13.5/15 (90%): “Good information” (female, age 50 years)
  • Health professional and researchers’ mean rating 11.5/15 (77%): “Could delete. Fruit and veg portions is larger than fist” (female, age 31 years)

Edited
Social and emotional well-being

Setting goals for self-care


“Hi [preferred name], setting aside time for yourself in your diary or on your phone can make it easier to stick to - whether it’s a walk, yoga or just reading a good book, treat yourself to some \'you\' time”
  • Consumers’ mean rating 12.33/15 (82%): “resources need to be more available. [they are] not always in a prominent place. These resources would have helped - had to really search.” (female, age 65 years)
  • Health professionals and researchers’ mean rating 10/15 (67%): “This message seems too busy. I would simplify. Maybe make into 2 messages as you are tapping into 2 different ideas: regular practice and ‘me time’. I would separate.” (female, age 55 years)

Edited

Oral interview feedback from consumers (n=3) and free-text feedback from the citizen collaborator revealed three important themes for consideration in message refinement: prevention of loneliness, impacts of treatment and medication side effects, and motivation to exercise. Example quotes for each theme are presented in Textbox 1. Feedback also revealed that the term journey was polarizing. For example, a consumer stated, “Many women don’t like the word journey. Could use breast cancer experiences instead” (female, age 41 years), and a health professional’s feedback mirrored this sentiment: “some people don’t like the word journey, maybe consider alternative eg experience” (female, age 62 years). Therefore, journey was replaced with the term experience throughout. Consumers also felt that messages relating to alcohol and cooking food on a barbeque were not appropriate in some cultures. For example, a consumer stated, “I heard the BBQ is not good for cancer people because when protein and oil getting burnt...burnt food is no good for cancer” and later explained, “here is one about limit[ing] alcohol. It’s a good message but some people when they read that message, even they don’t want to drink alcohol. Some people read it and they might think ‘oh maybe I can drink alcohol’” (consumer, female, age 50 years). All messages about alcohol were deleted, and the word BBQ was replaced with a suggestion to bake the food.

Consumer and citizen collaborator message content themes and quotes.

Theme 1: Prevention of Loneliness and Isolation

The messages [that] give information, give some encouragement because after treatment, I stayed home and I felt very lonely.
[Consumer, female, age 50 years]

Theme 2: Impact of Side Effects

I was slowly recuperating pretty good, but I’m still not over it yet, it’s been over 12 months...Tiredness, sometimes I can’t do housework.
[Consumer, female, age 76 years]
Fatigue was huge. And it would always hit you sort of 2, 3 o’clock in the afternoon.
[Consumer, female, age 56 years]

Theme 3: Motivation for Exercise

have an exercise buddy or just a friend that you meet to go and have a walk with or walk your dog...just go I’m meeting so and so and we’re going to do this today, and it’s like keeping an appointment
[Consumer, female, age 56 years]
[My smartwatch] counted the amount of steps I did every day...so it would tell me how many kilometres I had done. It gives you this sense of achievement at the end of the week.
[Consumer, female, age 56 years]
One thing you could add is a reminder that finding time to exercise and eat healthy can be really hard when you struggle with fatigue, but that it will actually help give you more energy.
[Citizen collaborator, female, age 30 years]
after operation...it’s been 3 years...but still pain and the scar is hard. When I’m moving it feels hard [tight]. The doctor said more exercises, stretch and do some physical therapy.
[Consumer, female, age 50 years]
Textbox 1. Consumer and citizen collaborator message content themes and quotes.

On the basis of the feedback (Likert scale, free-text questions, and interviews), 36.5% (69/189) of messages were edited, 37.6% (71/189) were deleted (score <12 or repetitive concept), and 12 new messages were created; 130 evidence-based, co-designed messages remained: 55.4% (72/130) of messages relating to the theme of physical activity and healthy eating, 29.2% (38/130) regarding social and emotional well-being, 32.3% (42/130) regarding general breast cancer information, and 28.5% (37/130) regarding medication adherence and side effects. Subthemes from step 1, such as financial support and practical solutions for side effects (fatigue, hot flushes, and cognitive load), were included within these four broader themes.

Readability

The 130 text messages had a mean Flesch-Kincaid grade level of 7.12 (SD 2.84) and an ease-of-reading score of 68.92 (SD 15.46), representing standard reading ease, which means that the texts will be easy to read for anyone with grade (or year) 7 education and higher [31]. The text messages had a mean of 2.02 (SD 0.69) sentences, 29.09 (SD 6.72) words, or 132.74 (SD 31.69) characters.


Principal Findings

This study reports the outcomes of a co-design process [14] and the development of a bank of evidence-based text messages. To our knowledge, this is the first SMS text message intervention to be co-designed by breast cancer survivors, a citizen collaborator, health professionals, and researchers, and includes both mental and physical health messages. The message content was combined with clinical guidelines [28] and behavior change techniques [23]. Messages were evaluated highly for ease of understanding, usefulness, and appropriateness for breast cancer survivors by consumers, health professionals, and researchers. Although there were discrepancies between some consumers’ and health professionals and researchers’ mean message ratings, the consumers’ feedback was prioritized to ensure that their voices were at the forefront of the co-design process. Compared with the initial bank of draft text messages (n=274), the resulting 130 evidence-based co-designed text messages were evaluated highly (score ≥12/15, 80% and positive qualitative feedback) by participants and focused on topics of interest to consumers—namely, social and emotional well-being, healthy eating, physical activity, medication adherence, side effects, and general breast cancer information. Overall, this iterative co-design process was feasible, produced an improved final text message bank, and highlighted the importance of consumer co-design.

SMS text message interventions are becoming increasingly popular as mHealth strategies [33]. However, there is sparse research on women with breast cancer [16-21], and few programs describe the process of text message content development [34]. For example, health literacy is often overlooked or not reported in the development of eHealth programs [35]. In this study, messages were short and rated highly for ease of understanding, which is supported by the Flesch-Kincaid grade level 7 and readability score (SD 68.9). These scores indicate that anyone with an education grade of 7 or above would likely understand the messages [31], which may reduce health literacy barriers [30] and increase user acceptability [27]. Moreover, health professionals, researchers, and consumers feedback revealed that a positive message tone was important, which is consistent across studies [27,36]. Recent systematic reviews reveal that message tailoring and personalization may [37] or may not [38] improve program efficacy, and message content does not need to be based on a theoretical framework to be effective [38]. Qualitative results suggest that it may be the overall impact of the program rather than a single program component that end users find helpful [27]. However, for adequate comparison across interventions, the development of message content should be clearly reported [37,38]. Factors including the co-design strategy, behavior change theories, readability, and message personalization can help elucidate what makes an effective and well-liked intervention.

This study also provides a framework for developing and implementing SMS text message programs with consumers’ voices at the forefront. Previous studies have developed and refined messages with health professionals, and consumers reviewed the edited messages [14,39]. This strategy may miss message topics or lived experiences important to consumers and limit program and delivery impact. Conversely, this study simultaneously involved consumers and a citizen collaborator with health professionals and researchers throughout the message development, review, and refinement. Moreover, all participants (consumers, a citizen collaborator, health professionals, and researchers) reviewed the same initial messages and were provided equal opportunity for opinions; furthermore, we prioritized consumer ratings when refining messages. Research shows that developing programs with consumers and citizen collaborators can improve user acceptance and engagement [7,9], which may explain the high rating of message usefulness and acceptability from both consumers and health professionals and researchers in this study. However, an ongoing challenge is to provide adequate compensation to consumers for their involvement and efforts. The National Health and Medical Research Council recently released guidelines for the involvement of consumers in research, which suggest that consumer reimbursement (financial, authorship, or acknowledgment) should be considered when planning a project or applying for grants [40]. These guidelines may help future researchers to identify barriers and enablers in consumer co-design.

Implications for Practice

The proliferation of breast cancer survivors is a testament to improvement in treatment [1]. However, women’s mental health can be impacted years after a breast cancer diagnosis [41,42] and increase the urgency for ongoing supportive care. There is evidence that eHealth self-management programs during cancer treatment can reduce women’s distress and depression [43,44]. However, few programs address the mental health concerns that arise after treatment [45]. In fact, many text message programs focus on improving physical behaviors such as physical activity, healthy eating, smoking cessation, and medication adherence [34]. However, previous research shows that mental and physical health are closely related and that consumers desire mental health information [5,46,47]. This program endeavored to fill this gap by co-designing messages for mental health after breast cancer treatment. The consumer feedback from this study provided further evidence that loneliness and treatment side effects are ongoing concerns that may impact mental health. This world-first co-designed program for breast cancer survivors may therefore add to current posttreatment support services by offering an overall lifestyle-focused approach, including both mental and physical health promotion.

Although the study provides new evidence for the co-design of SMS text message interventions for breast cancer survivors, it has some limitations. The number of consumers was relatively small, and most were White, which may not be generalizable to the priorities of the wider breast cancer community. However, cultural considerations, such as alcohol intake and cooking styles, were considered in the message evaluations and refinements. Consumers were recruited from WBCI, which services a large (about 2.3 million) multilingual and socioeconomically diverse population in Western Sydney. Half (49%) of the Western Sydney population speak a non-English language at home, including 8.5% who reported speaking English not well or not at all [22]. It is possible that the requirement to read and understand English limited some people from participating. However, this study demonstrates that the co-design process is acceptable and can be easily replicated in other populations or languages. To increase the diversity and number of message reviewers, future research should provide videoconference options for co-design workshops and web-based options for text message evaluation surveys, where possible and allowable through ethics. Reducing access barriers will allow women from distant or rural communities to offer important inputs. Moreover, the final text message bank will be evaluated in a randomized controlled trial and process evaluation [48]. A diverse sample of 160 women will be recruited to provide feedback via a questionnaire and focus groups to elucidate the feasibility and acceptability of the message content and overall one-way program within the wider breast cancer community.

Conclusions

Consumers, a citizen collaborator, health professionals, and researchers successfully co-designed a set of 130 evidence-based lifestyle-focused text messages to support women’s health after breast cancer treatment. The co-design process resulted in an improved final bank of text messages and highlighted the importance of involving consumers as equal co-designers. This process can easily be replicated to develop SMS text message interventions for other patient populations.

Acknowledgments

The authors thank the breast cancer consumer representatives from the Breast Cancer Network Australia and WBCI and all staff and patients at the WBCI for their involvement in the study. A special thanks to the consumer representatives Christine Mitchell and Fiona Neill. Thanks to the Westmead Applied Research Center staff members for their research support, especially Caroline Wu. AS had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

No project funding was received for this study, but several team members were supported by scholarships and fellowships. AS is supported by the University of Sydney’s Research Training Program Scholarship and the Westmead Applied Research Center Supplementary Postgraduate Research Scholarship in Breast Cancer. SRP is supported by a National Health and Medical Research Council Early Career Fellowship (APP1157438) and National Heart Foundation Postdoctoral Fellowship (HF102164). KKH is supported by a National Heart Foundation Postdoctoral Fellowship (HF 102138). JR is supported by the National Health and Medical Research Council Career Development Fellowship (APP1143538). CKC is supported by a Career Development Fellowship level 2 cofunded by the National Health and Medical Research Council and National Heart Foundation Future Leader Award (APP1105447). The data that support the findings of this study are available from the corresponding author (AS) upon reasonable request.

Authors' Contributions

AS, JR, SRP, EE, and MH contributed to the study conception and design. AS and RR supported the details of recruitment, data collection, and analyses of the results. AS, JR, SRP, and RR drafted the manuscript. All authors supported the text message development, intervention design, commented on previous versions of the manuscript and have read and approved the final manuscript.

Conflicts of Interest

None declared.

  1. Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 2018 Nov;68(6):394-424 [FREE Full text] [CrossRef] [Medline]
  2. Fiszer C, Dolbeault S, Sultan S, Brédart A. Prevalence, intensity, and predictors of the supportive care needs of women diagnosed with breast cancer: a systematic review. Psychooncology 2014 Apr;23(4):361-374. [CrossRef] [Medline]
  3. Ganz P, Yip C, Gralow J, Distelhorst S, Albain K, Andersen B, et al. Supportive care after curative treatment for breast cancer (survivorship care): resource allocations in low- and middle-income countries. A Breast Health Global Initiative 2013 consensus statement. Breast 2013 Oct;22(5):606-615. [CrossRef] [Medline]
  4. Miedema B, Easley J. Barriers to rehabilitative care for young breast cancer survivors: a qualitative understanding. Support Care Cancer 2012 Jun;20(6):1193-1201. [CrossRef] [Medline]
  5. Mead KH, Raskin S, Willis A, Arem H, Murtaza S, Charney L, et al. Identifying patients' priorities for quality survivorship: conceptualizing a patient-centered approach to survivorship care. J Cancer Surviv 2020 Dec;14(6):939-958. [CrossRef] [Medline]
  6. Nekhlyudov L, Mollica M, Jacobsen P, Mayer D, Shulman L, Geiger A. Developing a Quality of Cancer Survivorship Care Framework: Implications for Clinical Care, Research, and Policy. J Natl Cancer Inst 2019 Nov 01;111(11):1120-1130 [FREE Full text] [CrossRef] [Medline]
  7. Steen M, Manschot M, De KN. Benefits of co-design in service design projects. Int J Design 2011;5(2) [FREE Full text]
  8. Tsianakas V, Robert G, Maben J, Richardson A, Dale C, Griffin M, et al. Implementing patient-centred cancer care: using experience-based co-design to improve patient experience in breast and lung cancer services. Support Care Cancer 2012 Nov;20(11):2639-2647 [FREE Full text] [CrossRef] [Medline]
  9. Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, et al. Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect 2014 Oct;17(5):637-650 [FREE Full text] [CrossRef] [Medline]
  10. Tsianakas V, Maben J, Wiseman T, Robert G, Richardson A, Madden P, et al. Using patients' experiences to identify priorities for quality improvement in breast cancer care: patient narratives, surveys or both? BMC Health Serv Res 2012 Aug 22;12:271 [FREE Full text] [CrossRef] [Medline]
  11. Martínez-Pérez B, de la Torre-Díez I, López-Coronado M. Mobile health applications for the most prevalent conditions by the World Health Organization: review and analysis. J Med Internet Res 2013 Jun 14;15(6):e120 [FREE Full text] [CrossRef] [Medline]
  12. Cole-Lewis H, Kershaw T. Text messaging as a tool for behavior change in disease prevention and management. Epidemiol Rev 2010;32:56-69 [FREE Full text] [CrossRef] [Medline]
  13. Chow CK, Redfern J, Hillis GS, Thakkar J, Santo K, Hackett ML, et al. Effect of Lifestyle-Focused Text Messaging on Risk Factor Modification in Patients With Coronary Heart Disease: A Randomized Clinical Trial. JAMA 2015;314(12):1255-1263. [CrossRef] [Medline]
  14. Redfern J, Thiagalingam A, Jan S, Whittaker R, Hackett ML, Mooney J, et al. Development of a set of mobile phone text messages designed for prevention of recurrent cardiovascular events. Eur J Prev Cardiol 2014 Apr;21(4):492-499. [CrossRef] [Medline]
  15. Burn E, Nghiem S, Jan S, Redfern J, Rodgers A, Thiagalingam A, et al. Cost-effectiveness of a text message programme for the prevention of recurrent cardiovascular events. Heart 2017 Jun;103(12):893-894. [CrossRef] [Medline]
  16. Goode AD, Lawler SP, Brakenridge CL, Reeves MM, Eakin EG. Telephone, print, and Web-based interventions for physical activity, diet, and weight control among cancer survivors: a systematic review. J Cancer Surviv 2015 Dec;9(4):660-682. [CrossRef] [Medline]
  17. M Quintiliani L, Mann DM, Puputti M, Quinn E, Bowen DJ. Pilot and Feasibility Test of a Mobile Health-Supported Behavioral Counseling Intervention for Weight Management Among Breast Cancer Survivors. JMIR Cancer 2016 May 09;2(1):e4 [FREE Full text] [CrossRef] [Medline]
  18. Job JR, Spark LC, Fjeldsoe BS, Eakin EG, Reeves MM. Women's Perceptions of Participation in an Extended Contact Text Message-Based Weight Loss Intervention: An Explorative Study. JMIR Mhealth Uhealth 2017 Feb 27;5(2):e21 [FREE Full text] [CrossRef] [Medline]
  19. Mougalian SS, Epstein LN, Jhaveri AP, Han G, Abu-Khalaf M, Hofstatter EW, et al. Bidirectional text messaging to monitor endocrine therapy adherence and patient-reported outcomes in breast cancer. JCO Clin Cancer Inform 2017 Nov;1:1-10 [FREE Full text] [CrossRef] [Medline]
  20. Hershman DL, Unger JM, Hillyer GC, Moseley A, Arnold KB, Dakhil SR, et al. Randomized Trial of Text Messaging to Reduce Early Discontinuation of Adjuvant Aromatase Inhibitor Therapy in Women With Early-Stage Breast Cancer: SWOG S1105. J Clin Oncol 2020 Jul 01;38(19):2122-2129. [CrossRef] [Medline]
  21. Spark LC, Fjeldsoe BS, Eakin EG, Reeves MM. Efficacy of a Text Message-Delivered Extended Contact Intervention on Maintenance of Weight Loss, Physical Activity, and Dietary Behavior Change. JMIR Mhealth Uhealth 2015 Sep 15;3(3):e88 [FREE Full text] [CrossRef] [Medline]
  22. Hamilton O. Cultural and Linguistic Diversity in Greater Western Sydney. WESTIR Ltd. 2016.   URL: https://www.westir.org.au/new/images/CALDOCC.pdf [accessed 2021-04-07]
  23. Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med 2013 Aug;46(1):81-95. [CrossRef] [Medline]
  24. Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev 1977 Mar;84(2):191-215. [CrossRef] [Medline]
  25. Strecher VJ, DeVellis BM, Becker MH, Rosenstock IM. The role of self-efficacy in achieving health behavior change. Health Educ Q 1986;13(1):73-92. [CrossRef] [Medline]
  26. Bock BC, Heron KE, Jennings EG, Magee JC, Morrow KM. User preferences for a text message-based smoking cessation intervention. Health Educ Behav 2013 Apr;40(2):152-159. [CrossRef] [Medline]
  27. Redfern J, Santo K, Coorey G, Thakkar J, Hackett M, Thiagalingam A, et al. Factors influencing engagement, perceived usefulness and behavioral mechanisms associated with a text message support program. PLoS One 2016 Oct 14;11(10):e0163929 [FREE Full text] [CrossRef] [Medline]
  28. Position Statement - Lifestyle Risk Factors and the Primary Prevention of Cancer. Australian Government - Cancer. 2015.   URL: https:/​/www.​canceraustralia.gov.au/​publications-and-resources/​position-statements/​lifestyle-risk-factors-and-primary-prevention-cancer [accessed 2021-05-21]
  29. Cancer Australia. Managing Menopausal Symptoms After Breast Cancer - A Guide for Women Second Edition. Cancer Australia Publications. 2016.   URL: https://tinyurl.com/4h63p4d6 [accessed 2021-05-21]
  30. Williamson J, Martin A. Analysis of patient information leaflets provided by a district general hospital by the Flesch and Flesch-Kincaid method. Int J Clin Pract 2010 Dec;64(13):1824-1831. [CrossRef] [Medline]
  31. Flesch R. A new readability yardstick. J Appl Psychol 1948 Jun;32(3):221-233. [CrossRef] [Medline]
  32. Brett J, Fenlon D, Boulton M, Hulbert-Williams N, Walter F, Donnelly P, et al. Factors associated with intentional and unintentional non-adherence to adjuvant endocrine therapy following breast cancer. Eur J Cancer Care (Engl) 2018 Jan;27(1):e12601 [FREE Full text] [CrossRef] [Medline]
  33. Kannisto KA, Koivunen MH, Välimäki MA. Use of mobile phone text message reminders in health care services: a narrative literature review. J Med Internet Res 2014 Oct 17;16(10):e222 [FREE Full text] [CrossRef] [Medline]
  34. Hall AK, Cole-Lewis H, Bernhardt JM. Mobile text messaging for health: a systematic review of reviews. Annu Rev Public Health 2015 Mar 18;36:393-415 [FREE Full text] [CrossRef] [Medline]
  35. Cheng C, Beauchamp A, Elsworth GR, Osborne RH. Applying the electronic health literacy lens: systematic review of electronic health interventions targeted at socially disadvantaged groups. J Med Internet Res 2020 Aug 13;22(8):e18476 [FREE Full text] [CrossRef] [Medline]
  36. Ranney M, Choo E, Cunningham R, Spirito A, Thorsen M, Mello M, et al. Acceptability, language, and structure of text message-based behavioral interventions for high-risk adolescent females: a qualitative study. J Adolesc Health 2014 Jul;55(1):33-40 [FREE Full text] [CrossRef] [Medline]
  37. Head K, Noar S, Iannarino N, Harrington NG. Efficacy of text messaging-based interventions for health promotion: a meta-analysis. Soc Sci Med 2013 Nov;97:41-48 [FREE Full text] [CrossRef] [Medline]
  38. Armanasco A, Miller Y, Fjeldsoe B, Marshall A. Preventive Health Behavior Change Text Message Interventions: A Meta-analysis. Am J Prev Med 2017 Mar;52(3):391-402. [CrossRef] [Medline]
  39. Fletcher R, May C, Wroe J, Hall P, Cooke D, Rawlinson C, et al. Development of a set of mobile phone text messages designed for new fathers. J Reproduct Infant Psychol 2016 Aug 9;34(5):525-534. [CrossRef]
  40. Statement on Consumer and Community Involvement in Health and Medical Research. National Health and Medical Research Centre. 2016.   URL: https:/​/www.​nhmrc.gov.au/​about-us/​publications/​statement-consumer-and-community-involvement-health-and-medical-research [accessed 2021-04-05]
  41. Maass S, Roorda C, Berendsen A, Verhaak P, de Bock GH. The prevalence of long-term symptoms of depression and anxiety after breast cancer treatment: A systematic review. Maturitas 2015 Sep;82(1):100-108 [FREE Full text] [CrossRef] [Medline]
  42. Zainal NZ, Nik-Jaafar NR, Baharudin A, Sabki ZA, Ng CG. Prevalence of depression in breast cancer survivors: a systematic review of observational studies. Asian Pac J Cancer Prev 2013 Apr 30;14(4):2649-2656 [FREE Full text] [CrossRef] [Medline]
  43. Kim SC, Shaw BR, Shah DV, Hawkins RP, Pingree S, McTavish FM, et al. Interactivity, Presence, and Targeted Patient Care: Mapping e-Health Intervention Effects Over Time for Cancer Patients with Depression. Health Commun 2019 Feb;34(2):162-171 [FREE Full text] [CrossRef] [Medline]
  44. Lally RM, Kupzyk KA, Bellavia G, Hydeman J, Gallo S, Helgeson VS, et al. CaringGuidance™ after breast cancer diagnosis eHealth psychoeducational intervention to reduce early post-diagnosis distress. Support Care Cancer 2020 May;28(5):2163-2174 [FREE Full text] [CrossRef] [Medline]
  45. Willems RA, Mesters I, Lechner L, Kanera IM, Bolman CA. Long-term effectiveness and moderators of a web-based tailored intervention for cancer survivors on social and emotional functioning, depression, and fatigue: randomized controlled trial. J Cancer Surviv 2017 Dec;11(6):691-703 [FREE Full text] [CrossRef] [Medline]
  46. Thakkar J, Redfern J, Thiagalingam A, Chow CK. Patterns, predictors and effects of texting intervention on physical activity in CHD - insights from the TEXT ME randomized clinical trial. Eur J Prev Cardiol 2016 Nov;23(17):1894-1902. [CrossRef] [Medline]
  47. Ohrnberger J, Fichera E, Sutton M. The relationship between physical and mental health: A mediation analysis. Soc Sci Med 2017 Dec;195:42-49 [FREE Full text] [CrossRef] [Medline]
  48. Singleton A, Partridge SR, Raeside R, Regimbal M, Hyun KK, Chow CK, et al. A text message intervention to support women's physical and mental health after breast cancer treatments (EMPOWER-SMS): a randomised controlled trial protocol. BMC Cancer 2019 Jul 04;19(1):660. [CrossRef] [Medline]


mHealth: mobile health
WBCI: Westmead Breast Cancer Institute


Edited by R Kukafka; submitted 10.01.21; peer-reviewed by M Bientzle, A Bermon, J Job, R Brar Prayaga; comments to author 17.03.21; revised version received 07.04.21; accepted 06.05.21; published 14.06.21

Copyright

©Anna Singleton, Rebecca Raeside, Stephanie R Partridge, Molly Hayes, Katherine Maka, Karice K Hyun, Aravinda Thiagalingam, Clara K Chow, Kerry A Sherman, Elisabeth Elder, Julie Redfern. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 14.06.2021.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.