This paper is in the following e-collection/theme issue:

e-Learning and Digital Medical Education (705) Registered Report (579) Web-based and Mobile Health Interventions (3358) Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (1566) Nursing (101) Occupational Health and Ergonomics/Prevention at the Workplace (241)

Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/43771, first published .
Implementation of a Web-Based Resilience Enhancement Training for Nurses: Pilot Randomized Controlled Trial

Implementation of a Web-Based Resilience Enhancement Training for Nurses: Pilot Randomized Controlled Trial

Implementation of a Web-Based Resilience Enhancement Training for Nurses: Pilot Randomized Controlled Trial

Authors of this article:

Catherine Henshall1, 2 Author Orcid Image ;   Zoe Davey1 Author Orcid Image ;   Cynthia Srikesavan1 Author Orcid Image ;   Liam Hart2 Author Orcid Image ;   Dan Butcher1 Author Orcid Image ;   Andrea Cipriani3 Author Orcid Image
Article Authors Cited by (9) Tweetations (13) Metrics

    Original Paper

    1Oxford Institute for Nursing, Midwifery and Allied Health Research, Oxford Brookes University, Oxford, United Kingdom

    2Research and Development, Oxford Health NHS Foundation Trust, Oxford, United Kingdom

    3Department of Psychiatry, University of Oxford, Oxford, United Kingdom

    Corresponding Author:

    Catherine Henshall, RN, MA, MN, PhD

    Oxford Institute for Nursing, Midwifery and Allied Health Research

    Oxford Brookes University

    Headington Campus

    Marston Road Site

    Oxford, OX3 0FL

    United Kingdom

    Phone: 44 7778 428994

    Email: chenshall@brookes.ac.uk


    Background: Global workforce challenges faced by health care providers are linked to low levels of job satisfaction, recruitment, retention, and well-being, with detrimental impacts on patient care outcomes. Resilience-building programs can provide support for staff who endure highly stressful environments, enhance resilience, and support recruitment and retention, with web-based formats being key to increasing accessibility.

    Objective: We aimed to examine participants’ engagement with a newly developed Resilience Enhancement Online Training for Nurses (REsOluTioN), explore its acceptability, and compare levels of resilience and psychological well-being in nurses who completed REsOluTioN with those who did not.

    Methods: We carried out a pilot randomized trial (1:1), conducted at a single site (mental health and community trust in South England) between August 2021 and May 2022. Local research ethics approvals were obtained. Nurses were invited to participate and were randomly assigned to a waitlist group or REsOluTioN group. Training lasted for 4 weeks, consisting of prereading, web-based facilitated sessions, and mentorship support. We evaluated trial engagement, acceptability of training, and pre-post changes in resilience, measured by the Brief Resilience Scale, and psychological well-being, measured by the Warwick Edinburgh Mental Wellbeing Scale. Qualitative participant feedback was collected. Consolidated Standards of Reporting Trials 2010 extension guidelines for reporting pilot and feasibility trials were used.

    Results: Of 108 participants recruited, 93 completed the study. Participants’ mean age was 44 (SD 10.85) years. Most participants were female (n=95, 88.8%), White (n=95, 88.8%), and worked in community settings (n=91, 85.0%). Sixteen facilitated and 150 mentoring sessions took place. Most REsOluTioN program participants reported the sessions helped improve their resilience (n=24, 72.8%), self-confidence (n=24, 72.7%), ability to provide good patient care (n=25, 75.8%), relationships with colleagues (n=24, 72.7%), and communication skills (n=25, 75.8%). No statistically significant differences between training and control groups and time on well-being (F1,91=1.44, P=.23, partial η2=0.02) and resilience scores (F1,91=0.33, P=.57, partial η2=0.004) were revealed; however, there were positive trends toward improvement in both. Nurse participants engaged with the REsOluTioN program and found it acceptable. Most found web-based training and mentoring useful and enjoyed learning, reflection, networking, and participatory sessions.

    Conclusions: The REsOluTioN program was acceptable, engaging, perceived as useful, and nurses were keen for it to be implemented to optimize resilience, psychological health, communication, and workplace environments. The study has evidenced that it is acceptable to implement web-based resilience programs with similar design features within busy health care settings, indicating a need for similar programs to be carefully evaluated. Mentorship support may also be a key in optimizing resilience. Trial limitations include small sample size and reduced statistical power; a multicenter randomized controlled trial could test effectiveness of the training on a larger scale.

    Trial Registration: ClinicalTrials.gov NCT05074563; https://clinicaltrials.gov/ct2/show/NCT05074563

    International Registered Report Identifier (IRRID): RR2-10.2196/37015

    J Med Internet Res 2023;25:e43771

    doi:10.2196/43771

    Keywords

    burnout; COVID-19; health care setting; health care staff; health care provider; mental health; mental well-being; nurses; nursing; pilot trial; psychological health; resilience training; resilience; web-based health; web-based training 


    Overview

    The ongoing global workforce challenges facing health care providers are well documented and are linked to low levels of job satisfaction, recruitment, retention, and staff well-being, with detrimental impacts on patient care outcomes [1,2]. The central role of nurses in health care delivery is notable, as they are the largest group of health care professionals worldwide and are at the forefront of patient facing care [3]. However, the increased pressures they face in providing high-quality, complex patient care within overstretched and underresourced environments place many nurses under acute stress, testing their resilience [1,4-6]. In recent years, widespread media and public recognitions have been awarded to nurses who have continuously worked to protect patients, often to the detriment of their own health and well-being. The resulting physical, psychological, and emotional impact on nurses has been substantial, with an increase in mental health problems and burnout reported [7-9] and an increase in the number of nurses leaving the profession [10].

    The development of evidence-based strategies to improve the psychological well-being of health care staff and mitigate against burnout has been cited as a key priority [11], with resilience-enhancement programs identified as one tool to help address this problem [12-15]. Resilience-building programs can provide targeted support for staff who are enduring unprecedented levels of stress and burnout, with recognized importance in contributing to increased psychological health and well-being in nurses [16-19]. They can also aid recruitment and retention within international health care organizations [20,21]. Resilience can be defined in many ways and is a dynamic rather than static construct, in which an individual’s resilience level can change depending on the fluctuating internal and external challenges they face [6,19]. In this paper, resilience is defined as an individual’s ability to “adjust to adversity, maintain equilibrium, retain some sense of control over their environment, and continue to move on in a positive manner” [19,22].

    Several resilience-enhancement programs have been developed for health care professionals, using both group and individual programs, delivered in a range of contexts and using blended models of delivery [4,21,23-29]. These include resilience-building wellness apps [30], mentorship programs [20], Balint group sessions with colleagues, and access to resilience training programs for frontline health care staff [31]. Resilience programs have been found to enhance resilience and support retention and recruitment of health care staff [6,21,24-27,32], and systematic reviews have reported some evidence of their effectiveness and value in the health care population [22,24,33,34]. However, there is limited evidence regarding how these benefits are provided and which types of programs work for which staff and in what context. A recent review examining the use of web-based resilience-enhancement interventions showed them to have potential value in clinical practice settings by supporting staff who experienced prolonged workplace stress [35]. This is particularly important as the development of effective and evidence-based web-based programs can play a vital role in the current pandemic climate, where face-to-face training or meetings are often restricted or not allowed [36]. Web-based modes of delivery increase easy access and flexibility and decrease the need for face-to-face only interactions.

    As a result of the need for targeted resilience-enhancement programs within the nursing setting, this paper reports on a pilot randomized controlled trial (RCT) that was designed to evaluate a web-based resilience-enhancement program for nurses [37]. The web-based training program, Resilience Enhancement Online Training for Nurses (REsOluTioN), was based on a face-to-face resilience-enhancement training program that had been previously piloted with nurses [6,29]. The design of the training program was also informed by a systematic review examining the effectiveness of web-based interventions to enhance resilience in health care professionals [35] and focus groups with nurses to gather information on what they felt should be the key features of such training programs [38]. During the focus group discussions, nurses viewed web-based programs aimed at enhancing resilience positively, highlighting potential benefits around combating burnout, managing stress, regaining work-life balance, mentorship, and building networks of support. Nurses emphasized the importance of branding, organizational support, and time in maximizing engagement with such a program.

    Study Aim

    The aim of this paper is to report on the implementation and evaluation of the REsOluTioN pilot RCT. Specific study objectives were to (1) explore participants’ engagement with the REsOluTioN trial, assessed by the number of nurses recruited to it; (2) explore the acceptability of the REsOluTioN program, assessed by participant retention numbers and data on how the training impacted participants’ views on resilience, communication, clinical practice, and workplace relationships; and (3) compare levels of resilience and psychological well-being in nurses who completed REsOluTioN program with nurses who did not (waitlist control arm).


    Trial Design and Setting

    The study was a 1:1 two-armed pilot randomized trial. It was conducted in a mental health and community National Health Service (NHS) trust in the South of England.

    Ethical Considerations

    The Oxford Brookes University Faculty Research Ethics Committee (F.20.01.12.1, dated August 22, 2021) reviewed and approved the trial protocol. Other necessary local research and development office approvals were obtained from the Oxford Health NHS Foundation Trust Research and Development Department (21/HRA/1418). The trial protocol was registered on ClinicalTrials.gov (NCT05074563). Consolidated Standards of Reporting Trials (CONSORT) 2010 extension guidelines for pilot and feasibility trials were used [39]. Web-based informed consent was obtained from all participants prior to study participation. All study data were deidentified to protect the privacy and confidentiality of participants. No financial incentives were provided; however, participants who completed the study did receive a continuous professional development certificate.

    Recruitment

    We invited nonagency nurses of different levels of seniority, working across a wide range of clinical settings from the participating NHS trust to participate. We used posters on the participating trust’s website, social media platforms, and meetings with nursing staff, research delivery teams, and trust communications teams to promote the study. The participating trust’s chief nurse also shared information about the trial with all nurses employed by the trust, using email communications and web-based meeting forums. Nurses who were interested in taking part were provided with a Qualtrics survey web link that contained a study information sheet and consent form. Upon providing consent, they were asked to provide demographic information and complete a prestudy survey (Multimedia Appendix 1).

    The REsOluTioN Program

    The REsOluTioN program was hosted on the Totara learning management system (version 12), via the Learning and Development information technology team at the participating trust. The web-based training was conducted over 4 weeks and covered weekly modules on (1) building hardiness and maintaining a positive outlook, (2) intellectual flexibility and emotional intelligence, (3) reflective and critical thinking, and (4) achieving life balance and enabling spirituality.

    A blended synchronous and asynchronous learning approach was used, which included (1) web-based 4×120 minutes large-group facilitated sessions on the weekly modules led by experienced senior nurses and other senior multidisciplinary health care staff; (2) 4×30 minute independent preparatory learning on the module topics prior to the large-group facilitated sessions; and (3) 8 small group mentoring sessions led by senior nurses and delivered between 30 and 60 minutes at flexible timings, twice weekly.

    Both large-group facilitated sessions and mentor meetings were delivered via Teams (Microsoft Corp). Learning materials in the form of PowerPoint presentations, instructional videos created by the study team, case examples, and peer-reviewed journal articles were used. The facilitated sessions also included group discussions and breakout activities. More about the content and delivery of REsOluTioN program is found elsewhere [37]. To gain a training completion certificate, participants randomized to the REsOluTioN program were expected to attend all the large-group facilitated sessions and at least one mentor meeting each week.

    Waitlist Control

    Nurses who were randomized to the control arm were allocated to a waitlist for 6 weeks. After 6 weeks, participants from both arms were asked to complete a poststudy survey (Multimedia Appendix 2).

    Outcomes

    The following outcome data were collected: (1) participant engagement: data were collected on the number of nurses who expressed an interest in joining the trial and those randomized to assess recruitment success and participant engagement with the trial. (2) Acceptability of the REsOluTioN program: data were collected on how many participants were retained in the REsOluTioN program. Baseline Likert-style data were collected from all participants via a web-based prestudy survey to examine their understanding of resilience and the anticipated usefulness of the REsOluTioN tool in enhancing resilience levels, confidence, views on clinical practice, communication skills, and relationships with workplace colleagues. Six weeks later, participants were provided with this information again in a web-based poststudy survey to monitor any changes over time. (3) Resilience and Psychological Well-being: the validated Brief Resilience Scale [40] and Warwick-Edinburgh Mental Wellbeing Scale [41] were used to measure changes in resilience, psychological health, and well-being over time between the REsOluTioN program and the waitlist control arms at 6 weeks.

    Data Management

    All data were deidentified using study codes and stored in password-protected Excel (Microsoft Corp) spreadsheets that were accessed by authorized team members only. We followed the university’s policies and General Data Protection Regulation requirements for data storage.

    Sample Size

    The limitations of the pilot study design, as well as finite resource availability, determined our sample size. The study objective was to afford a preliminary comparison of training outcomes, and due to funding constraints and the pressures imposed by COVID-19, we aimed to recruit between 60 and 100 participants; this was deemed appropriate for a pilot study of this nature [42]. We aimed to recruit participants over 4 cohorts to maximize recruitment potential due to the study being conducted during the pandemic and nurse participants having very busy work schedules. As a result, having a choice of 4 cohorts aided flexibility in terms of nurse participants’ being able to take part in the study alongside their work schedules. Though we intended for approximately 25 participants to be enrolled per cohort, there was variation in cohort size; this is reflective of nurse participants’ varying levels of availability throughout the study.

    Randomization and Blinding

    An independent team member who was not involved in the conduct of the trial, delivery of the REsOluTioN program, or data analysis implemented the randomization and allocation. For randomization, we used a computer-generated random number sequence. For allocation concealment, we used sequentially numbered opaque-sealed envelopes that were opened only after entering the name of each participant on the envelope. A team member who was involved in data analysis was blinded to the group allocation. However, participants were not blinded to group allocation due to the nature of the training.

    Statistical Methods

    Participants’ demographic characteristics and acceptability outcomes (completers or noncompleters) were descriptively analyzed. Depending on the normality of the data, resilience and psychological well-being measures were presented as means (SD) or medians (IQR). Intention-to-treat analysis was carried out to examine outcomes. Data from participants who withdrew from the study and who were lost to follow up (n=14, 13.1%) were imputed using the expectation maximization technique. We used ANOVA to evaluate any differences in resilience and psychological well-being between arms at 6 weeks. All analyses were undertaken in SPSS statistics software (version 22.0; IBM Corp) [43], with a significance level set at 0.05.


    Overview

    A CONSORT diagram detailing the flow of participants through the pilot trial is presented in Figure 1.

    ‎
    Figure 1. Consolidated Standards of Reporting Trials (CONSORT) flow diagram depicting flow of participants through the pilot trial.

    Characteristics of Trial Participants

    Baseline characteristics of trial participants are presented in Table 1. The mean age of participants was 44 (SD 10.85) years; ages ranged between 24 and 69 years. Most participants were female (n=95, 88.8%), White (n=95, 88.8%), and working in the community setting (n=91, 85.0%). Participants were from a range of NHS clinical bands (band 4-8), with band 6 being the most common (n=47, 43.9%). A small number (n=5) of band 4 nursing associates were included, as they were experienced members of staff embedded within clinical teams during the pandemic, working alongside registered nurses in extended roles. The mean number of years of experience working in the nursing profession was 15.75 (SD 11.58).

    Participants randomized to the REsOluTioN program (n=56) did not differ significantly from those randomized to the control group (n=51) with regard to age (t105=-0.26, P=.80), years working in the profession (t105=0.82, P=.42), gender (χ21=0.2, P=.66), ethnicity (χ21=1.96, P=.16), banding (χ21=0.3, P=.57), nursing field (χ21=0.8, P=.38), well-being (t105=0.56, P=.58)-, or resilience (t105=0.58, P=.56) outcomes at baseline (Table 1). The baseline, prestudy survey indicated that all participants (n=107, 100%) recognized the importance of personal resilience in the workplace, with the majority rating it as extremely important (n=88, 82.2%).

    Table 1. Baseline characteristics of participants, mean psychological well-being, and resilience at baseline and 6 weeks.
    CharacteristicsTotalREsOluTioNa groupWaitlist control group
    Number of participants randomized, n1075651
    Age in years, mean (SD)43.78 (10.85)44.04 (10.72)43.49 (11.08)
    Gender, n (%)

    		Male12 (11.2)7 (12.5)5 (9.8)

    		Female95 (88.8)49 (87.5)46 (90.2)
    Ethnicity, n (%)

    		White95 (88.8)52 (92.9)43 (84.3)

    		Asian3 (2.8)0 (0.0)3 (5.9)

    		Black7 (6.5)2 (3.6)5 (9.8)

    		Mixed2 (1.9)2 (3.6)0 (0.0)
    Work experience in years, mean (SD)15.75 (11.58)14.88 (11.28)16.71 (11.94)
    Level of NHSb bands, n (%)

    		Band 45 (4.7)4 (7.1)1 (2.0)

    		Band 516 (15.0)7 (12.5)9 (17.6)

    		Band 647 (43.9)26 (46.4)21 (41.2)

    		Band 721 (19.6)11 (19.6)10 (19.6)

    		Band 8 and above18 (16.8)8 (16.8)10 (19.6)
    Type of work setting, n (%)

    		Community and mental health services91 (85.0)46 (82.1)45 (88.2)

    		Forensics4 (3.7)3 (5.4)1 (2.0)

    		Corporate6 (5.6)2 (3.6)4 (7.8)

    		Learning disabilities6 (5.6)5 (8.9)1 (2.0)
    Resilience, mean (SD)

    		Baseline3.02 (0.27)3.01 (0.25)3.04 (0.28)

    		6 weeks3.02 (0.26)3.02 (0.25)3.02 (0.26)
    Psychological well-being, mean (SD)

    		Baseline46.35 (7.52)46.73 (8.32)45.92 (6.59)

    		6 weeks47.56 (9.26)48.55 (9.64)46.47 (8.78)

    aREsOluTioN: Resilience Enhancement Online Training for Nurses.

    bNHS: National Health Service.

    Participant Engagement and Retention

    Between August 2021 and May 2022, a total of 134 nurses expressed an interest in participating in the study. Of 134, a total of 108 completed the web-based consent process and prestudy survey. One participant was excluded on the basis of eligibility as he/she was a nursing student rather than an employed member of staff. Consented participants (n=107) were randomly assigned to the waitlist control (n=51) or REsOluTioN program (n=56). Nine participants withdrew from the REsOluTioN group prior to the intervention starting due to changing work commitments or annual leave requirements, which meant that they were unable to be allocated to a training cohort. At 6 weeks post enrollment, 93 participants had completed the poststudy survey, as 5 were lost to follow up and did not complete (2 in the waiting list group and 3 in the REsOluTioN group). When comparing participants who completed the study with those who withdrew or were lost to follow-up, there were no significant differences in terms of baseline demographic characteristics age (t105=0.92, P=.36), years working in the profession (t105=0.12, P=.99), gender (P=.51), ethnicity (P=.49), banding (χ21=0.004, P=.95), nursing field (P=.65), resilience (t105=1.25, P=.22), or psychological well-being (t105=1.23, P=.22).

    Acceptability of the REsOluTioN Program

    Participants were allocated to waitlist control and REsOluTioN groups in 4 consecutive cohorts during the recruitment period. Cohort 1 had 14 people in the waitlist control and 6 in the REsOluTioN group, cohort 2 had 2 and 4, cohort 3 had 13 and 11, and cohort 4 had 22 and 26 participants, respectively. A total of 150 mentoring sessions and 16 facilitated sessions took place across the 4 cohorts. No mentors or facilitators reported the length of the sessions, but the mentoring sessions lasted between 30 minutes to 1 hour depending upon the number of participants allocated to the mentor, while the large-group facilitated sessions lasted up to 2 hours. Thus, the sessions were acceptable in terms of delivery and duration. The participant retention rate at 6 weeks was 96% (44/47) in the REsOluTioN group; of these, 33 (75%) participants provided extra feedback on the REsOluTioN program via an additional survey.

    Of the participants who completed the poststudy evaluation of the REsOluTioN program (n=33), the majority thought that both the web-based workplace resilience training (n=30, 90.9%) and mentoring (n=29, 87.9%) had been useful; a minority felt that their participation in the training program had not impacted on their experience or outlook toward clinical practice (n=7, 21.2%). Participants felt that participation in the web-based training had been important for improving their levels of resilience (n=24, 72.8%), self-confidence (n=24, 72.7%), belief in their ability to provide good patient care (n=25, 75.8%), relationships with work colleagues (n=24, 72.7%), and communication skills with colleagues (n=25, 75.8%).

    Most participants who completed poststudy evaluation also found the content and sessions helpful (n=29, 87.9%) thought the training delivered an appropriate amount of information (n=27, 81.8%) and that the 4-week duration was about right for training of this type (n=23, 69.7%). The sessions on emotional intelligence and intellectual flexibility were rated most favorably, with 75.8% (n=25) of them indicating that they found it particularly helpful.

    Analysis of free-text responses from REsOluTioN program participants suggested that they enjoyed opportunities for learning and reflection offered by the training as well as the chance to build networks and interact with colleagues at all levels. Participants indicated that they enjoyed the networking, mentorship, and participatory sessions the most (n=16, 51.5%). However, ringfencing time to attend and engage with the sessions was the most reported challenge due to pressurized working environments. One participant highlighted the need for a cultural shift to support people to take more time for their own well-being. Participants also highlighted organization-wide issues and variability in the way sessions were run as detracting from their overall experience. Table 2 provides a summary of illustrative quotes.

    Table 2. Evaluation of Resilience Enhancement Online Training for Nurses (REsOluTioN) program–Illustrative quotes.
    ThemeIllustrative quotes
    Opportunities for learning and reflection
    • “I feel I have learned something about myself and am very grateful to have attended this.” [Band 6, Female, Community and Mental Health]
      • ‎
    Building networks and interacting with colleagues
    • “I enjoyed having senior managers actively taking part in the interactive discussions and group work, because it made me feel connected and listened to.” [Band 6, Female, Community and Mental Health]
      • ‎
    • “[I enjoyed that] participants included a good range of nurses from very different professional backgrounds and specialities.” [Band 5, Female, Community and Mental Health]
      • ‎
    Networking, mentorship, and participatory sessions
    • “They were all interesting sessions and it was good to have the protected time to review these subjects and reflect on my own feelings and development.” [Band 7, Female, Community and Mental Health]
      • ‎
    • “The mentor sessions were the most rewarding – quickly building rapport with a small supportive group, where you can cry, laugh or vent.” [Band 7, Female, Community and Mental Health]
      • ‎
    Time as a barrier
    • “It was sometimes difficult to attend the whole session or focus on it completely due to the responsibilities of my role. I tried to protect the time but this was not always possible which was frustrating at times.” [Band 7, Female, Community and Mental Health]
      • ‎
    Culture as a barrier
    • “I feel a longer term…approach…would be really helpful and cement the belief that you deserve time to think about yourself regularly, to carve out headspace to consider yourself before reaching crisis.” [Band 7, Female, Community and Mental Health]
      • ‎
    Better organization of the sessions
    • “I think it would have been useful to set out some ground rules.” [Band 6, Male, Community and Mental Health]
      • ‎
    • “It would have been useful to have the pre-reading. I never received any information before the sessions.” [Band 5, Female, Community and Mental Health]
      • ‎

    Resilience and Psychological Well-being

    Mean resilience and psychological well-being scores at baseline and 6 weeks for both groups are presented in Table 1. There were very little pre-post differences in resilience scores across control group (mean 0.01, SD 0.35) and REsOluTioN group (mean 0.01, SD 0.27). The mean pre-post difference in psychological well-being scores was smaller in the control group (mean 0.55, SD 6.77) than in the REsOluTioN group (mean 1.82, SD 6.53).

    Two-way mixed ANOVAs revealed no statistically significant differences between groups and time (baseline and 6 weeks) on resilience scores (F1,105=0.20, P=.66, partial η2=0.002) and well-being scores (F1,105=0.97, P=.33, partial η2=0.09).


    Principal Findings

    Our findings have shown that nurse participants engaged with REsOluTioN program, as evidenced by the high recruitment rate to the pilot study. The training was acceptable to nurses working in frontline clinical settings; this is demonstrated by the large number of participants who enrolled in and completed the study. While a small number of participants withdrew from the study or were lost to follow-up, the majority of these withdrew prior to the training commencing due to changing work commitments, meaning that they were no longer able to join a cohort. Participant feedback demonstrated that most participants clearly valued the importance of protecting their resilience within the workplace. Most participants were receptive toward the REsOluTioN program and reported that they felt it was an important tool for helping to enhance their resilience, confidence, patient care provision, and relationships with work colleagues; this demonstrates the potential application of web-based resilience tools for this population group. Overall, the REsOluTioN program was well received and identified a desire from nurses for web-based resilience training tools to be implemented as a way of optimizing resilience, psychological health, communication practices, and the workplace environment. Though there were no significant differences between REsOluTioN and waitlist control groups at 6 weeks in terms of resilience and psychological well-being, these results must be considered alongside the small sample size, due to the pilot nature of the trial.

    Comparison With Prior Work

    Our findings have highlighted the potential need for resilience-enhancement programs for nurses working in highly stressful working conditions. This pilot trial was carried out across an NHS trust in South England during the height of the COVID-19 pandemic, when pressures on health care staff were extremely high, with nurses having considerable demands on their time and multiple conflicting priorities [1,4,5,23,44]. Despite this, we managed to recruit on time and reach our target, implement the REsOluTioN program successfully, and collect data at the relevant time points. Hence, our study has provided initial evidence that it is acceptable to implement web-based resilience-enhancement programs with similar design features within busy health care settings; this has been identified in the wider literature prior to the pandemic [35], but to our knowledge has not been tested since COVID-19. Thus, these findings will enable larger scale studies to test the effectiveness of web-based resilience programs for nurses in terms of increasing resilience and psychological well-being.

    The REsOluTioN pilot trial has shown that web-based resilience-enhancement programs appear acceptable to nurses working across a range of health care settings. This is evidenced by the low dropout rate of participants who enrolled in the study, which is an indicator of high levels of acceptance [45]. This was further evidenced by the qualitative feedback from participants who enrolled in the training arm of the study. These findings provide evidence of nurses’ engagement and satisfaction with the program. This indicates a real need for carefully evaluated web-based resilience-enhancement programs for nurses to be implemented across health care settings.

    Feedback from participants who enrolled in the training arm indicated that they were satisfied with the different the REsOluTioN program components and that the web-based facilitated and mentorship sessions were well received. This endorsement of the mentorship component of the REsOluTioN program has been evidenced in previous research exploring resilience in nurses [6,25,29], suggesting that mentorship support may be a key component in optimizing resilience among the nursing workforce. Future studies could focus on evaluating mentorship-based sessions for nurses, as these have the potential to be flexibly implemented and tailored to the needs of individuals working across a range of health and social care settings. Furthermore, focus groups carried out with nurses in the participating trust indicated a need for resilience training, with nurses identifying that supportive measures to help combat workplace stressors and burnout were acutely needed [38]. This suggests that the design features, content, and format of REsOluTioN are appropriate and acceptable for use in this population and could be replicated and adapted for use in larger populations using a large-scale RCT design.

    Although no statistically significant mean differences were found in levels of resilience or psychological well-being between the waitlist control and training arms, the small sample size of the pilot study makes it difficult to draw meaningful conclusions from the dataset. Furthermore, resilience and psychological well-being scores were higher in the training arm than the waitlist control arm at the end of the study, suggesting positive trends in the right direction and that the REsOluTioN program may lead to statistically significant outcomes when tested on a larger population. Pilot studies are recommended as the first step in determining information relating to study design, engagement, and acceptability, as P values alone can produce arbitrary results that can lead to potentially important findings being missed [46]. A fully powered, multicenter RCT is required to test the effectiveness of the REsOluTioN program on resilience and psychological well-being scores in a larger population.

    Strengths and Limitations of the Study

    To our knowledge, REsOluTioN was the first web-based training piloted on nurses working during the COVID-19 pandemic and has highlighted many benefits of providing such a resource to nurses working under highly pressurized conditions. In addition, the engagement and acceptability outcomes have been achieved as indicated by the high study recruitment and adherence rates and from the qualitative survey feedback. This confirms that it is possible to implement web-based resilience training programs for nurses within busy workplace environments with successful engagement from nurses.

    Study limitations include the small sample size, and hence robust conclusions on psychological well-being and resilience outcomes cannot be made. In addition, this study was conducted at only one NHS trust; future studies should be conducted across a range of NHS health and social care settings to increase the generalizability of the findings. Finally, conducting a study during the COVID-19 pandemic may have influenced the findings, as nurses were working under even more pressurized conditions than usual [1,23,44], which may have influenced their responses due to heightened levels of stress and anxiety. Care must be taken to be aware of these issues when implementing similar resources across health and social care settings in the peri- and postpandemic era.

    Conclusions

    This pilot RCT has identified the importance of, and need for, tailored resilience-enhancement programs for nurses, who are facing unprecedented workforce pressures and may benefit from additional forms of structured support. The components of the REsOluTioN program were well received, with specific emphasis placed on the mentorship components, suggesting this may be an area of future research focus and practical application.

    Further, large-scale research is required to test the effectiveness of the REsOluTioN program across real-world health care settings, with the aim of increasing the sustainability, health, and well-being of the nursing workforce in the future.

    Acknowledgments

    This study is funded by the Burdett Trust for Nursing (SB\ZA\101010662\633134). The authors would like to thank the REsOluTioN session facilitators, mentors, and the learning and development team for their support with the study, as well as all the nurses who participated in this study. CH is supported by the National Institute for Health Research Oxford Health Clinical Research Facility. The views expressed are those of the authors and not necessarily those of the NIHR, UK National Health Service, or the UK Department of Health and Social Care.

    Data Availability

    The data that support the findings of this study are available from the corresponding author upon reasonable request.

    Conflicts of Interest

    AC is supported by the National Institute for Health Research (NIHR) Oxford Cognitive Health Clinical Research Facility, by an NIHR Research Professorship (grant RP-2017-08-ST2-006), by the NIHR Oxford and Thames Valley Applied Research Collaboration and by the NIHR Oxford Health Biomedical Research Centre (grant BRC-1215-20005). The views expressed are those of the authors and not necessarily those of the UK National Health Service, the NIHR, or the UK Department of Health; he has received research, educational and consultancy fees from INCiPiT (Italian Network for Paediatric Trials), CARIPLO Foundation, Lundbeck and Angelini Pharma.

    ‎
    Multimedia Appendix 1

    Preintervention Survey.

    DOCX File , 18 KB
    ‎
    Multimedia Appendix 2

    Postintervention Survey and Evaluation.

    DOCX File , 16 KB
    ‎
    Multimedia Appendix 3

    CONSORT-eHEALTH checklist (V 1.6.2).

    PDF File (Adobe PDF File), 98 KB
    1. Iacobucci G. Staff burnout: MPs demand "total overhaul" of NHS workforce planning. BMJ 2021 Jun 08;373:n1461. [CrossRef] [Medline]
    2. Salyers MP, Bonfils KA, Luther L, Firmin RL, White DA, Adams EL, et al. The relationship between professional burnout and quality and safety in healthcare: a meta-analysis. J Gen Intern Med 2017 Apr;32(4):475-482 [FREE Full text] [CrossRef] [Medline]
    3. Hughes F. Nurses at the forefront of innovation. Int Nurs Rev 2006 Jun;53(2):94-101 [FREE Full text] [CrossRef] [Medline]
    4. Jo S, Kurt S, Bennett JA, Mayer K, Pituch KA, Simpson V, et al. Nurses' resilience in the face of coronavirus (COVID-19): An international view. Nurs Health Sci 2021 Sep;23(3):646-657 [FREE Full text] [CrossRef] [Medline]
    5. Green S, Markaki A, Baird J, Murray P, Edwards R. Addressing healthcare professional burnout: a quality improvement intervention. Worldviews Evid Based Nurs 2020 Jun;17(3):213-220. [CrossRef] [Medline]
    6. Henshall C, Davey Z, Jackson D. The implementation and evaluation of a resilience enhancement programme for nurses working in the forensic setting. Int J Ment Health Nurs 2020 Jun;29(3):508-520. [CrossRef] [Medline]
    7. Couarraze S, Delamarre L, Marhar F, Quach B, Jiao J, Avilés Dorlhiac R, COVISTRESS network, et al. The major worldwide stress of healthcare professionals during the first wave of the COVID-19 pandemic - the international COVISTRESS survey. PLoS One 2021;16(10):e0257840 [FREE Full text] [CrossRef] [Medline]
    8. Ferry AV, Wereski R, Strachan FE, Mills NL. Predictors of UK healthcare worker burnout during the COVID-19 pandemic. QJM 2021 Oct 07;114(6):374-380 [FREE Full text] [CrossRef] [Medline]
    9. Morgantini LA, Naha U, Wang H, Francavilla S, Acar O, Flores JM, et al. Factors contributing to healthcare professional burnout during the COVID-19 pandemic: A rapid turnaround global survey. PLoS One 2020;15(9):e0238217 [FREE Full text] [CrossRef] [Medline]
    10. Staffing for safe and effective car: state of the nation's labour nursing market. Royal College of Nursing. 2022.   URL: https:/​/www.​rcn.org.uk/​Professional-Development/​publications/​staffing-for-safe-effective-care-labour-nursing-market-2022-uk-​pub-010-108 [accessed 2022-07-12]
    11. King R, Ryan T, Senek M, Wood E, Taylor B, Tod A, et al. The impact of COVID-19 on work, training and well-being experiences of nursing associates in England: A cross-sectional survey. Nurs Open 2022 May;9(3):1822-1831 [FREE Full text] [CrossRef] [Medline]
    12. Jennings BM. Work stress and burnout among nurses: role of the work environment and working conditions. In: Hughes RG, editor. Patient Safety and Quality: An Evidence-Based Handbook for Nurses. Rockville: Agency for Healthcare Research and Quality's (AHRQ); 2008.
    13. Baskin RG, Bartlett R. Healthcare worker resilience during the COVID-19 pandemic: An integrative review. J Nurs Manag 2021 Nov;29(8):2329-2342 [FREE Full text] [CrossRef] [Medline]
    14. Preti E, Di Mattei V, Perego G, Ferrari F, Mazzetti M, Taranto P, et al. The psychological impact of epidemic and pandemic outbreaks on healthcare workers: rapid review of the evidence. Curr Psychiatry Rep 2020 Jul 10;22(8):43 [FREE Full text] [CrossRef] [Medline]
    15. Hu D, Kong Y, Li W, Han Q, Zhang X, Zhu LX, et al. Frontline nurses' burnout, anxiety, depression, and fear statuses and their associated factors during the COVID-19 outbreak in Wuhan, China: A large-scale cross-sectional study. EClinicalMedicine 2020 Jul;24:100424 [FREE Full text] [CrossRef] [Medline]
    16. Bozdağ F, Ergün N. Psychological resilience of healthcare professionals during COVID-19 pandemic. Psychol Rep 2021 Dec;124(6):2567-2586 [FREE Full text] [CrossRef] [Medline]
    17. Labrague LJ, de Los Santos JAA. Fear of COVID-19, psychological distress, work satisfaction and turnover intention among frontline nurses. J Nurs Manag 2021 Apr;29(3):395-403 [FREE Full text] [CrossRef] [Medline]
    18. Padilla-Rivas GR, Delgado-Gallegos JL, Montemayor-Garza RJ, Franco-Villareal H, Cosio-León MDLÁ, Avilés-Rodriguez G, et al. Dataset of the adapted COVID stress scales for healthcare professionals of the northeast region of Mexico. Data Brief 2021 Mar;34:106733 [FREE Full text] [CrossRef] [Medline]
    19. Jackson D, Firtko A, Edenborough M. Personal resilience as a strategy for surviving and thriving in the face of workplace adversity: a literature review. J Adv Nurs 2007 Oct;60(1):1-9. [CrossRef] [Medline]
    20. Hart PL, Brannan JD, De Chesnay M. Resilience in nurses: an integrative review. J Nurs Manag 2014 Sep;22(6):720-734 [FREE Full text] [CrossRef] [Medline]
    21. Craigie M, Slatyer S, Hegney D, Osseiran-Moisson R, Gentry E, Davis S, et al. A pilot evaluation of a mindful self-care and resiliency (MSCR) intervention for nurses. Mindfulness 2016 Apr 18;7(3):764-774 [FREE Full text] [CrossRef]
    22. Pollock A, Campbell P, Cheyne J, Cowie J, Davis B, McCallum J, et al. Interventions to support the resilience and mental health of frontline health and social care professionals during and after a disease outbreak, epidemic or pandemic: a mixed methods systematic review. Cochrane Database Syst Rev 2020 Nov 05;11(11):CD013779 [FREE Full text] [CrossRef] [Medline]
    23. Charles A, Ewbank L. The road to renewal: five priorities for health and care. The King's Fund.   URL: https://www.kingsfund.org.uk/publications/covid-19-road-renewal-health-and-care [accessed 2022-09-18]
    24. Kunzler AM, Helmreich I, Chmitorz A, König J, Binder H, Wessa M, et al. Psychological interventions to foster resilience in healthcare professionals. Cochrane Database Syst Rev 2020 Jul 05;7(7):CD012527 [FREE Full text] [CrossRef] [Medline]
    25. McDonald G, Jackson D, Wilkes L, Vickers MH. A work-based educational intervention to support the development of personal resilience in nurses and midwives. Nurse Educ Today 2012 May;32(4):378-384. [CrossRef] [Medline]
    26. Foster K, Shochet I, Wurfl A, Roche M, Maybery D, Shakespeare-Finch J, et al. On PAR: A feasibility study of the Promoting Adult Resilience programme with mental health nurses. Int J Ment Health Nurs 2018 Oct;27(5):1470-1480. [CrossRef] [Medline]
    27. Foster K, Cuzzillo C, Furness T. Strengthening mental health nurses' resilience through a workplace resilience programme: A qualitative inquiry. J Psychiatr Ment Health Nurs 2018 Jun;25(5-6):338-348. [CrossRef] [Medline]
    28. Slatyer S, Craigie M, Heritage B, Davis S, Rees C. Evaluating the effectiveness of a brief mindful self-care and resiliency (MSCR) intervention for nurses: a controlled trial. Mindfulness 2017 Aug 26;9(2):534-546. [CrossRef]
    29. Davey Z, Jackson D, Henshall C. The value of nurse mentoring relationships: Lessons learnt from a work-based resilience enhancement programme for nurses working in the forensic setting. Int J Ment Health Nurs 2020 Oct;29(5):992-1001. [CrossRef] [Medline]
    30. Golden EA, Zweig M, Danieletto M, Landell K, Nadkarni G, Bottinger E, et al. A resilience-building app to support the mental health of health care workers in the COVID-19 era: design process, distribution, and evaluation. JMIR Form Res 2021 May 05;5(5):e26590 [FREE Full text] [CrossRef] [Medline]
    31. Mollica RF, Fricchione GL. Mental and physical exhaustion of health-care practitioners. Lancet 2021 Dec 18;398(10318):2243-2244 [FREE Full text] [CrossRef] [Medline]
    32. Foster K, Roche M, Delgado C, Cuzzillo C, Giandinoto JA, Furness T. Resilience and mental health nursing: An integrative review of international literature. Int J Ment Health Nurs 2019 Mar;28(1):71-85. [CrossRef] [Medline]
    33. Ruotsalainen J, Serra C, Marine A, Verbeek J. Systematic review of interventions for reducing occupational stress in health care workers. Scand J Work Environ Health 2008 Jun;34(3):169-178 [FREE Full text] [CrossRef] [Medline]
    34. Lamothe M, Rondeau É, Malboeuf-Hurtubise C, Duval M, Sultan S. Outcomes of MBSR or MBSR-based interventions in health care providers: A systematic review with a focus on empathy and emotional competencies. Complement Ther Med 2016 Mar;24:19-28 [FREE Full text] [CrossRef] [Medline]
    35. Henshall C, Ostinelli E, Harvey J, Davey Z, Aghanenu B, Cipriani A, et al. Examining the effectiveness of web-based interventions to enhance resilience in health care professionals: systematic review. JMIR Med Educ 2022 Sep 06;8(3):e34230 [FREE Full text] [CrossRef] [Medline]
    36. Rauschenberg C, Schick A, Goetzl C, Roehr S, Riedel-Heller SG, Koppe G, et al. Social isolation, mental health, and use of digital interventions in youth during the COVID-19 pandemic: A nationally representative survey. Eur Psychiatry 2021 Mar 09;64(1):e20 [FREE Full text] [CrossRef] [Medline]
    37. Srikesavan C, Davey Z, Cipriani A, Henshall C. Resilience Enhancement Online Training for Nurses (REsOluTioN): protocol for a pilot randomized controlled trial. JMIR Res Protoc 2022 Aug 03;11(8):e37015 [FREE Full text] [CrossRef] [Medline]
    38. Davey Z, Srikesavan C, Cipriani A, Henshall C. It's what we do: experiences of UK nurses working during the COVID-19 pandemic: impact on practice, identity and resilience. Healthcare (Basel) 2022 Sep 01;10(9):1-12 [FREE Full text] [CrossRef] [Medline]
    39. Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S, Thabane L, PAFS consensus group. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. BMJ 2016 Oct 24;355:i5239 [FREE Full text] [CrossRef] [Medline]
    40. Smith BW, Dalen J, Wiggins K, Tooley E, Christopher P, Bernard J. The brief resilience scale: assessing the ability to bounce back. Int J Behav Med 2008;15(3):194-200. [CrossRef] [Medline]
    41. Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, et al. The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): development and UK validation. Health Qual Life Outcomes 2007 Nov 27;5:63 [FREE Full text] [CrossRef] [Medline]
    42. Whitehead AL, Julious SA, Cooper CL, Campbell MJ. Estimating the sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and main trial for a continuous outcome variable. Stat Methods Med Res 2016 Jun;25(3):1057-1073 [FREE Full text] [CrossRef] [Medline]
    43. 2a IBM SPSS statistics processes for PC. In: IBM SPSS Statistics 23 Step by Step: A Simple Guide and Reference, 14e. Routledge: Behavioral Sciences; 2013.
    44. Shembavnekar N, Woodham E. What might COVID-19 mean for England’s nurse supply? The Health Foundation.   URL: https://www.health.org.uk/news-and-comment/blogs/what-might-covid-19-mean-for-englands-nurse-supply [accessed 2022-07-12]
    45. Amagai S, Pila S, Kaat AJ, Nowinski CJ, Gershon RC. Challenges in participant engagement and retention using mobile health apps: literature review. J Med Internet Res 2022 Apr 26;24(4):e35120 [FREE Full text] [CrossRef] [Medline]
    46. Sakai T. Statistical significance, power, and sample sizes: a systematic review of SIGNIR and TOIS, 2006-2015. : Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval; 2016 Presented at: SIGIR '16: Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information; 17-21 July 2016; Pisa, Italy   URL: https://doi.org/10.1145/2911451.2911492 [CrossRef]

    ‎
    CONSORT: Consolidated Standards of Reporting Trials
    NHS: National Health Service
    RCT: randomized controlled trial
    REsOluTioN: Resilience Enhancement Online Training for Nurses

    Edited by A Mavragani; submitted 28.11.22; peer-reviewed by S Amagai, F Weber; comments to author 19.12.22; revised version received 22.12.22; accepted 12.01.23; published 14.02.23

    Copyright

    ©Catherine Henshall, Zoe Davey, Cynthia Srikesavan, Liam Hart, Dan Butcher, Andrea Cipriani. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 14.02.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.