Published on in Vol 26 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/50217, first published .
Factors Influencing the Implementation of Digital Advance Care Planning: Qualitative Interview Study

Factors Influencing the Implementation of Digital Advance Care Planning: Qualitative Interview Study

Factors Influencing the Implementation of Digital Advance Care Planning: Qualitative Interview Study

Original Paper

1Cicely Saunders Institute, Kings College London, London, United Kingdom

2Leeds Institute of Health Sciences, University of Leeds, Leeds, United Kingdom

3Sussex Community NHS Foundation Trust, Brighton, United Kingdom

4Whitehall Surgery, Leeds, United Kingdom

5NHS West Yorkshire Integrated Care Board, White Rose House, Wakefield, United Kingdom

6Hull York Medical School, Institute of Clinical and Applied Health Research, Allam Medical Building, University of Hull, Hull, United Kingdom

Corresponding Author:

Matthew J Allsop, BSc, PhD, CPsychol

Leeds Institute of Health Sciences

University of Leeds

Worsley Building

Leeds, LS2 9LU

United Kingdom

Phone: 44 1133434185

Email: m.j.allsop@leeds.ac.uk


Background: Palliative care aims to improve the quality of life for people with life-limiting illnesses. Advance care planning conversations that establish a patient’s wishes and preferences for care are part of a person-centered approach. Internationally, electronic health record systems are digital interventions used to record and share patients’ advance care plans across health care services and settings. They aim to provide tools that support electronic information sharing and care coordination. Within the United Kingdom, Electronic Palliative Care Coordination Systems (EPaCCS) are an example of this. Despite over a decade of policy promoting EPaCCS nationally, there has been limited implementation and consistently low levels of use by health professionals.

Objective: The aim of this study is to explore the factors that influence the implementation of EPaCCS into routine clinical practice across different care services and settings in 2 major regions of England.

Methods: A qualitative interview study design was used, guided by Normalization Process Theory (NPT). NPT explores factors affecting the implementation of complex interventions and consists of 4 primary components (coherence, cognitive participation, collective action, and reflexive monitoring). Health care and social care practitioners were purposively sampled based on their professional role and work setting. Individual web-based semistructured interviews were conducted. Data were analyzed using thematic framework analysis to explore issues which affected the implementation of EPaCCS across different settings at individual, team, organizational, and technical levels.

Results: Participants (N=52) representing a range of professional roles were recruited across 6 care settings (hospice, primary care, care home, hospital, ambulatory, and community). In total, 6 themes were developed which mapped onto the 4 primary components of NPT and represented the multilevel influences affecting implementation. At an individual level, these included (1) EPaCCS providing a clear and distinct way of working and (2) collective contributions and buy-in. At a team and organizational level, these included (3) embedding EPaCCS into everyday practice and (4) championing driving implementation. At a technical level, these included (5) electronic functionality, interoperability, and access. Breakdowns in implementation at different levels led to variations in (6) confidence and trust in EPaCCS in terms of record accuracy and availability of access.

Conclusions: EPaCCS implementation is influenced by individual, organizational, and technical factors. Key challenges include problems with access alongside inconsistent use and engagement across care settings. EPaCCS, in their current format as digital advance care planning systems are not consistently facilitating electronic information sharing and care coordination. A redesign of EPaCCS is likely to be necessary to determine configurations for their optimal implementation across different settings and locations. This includes supporting health care practitioners to document, access, use, and share information across multiple care settings. Lessons learned are relevant to other forms of digital advance care planning approaches being developed internationally.

J Med Internet Res 2024;26:e50217

doi:10.2196/50217

Keywords



Palliative care aims to improve the quality of life for people with life-limiting illnesses through a person-centered, multidisciplinary, and holistic approach [1]. The focus on person-centeredness is reflected in health policy both within the United Kingdom and internationally [2-5]. Key to facilitating person-centered care in palliative services is the concept of advance care planning. This involves having planned conversations with a patient around their individual goals, wishes, and preferences for their current and future care [6]. If a person’s preferences are documented and shared, there is evidence of beneficial outcomes. Advance care planning has been associated with better quality of care, helping people to be cared for and die in their usual place of residence, and preventing unplanned hospital admissions [7-9]. However, other studies indicate that it has no impact on patient outcomes or quality of life [10-12]. Despite this uncertainty, advance care planning has been adopted by health care systems internationally as a key feature of person-centered care.

While there are benefits associated with advance care planning, delivery of palliative care requires the involvement of, and communication between, multiprofessional services across different settings of care (ie, hospice, general practice, community-based care, out-of-hours services, hospitals, emergency services, care homes, and social care) [13,14]. To overcome the need for information sharing across multiple health care providers and settings, electronic health record systems are increasingly being used to document and share advance care planning information. This approach has been reported across countries that include the United States [15,16], Australia [17], and the United Kingdom. In the United Kingdom, the use of electronic health record systems for documenting and sharing advance care plans are called Electronic Palliative Care Coordination Systems, often referred to using the acronym EPaCCS.

EPaCCS emerged in response to the Department of Health’s 2008 End of Life Care Strategy, which advocated for improved coordination of care at the end of life for people with life-limiting conditions (ie, cancer and noncancer conditions, including dementia) [18]. Policy drivers for the widespread use of electronic systems (such as EPaCCS) across health and social care providers have continued to the present day [19,20]. This includes, for example, an expectation that care records for all people living with a long-term condition should include a person’s care needs and preferences, and should be shared with all those involved in their care [19]. The development of EPaCCS sought to overcome challenges arising through the fragmentation of health systems that can lead to patients not receiving person-centered care at the right time and in the right place [21,22]. This can result in patient needs not being met, unplanned and avoidable hospital admissions, and patients not being cared for, or dying in a place of their choice [23-25].

EPaCCS have been developed across the United Kingdom since 2008 and multiple variants have arisen. These include standalone web-based electronic registers such as Coordinate my Care which was implemented in London [26], and template forms integrated into already-existing electronic patient records, such as in Leeds [27] and the Key Information Summary in Scotland [28]. Regardless of the mode used for implementing EPaCCS locally across regions, the Palliative and End of Life Care Information Standard specifies the core content that should be recorded and shared (eg, demographic information, diagnosis, medication, advance care planning information, Do Not Attempt Cardiopulmonary Resuscitation decisions, and preferred places of care and death) [29]. The expectation is that once this information is stored, it should be possible to share across all settings involved in the delivery of palliative and end-of-life care, as well as sharing any updates on the care plan.

However, there is widespread variation with regard to how EPaCCS are implemented within local health care systems (eg, who initiates the creation of a record, which settings of care can access and edit information in EPaCCS records) [14] which has resulted in variable levels of interoperability and access [14,30-33]. In part, this may be a factor influencing the low use rates reported for EPaCCS, with 9%-43% of people with palliative care needs having an EPaCCS record created before death [14,27,34,35]. Alongside low use, there is uncertainty about how EPaCCS are being used in routine practice and limited evidence of their impact, inhibiting the development of an evidence base to guide how their implementation might be optimized [13,14,30,36,37]. The aim of this study was to explore health care professionals’ perspectives on factors that influence the implementation of EPaCCS in routine clinical practice across different care settings in England.


Design

We undertook a qualitative interview study. This approach was selected as we sought to develop new insights and knowledge on a relatively understudied topic area [38]. Our study was informed by an interpretative paradigm [39]. That is, we explored the study aim from the standpoint of ontological relativism (the acceptance of multiple, mind-dependent realities) and epistemological constructionism (an appreciation that knowledge generated during data analysis and write-up reflected interpretations made collectively by the research team) [40]. We reported the research in line with the consolidated criteria for reporting qualitative research (COREQ [consolidated criteria for reporting qualitative research], see Multimedia Appendix 1) [41].

Theoretical Perspective

EPaCCS can be conceptualized as a complex intervention. This is because they comprise multiple interacting components and operate at the interface of different health care professionals, organizations, settings of care, and patients and their families [42]. Normalization Process Theory (NPT) is an implementation theory that is used to explain how complex interventions are normalized (ie, deeply embedded into, and used as part of, routine practice) [43-45].

In explaining the different types of “work” that people do in normalizing complex interventions, NPT consists of 4 interlinked primary constructs (Table 1) [46,47]. We used these primary constructs of NPT as a guiding theoretical framework to guide data collection, analysis, and interpretation in understanding the factors affecting the implementation of EPaCCS into routine clinical practice.

Table 1. An overview of the 4 constructs from the Normalization Process Theory (NPT), definitions of the constructs, and how the constructs were applied and understood in the context of the study.
NPT constructDefinitionaFramework applied in this studyb
Coherence (“sense-making work”)“How do people work together in everyday settings to understand and plan the activities that need to be accomplished to put an intervention and its components into practice?”The ways in which participants think about distinguishing use of digital systems from other formats for advance care planning, collectively agreeing on the purpose of EPaCCSc, individually understanding what EPaCCS requires of them, and constructing potential value of EPaCCS for their work.
Cognitive participation (“relational work”)“How do people work together to create networks of participation and communities of practice around interventions and their components?”The ways in which participants become engaged in understanding what they need to do and support for EPaCCS to be sustained, influencing how EPaCCS use can be sustained, adapting to EPaCCS to support use by themselves and others, and supporting others’ engagement with EPaCCS.
Collective action (“operational work”)“How do people work together to enact interventions and their components?”The ways in which participants perform the tasks required for EPaCCS to support advance care planning, build accountability and maintain confidence in the use of EPaCCS, understand the appropriateness of existing roles and responsibilities relating to EPaCCS use, and view the resources and organizational support for EPaCCS use.
Reflexive monitoring (“appraisal work”)“How do people work together to appraise interventions and their components?”The ways in which participants appraise the effects of EPaCCS, themselves and with colleagues understand whether EPaCCS are operating well, individually understand and respond to the impact of EPaCCS, and modify their work in response to their appraisal of EPaCCS.

aDefinitions derived from May et al (2022) [46].

bHow definitions of NPT constructs were “in the simplest possible terms” [48] and applied to data collection, analysis, and interpretation.

cEPaCCS: Electronic Palliative Care Coordination Systems.

Recruitment and Settings

Recruitment took place in 2 UK regions in London (population circa 9 million) and West Yorkshire (population circa 2.3 million). Participants comprised a subsample of respondents to an earlier survey who had agreed to be contacted for follow-up interviews. In West Yorkshire, EPaCCS comprise a template that is embedded within a patient’s electronic record, generally in the electronic record system used by primary care providers that can share information across different care settings within a defined geographical area. Within London, at the time of this study, the most used EPaCCS system was “Coordinate My Care” (CMC). This was a standalone system (eg, it operated outside routinely used patient records), and enabled patients to access their own records [14]. Since the conception of this study, it has been superseded by an EPaCCS system called “Universal Care Plan.”

Participants were initially selected using purposive maximum variation sampling to gather the widest range of perspectives [49]. This entailed sampling participants based on specific criteria (geographical location, professional role, setting of care, and levels of understanding of or engagement with EPaCCS based on previous survey responses). The logic underpinning this approach was to explore our research aim from diverse perspectives [49]. We worked across primary, secondary, and tertiary care settings in purposefully recruiting doctors, nurses, care home staff, paramedics, and general practitioners. Difficulties in recruitment, however, meant that we supplemented our recruitment approach with convenience sampling using the same criteria.

Participants were approached via email and provided with a participant information sheet. A combination of verbal and written informed consent was obtained, either by AB or JB, prior to interviews being conducted. Recruitment ran concurrently with data collection between November 2021 and June 2022. The concept of “information power” [50] was used to guide decisions on when to halt recruitment and data collection. This entailed several meetings during which research team members (AB, JB, MT, MA, CE, and KS) considered whether and when data collected from our sample held enough relevant and detailed information to comprehensively understand our research aim.

Data Collection

Single, web-based interviews were conducted by 1 of 2 researchers, both of whom had prior experience in qualitative interviewing [AB (male, research fellow) and JB (female, research fellow)]. The topic guide (provided in Multimedia Appendix 2) comprised questions about how participants used EPaCCS, alongside the factors that they perceived affected their implementation. During development, these questions were mapped onto the 4 primary constructs of NPT. Interviews were audio recorded, anonymized, and transcribed verbatim. All participant personal data were stored in a secure cloud storage platform within password-protected files. These data were only accessible to, shared between, and used by members of the research team, using data-sharing agreements.

Analysis

Interview data were managed using NVivo (version 12; Lumivero) [51] and analyzed using thematic Framework analysis [52]. The 4 primary constructs of NPT were used as the theoretical framework to guide the coding and interpretation of data. Data analysis included moving between induction and deduction. We first used NPT to deductively build our initial analytic framework and then supplemented this through inductive coding in which we explored how patterns grounded in the data related to and enriched our analytic framework. Analysis consisted of seven iterative steps: (1) familiarization (through rereading transcripts), (2) coding (by labeling relevant segments of transcripts that aligned with our research aims), (3) creation of an initial analytic framework (by grouping similar codes into categories and categories into themes), (4) indexing (by applying our analytic framework back to raw data and refining it where appropriate), (5) charting (by creating a matrix that explored differences in data across region, role, and setting of care), (6) description (through defining and describing themes), and (7) interpretation (using our theoretical framework to further interpret our findings through the write-up of data). This approach allowed us to conduct within- and between-case pattern matching to explore where participant accounts on the use and implementation of EPaCCS converged or diverged, and how this was influenced by contextual factors (ie, setting, region, and role). Data analysis was led by AB, with fortnightly meetings between authors (AB, JB, MT, and MJA) to review the ongoing coding and analysis.

Multiple approaches were used to ensure rigor during data analysis. Throughout data collection and analysis, the researchers engaged in different forms of reflexivity. This included reflecting introspectively (inward reflections on how they impacted the research process and vice versa) and intersubjectively (reflections on relationships between them and participants) [53]. These were used as a “springboard for interpretations and more general insight” into the ways through which understandings of the research aim were being co-constructed through the research process, including analysis [53]. This included regular discussions with JB, who shared data collection and who was familiar with the data corpus. Moreover, throughout the analytical process, members of the wider interdisciplinary research team (consisting of academics and clinicians with experience in palliative care research and practice from across care settings including hospital, community, and primary care) acted as “critical friends” [54]. This entailed working collaboratively through regular meetings and written feedback in which findings were constructively challenged, reflexivity encouraged, and alternative interpretations of the data proposed. This process took place until the research team agreed that the final analytic framework accurately reflected participant accounts.

Ethical Considerations

The North of Scotland Research Ethics Committee approved the research (reference 21/PR/0428). In this study, we also recognized ethics as a reflexive process through engaging in “ethics in practice” [55]. This approach was used to remain responsive to and navigate ongoing and potentially unexpected ethical issues that may have arisen throughout data collection, analysis, and write-up (eg, by reflecting on how the research might affect professionals’ clinical practice and potential impact on patients and carers). All participants provided written consent prior to participating in the study. Before analysis, all interview transcripts were deidentified and stored on a secure cloud storage platform only accessible to the study team. Organizations in which participants were based were offered reimbursement of £75 (US $95.91) for allowing a professional to participate in the study. The level of the incentive payment was based on the cost of 1 hour of a locum doctor in the United Kingdom and was agreed upon by the research ethics committee and study funder.


A total of 52 people (characterized in Table 2) participated out of the 99 people approached for interview participated (characterized in Table 2), from London (n=29) and West Yorkshire (n=23). These participants represented a range of different professionals who work across hospice, primary care, care home, hospital, and community settings.

Six themes were developed and are represented under the corresponding constructs of NPT (coherence, cognitive participation, collective action, and reflexive monitoring). Figure 1 provides an overview of these main themes.

Table 2. Characteristics of study participants (N=52) including location, settings of care, and role.

LondonWest YorkshireTotal
Interviews, n292352
Setting of care, n

Hospice8412

Primary care7512

Care home549

Hospital538

Ambulance336

Community nurse145
Role, n

Registered nurse6713

Care home436

Community145

Hospital112

General practitioner7512

Palliative care consultant6413

Paramedic336

Clinical Nurse Specialist415

Care home manager123
Figure 1. An overview of the themes and key messages generated from the thematic framework analysis as they align with the 4 constructs of normalization process theory. EPaCCS: Electronic Palliative Care Coordination Systems.

Coherence: How Participants Understood EPaCCS—Theme 1: A Clear and Distinct Way of Working

For a complex intervention to be normalized, it needs to be understood as a clear and distinct way of working that enhances patient care. In the case of EPaCCS, this required health care professionals to appreciate how adding all relevant advance care planning information onto a single digital platform allowed for easier sharing among organizations. Across all settings of care, however, participants did not always see how EPaCCS enhanced patient care and outcomes compared to traditional channels of communication. These included using paper-based discharge summaries, cover letters, face-to-face conversations, emails, and telephone for direct communication of advance care plans across settings:

I don’t think it [EPaCCS] changes much in terms of our GP engagement with patients … our primary channel of communication is telephone, face to face, perhaps email and EPaCCS doesn’t sort of sit with any of those. Our primary function really is to provide the clinical care and record that clinical care and those are traditional methods of doing that. EPaCCS is an add-on, and I think because it’s an add-on, it’s not the primary form of communication.
[Lon18, GP, London]

Participants working in care homes across London and West Yorkshire reported using a range of different electronic patient record systems for documenting their residents’ care plans. These systems facilitated the documentation of patient wishes and preferences that could be easily accessed, reviewed, and updated internally by care home staff. Some electronic record systems used in care homes were also capable of integrating and sharing data with other systems across different settings, but this was often limited to those in general practice and not on the scale envisaged by EPaCCS:

The electronic care plan system that we are using, it’s something called PCS, so Person Centred Software. You can do your usual stuff like you said, day-to-day care notes and things like that. There also with PCS, the party piece it has is something called GP connect … with PCS if you do kind of speak with them, they are able to kind of merge certain systems together with their [other healthcare settings’] system … as far as I know PCS works with all of them
[WY12&WY13, care home managers, West Yorkshire]

Cognitive Participation: How Participants Built Networks of Practice Around and Bought Into EPaCCS

Theme 2: Embedding EPaCCS Into Everyday Practice

The service-wide embedding of EPaCCS into everyday practice varied and was partly influenced by the extent to which they were an integral part of everyday care processes, structures, and settings. In some contexts, entire services had no access to EPaCCS. Where EPaCCS were present and accessible across multiple settings, implementation was still thwarted because they were not used consistently by some health care professionals:

it can be like an easy thing to do and I think it gets ingrained in your normal kind of process of doing a patient’s notes … but I think when people just don’t know about it or don’t know how to access it, it then becomes, it seems more of a challenge to actually set one up whereas once you’ve got used to it, it just becomes part of your normal routine first assessment, set up CMC and then it’s done.
[Lon5, hospice community doctor, London]

Some participants reported that EPaCCS were integrated into everyday clinical routines. In these instances, EPaCCS were referred to as being “part of what we do” [WY2, community/hospice, West Yorkshire]. This included ensuring that EPaCCS management was integrated into key care processes such as initial assessments, caseload reviews, admission and discharge planning, multidisciplinary team meetings, handover sheets, and standard operating procedures:

Whenever we take on a new patient onto the caseload, we will do our level best to have a conversation about the current EPaCCS system we use, which is Coordinate My Care, to get consent to put people on that system … it’s very much part of our mantra, it’s something that we do … We talk about Coordinate My Care at our weekly multidisciplinary team meetings, so we ask people to check that people are on there and if they’re not, we try and think of a plan to get somebody on there.
[Lon26, hospice consultant nurse, London]
Theme 3: Championing Driving Implementation

Participants across all professional groups in both regions reflected on the role of colleagues who championed the use of EPaCCS. Champions were typically individuals who had been given dedicated time within their role to promote implementation and who encouraged staff engagement with EPaCCS. Champions used a range of approaches including offering peer support, taking active roles in teaching and education, presenting the potential benefits of EPaCCS, and keeping them present or “in view” in everyday clinical practice:

Having local champions who are just, [I] don’t want to say checking, but just ensuring that locally they’re being completed, that they’re demonstrating a difference. You know, there’s no point doing it if it’s not demonstrating any benefit really is there?
[WY2, community/hospice consultant, West Yorkshire]

There were examples where engaging staff in the use of EPaCCS and learning how different systems work was described as a “constant recurring battle” [Lon06, hospital Clinical Nurse Specialist, London] that required time, dedication, and energy. This view was particularly present in hospital settings and the challenge was mainly attributed to high staff turnover. Different staff meant that the same messages and training had to be repeated continuously for EPaCCS to remain a priority for teams. However, such training did not always translate into increases in health professional use:

The reality is, I think that EPaCCS is underused, but generally across the hospital. That's why I have to be out there doing education and encouragement… it's continually education, trial, training, nudging, pushing to get them to use it because, a level of busyness, a churn of staff, you know they’re churning staff all the time, they’re coming from different Trusts who are not used to SystmOne, never mind EPaCCS, so it's a continual, continual, continual thing and training
[WY7, hospital nurse, West Yorkshire]

Collective Action: How People Enact EPaCCS

Theme 4: Collective Contributions and Buy-in

Collective contributions referred to the extent to which health care professionals across settings of care contributed to the creation, sharing, updating, and use of EPaCCS records to inform care. Underpinning collective contributions was the degree to which health care professionals “bought into” EPaCCS by seeing them as a legitimate part of their role or as supporting the work of others. There was a general agreement that EPaCCS needed “buy-in from everyone - not just palliative care teams – for it to work” [WY2, consultant, community/hospice consultant, West Yorkshire]. Despite this, health care professionals working in specialist palliative care were often the ones creating and updating EPaCCS records.

Participants had different perceptions in terms of the skills and capacity of professionals across different care settings to support advance care planning. Some felt that staff working in specialist palliative care were best placed to initiate sensitive conversations about advance care planning and end-of-life choices. Others reflected that although they believed health care professionals working outside of palliative care settings could broach advance care planning conversations, they did not always have the confidence to do so. Indeed, participant accounts suggested that when palliative care services were not involved in a patient’s care, this led to a general lack of clarity over who should do what, when, and how, which often resulted in the ad hoc creation of records.

If they’re working in specialist palliative care, most of those people will have those skills [for advance care planning]. If we then look at people who don’t deal exclusively with palliative care but see a lot of it, so district nurses, elderly medicine doctors, general practitioners, I think there is a lot of skill there. There’s not always the skill and there’s often a gap in confidence to apply the skills that people have … when people don’t have the skills and confidence, that first conversation where we seek, where we explain to the patient where they are in their illness and the fact that they’re in a palliative phase of their illness and seeking consent to use an EPaCCS doesn’t happen
[WY6, hospice, West Yorkshire]
…in [our] Community Trust we’ve also got a respiratory service who are involved with people that are end stage of respiratory failure and we also have heart failure nurses and diabetic nurse specialists, and you know, those sorts of questions are talked about with patients often. But what we’re trying to do as a service in palliative care [non-specialist palliative care in Community Nurse Team] is encourage that to be done because it isn’t done as much as it should be really. You know when people are actually reaching sort of end-stage heart failure but yet nobody’s actually spoken to them about their wishes at the end of life. They feel it’s not their responsibility.
[WY9, community nurse, West Yorkshire]

A concern among participants working in general practice was that it was difficult to contribute to EPaCCS because they did not always fit with their existing ways of working. Given the time constraints and competing priorities in general practice, accessing an EPaCCS record and then conducting and documenting advance care planning conversations was often seen as unmanageable and unrealistic:

we’ve only got a 10- or 15-minute window to see that patient for their current problem, so we don’t bother to update the CMC after just because of sheer time. So, unless you’re having a special CMC kind of session and you’ve dedicated a bit of time to go and do a home visit on someone or you’ve planned it in that you’re going to update the CMC and those wishes and concerns etc, that’s only when it really gets touched by the GP practice.
[Lon16, GP, London]

Conversely, paramedics with access in London were likely to use EPaCCS records, typically because it helped decision-making around the urgent management of patients that they were hitherto unfamiliar with:

…we use it just as part of our decision making … I would say it’s a big part of my role… in the main bulk of my role which is in an ambulance setting I use it all the time, it’s second nature and it’s very valuable.
[Lon29, paramedic, London]
Theme 5: Electronic Functionality, Interoperability, and Access

At a technical level, the integration of EPaCCS within existing electronic systems was important to their implementation. However, according to participants, this process of integration had not always occurred. Across most care settings in London, participants were frustrated that CMC was not seamlessly interoperable with existing electronic patient record systems. This lack of technical interoperability (ie, basic data exchange capabilities between systems) created a restrictive process that resulted in additional work because health care professionals had to remember (and frequently update) log-in details and enter duplicate information across different systems:

Coordinate My Care for us is a completely separate system … it doesn’t pull data from the current electronic system, you still have to kind of manually enter the patient’s name, address, NHS number … it is extra work … that kind of influence[s] how detailed a care record might be. Sometimes we will just put on the basic information that you think’s important … if it was integrated into a current kind of electronic system then I guess it would just make it easier.
[Lon5, hospice community doctor, London]

In services across West Yorkshire, problems were caused by the fact that EPaCCS were embedded within several different electronic health record systems. However, because no mechanism in place allowed for the sharing of information between these systems, health care professionals could not always access relevant information from EPaCCS records when they needed it:

In this area a lot of folks were using SystmOne and we use EMIS … So, they [hospice services] can’t see what we’ve done on our system and it’s a bit messy … I know EPaCCS is supposed to be a document that everyone can access and fill in, but you can’t, ours is just on our system and ‘cos no one else can fill it in or see what’s been changed that’s where it falls down…. it is stupid that you can’t share an EPaCCS with anyone, it seems like a bit pointless
[WY17, GP, West Yorkshire]

Reflexive Monitoring (“Appraisal Work”): Appraising the Value of EPaCCS—Theme 6: Confidence and Trust in EPaCCS

Participants across different regions and settings reflected on the potential value of EPaCCS as a tool that could facilitate the coordination of care. Others reflected on first-hand experiences of how EPaCCS were valuable in the context of crisis and out-of-hours care. In particular, paramedics who had access felt that EPaCCS provided vital information needed to effectively support person-centered decision-making with people whom they did not know:

If I saw a CMC for example where it was recorded that the patient had a preference for treatment care in the home, that would make it much more likely that I would dispatch one of my colleagues because we already know that that is the patient’s preferences and so as far as possible, we’re going to work to make that happen … End of life care pushes against the normal direction of paramedic care, [the] normal direction of paramedic care is rescue, save … end of life care obviously isn’t about life-saving, it’s about dignified death, symptom control management. It’s a change of thinking and so a lot of paramedics struggle with that, and I think they will look for anything that will help them guide them in that process and I think CMC is one that people are very familiar with using and generally find quite helpful.
[Lon29, paramedic, London]
I’ve worked with the ambulance service in the time before it [EPaCCS] was standard practice and I would say it’s such a necessity now that we’ve got it, if we lost it I think it would literally be like losing my hand … it cuts out awkward conversations and it also cuts out us doing something that may be an issue would be against their wishes … it takes that anxiety or the uncertainty out of the what are we going to do and see what’s best for this patient.
[Lon28, paramedic, London]

However, other professionals reported that EPaCCS records were sometimes of poor quality and that there were frequent problems with accessing the system. Consequently, this reduced their confidence that EPaCCS records contained sufficiently up-to-date information to support decision-making. Concerns were not about the potential of EPaCCS to improve care but regarding implementation issues such as restricted access, shareability, and inconsistent use of these records by staff. There was a fear that such problems could lead to patients receiving interventions and treatments that were against their stated and recorded wishes and preferences. This was particularly the case for paramedics who, without access to records, were more likely to make risk-averse decisions to hospitalize patients in the absence of knowing their wishes:

I can tell you categorically that we have not acted in the patient’s best interest … I’ll have taken somebody into hospital without my knowledge that [they have] an end-of-life care plan somewhere
[WY21, paramedic, West Yorkshire]

Principal Results

This study explored factors that influenced the implementation of EPaCCS in routine clinical practice across different care settings in 2 major regions of England. It identifies and elaborates on challenges around the implementation of EPaCCS, including problems with access, and inconsistent use and engagement across settings. A key issue was technological limitations, with separate electronic health records often operating in parallel systems or failing to provide sufficient documentation or access. Such problems have led to the potential value of EPaCCS being unrealized.

Guided by sociotechnical systems theory [56], Figure 2 summarizes these issues by highlighting how interactions between the individual, team, organizational, and technical dimensions of EPaCCS affected implementation. The content of this figure is grounded in the data. It was generated inductively through highlighting relationships between each of our themes alongside how they related to different levels of practice. This allowed us to move beyond description by explaining linkages between themes and bringing them together in a way that tells an overarching story of health care professionals’ perspectives on the processes that influenced the implementation of EPaCCS.

Figure 2. An overview of the individual, team, organizational, and technical factors that affect the implementation of digital advance care planning systems (ie, EPaCCS) in routine practice. EPaCCS: Electronic Palliative Care Coordination Systems.

Comparison With Prior Work

A key theme in this study was that limited buy-in and collective contributions to the creation, initiation, and use of EPaCCS across care settings affected implementation. Previous research has primarily used quantitative approaches to explore EPaCCS implementation, such as determining the proportion of EPaCCS records created across a specified population, and the average number of days that EPaCCS records are created before death [27,34]. However, our findings add novel and unique contributions by describing who initiates EPaCCS records, the factors that influence this, and the differences across regions. While some general practitioners and community nurses reported recording advance care planning discussions electronically, our study also highlights contributions made by health care professionals working across specialist palliative care settings. For some participants, providers of specialist palliative care were perceived as being better placed to initiate advance care planning conversations. A referral of a patient to specialist palliative care was perceived as affording greater time to interact with patients and other staff groups, alongside their experience in facilitating advance care planning discussions with patients and their families.

Participant experiences resonate with previously documented challenges related to advance care planning such as perceived lack of time, hesitancy in initiating conversations, and lack of care continuity [57-59]. Lack of clarity over who contributed to records and the timing of these contributions often resulted in poor-quality data. Such issues led to fears that EPaCCS records were incomplete or out of date, with some records being overly detailed or conversely, insufficiently informative to effectively support decision-making in out-of-hours or emergency care. The successful implementation of interventions that work across organizations (such as EPaCCS) relies on “whole systems” thinking [35]. Such implementation entails those involved in the use and implementation of EPaCCS (including commissioners and those responsible for service [re]design) accounting for the needs and influence of people working across different care settings and specialties.

In this study, care home staff reported having detailed discussions regarding residents’ wishes and preferences for care and documenting these within their own electronic systems. This aligns with previous research that the close relationships between care home staff and residents mean that staff are also well placed to have the sensitive and in-depth conversations required for advance care planning [60]. In this study, while electronic systems were reported to be used and engaged across care homes, the information contained within them was mostly inaccessible to external services. Care homes were also largely unable to access or provide helpful and detailed information from EPaCCS that could be used by other services. This highlights a key gap in the “whole systems” approach to EPaCCS. Addressing this gap is especially important given that care homes are projected to be the most common place of death in England by 2040 [61].

The implementation of EPaCCS at the individual, team, and organizational levels was affected by wider technological challenges. Issues related to the technical dimensions of EPaCCS have been well documented in the literature [13,30,33,36]. However, this study provides novel findings relating to health professional experiences of EPaCCS, further strengthened by its collection of data across 2 large geographical regions. This study builds on previous work and contributes details of how and why issues with access, functionality, and technical interoperability (ie, data integration, presentation, and exchange) [62] affected the implementation of EPaCCS across the United Kingdom. In London, challenges were experienced around the ability to move data between EPaCCS and existing electronic patient record systems (and vice versa) without duplication. Across West Yorkshire, a major interoperability issue was the failure of different electronic patient record systems to exchange advance care planning information. Moreover, while paramedics were most likely to use information within EPaCCS records in London to support decision-making in crisis contexts, they did not have this access across West Yorkshire. While these interoperability limitations affected health care professionals in different ways, they ultimately hindered the harnessing of the electronic information sharing and care coordination that EPaCCS is intended for.

Implications for Policy and Practice

Our findings highlight implications for practice relating to the use and implementation of electronic systems for palliative and end-of-life care. For complex interventions like EPaCCS to become normalized into everyday practice, they must fit within and enhance established systems of care [63]. It is also crucial that users can see their benefits to patient care and clinical practice compared to traditional ways of working [64,65]. However, these findings suggest that, in their current format, EPaCCS are not working as intended for facilitating person-centered care. Implementation challenges which resulted in missed opportunities to deliver care in line with recorded patient wishes, sometimes led to a loss of trust and confidence in EPaCCS, instead staff opted for more traditional means of communication and a return to traditional communication methods. Consequently, a redesign of EPaCCS is likely to be necessary to achieve the optimal configuration for successful implementation across different settings of care and geographical locations. To this end, we have generated a set of questions focusing on factors that were found to be influencing the uptake and use of EPaCCS across different settings of care (see Table 3).

Table 3. Questions for health care practitioners, commissioners of health care services, and policy makers to consider in optimizing the uptake and implementation of electronic information-sharing systems across different settings of care.
Level of actionRelevant toQuestions to consider
Individual or userProfessionals across settings of care involved in the creation, updating, reviewing, and use of electronic information sharing systems to inform decision-making
  • What are current levels of staff confidence in broaching and conducting advance care planning conversations with patients who have life-limiting illnesses?
  • To what extent are professionals across care settings clear on whose responsibility (including their own) it is to engage in advance care planning and documentation of any resultant patient wishes and preferences?
  • What are current levels of staff awareness of the different stages of electronic information sharing (eg, the creation, update, review, and use to inform decision-making) relating to their role?
Team or organizationalTeam leaders and service management
  • Is there collective agreement across care teams on how to embed electronic information sharing systems within everyday structures and processes (eg, at admission or discharge, multidisciplinary team meetings, and handovers)?
  • Is there a dedicated member or group of staff that can help to monitor uptake and promote sustained engagement with electronic information sharing systems both within and between services?
  • Is there clarity on the way in which electronic systems are intended to be used for the documentation of advance care plans (eg, which patients it is intended for, and when it might be used as part of their care)?
Technical or structuralCommissioners and policy makers
  • Do all services that are involved in the care of people with life-limiting illnesses have access to an electronic information sharing system (including paramedics and care homes)?
  • Have the outcomes of the electronic information-sharing systems been agreed upon, alongside how outcomes can be measured and fed back to users?

While this study was conducted within England and discussed within the policy context of the United Kingdom, the policy implications have international relevance. The global strategy on digital health from the World Health Organization calls for the implementation of functional and interoperable electronic health records that can contribute to informed decision-making and high-quality, person-centered care [66]. Our findings highlight factors to consider when developing electronic systems for use in the delivery of palliative and end-of-life care. The questions presented in Table 3, therefore, are likely to have relevance to policy makers and practitioners seeking to use and implement similar complex digital interventions (including electronic information-sharing systems) across multiple country and health care contexts. With increasing governmental policies on the development and implementation of health information technologies within the United Kingdom [62], these questions can guide efforts in the context of palliative and end-of-life care.

Strengths and Limitations

A strength and novelty of this work lies in the adoption of NPT to explain the processes across different levels of the health care system which affected whether and how EPaCCS were normalized into everyday practice. Through recruiting a wide range of health care professionals, across 5 settings of care, and 2 major regions within the United Kingdom, naturalistic generalizations [67] may be made from this work. That is, the findings of this study are likely to resonate with the personal experiences of healthcare professionals who use EPaCCS and similar health information technologies across end-of-life settings. We highlight 4 study limitations. First, we struggled to recruit community nurses across London, meaning that the application of study findings to this professional group is likely to be limited. Second, this study only sought the perspectives of health care professionals. Future research should explore patients' preferences on the content, sharing, and accessibility of their electronic records, alongside the impact of such digital interventions on the patient experience and clinical outcomes. Third, in line with other studies [68] throughout analysis, we found that the technical language of NPT and the overlapping of its components made deductively coding and interpreting data using this theoretical framework challenging. Fourth, we also appreciate that constructs comprising NPT focus on specific factors that influenced the implementation of EPaCCS in routine practice. Other implementation theories, models, and frameworks (eg, the Consolidated Framework for Implementation Research [69], Promoting Action on Research Implementation in Health Services [70], Capability, Opportunity, Motivation and Behaviour Theory [71]) may have provided different, yet equally valuable insights into answering the research question.

Conclusions

The successful implementation of digital interventions into routine care depends on the extent to which they enhance established ways of working with minimal disruption. EPaCCS represents just 1 approach to the electronic sharing of advance care plans, and other forms of digital advance care planning exist internationally. Integral to the implementation of digital advance care planning systems for palliative care is ensuring they can allow health care practitioners to document, access, use, and share information across multiple care settings. There also needs to be an effort at individual, team, and organizational levels to make sure that these tools are embedded into everyday care practices. It is paramount that they are championed within and between services, and that people know when, how, and why to use them. Commissioners, health care services, and practitioners should consider these multilevel factors when planning and rolling out digital advance care planning approaches.

Acknowledgments

This study is funded by the NIHR Health and Social Care Delivery Research Programme (NIHR129171). The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care. MA is a University Academic Fellow, funded through a research fellowship from Yorkshire Cancer Research. We wish to acknowledge Dr Samantha Coster, our colleague at King's College London, for her support and guidance in editing this article. This manuscript is published on behalf of the wider Optimal Care project team. Members of the team who are not included as authors on this manuscript but who were coapplicants and made significant contributions to the conceptualization and design of the project include Prof Michael Bennett (University of Leeds) and Dr Samuel Relton (University of Leeds, United Kingdom). We would also like to extend specific acknowledgment and recognition of our patient and public involvement lead for the Optimal Care project, Mrs Barbara Hibbert, who supported the development of project plans, formed our patient involvement group and facilitated inclusive and insightful patient and public involvement group meetings.

Data Availability

Deidentified transcripts generated and analyzed during this study are available from the corresponding author on reasonable request.

Authors' Contributions

MJA is the grant holder and Chief Investigator and was responsible for study conceptualization and development of the study protocol, with critical input from grant coapplicants, SR, RF, MT, KES, CJE, PC, and PMM. AB and JB conducted interviews with study participants. Analysis was led by AB and conducted with critical input and supervision from JB, MT, and MA. All authors had access to all study data, discussed the interpretation of findings, take responsibility for data integrity and analysis, contributed to the analysis plan, and provided critical comments and contributed to the writing and development of the manuscript. All authors reviewed the final manuscript. Artificial Intelligence was not used to generate any portions of the submitted manuscript.

Conflicts of Interest

This study is funded by the NIHR Health and Social Care Delivery Research Programme (NIHR129171). The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care. KES is the Laing Galazka chair at King’s College London, funded through an endowment from Cicely Saunders International and the Kirby Laing Foundation. MJA is a University Academic Fellow, funded through a research fellowship from Yorkshire Cancer Research. RF receives funding from the UK National Institute for Health and Care Research and is chair of the National Institute for Health and Care Excellence Implementation Strategy Group. We wish to acknowledge Dr Samantha Coster, our colleague at King's College London, for her support and guidance in editing this article. This manuscript is published on behalf of the wider Optimal Care project team. Members of the team who are not included as authors on this manuscript but who were coapplicants and made significant contributions to the conceptualization and design of the project include Prof Michael Bennett (University of Leeds) and Dr Samuel Relton (University of Leeds, United Kingdom). We would also like to extend specific acknowledgment and recognition of our patient and public involvement lead for the Optimal Care project, Mrs Barbara Hibbert, who supported the development of project plans, formed our patient involvement group and facilitated inclusive and insightful patient and public involvement group meetings.

Multimedia Appendix 1

COREQ (consolidated criteria for reporting qualitative research) checklist.

DOCX File , 27 KB

Multimedia Appendix 2

Interview topic guide.

DOCX File , 82 KB

  1. Twycross R. Introducing Palliative Care. United Kingdom. Radcliffe Publishing; 2003.
  2. Paparella G. Person-Centred Care in Europe: A Cross-Country Comparison of Health System Performance, Strategies and Structures. England. Picker Institute; 2016.
  3. WHO global strategy on integrated people-centred health services 2016-2026: Executive Summary. Geneva, Switzerland. World Health Organisation; 2015.
  4. Sleeman KE, Timms A, Gillam J, Anderson JE, Harding R, Sampson EL, et al. Priorities and opportunities for palliative and end of life care in United Kingdom health policies: a national documentary analysis. BMC Palliat Care. 2021;20(1):108. [FREE Full text] [CrossRef] [Medline]
  5. Alderwick H, Dixon J. The NHS long term plan. BMJ. 2019;364:l84. [FREE Full text] [CrossRef] [Medline]
  6. Sudore RL, Lum HD, You JJ, Hanson LC, Meier DE, Pantilat SZ, et al. Defining advance care planning for adults: a consensus definition from a multidisciplinary delphi panel. J Pain Symptom Manage. 2017;53(5):821-832. [FREE Full text] [CrossRef] [Medline]
  7. Brinkman-Stoppelenburg A, Rietjens JA, van der Heide A. The effects of advance care planning on end-of-life care: a systematic review. Palliat Med. 2014;28(8):1000-1025. [CrossRef] [Medline]
  8. Klingler C, in der Schmitten J, Marckmann G. Does facilitated advance care planning reduce the costs of care near the end of life? Systematic review and ethical considerations. Palliat Med. 2016;30(5):423-433. [FREE Full text] [CrossRef] [Medline]
  9. Abel J, Pring A, Rich A, Malik T, Verne J. The impact of advance care planning of place of death, a hospice retrospective cohort study. BMJ Support Palliat Care. 2013;3(2):168-173. [FREE Full text] [CrossRef] [Medline]
  10. Korfage IJ, Carreras G, Arnfeldt Christensen CM, Billekens P, Bramley L, Briggs L, et al. Advance care planning in patients with advanced cancer: a 6-country, cluster-randomised clinical trial. PLoS Med. 2020;17(11):e1003422. [FREE Full text] [CrossRef] [Medline]
  11. Malhotra C, Shafiq M, Batcagan-Abueg APM. What is the evidence for efficacy of advance care planning in improving patient outcomes? A systematic review of randomised controlled trials. BMJ Open. 2022;12(7):e060201. [CrossRef]
  12. Rietjens J, Korfage I, van der Heide A. Advance care planning: not a panacea. Palliat Med. 2016;30(5):421-422. [CrossRef] [Medline]
  13. Allsop MJ, Chumbley K, Birtwistle J, Bennett MI, Pocock L. Building on sand: digital technologies for care coordination and advance care planning. BMJ Support Palliat Care. 2022;12(2):194-197. [FREE Full text] [CrossRef] [Medline]
  14. Birtwistle J, Millares-Martin P, Evans CJ, Foy R, Relton S, Richards S, et al. Mapping and characterising electronic palliative care coordination systems and their intended impact: a national survey of end-of-life care commissioners. PLoS One. 2022;17(10):e0275991. [FREE Full text] [CrossRef] [Medline]
  15. Huber MT, Highland JD, Krishnamoorthi VR, Tang JW. Utilizing the electronic health record to improve advance care planning: a systematic review. Am J Hosp Palliat Care. 2018;35(3):532-541. [CrossRef] [Medline]
  16. Lamas D, Panariello N, Henrich N, Hammes B, Hanson LC, Meier DE, et al. Advance care planning documentation in electronic health records: current challenges and recommendations for change. J Palliat Med. 2018;21(4):522-528. [CrossRef] [Medline]
  17. McCarthy S, Meredith J, Bryant L, Hemsley B. Legal and Ethical Issues Surrounding Advance Care Directives in Australia: Implications for the Advance Care Planning Document in the Australian My Health Record. J Law Med. 2017;25(1):136-149. [Medline]
  18. End of Life Care Strategy promoting high quality care for all adults at the end of life. UK. Department of Health; 2008.
  19. National Palliative and End of Life Care Partnership, Ambitions for Palliative and End of Life Care: A National Framework for Local Action 2021-2026. 2021. URL: https:/​/www.​england.nhs.uk/​wp-content/​uploads/​2022/​02/​ambitions-for-palliative-and-end-of-life-care-2nd-edition.​pdf [accessed 2024-06-18]
  20. Our Commitment to you for end of life care: the Government Response to the Review of Choice in End of Life Care. London. Department of Health; 2016.
  21. den Herder-van der Eerden M, van Wijngaarden J, Payne S, Preston N, Linge-Dahl L, Radbruch L, et al. Integrated palliative care is about professional networking rather than standardisation of care: a qualitative study with healthcare professionals in 19 integrated palliative care initiatives in five European countries. Palliat Med. 2018;32(6):1091-1102. [FREE Full text] [CrossRef] [Medline]
  22. Hsiao CJ, King J, Hing E, Simon AE. The role of health information technology in care coordination in the United States. Med Care. 2015;53(2):184-190. [FREE Full text] [CrossRef] [Medline]
  23. Beernaert K, Cohen J, Deliens L, Devroey D, Vanthomme K, Pardon K, et al. Referral to palliative care in COPD and other chronic diseases: a population-based study. Respir Med. 2013;107(11):1731-1739. [FREE Full text] [CrossRef] [Medline]
  24. Billingham MJ, Billingham S. Congruence between preferred and actual place of death according to the presence of malignant or non-malignant disease: a systematic review and meta-analysis. BMJ Support Palliat Care. 2013;3(2):144-154. [CrossRef] [Medline]
  25. Ko W, Deliens L, Miccinesi G, Giusti F, Moreels S, Donker GA, et al. EURO IMPACT. Care provided and care setting transitions in the last three months of life of cancer patients: a nationwide monitoring study in four European countries. BMC Cancer. 2014;14:960. [FREE Full text] [CrossRef] [Medline]
  26. Smith C, Hough L, Cheung C, Millington-Sanders C, Sutton E, Ross JR, et al. Coordinate my care: a clinical service that coordinates care, giving patients choice and improving quality of life. BMJ Support Palliat Care. 2012;2(4):301-307. [CrossRef] [Medline]
  27. Allsop MJ, Kite S, McDermott S, Penn N, Millares-Martin P, Bennett MI. Electronic palliative care coordination systems: devising and testing a methodology for evaluating documentation. Palliat Med. 2017;31(5):475-482. [FREE Full text] [CrossRef] [Medline]
  28. Finucane AM, Davydaitis D, Horseman Z, Carduff E, Baughan P, Tapsfield J, et al. Electronic care coordination systems for people with advanced progressive illness: a mixed-methods evaluation in Scottish primary care. Br J Gen Pract. 2020;70(690):e20-e28. [FREE Full text] [CrossRef] [Medline]
  29. Palliative and end of life care information standard. Professional Record Standards Body. 2022. URL: https:/​/prsb2.​vercel.app/​page/​palliative-and-end-of-life-care-information-standard?hsCtaTracking=f03fff77-1ecb-44e3-955b- a56f038c83dd%7C52d83f23-deb4-48a6-99ef-5bd893ec26b6 [accessed 2024-06-18]
  30. Standing H, Patterson R, Lee M, Dalkin SM, Lhussier M, Bate A, et al. Information sharing challenges in end-of-life care: a qualitative study of patient, family and professional perspectives on the potential of an electronic palliative care Co-ordination system. BMJ Open. 2020;10(10):e037483. [FREE Full text] [CrossRef] [Medline]
  31. Patterson R, Standing H, Lee M, Dalkin S, Lhussier M, Exley C, et al. Paramedic information needs in end-of-life care: a qualitative interview study exploring access to a shared electronic record as a potential solution. BMC Palliat Care. 2019;18(1):108. [FREE Full text] [CrossRef] [Medline]
  32. Electronic palliative care co-ordination systems (EPaCCS). Public Health England. 2013. URL: https://www.gov.uk/government/publications/electronic-palliative-care-co-ordination-systems-epaccs [accessed 2024-06-18]
  33. Millares Martin P. Electronic palliative care coordination system (EPaCCS): interoperability is a problem. BMJ Support Palliat Care. 2018;8(3):358-359. [CrossRef] [Medline]
  34. Pocock L, Morris R, French L, Purdy S. Underutilisation of EPaCCS (electronic palliative care coordination systems) in end-of life-care: a cross-sectional study. BMJ Support Palliat Care. 2021:bmjspcare-2020-002798. [CrossRef] [Medline]
  35. Wye L, Lasseter G, Simmonds B, Duncan L, Percival J, Purdy S. Electronic palliative care coordinating systems (EPaCCS) may not facilitate home deaths: A mixed methods evaluation of end of life care in two English counties. Journal of Research in Nursing. 2016;21(2):96-107. [CrossRef]
  36. Petrova M, Riley J, Abel J, Barclay S. Crash course in EPaCCS (electronic palliative care coordination systems): 8 years of successes and failures in patient data sharing to learn from. BMJ Support Palliat Care. 2018;8(4):447-455. [FREE Full text] [CrossRef] [Medline]
  37. Leniz J, Weil A, Higginson IJ, Sleeman KE. Electronic palliative care coordination systems (EPaCCS): a systematic review. BMJ Support Palliat Care. 2020;10(1):68-78. [FREE Full text] [CrossRef] [Medline]
  38. Stebbins RA. Exploratory research in the social sciences. London. Sage Publications; 2001.
  39. Bryman A. Social research methods. England. Oxford: Oxford University Press; 2004.
  40. Burke S. Rethinking 'validity' and 'trustworthiness' in qualitative inquiry: How might we judge the quality of qualitative research in sport and exercise sciences?, in Routledge Handbook of Qualitative Research in Sport and Exercise. London. Routledge; 2016:330-339.
  41. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349-357. [CrossRef] [Medline]
  42. Skivington K, Matthews L, Simpson SA, Craig P, Baird J, Blazeby JM, et al. A new framework for developing and evaluating complex interventions: update of medical research council guidance. BMJ. 2021;374:n2061. [FREE Full text] [CrossRef] [Medline]
  43. May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: normalization process theory. Implement Sci. 2009;4:29. [FREE Full text] [CrossRef] [Medline]
  44. Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010;8:63. [FREE Full text] [CrossRef] [Medline]
  45. May C. Towards a general theory of implementation. Implement Sci. 2013;8:18. [FREE Full text] [CrossRef] [Medline]
  46. May CR, Albers B, Bracher M, Finch TL, Gilbert A, Girling M, et al. Translational framework for implementation evaluation and research: a normalisation process theory coding manual for qualitative research and instrument development. Implement Sci. 2022;17(1):19. [FREE Full text] [CrossRef] [Medline]
  47. McEvoy R, Ballini L, Maltoni S, O'Donnell CA, Mair FS, Macfarlane A. A qualitative systematic review of studies using the normalization process theory to research implementation processes. Implement Sci. 2014;9:2. [FREE Full text] [CrossRef] [Medline]
  48. May CR, Finch T, Ballini L, MacFarlane A, Mair F, Murray E, et al. Evaluating complex interventions and health technologies using normalization process theory: development of a simplified approach and web-enabled toolkit. BMC Health Serv Res. 2011;11:245. [FREE Full text] [CrossRef] [Medline]
  49. Etikan I, Musa SA, Alkassim RS. Comparison of convenience sampling and purposive sampling. AJTAS. 2016;5(1):1. [CrossRef]
  50. Malterud K, Siersma VD, Guassora AD. Sample size in qualitative interview studies: guided by information power. Qual Health Res. 2016;26(13):1753-1760. [CrossRef] [Medline]
  51. NVIVO. 2020. URL: https:/​/www.​qsrinternational.com/​nvivo-qualitative-data-analysis-software/​support-services/​nvivo-downloads/​older-versions [accessed 2024-06-18]
  52. Ritchie L, Lewis J, Nicholls CM, Ormston R. Qualitative research practice: a guide for social science students and researchers. California. Los Angeles, CA: Sage; 2003.
  53. Finlay L. Negotiating the swamp: the opportunity and challenge of reflexivity in research practice. Qualitative Research. 2016;2(2):209-230. [CrossRef]
  54. Smith B, McGannon KR. Developing rigor in qualitative research: problems and opportunities within sport and exercise psychology. International Review of Sport and Exercise Psychology. 2017;11(1):101-121. [CrossRef]
  55. Sparkes A, Smith B. Qualitative Research Methods in Sport, Exercise & Health From Process to Product. London. Routledge; 2014.
  56. Papagiannidis S. TheoryHub book: A theory resource for students and researchers alike. UK. Theory for Explaining; 2022.
  57. Bernacki RE, Block SD, American College of Physicians High Value Care Task Force. Communication about serious illness care goals: a review and synthesis of best practices. JAMA Intern Med. 2014;174(12):1994-2003. [CrossRef] [Medline]
  58. De Vleminck A, Houttekier D, Pardon K, Deschepper R, Van Audenhove C, Vander Stichele R, et al. Barriers and facilitators for general practitioners to engage in advance care planning: a systematic review. Scand J Prim Health Care. 2013;31(4):215-226. [FREE Full text] [CrossRef] [Medline]
  59. Jabbarian LJ, Zwakman M, van der Heide A, Kars MC, Janssen DJA, van Delden JJ, et al. Advance care planning for patients with chronic respiratory diseases: a systematic review of preferences and practices. Thorax. 2018;73(3):222-230. [CrossRef] [Medline]
  60. Bradshaw A, Ostler S, Goodman C, Batkovskyte I, Ellis-Smith C, Tunnard I, et al. Provision of palliative and end-of-life care in UK care homes during the Covid-19 pandemic: a mixed methods observational study with implications for policy. Front Public Health. 2023;11:1058736. [FREE Full text] [CrossRef] [Medline]
  61. Bone AE, Gomes B, Etkind SN, Verne J, Murtagh FE, Evans CJ, et al. What is the impact of population ageing on the future provision of end-of-life care? Population-based projections of place of death. Palliat Med. 2018;32(2):329-336. [FREE Full text] [CrossRef] [Medline]
  62. Sheikh A, Anderson M, Albala S, Casadei B, Franklin BD, Richards M, et al. Health information technology and digital innovation for national learning health and care systems. Lancet Digit Health. 2021;3(6):e383-e396. [FREE Full text] [CrossRef] [Medline]
  63. Dorr D, Bonner LM, Cohen AN, Shoai RS, Perrin R, Chaney E, et al. Informatics systems to promote improved care for chronic illness: a literature review. J Am Med Inform Assoc. 2007;14(2):156-163. [FREE Full text] [CrossRef] [Medline]
  64. Hall S, Murchie P, Campbell C, Murray SA. Introducing an electronic palliative care summary (ePCS) in Scotland: patient, carer and professional perspectives. Fam Pract. 2012;29(5):576-585. [CrossRef] [Medline]
  65. Carlfjord S, Lindberg M, Bendtsen P, Nilsen P, Andersson A. Key factors influencing adoption of an innovation in primary health care: a qualitative study based on implementation theory. BMC Fam Pract. 2010;11:60. [FREE Full text] [CrossRef] [Medline]
  66. Global strategy on digital health 2020-2025. California. World Health Organisation; 2020.
  67. Smith B. Generalizability in qualitative research: misunderstandings, opportunities and recommendations for the sport and exercise sciences. Qualitative Research in Sport, Exercise and Health. 2017;10(1):137-149. [CrossRef]
  68. May CR, Cummings A, Girling M, Bracher M, Mair FS, May CM, et al. Using normalization process theory in feasibility studies and process evaluations of complex healthcare interventions: a systematic review. Implement Sci. 2018;13(1):80. [FREE Full text] [CrossRef] [Medline]
  69. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. [FREE Full text] [CrossRef] [Medline]
  70. Rycroft-Malone J. The PARIHS framework--a framework for guiding the implementation of evidence-based practice. J Nurs Care Qual. 2004;19(4):297-304. [CrossRef] [Medline]
  71. Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42. [FREE Full text] [CrossRef] [Medline]


CMC: Coordinate My Care
COREQ: consolidated criteria for reporting qualitative research
EPaCCS: Electronic Palliative Care Coordination Systems
NPT: Normalization process theory


Edited by A Mavragani; submitted 23.06.23; peer-reviewed by C Laranjeira, T Phenwan; comments to author 14.09.23; revised version received 18.10.23; accepted 30.05.24; published 16.08.24.

Copyright

©Andy Bradshaw, Jacqueline Birtwistle, Catherine J Evans, Katherine E Sleeman, Suzanne Richards, Robbie Foy, Pablo Millares Martin, Paul Carder, Matthew J Allsop, Maureen Twiddy. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 16.08.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.