This paper is in the following e-collection/theme issue:

Web-based and Mobile Health Interventions (3297) Consumer & Patient Education and Shared-Decision Making (679)

Published on in Vol 22, No 3 (2020): March

The Feasibility and Effectiveness of Web-Based Advance Care Planning Programs: Scoping Review

The Feasibility and Effectiveness of Web-Based Advance Care Planning Programs: Scoping Review

The Feasibility and Effectiveness of Web-Based Advance Care Planning Programs: Scoping Review

Authors of this article:

Doris van der Smissen1 Author Orcid Image ;   Anouk Overbeek1, 2 Author Orcid Image ;   Sandra van Dulmen3, 4, 5 Author Orcid Image ;   Lisette van Gemert-Pijnen6 Author Orcid Image ;   Agnes van der Heide1 Author Orcid Image ;   Judith AC Rietjens1 Author Orcid Image ;   Ida J Korfage1 Author Orcid Image
Article Authors Cited by (26) Tweetations (8) Metrics

    Review

    1Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, Netherlands

    2Department of Criminal Law, Erasmus University Rotterdam, Rotterdam, Netherlands

    3Nivel (Netherlands institute for health services research), Utrecht, Netherlands

    4Department of Primary and Community Care, Radboud Institute for Health Sciences, Radboud university medical center, Nijmegen, Netherlands

    5Faculty of Health and Social Sciences, University of South-Eastern Norway, Drammen, Norway

    6Centre for eHealth and Wellbeing Research, Department of Psychology, Health and Technology, University of Twente, Enschede, Netherlands

    Corresponding Author:

    Doris van der Smissen, MSc

    Department of Public Health

    Erasmus MC, University Medical Center Rotterdam

    P O Box 2040

    Rotterdam, 3000 CA

    Netherlands

    Phone: 31 107038470

    Email: d.vandersmissen@erasmusmc.nl


    Background: Advance care planning (ACP) is a process with the overall aim to enhance care in concordance with patients’ preferences. Key elements of ACP are to enable persons to define goals and preferences for future medical treatment and care, to discuss these with family and health care professionals, and to document and review these if appropriate. ACP is usually conducted through personal conversations between a health care professional, a patient, and—if appropriate—family members. Although Web-based ACP programs have the potential to support patients in ACP, their effectiveness is unknown.

    Objective: This study aimed to assess the feasibility and effectiveness of Web-based, interactive, and person-centered ACP programs.

    Methods: We systematically searched for quantitative and qualitative studies evaluating Web-based, interactive, and person-centered ACP programs in seven databases including EMBASE, Web of Science, Cochrane Central and Google Scholar. Data on the characteristics of the ACP programs’ content (using a predefined list of 10 key elements of ACP), feasibility, and effectiveness were extracted using a predesigned form.

    Results: Of 3434 titles and abstracts, 27 studies met the inclusion criteria, evaluating 11 Web-based ACP programs—10 were developed in the United States and one in Ireland. Studied populations ranged from healthy adults to patients with serious conditions. Programs typically contained the exploration of goals and values (8 programs), exploration of preferences for treatment and care (11 programs), guidance for communication about these preferences with health care professionals or relatives (10 programs), and the possibility to generate a document in which preferences can be recorded (8 programs). Reportedly, participants were satisfied with the ACP programs (11/11 studies), considering them as easy to use (8/8 studies) and not burdensome (7/8 studies). Designs of 13 studies allowed evaluating the effectiveness of five programs. They showed that ACP programs significantly increased ACP knowledge (8/8 studies), improved communication between patients and their relatives or health care professionals (6/6 studies), increased ACP documentation (6/6 studies), and improved concordance between care as preferred by the patients and the decisions of clinicians and health care representatives (2/3 studies).

    Conclusions: Web-based, interactive, and person-centered ACP programs were mainly developed and evaluated in the United States. They contained the key elements of ACP, such as discussing and documenting goals and preferences for future care. As participants considered programs as easy to use and not burdensome, they appeared to be feasible. Among the 13 studies that measured the effectiveness of programs, improvement in ACP knowledge, communication, and documentation was reported. The concordance between preferred and received care is yet understudied. Studies with high-quality study designs in different health care settings are warranted to further establish the feasibility and effectiveness of Web-based ACP programs.

    J Med Internet Res 2020;22(3):e15578

    doi:10.2196/15578

    Keywords

    advance care planning; Web-based intervention; decision aids; patient education; eHealth; health communication; patient-centered care; chronic disease 


    Background

    Contemporary conceptualization of advance care planning (ACP) defines ACP as a process that enables persons to define goals and preferences for future medical treatment and care and to discuss these with family and health care professionals [1]. Furthermore, persons may record and review these preferences if appropriate [1]; therefore, preferences can be accessed when these persons are not able to speak for themselves. The overall aim of ACP is to improve concordance between preferred and received care. ACP may be useful in any stage of life but becomes more targeted when a person’s health condition worsens or when age increases [1]. ACP is usually conducted through a structured, personal conversation between a health care professional, a patient, and—if appropriate—family members. Since the 1990s, evidence has amassed, showing that ACP interventions have potentially beneficial outcomes for patients and health care systems. These include increased completion of advance directives (ADs): documents in which preferences for future medical treatment and care can be recorded [2,3]. Furthermore, these beneficial outcomes include better alignment of care to expressed preferences, better quality of communication in clinical consultations, improved quality of life, reduction of unwanted hospital admissions, and increased use of palliative care [2,3].

    Health care professionals and patients generally underline the importance of ACP [4]. Given that the number of people with chronic conditions is increasing [5] and that ACP can be relevant in the early stages of disease, ACP will become relevant for a growing number of people. Nevertheless, the implementation of ACP in practice faces several challenges [4,6,7]. The (facilitated) ACP process takes time, and supporting patients in this process is, therefore, costly [4,6]. This limits the upscaling of and accessibility to the ACP process. Engagement in ACP is further limited by the delay in its initiation because of the barriers experienced by health care professionals and patients: health care professionals report concerns about taking away patients’ hope and uncertainty about timing of ACP, whereas patients expect health care professionals to initiate ACP [4,6]. Further barriers to engagement in ACP are physicians’ lack of training in having ACP conversations and lack of continuity of care [4,6]. Furthermore, people with chronic diseases may not have the time and energy for face-to-face conversations, for example, because of treatment burden, even if these conversations would help them [8-10]. Still, there are patients and healthy individuals who experience a clear need to engage in ACP. For instance, 398 of 502 (79.3%) Belgian citizens aged 64 years and older indicated to be willing to take the initiative to start the ACP process, for example, by completion of an AD [11].

    One way of overcoming the barriers to wider implementation of ACP may be Web-based ACP programs [12-14]. They can be accessed on the Web at any preferred time, have the potential to reach a larger audience, are relatively easy to implement, and are scalable. Moreover, a Web-based format of ACP may be an addition to the ACP process as facilitated by professionals, as it can be delivered stepwise and tailored and can include interactive elements and videos. Web-based ACP programs should not replace discussions with health care professionals or with ACP facilitators, but they may support patients to prepare these discussions and to consider their values, beliefs, and care preferences in their own time and environment. Ample research in other domains has shown that Web-based health programs can be effective in improving health outcomes such as physical activity [15], patient empowerment [15,16], and depression [17]. They have the potential to be cost-effective [18]. Patients perceive Web-based health programs usually to be useful and helpful [19]. Therefore, Web-based ACP programs may have the potential to support patients in ACP.

    Several reviews described person-centered tools, including decision aids targeted at adult patients and their relatives as well as healthy individuals. These tools are related to ACP, shared decision making, and end-of-life care. Some studies in these reviews also included Web-based or computerized programs [14,20-24]. None of these reviews focused specifically on empirically evaluated, Web-based, and available programs for ACP and their feasibility and effectiveness. In addition, none of the reviews focused on interactive programs, which guide users through the information and in which users are enabled to interact with the information. Only Butler et al [14] focused specifically on ACP decision aids. Most of the reviews (except for the study by Butler et al [14]) focused on specific populations instead of providing an overview of available ACP programs for the general population as well as for patients.

    Scope of This Review

    The overall aim of this scoping review was to assess the feasibility and effectiveness of Web-based, interactive, and person-centered ACP programs. This review focuses on the following research questions: (1) What are the functionalities of Web-based ACP programs?, (2) What is the content of Web-based ACP programs?, (3) How feasible are Web-based ACP programs?, and (4) How effective are Web-based ACP programs?


    Methodological Framework

    Scoping studies “aim to map rapidly the key concepts underpinning a research area and the main sources and types of evidence available and can be undertaken as stand-alone projects in their own right, especially where an area is complex or has not been reviewed comprehensively before” [25]. Scoping reviews can be used to explore the literature within a research area of interest by addressing broad research questions. This exploration can be done regardless of the methodological quality of the studies or risk of bias [26,27]. We used a systematic approach, namely, the methodological framework for scoping reviews by Arksey and O’Malley [26]. The five stages of the framework for scoping reviews are (1) identifying the research question; (2) identifying relevant studies; (3) study selection; (4) charting the data; and (5) collating, summarizing, and reporting the results [26].

    Search Strategy

    The search strategy was developed in collaboration with a medical librarian. We systematically searched for empirical studies written in the English language that evaluated Web-based, interactive, and person-centered ACP programs. We searched in EMBASE on July 24, 2017, and in Medical Literature Analysis and Retrieval System Online Epub (MEDLINE Epub [Ovid]), Web of Science, Cochrane Central, PsycINFO (Ovid), Cumulative Index to Nursing and Allied Health Literature (CINAHL [EBSCO]), and Google Scholar on July 28, 2017, and updated this search on April 16, 2019. Multimedia Appendix 1 presents the search strategy.

    Study Selection

    Duplicates were removed. Two reviewers (DS and AO) independently screened titles, abstracts, and full text of articles to identify relevant studies, assisted by the program Covidence (operated by Veritas Health Innovation Ltd) [28]. Articles were included when they fulfilled the inclusion criteria, as presented in Textbox 1. In addition, we handsearched the references of included articles and other possibly relevant articles. When DS and AO could not reach consensus about inclusion or exclusion, other authors were consulted (IK and JR). Disagreements were readily resolved.

    Inclusion criteria for the full-text papers.

    1. The study has an original empirical quantitative or qualitative research design. Reviews and conference abstracts were excluded.

    2. The study evaluates a program that:

    • supports the completion of one or more elements of advance care planning (ACP), defined as enabling persons to define, discuss, record, and review goals and preferences for future medical treatment and care [1];
    • is accessible and available on the internet;
    • is interactive, defined as guiding users through the ACP process in which they are enabled to interact with information instead of only reading text; and
    • is person centered, defined as being targeted at adult patients, relatives, and/or healthy individuals in general rather than solely at clinicians or medical students.

    3. Language of the publication should be English.

    Textbox 1. Inclusion criteria for the full-text papers.

    Data Extraction and Outcomes of Interest

    Data extraction was performed by DS and AO using a predesigned form. Data were extracted from the ACP programs and from the studies evaluating the ACP programs.

    Advance Care Planning Programs

    Functionalities of the ACP programs were extracted based on the Consolidated Standards of Reporting Trials of Electronic and Mobile HEalth Applications and onLine TeleHealth (CONSORT-EHEALTH) checklist [29], which is developed to ensure that electronic health (eHealth) interventions in randomized controlled trials (RCTs) are reported in sufficient detail for replication. We extracted the programs’ target group and accessibility, for example, whether it was possible to access the program without registration. Furthermore, we extracted whether the programs were free of charge; were tailored to the users’ information needs; provided feedback on responses; showed progress information; had the possibility of giving input, for example, to answer questions; contained hyperlinks to (external) Web pages; contained a text-to-speech option; contained videos; could be used without assistance; addressed the privacy policy; and addressed log data analysis (tracking behavior of users in a Web-based program).

    The content of the ACP programs was extracted based on the European Association for Palliative Care (EAPC) consensus definition of ACP [1]. In this review, the EAPC ACP task force defined 12 key elements of ACP, which we summarized into 10 elements, such as providing information about ACP, addressing the readiness/timing for ACP, addressing exploration of values and goals, and addressing recording of ACP and ACP communication [1].

    Advance Care Planning Studies

    The following study characteristics were extracted: first author and year, country, participants and setting, study design, intervention and outcome measures, and results of the studies on feasibility and effectiveness of ACP programs.

    The feasibility of the ACP programs was extracted based on the framework of Bowen et al [30]. We extracted the acceptability of the burden of the program, ease of use, understandability of the text in the program, and the acceptability of the program. To briefly address the implementation of the programs, we extracted whether further developments or research of the programs were described. Furthermore, we extracted outcomes as recommended by the CONSORT-EHEALTH checklist [29], namely, participation rates among the contacted participants, completion rates of those who provided consent completing the entire program, whether the use of log data of users was described, and whether user feedback was obtained.

    To report on the effectiveness of ACP programs, we used the outcome measures of ACP that were recommended by the EAPC ACP task force, such as ACP knowledge; self-efficacy; identification of goals, values, and preferences; helpfulness in ACP (for making decisions); health care use; and decision concordance between the patients’ preferences and health care professionals’ decisions [1].


    Inclusion of Papers

    The search resulted in 6812 records (see Figure 1). After removing duplicates, 3434 titles and abstracts remained. On the basis of the inclusion criteria, 3300 titles and abstracts were found to be irrelevant and were excluded. Next, 134 studies were screened full text, of which 113 studies were excluded (see Figure 1 for details on exclusion). Twenty-one studies were identified as relevant. Handsearch of systematic reviews and potentially relevant other references resulted in the inclusion of three further studies. Overall, in 2017, 24 studies were included for data extraction. On the basis of their initial independent scoring, DS and AO had an agreement for 110 of the 134 full texts (82.1%) about inclusion or exclusion. The interrater reliability is considered moderate (kappa=0.52). Disagreements about inclusion or exclusion were readily resolved, and it was seldom necessary to consult other authors.

    In 2019, 983 new references were identified, of which 36 were screened for full-text review. Three articles were included, which analyzed two programs that were already described in this review. This resulted in a total number of 27 included articles.

    ‎
    Figure 1. Flowchart of the inclusion of papers.
    View this figure

    Functionalities of the Web-Based Advance Care Planning Programs

    Table 1 presents an overview of the functionalities of the Web-based ACP programs, and Multimedia Appendix 2 presents the links to the Web-based programs. The 27 included studies evaluated 11 Web-based programs—8 programs were targeted at patients or healthy individuals, two programs were targeted at patients and relatives, and one program was targeted at patients and health care professionals. Related to the accessibility of the Web-based programs, we found that six programs were accessible without registration, and 10 programs were free of charge. Ten programs could be used without assistance of a health care professional. Related to the interactivity, we found that all programs provided the possibility for the users to give input, for example, by answering questions. Eight programs included an indicator of the progress of users in completing the program. Seven programs could tailor to users’ information needs by providing additional information if preferred, and six programs contained hyperlinks to (external) Web pages. Three of the programs provided (specific) feedback on responses of users, for example, by giving a personalized response to answered questions in the program. Related to the layout, eight programs contained videos, and two had a text-to-speech option to play text in audio. Finally, eight programs described their privacy policy in the program and reported that they analyzed log data of users. The program PREPARE For Your Care (PREPARE) addresses 11 of 12 functionalities, and the program Making Your Wishes Known addresses 10 functionalities. The programs Death over Dinner, MyDirectives, and Think Ahead address nine functionalities each, and all other programs address five to eight functionalities.

    Table 1. Functionalities of the Web-based advance care planning programs.
    ProgramsTarget groupAccessible (without registration)Free of chargeCan be used without assistancePossibility to give input (eg, answer questions)Shows progress informationTailored to users’ information needsContains hyperlinks to (external) Web pagesProvides feedback on responsesContains videosText-to-speech optionPrivacy policy addressedLog data analysis addressed
    ACP Decisions [31]Pa and Hbxc✓dx✓xxxx✓x✓✓
    Death over Dinner [32]P and Re✓✓✓✓✓✓✓✓✓xxx
    Five Wishes [33]Pxx✓✓✓x✓x✓x✓✓
    Making Your Wishes Known [34-45]Px✓✓✓✓✓x✓✓✓✓✓
    MyDirectives [38,46]Px✓✓✓✓✓✓x✓x✓✓
    MyICUGuide [47]P and R✓✓✓✓✓xxxxx✓✓
    NVLivingWill [48]Px✓✓✓✓✓✓xxxxx
    Plan Your Lifespan [49]P✓✓✓✓✓✓✓x✓xxx
    PREPARE For Your Care [38,50-55]P✓✓✓✓✓✓x✓✓✓✓✓
    The Letter Project Advance Directive [56]P✓✓✓✓xxxxxx✓✓
    Think Ahead [57]P✓✓✓✓x✓✓x✓x✓✓
    Totalf-610101187638288

    aP: patients.

    bH: health care professionals.

    cx: not addressed in the program.

    d✓: addressed in the program.

    eR: relatives.

    fTotal number of programs that addressed the functionalities.

    Content of the Web-Based Advance Care Planning Programs

    Table 2 presents an overview of the content of the Web-based ACP programs, and Multimedia Appendix 2 presents the links to the Web-based programs. Target groups, for example, patients, were involved in the development of seven programs [31,34-45,47,49-57]. Four programs had a theory base [34-45,47,50,57], for example, Making Your Wishes Known was based on the Multi-Attribute Utility Theory, and PREPARE was based on behavior change theories. Related to the key elements for ACP, we found that almost all programs provided information about ACP (10 programs) and included attention for readiness for ACP or for adequate timing of ACP (10 programs). Furthermore, the exploration of goals and values for future treatment and care was addressed by eight programs. In all programs, attention was paid to treatment and care options and treatment and care preferences. Furthermore, all programs addressed the potential appointment of a health care representative (ie, someone who can make decisions on behalf of the patient when he or she is unable to do so) and paid attention to the recording of ACP: eight programs included the possibility to generate a document in which patients can record their goals, values, and preferences. In nine programs, users were encouraged to share this document with their relatives or health care professionals. Ten programs addressed how to communicate preferences with health care professionals or with relatives.

    Table 2. Inclusion of the recommended key elements for advance care planning in the Web-based advance care planning programs.
    ProgramsProvides information about ACPaAddresses readiness/timing for ACPAddresses exploration of values/goalsAddresses treatment and care optionsAddresses treatment and care preferencesAddresses appointment of a health care representativeAddresses recording of ACPGenerates documentEncourages to share the documentAddresses ACP communication
    ACP Decisions [31]✓b✓✓✓✓✓✓xcx✓
    Death over Dinner [32]✓xx✓✓✓✓x✓✓
    Five Wishes [33]✓✓✓✓✓✓✓✓✓✓
    Making Your Wishes Known [34-45]✓✓✓✓✓✓✓✓✓✓
    MyDirectives [38,46]✓✓✓✓✓✓✓✓✓✓
    MyICUGuide [47]✓✓✓✓✓✓✓✓✓✓
    NVLivingWill [48]✓✓x✓✓✓✓✓✓✓
    Plan Your Lifespan [49]✓✓x✓✓✓✓✓x✓
    PREPARE For Your Care [38,50-55]✓✓✓✓✓✓✓✓✓✓
    The Letter Project Advance Directive [56]x✓✓✓✓✓✓✓✓x
    Think Ahead [57]✓✓✓✓✓✓✓x✓✓
    Totald10108111111118910

    aACP: advance care planning.

    b✓: addressed in the program.

    cx: not addressed in the program.

    dTotal number of programs that addressed the elements.

    Evaluation of the Web-Based Advance Care Planning Programs

    Most programs were evaluated in one study [31-33,47-49,56,57], two studies evaluated MyDirectives [38,46], seven studies evaluated PREPARE [38,50-55], and 12 studies evaluated Making Your Wishes Known in [34-45]. Multimedia Appendix 3 presents an overview of the characteristics of the studies. All programs were developed in the United States, except for Think Ahead, which was developed in Ireland [57]. All studies were published in the period from 2007 to 2018, of which nine studies were published in 2017. In total, 25 of the studies have a quantitative design [31,33-49,51-57], and two study designs are qualitative [32,50]. Nine studies allowed comparison of outcomes before/after an intervention [31,35,40,42,43,45,53-55], and eight studies allowed comparison between intervention and control groups [31,39,45,49,52,54-56]. Studied populations ranged from healthy adults to patients with serious conditions. The sample sizes of the quantitative studies ranged from 17 to 3119, and participation rates ranged from 14% to 100%. The use of validated measures, if applicable, is indicated in Multimedia Appendix 3.

    Feasibility of the Web-Based Advance Care Planning Programs

    Multimedia Appendix 4 presents an overview of the feasibility of the Web-based ACP programs of the 25 quantitative studies. The participation rate among contacted participants was over 60% in six studies and ranged from 14% to 58% in 12 studies. Seven studies did not report on participation rates. The completion rate considering the entire program ranged from 31% to 72% in five studies and ranged from 83% to 100% in the other 17 studies. Three studies did not report on completion rates. One paper used log data analysis [58] to assess feasibility, seven studies obtained (qualitative) user feedback, and 12 studies described further developments of the program or planned future research on the program, which may indicate further implementation/continued use of the programs.

    Thirteen of the 25 quantitative studies evaluated one or more of the four predefined elements of feasibility [30] in 6 of the 11 programs: acceptability of the burden of the program (8 studies), ease of use (8 studies), understandability of the text (4 studies), and acceptability of the program (2 studies). With the exception of one study with mixed results [57], outcomes indicated that users found the burden acceptable, the program easy to use, and the text understandable. The program was found acceptable in one study [47].

    In one qualitative study, participants reported ease of use and understandability of the text as well as barriers because of confusing layout and emotive language [50]. However, the authors concluded that the program was acceptable, applicable, and understandable.

    Outcomes of the Studies on Web-Based Advance Care Planning Programs

    Multimedia Appendix 3 presents an overview of the outcomes of the quantitative and qualitative studies. The 25 quantitative studies reported on evaluations of ACP as recommended by the EAPC ACP task force [1], such as the identification of goals, values, and preferences (18 studies) or documentation of preferences in a PDF output document or an AD (18 studies). Often, these aspects were part of the ACP program. In approximately half of the studies, ACP communication (13 studies), satisfaction with the program (11 studies), and ACP helpfulness (11 studies) were evaluated. Less than half of the studies evaluated ACP knowledge (11 studies) and quality of ACP/accuracy in reflecting wishes (7 studies). Few studies evaluated ACP readiness (6 studies), self-efficacy (6 studies), ACP revision over time (4 studies), (decision) concordance between the patients’ preferences and the health care professionals’ decisions (2 studies) or the health care representatives’ decisions (1 study), and health care use (1 study).

    The research designs of 13 of the 25 quantitative studies allowed for the determination of the effectiveness of Web-based ACP programs using an RCT design and/or before and after designs. Eight studies applied an RCT design [31,39,45,49,52,54-56], and nine studies compared follow-up results of the intervention group with baseline (before and after design) [31,34,40,42,43,45,53-55] (see Multimedia Appendix 3). These studies evaluated the effectiveness of five Web-based ACP programs. Outcomes of these 13 quantitative studies indicate significantly increased ACP knowledge (8/8 studies); ACP communication (6/6 studies); ACP documentation (6/6 studies); identification of goals, values, and preferences (4/4 studies); self-efficacy (4/5 studies); and ACP readiness (4/5 studies). These outcomes are visualized in Table 3 and Figure 2 [31,34,39,40,42,43,45,49,52-56]. The remaining 12 quantitative studies were cross-sectional.

    The extent to which programs were evaluated differed. For example, the programs ACP Decisions, MyICUGuide, and NVLivingWill were each evaluated considering one of the predefined outcome measures [1] in one study, whereas Making Your Wishes Known was evaluated in 12 studies in different settings considering 10 outcome measures, and PREPARE was evaluated in seven studies in different settings considering eight outcome measures.

    The two qualitative studies indicated that participants were satisfied with the programs, which helped them to communicate about ACP [32,50]. In one of these qualitative studies, which evaluated the program PREPARE, participants gained more knowledge about ACP, although the section about values and beliefs was considered less relevant [50].

    ‎
    Figure 2. Results of quantitative studies assessing the effectiveness of Web-based advance care planning programs comparing the intervention group (Web-based advance care planning program) with baseline or control groups (N=13). ACP: advance care planning.
    View this figure
    Table 3. Results of quantitative studies assessing the effectiveness of Web-based advance care planning programs comparing the intervention group (Web-based advance care planning program) with baseline and/or control groups.
    StudiesProgramACPa knowledgeSelf-efficacyACP readinessIdentification of goals, values and preferencesACP communicationACP documentationACP revisionACP helpfulness (making decisions)Quality of ACP or accuracySatisfactionHealth care useDecision concordance
    Volandes et al [31]ACP Decisions—b————+c————↓d—
    Green and Levi [34]Making Your Wishes Known————————+———
    Markham et al [40]Making Your Wishes Known+———————————
    Green et al [39]Making Your Wishes Known+——++——+—+——
    Van Scoy et al [42]Making Your Wishes Known+———————————
    Levi et al [43]Making Your Wishes Known+——————————+
    Green et al [45]Making Your Wishes Known—NSe—————————+
    Lindquist et al [49]Plan Your Lifespan——NS—+++—————
    Sudore et al [53]PREPARE For Your Care++++++——————
    Sudore et al [52]PREPARE For Your Care++++++———NS——
    Lum et al [54]PREPARE For Your Care+++—++——————
    Sudore et al [55]PREPARE For Your Care+++—++—+—NS——
    Periyakoil et al [56]The Letter Project Advance Directive———+———+————
    Totalf13855466131312

    aACP: advance care planning.

    b—: Not examined by statistically comparing groups.

    c+: significant increase.

    d↓: significant decrease.

    eNS: effectiveness examined, but no significant differences found.

    fTotal number of studies in which the outcome measures were examined by comparing the intervention group (Web-based advance care planning program) with baseline and/or control groups.


    Principal Findings

    This scoping review provides an overview of Web-based, interactive, and person-centered ACP programs, including their functionalities, content, feasibility, and effectiveness.

    This review identified 11—mainly developed in the United States—programs, many of which contain videos, provide tailored information, and can be used without assistance. Most of the programs contain the key elements of ACP [1], such as information about ACP, goals and preferences for future treatment and care, and included the possibility to generate a document in which patients can record their goals, values, and preferences. The extent to which programs contain functionalities such as text-to-speech differs. The program PREPARE, for instance, has 11 of such functionalities, whereas ACP Decisions contains five functionalities. Furthermore, the extent to which programs were evaluated differed between studies. For example, the programs ACP Decisions, MyICUGuide, and NVLivingWill were each evaluated in one study, whereas the program Making Your Wishes Known was evaluated in 12 studies in different settings.

    Reportedly, programs were easy to use and not burdensome to participants. However, the feasibility of the programs was evaluated in only 13 of 27 studies for six programs, the evaluation was often limited to one or two outcome measures, and the response and completion rates were relatively low for some studies. In general, reportedly, participants were satisfied with the ACP programs. Some outcome measures, such as quality or accuracy of the program in representing wishes, health care use, its concordance with patients’ preferences, and the revision of preferences and documents over time, were less often evaluated. Overall, the studies with RCT or before and after designs comparing the intervention group with baseline or a control group showed that Web-based ACP programs are a promising approach to support patients in ACP by showing significant improvement in ACP knowledge, ACP communication, and ACP documentation.

    There seems to be no link between the outcomes and the content of the programs because almost all programs address the key elements of ACP. Although many studies found results in a favorable direction, only the minority of the studies, namely, 13 of 27, use strong research designs in which groups were statistically compared.

    Comparison With Prior Research

    This review focuses on providing an overview of Web-based, interactive, and person-centered ACP programs that are currently available. Although previous reviews did not have this specific focus, the reviews describe similar content and outcomes for Web-based programs related to ACP as in the this review, such as identification of preferences and treatment options, completion of ADs, the appointment of a health care representative, and they report satisfaction with the programs and increase of knowledge after using the program [14,20,21]. This review found some Web-based programs, which were also identified by the prior reviews, such as Making Your Wishes Known and PREPARE. As Butler et al [14] described, it seems that many Web-based programs in ACP, end-of-life care, and palliative care are available in the gray literature as well. For example, the interactive ACP program My Decisions from the United Kingdom [59] and the palliative care communication program Tell Us from the United States [60] are available on the internet but seemed not to be investigated in a study (when our search strategy was conducted). Therefore, the evaluation of Web-based ACP programs seems to be a challenge/opportunity for future research.

    Strengths and Limitations

    This review has several strengths. We used a systematic approach, namely, the methodological framework for scoping reviews by Arksey and O’Malley [26]. The EAPC definition and recommendations for ACP allowed for a structured evaluation of the content and the effectiveness of the programs [1]. The framework of Bowen et al [30] and the CONSORT-EHEALTH checklist [29] allowed for a structured evaluation of the feasibility of the programs. The search was systematically conducted and performed with broad search terms in seven databases. Two reviewers independently screened the titles, abstracts, and full text of articles to select relevant studies.

    Some limitations should also be mentioned. Importantly, it should be taken into account that the content and layout of Web-based programs are continually changing. Although the WebCite tool allowed us to archive the websites’ homepages (Multimedia Appendix 2), it is possible that (parts of the) programs have changed in the period between our review of the websites and the publication of this study. Furthermore, we only included Web-based programs which were evaluated in a study.

    Recommendations for Future Research

    First, as most of the Web-based ACP programs are developed in the United States, we recommend the development of evidence-based, Web-based, interactive, and person-centered ACP programs in countries outside the United States. Ideally, to allow for proper scaling up of ACP, these programs should be tailored to local cultural and legal circumstances. To enhance the quality of Web-based ACP programs, we recommend that these Web-based ACP programs contain all key elements of ACP. Second, several important outcomes of ACP were often not reported. More clarity on which outcome measure to report, and when, would be useful. In addition, support in how to assess key outcome measures, such as concordance between preferred and received care, is needed because this important outcome measure is difficult to measure. Namely, it is not always clearly stated in medical files whether provided treatments had a curative or a palliative intent [61]. When this is not mentioned, it is difficult to determine whether treatments aligned with preferences [61]. Furthermore, it is difficult to establish a baseline measure of patients’ goals, and when goals are not documented, the concordance with these goals cannot be evaluated [62]. In addition, patients’ preferences may change during the study period, which complicates the use of this measure in practice [62]. In addition, it could be that Web-based ACP affects care in the long run, which further complicates its measurement. We recommend further research into this topic, for instance, by developing a core outcome set for ACP. Third, we recommend evaluating the feasibility of ACP programs. A clear guideline of evaluating feasibility in eHealth tools/Web-based programs is not yet available. Therefore, preferably that evaluation should be based on the framework of Bowen et al [30] and the CONSORT-EHEALTH checklist [29], which indicate important outcome measures. Fourth, we recommend the use of proper research designs, such as RCTs or before and after research designs, allowing for further determination of the effectiveness and feasibility of Web-based ACP programs. Future studies may evaluate how stakeholders other than patients perceive the role of Web-based ACP programs in the health care process, for example, general practitioners. We strongly recommend comparing the feasibility and effectiveness of the programs to ACP by health care professionals or to ACP supported by facilitators because the effectiveness of the programs in health care practice is still unknown. Finally, related to safety and technology, the safety of the generated documents by the Web-based ACP programs is still unknown, and it is also unknown whether Web-based ACP programs can be used among underserved groups who have possibly less access to these technologies, for example, patients with low eHealth or health literacy skills.

    Conclusions

    This scoping review shows that Web-based, interactive, and person-centered ACP programs are mainly developed and evaluated in the United States. The Web-based programs contained the key elements of ACP, such as discussing and documenting goals and preferences for future care. In general, studies report that Web-based ACP programs tend to be feasible. Only 13 studies measured the programs’ effectiveness, and they showed significant improvement in ACP knowledge, communication, and documentation. The key outcome of ACP—concordance between preferred and received treatment and care—is yet understudied. Studies with high-quality study designs in diverse cultural contexts on feasibility and effectiveness are warranted to further establish the effectiveness of important outcomes. Furthermore, it is unknown how programs are used in practice, including attitudes of health care professionals toward Web-based ACP programs.

    Overall, we conclude that Web-based, interactive, and person-centered ACP programs are promising to support patients in ACP. Web-based ACP programs may improve accessibility to ACP, allowing people to start with ACP in their own time and environment. Web-based ACP programs may, therefore, help to overcome the time and emotional barriers in the initiation of ACP and to scale up ACP.

    Acknowledgments

    This study was funded by the Netherlands Organization for Health Research and Development. The authors thank Gerdien de Jonge, Wichor Bramer, Sabrina Gunput, and Elise Krabbendam (biomedical information specialists, Medical Library, Erasmus MC) for their support in literature searching.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Search strategy scoping review.

    DOCX File , 19 KB
    ‎
    Multimedia Appendix 2

    Links to the Web-based advance care planning programs.

    DOCX File , 16 KB
    ‎
    Multimedia Appendix 3

    Data extraction of the 27 included studies about Web-based advance care planning programs, alphabetical order of the program names and the year the article was published.

    DOCX File , 34 KB
    ‎
    Multimedia Appendix 4

    Feasibility of the Web-based advance care planning programs of the quantitative studies.

    DOCX File , 20 KB
    1. Rietjens JA, Sudore RL, Connolly M, van Delden JJ, Drickamer MA, Droger M, European Association for Palliative Care. Definition and recommendations for advance care planning: an international consensus supported by the European Association for Palliative Care. Lancet Oncol 2017 Sep;18(9):e543-e551. [CrossRef] [Medline]
    2. Brinkman-Stoppelenburg A, Rietjens JA, van der Heide A. The effects of advance care planning on end-of-life care: a systematic review. Palliat Med 2014 Sep;28(8):1000-1025. [CrossRef] [Medline]
    3. Houben CH, Spruit MA, Groenen MT, Wouters EF, Janssen DJ. Efficacy of advance care planning: a systematic review and meta-analysis. J Am Med Dir Assoc 2014 Jul;15(7):477-489. [CrossRef] [Medline]
    4. Jimenez G, Tan WS, Virk AK, Low CK, Car J, Ho AH. Overview of systematic reviews of advance care planning: summary of evidence and global lessons. J Pain Symptom Manage 2018 Sep;56(3):436-59.e25 [FREE Full text] [CrossRef] [Medline]
    5. Mathers CD, Loncar D. Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med 2006 Nov;3(11):e442 [FREE Full text] [CrossRef] [Medline]
    6. Jabbarian LJ, Zwakman M, van der Heide A, Kars MC, Janssen DJ, van Delden JJ, et al. Advance care planning for patients with chronic respiratory diseases: a systematic review of preferences and practices. Thorax 2018 Mar;73(3):222-230. [CrossRef] [Medline]
    7. Jimenez G, Tan WS, Virk AK, Low CK, Car J, Ho AH. State of advance care planning research: a descriptive overview of systematic reviews. Palliat Support Care 2018 Jul 30:1-11. [CrossRef] [Medline]
    8. May CR, Eton DT, Boehmer K, Gallacher K, Hunt K, MacDonald S, et al. Rethinking the patient: using Burden of Treatment Theory to understand the changing dynamics of illness. BMC Health Serv Res 2014 Jun 26;14:281 [FREE Full text] [CrossRef] [Medline]
    9. Tran VT, Montori VM, Eton DT, Baruch D, Falissard B, Ravaud P. Development and description of measurement properties of an instrument to assess treatment burden among patients with multiple chronic conditions. BMC Med 2012 Jul 4;10:68 [FREE Full text] [CrossRef] [Medline]
    10. Eton DT, Yost KJ, Lai J, Ridgeway JL, Egginton JS, Rosedahl JK, et al. Development and validation of the Patient Experience with Treatment and Self-management (PETS): a patient-reported measure of treatment burden. Qual Life Res 2017 Feb;26(2):489-503 [FREE Full text] [CrossRef] [Medline]
    11. Scholten G, Bourguignon S, Delanote A, Vermeulen B, van Boxem G, Schoenmakers B. Advance directive: does the GP know and address what the patient wants? Advance directive in primary care. BMC Med Ethics 2018 Jun 11;19(1):58 [FREE Full text] [CrossRef] [Medline]
    12. Houben C. Semantic Scholar. Maastricht: Maastricht University; 2018. Advance Care Planning in Life-Limiting Illnesses   URL: https:/​/pdfs.​semanticscholar.org/​6782/​021adbb7883c042c22eaa942f2f1aaf90325.​pdf?_ga=2.​6522868.​732736689.​1578897898-1679671381.​1567599385 [accessed 2020-01-13]
    13. Chiarchiaro J, Arnold RM, White DB. Reengineering advance care planning to create scalable, patient- and family-centered interventions. J Am Med Assoc 2015 Mar 17;313(11):1103-1104. [CrossRef] [Medline]
    14. Butler M, Ratner E, McCreedy E, Shippee N, Kane RL. Decision aids for advance care planning: an overview of the state of the science. Ann Intern Med 2014 Sep 16;161(6):408-418. [CrossRef] [Medline]
    15. Lustria ML, Noar SM, Cortese J, van Stee SK, Glueckauf RL, Lee J. A meta-analysis of web-delivered tailored health behavior change interventions. J Health Commun 2013;18(9):1039-1069. [CrossRef] [Medline]
    16. Samoocha D, Bruinvels DJ, Elbers NA, Anema JR, van der Beek AJ. Effectiveness of web-based interventions on patient empowerment: a systematic review and meta-analysis. J Med Internet Res 2010 Jun 24;12(2):e23 [FREE Full text] [CrossRef] [Medline]
    17. Van't Hof E, Cuijpers P, Stein DJ. Self-help and internet-guided interventions in depression and anxiety disorders: a systematic review of meta-analyses. CNS Spectr 2009 Feb;14(2 Suppl 3):34-40. [CrossRef] [Medline]
    18. Donker T, Blankers M, Hedman E, Ljótsson B, Petrie K, Christensen H. Economic evaluations of internet interventions for mental health: a systematic review. Psychol Med 2015 Dec;45(16):3357-3376. [CrossRef] [Medline]
    19. Apolinário-Hagen J, Harrer M, Kählke F, Fritsche L, Salewski C, Ebert DD. Public attitudes toward guided internet-based therapies: web-based survey study. JMIR Ment Health 2018 May 15;5(2):e10735 [FREE Full text] [CrossRef] [Medline]
    20. Austin CA, Mohottige D, Sudore RL, Smith AK, Hanson LC. Tools to promote shared decision making in serious illness: a systematic review. JAMA Intern Med 2015 Jul;175(7):1213-1221 [FREE Full text] [CrossRef] [Medline]
    21. Cardona-Morrell M, Benfatti-Olivato G, Jansen J, Turner RM, Fajardo-Pulido D, Hillman K. A systematic review of effectiveness of decision aids to assist older patients at the end of life. Patient Educ Couns 2017 Mar;100(3):425-435. [CrossRef] [Medline]
    22. Ostherr K, Killoran P, Shegog R, Bruera E. Death in the digital age: a systematic review of information and communication technologies in end-of-life care. J Palliat Med 2016 Apr;19(4):408-420 [FREE Full text] [CrossRef] [Medline]
    23. Saunders CH, Patel K, Kang H, Elwyn G, Kirkland K, Durand M. Serious choices: a systematic environmental scan of decision aids and their use for seriously ill people near death. J Hosp Med 2019 May;14(5):294-302. [CrossRef] [Medline]
    24. Baik D, Cho H, Creber RM. Examining interventions designed to support shared decision making and subsequent patient outcomes in palliative care: a systematic review of the literature. Am J Hosp Palliat Care 2019 Jan;36(1):76-88 [FREE Full text] [CrossRef] [Medline]
    25. Mays N, Roberts E, Popay J. Synthesising research evidence. In: Fulop N, Allen P, Clarke A, Black N, Anderson S, editors. Studying the Organisation and Delivery of Health Services: Research Methods. London: Routledge; 2001:188-220.
    26. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol 2005;8(1):19-32. [CrossRef]
    27. Tricco AC, Lillie E, Zarin W, O'Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med 2018 Oct 2;169(7):467-473. [CrossRef] [Medline]
    28. Covidence Systematic Review Software. Melbourne, Australia: Veritas Health Innovation; 2018.   URL: https://www.covidence.org/home [accessed 2019-05-21]
    29. Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011 Dec 31;13(4):e126 [FREE Full text] [CrossRef] [Medline]
    30. Bowen DJ, Kreuter M, Spring B, Cofta-Woerpel L, Linnan L, Weiner D, et al. How we design feasibility studies. Am J Prev Med 2009 May;36(5):452-457 [FREE Full text] [CrossRef] [Medline]
    31. Volandes AE, Paasche-Orlow MK, Davis AD, Eubanks R, El-Jawahri A, Seitz R. Use of video decision aids to promote advance care planning in Hilo, Hawai'I. J Gen Intern Med 2016 Sep;31(9):1035-1040 [FREE Full text] [CrossRef] [Medline]
    32. South AL, Elton J. Contradictions and promise for end-of-life communication among family and friends: death over dinner conversations. Behav Sci (Basel) 2017 Apr 20;7(2):pii: E24 [FREE Full text] [CrossRef] [Medline]
    33. Chovan WL. Implementing a pilot program of advanced directives in nursing homes. Psychol Rep 2007 Feb;100(1):195-198. [CrossRef] [Medline]
    34. Green MJ, Levi BH. Development of an interactive computer program for advance care planning. Health Expect 2009 Mar;12(1):60-69 [FREE Full text] [CrossRef] [Medline]
    35. Hossler C, Levi BH, Simmons Z, Green MJ. Advance care planning for patients with ALS: feasibility of an interactive computer program. Amyotroph Lateral Scler 2011 May;12(3):172-177. [CrossRef] [Medline]
    36. Levi BH, Heverley SR, Green MJ. Accuracy of a decision aid for advance care planning: simulated end-of-life decision making. J Clin Ethics 2011;22(3):223-238 [FREE Full text] [Medline]
    37. Schubart JR, Levi BH, Camacho F, Whitehead M, Farace E, Green MJ. Reliability of an interactive computer program for advance care planning. J Palliat Med 2012 Jun;15(6):637-642 [FREE Full text] [CrossRef] [Medline]
    38. Holland DE, Vanderboom CE, Dose AM, Ingram CJ, Delgado A, Austin CM, et al. Nurse-led patient-centered advance care planning in primary care. J Hosp Palliat Nurs 2017;19(4):368-375. [CrossRef]
    39. Green MJ, Schubart JR, Whitehead M, Farace E, Lehman E, Levi BH. Advance care planning does not adversely affect hope or anxiety among patients with advanced cancer. J Pain Symptom Manage 2015 Jun;49(6):1088-1096. [CrossRef] [Medline]
    40. Markham SA, Levi BH, Green MJ, Schubart JR. Use of a computer program for advance care planning with African American participants. J Natl Med Assoc 2015 Feb;107(1):26-32. [CrossRef] [Medline]
    41. Schubart JR, Green MJ, van Scoy LJ, Lehman E, Farace E, Gusani NJ, et al. Advanced cancer and end-of-life preferences: curative intent surgery versus noncurative intent treatment. J Palliat Med 2015 Dec;18(12):1015-1018 [FREE Full text] [CrossRef] [Medline]
    42. van Scoy LJ, Green M, Dimmock A, Bascom R, Boehmer J, Hensel J, et al. High satisfaction and low decisional conflict with advance care planning among chronically ill patients with advanced chronic obstructive pulmonary disease or heart failure using an online decision aid: A pilot study. Chronic Illn 2016 Sep;12(3):227-235. [CrossRef] [Medline]
    43. Levi BH, Simmons Z, Hanna C, Brothers A, Lehman E, Farace E, et al. Advance care planning for patients with amyotrophic lateral sclerosis. Amyotroph Lateral Scler Frontotemporal Degener 2017 Aug;18(5-6):388-396 [FREE Full text] [CrossRef] [Medline]
    44. Schubart JR, Camacho F, Green MJ, Rush KA, Levi BH. Assessing the internal consistency and temporal stability of advance directives generated by an interactive, online computer program. BMJ Support Palliat Care 2017 Mar;7(1):67-72 [FREE Full text] [CrossRef] [Medline]
    45. Green MJ, van Scoy LJ, Foy AJ, Stewart RR, Sampath R, Schubart JR, et al. A randomized controlled trial of strategies to improve family members' preparedness for surrogate decision-making. Am J Hosp Palliat Care 2018 Jun;35(6):866-874 [FREE Full text] [CrossRef] [Medline]
    46. Fine RL, Yang Z, Spivey C, Boardman B, Courtney M. Early experience with digital advance care planning and directives, a novel consumer-driven program. Proc (Bayl Univ Med Cent) 2016 Jul;29(3):263-267 [FREE Full text] [CrossRef] [Medline]
    47. van Scoy LJ, Chiarolanzio PJ, Kim C, Heyland DK. Development and initial evaluation of an online decision support tool for families of patients with critical illness: A multicenter pilot study. J Crit Care 2017 Jun;39:18-24. [CrossRef] [Medline]
    48. Klugman CM, Usatine RP. An evaluation of 2 online advance directive programs. Am J Hosp Palliat Care 2013 Nov;30(7):657-663. [CrossRef] [Medline]
    49. Lindquist LA, Ramirez-Zohfeld V, Sunkara PD, Forcucci C, Campbell DS, Mitzen P, et al. PlanYourLifeSpan.org - an intervention to help seniors make choices for their fourth quarter of life: results from the randomized clinical trial. Patient Educ Couns 2017 Nov;100(11):1996-2004 [FREE Full text] [CrossRef] [Medline]
    50. Cresswell MA, Robinson CA, Fyles G, Bottorff JL, Sudore R. Evaluation of an advance care planning web-based resource: applicability for cancer treatment patients. Support Care Cancer 2018 Mar;26(3):853-860. [CrossRef] [Medline]
    51. Ouchi K, Knabben V, Rivera-Reyes L, Ganta N, Gelfman LP, Sudore R, et al. Preparing older adults with serious illness to formulate their goals for medical care in the emergency department. J Palliat Med 2017 Apr 1;20(4):404-408 [FREE Full text] [CrossRef] [Medline]
    52. Sudore RL, Boscardin J, Feuz MA, McMahan RD, Katen MT, Barnes DE. Effect of the PREPARE website vs an easy-to-read advance directive on advance care planning documentation and engagement among veterans: a randomized clinical trial. JAMA Intern Med 2017 Aug 1;177(8):1102-1109 [FREE Full text] [CrossRef] [Medline]
    53. Sudore RL, Knight SJ, McMahan RD, Feuz M, Farrell D, Miao Y, et al. A novel website to prepare diverse older adults for decision making and advance care planning: a pilot study. J Pain Symptom Manage 2014 Apr;47(4):674-686 [FREE Full text] [CrossRef] [Medline]
    54. Lum HD, Barnes DE, Katen MT, Shi Y, Boscardin J, Sudore RL. Improving a full range of advance care planning behavior change and action domains: the prepare randomized trial. J Pain Symptom Manage 2018 Oct;56(4):575-81.e7 [FREE Full text] [CrossRef] [Medline]
    55. Sudore RL, Schillinger D, Katen MT, Shi Y, Boscardin WJ, Osua S, et al. Engaging diverse English- and Spanish-speaking older adults in advance care planning: the PREPARE randomized clinical trial. JAMA Intern Med 2018 Dec 1;178(12):1616-1625 [FREE Full text] [CrossRef] [Medline]
    56. Periyakoil VS, Neri E, Kraemer H. A randomized controlled trial comparing the letter project advance directive to traditional advance directive. J Palliat Med 2017 Sep;20(9):954-965. [CrossRef] [Medline]
    57. O'Shea B, Martin D, Brennan B, Bailey O, McElwee O, O'Leary F, et al. Are we ready to 'think ahead'? Acceptability study using an innovative end of life planning tool. Ir Med J 2014 May;107(5):138-140. [Medline]
    58. Suneetha K, Krishnamoorthi R. Identifying user behavior by analyzing web server access log file. Int J Comput Sci Netw Secur 2009;9(4):327-332 [FREE Full text]
    59. My Decisions. England and Wales: Compassion in Dying   URL: https://mydecisions.org.uk/ [accessed 2019-04-12]
    60. Dy SM, Roy J, Ott GE, McHale M, Kennedy C, Kutner JS, et al. Tell Us: a web-based tool for improving communication among patients, families, and providers in hospice and palliative care through systematic data specification, collection, and use. J Pain Symptom Manage 2011 Oct;42(4):526-534 [FREE Full text] [CrossRef] [Medline]
    61. Overbeek A, Korfage IJ, Jabbarian LJ, Billekens P, Hammes BJ, Polinder S, et al. Advance care planning in frail older adults: a cluster randomized controlled trial. J Am Geriatr Soc 2018 Jul;66(6):1089-1095. [CrossRef] [Medline]
    62. Halpern SD. Goal-concordant care - searching for the holy grail. N Engl J Med 2019 Oct 24;381(17):1603-1606. [CrossRef] [Medline]

    ‎
    ACP: advance care planning
    AD: advance directive
    CONSORT-EHEALTH: Consolidated Standards of Reporting Trials of Electronic and Mobile HEalth Applications and onLine TeleHealth
    EAPC: European Association for Palliative Care
    eHealth: electronic health
    RCT: randomized controlled trial
    PREPARE: PREPARE For Your Care

    Edited by G Eysenbach; submitted 22.07.19; peer-reviewed by C Pasarelu, G Jimenez; comments to author 10.09.19; revised version received 04.11.19; accepted 16.12.19; published 17.03.20

    Copyright

    ©Doris van der Smissen, Anouk Overbeek, Sandra van Dulmen, Lisette van Gemert-Pijnen, Agnes van der Heide, Judith AC Rietjens, Ida J Korfage. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 17.03.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.