Published on in Vol 24, No 12 (2022): December

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/43086, first published .
Patient-Centered Digital Health Records and Their Effects on Health Outcomes: Systematic Review

Patient-Centered Digital Health Records and Their Effects on Health Outcomes: Systematic Review

Patient-Centered Digital Health Records and Their Effects on Health Outcomes: Systematic Review

Review

1Department of Pediatric Hematology, Emma Children’s Hospital, Amsterdam Reproduction & Development, Public Health, Amsterdam UMC location University of Amsterdam, Amsterdam, Netherlands

2Galter Health Sciences Library at Northwestern University, Chicago, IL, United States

3Department of Medicine, The Ohio State University, Columbus, OH, United States

4Department of Molecular Cellular Hemostasis, Sanquin Research and Landsteiner Laboratory, Amsterdam, Netherlands

5Department of Pediatrics, Feinberg School of Medicine, Northwestern University, Chicago, IL, United States

6Division of Hematology, Oncology, and Stem Cell Transplant, Ann and Robert H Lurie Children's Hospital of Chicago, Chicago, IL, United States

Corresponding Author:

Sherif M Badawy, MBBCh, MS, MD

Department of Pediatrics

Feinberg School of Medicine, Northwestern University

420 E Superior St

Chicago, IL, 60611

United States

Phone: 1 312 227 4789

Email: sherif.badawy@northwestern.edu


Background: eHealth tools such as patient portals and personal health records, also known as patient-centered digital health records, can engage and empower individuals with chronic health conditions. Patients who are highly engaged in their care have improved disease knowledge, self-management skills, and clinical outcomes.

Objective: We aimed to systematically review the effects of patient-centered digital health records on clinical and patient-reported outcomes, health care utilization, and satisfaction among patients with chronic conditions and to assess the feasibility and acceptability of their use.

Methods: We searched MEDLINE, Cochrane, CINAHL, Embase, and PsycINFO databases between January 2000 and December 2021. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were followed. Eligible studies were those evaluating digital health records intended for nonhospitalized adult or pediatric patients with a chronic condition. Patients with a high disease burden were a subgroup of interest. Primary outcomes included clinical and patient-reported health outcomes and health care utilization. Secondary outcomes included satisfaction, feasibility, and acceptability. Joanna Briggs Institute critical appraisal tools were used for quality assessment. Two reviewers screened titles, abstracts, and full texts. Associations between health record use and outcomes were categorized as beneficial, neutral or clinically nonrelevant, or undesired.

Results: Of the 7716 unique publications examined, 81 (1%) met the eligibility criteria, with a total of 1,639,556 participants across all studies. The most commonly studied diseases included diabetes mellitus (37/81, 46%), cardiopulmonary conditions (21/81, 26%), and hematology-oncology conditions (14/81, 17%). One-third (24/81, 30%) of the studies were randomized controlled trials. Of the 81 studies that met the eligibility criteria, 16 (20%) were of high methodological quality. Reported outcomes varied across studies. The benefits of patient-centered digital health records were most frequently reported in the category health care utilization on the “use of recommended care services” (10/13, 77%), on the patient-reported outcomes “disease knowledge” (7/10, 70%), “patient engagement” (13/28, 56%), “treatment adherence” (10/18, 56%), and “self-management and self-efficacy” (10/19, 53%), and on the clinical outcome “laboratory parameters,” including HbA1c and low-density lipoprotein (LDL; 16/33, 48%). Beneficial effects on “health-related quality of life” were seen in only 27% (4/15) of studies. Patient satisfaction (28/30, 93%), feasibility (15/19, 97%), and acceptability (23/26, 88%) were positively evaluated. More beneficial effects were reported for digital health records that predominantly focus on active features. Beneficial effects were less frequently observed among patients with a high disease burden and among high-quality studies. No unfavorable effects were observed.

Conclusions: The use of patient-centered digital health records in nonhospitalized individuals with chronic health conditions is potentially associated with considerable beneficial effects on health care utilization, treatment adherence, and self-management or self-efficacy. However, for firm conclusions, more studies of high methodological quality are required.

Trial Registration: PROSPERO (International Prospective Register of Systematic Reviews) CRD42020213285; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=213285

J Med Internet Res 2022;24(12):e43086

doi:10.2196/43086

Keywords



Background

The prevalence and disease burden of chronic health conditions is on the rise. The World Health Organization predicts that by 2030, chronic noncommunicable health conditions will account for >50% of the total disease burden [1,2]. In particular, cardiovascular conditions, cancer, respiratory conditions, and diabetes have the highest morbidity and mortality [1]. Currently, 60% of the US population has at least 1 chronic condition and 42% of the population has multiple chronic conditions [3]. This results in a high individual disease burden owing to the large impact on social participation and required patient self-management skills. Self-management refers to a person’s ability to manage the clinical, psychosocial, and societal aspects of their illness and its care [4]. In contrast, self-efficacy is a person’s belief that he or she can successfully execute this behavior [4]. Apart from a high individual disease burden, the prevalence of chronic conditions imposes a high macroeconomic burden [5]. Furthermore, an increasing shortage of health care providers is expected, among others in the United States [6] and Europe [7,8]. In combination with the increased pressure put on health systems by unexpected events such as the COVID-19 pandemic, this shortage threatens the delivery of essential health services [9]. To preserve the access to care for all patients, new technologies are increasingly being developed and adopted, including patient-centered digital health records.

Such patient-centered digital health records can significantly help engage and empower patients with a chronic health condition [10-13]. Patient-centered digital health records enable patients to take on a more active role in their care by allowing them to view parts of their medical records, such as medication lists, laboratory and imaging results, allergies, and correspondence. Other common features include secure messaging, requesting prescription refills, video consultation, paying bills, and managing appointments. Examples of patient-centered digital health records include patient portals and personal health records (PHRs). Patient-centered digital health records differ in the volume and detail of the provided medical data, functionalities, and level of patient control, as shown in Textbox 1. Highly engaged patients are reported to have increased disease knowledge, better self-management, more self-efficacy, and improved clinical outcomes [14-16]. The effects of using patient-centered digital health records may be most substantial for patients with chronic conditions. Many self-management skills are required, and their potential gains are the highest. Not only patients but the entire health care system might benefit from an increased adoption of patient-centered digital health records.

Proposed taxonomy of patient-centered digital health records [10,17-21].
  • Electronic health record (EHR): a digital version of a health care provider’s paper chart, used by health care professionals alone. Patients cannot access data in an EHR. An EHR might contain data from one health care institution or from multiple institutions. Its scope can range from regional, to national, or international.
  • Patient portal: the patient-facing interface of an EHR that enables people to view sections of their medical record. This might include access to test results, medication lists, or therapeutic instructions. Health care providers or health care offices determine what health information is accessible for patients. Patient portals often have additional features such as patient-professional messaging, requesting prescription refills, scheduling appointments, or communicating patient-reported outcomes. By definition, patient portals are “tethered,” in which “tethered” refers to a patient portal’s connection to an EHR. Occasionally, a patient portal is referred to as a tethered personal health record (PHR).
  • PHR: a PHR is similar to a patient portal and can have similar features. However, the main difference is that contents are managed and maintained by individuals, not health care providers. People can access, manage, and share their health information, and that of others for whom they are authorized, such as parents or caretakers. Health information from different health care institutions may reside in a single patient-managed PHR. In general, PHRs are not tethered unless otherwise specified. Few tethered PHRs currently exist but are increasingly being developed [22].
  • Patient-centered digital health records: an umbrella term referring to patient portals, tethered PHRs, and part of the untethered PHRs. Patient-centered digital health records enable a 2-way exchange of health information between patients and the health care system and provide patients with the ability to view, download, or transmit their health information on the web. This health information is updated at regular intervals. In addition, it enables communication between patients and the health care system, either by adding or editing health information, exchanging patient-reported outcomes, or by using communication tools such as messaging. Additional functionalities are often present.
  • “Electronic medical record” is an outdated term [21]. It can be considered a professional-centered EHR with limited functionalities.
Textbox 1. Proposed taxonomy of patient-centered digital health records [10,17-21].

Currently, huge investments of time and resources are made in patient-centered digital health records. However, limited insight exists in how the use of patient-centered digital health records by patients with a broad range of chronic conditions affects clinical and patient-reported outcomes and health care utilization. Moreover, we lack an overview of their effects on patient satisfaction, and the feasibility and acceptability of their use by people with chronic conditions. Previous systematic reviews focused on one health condition [23], focused on one type of digital health record [24-27], investigated a select set of health outcomes [24,26,28], or are now obsolete in this rapidly changing technological landscape [23,25,27].

Objectives

Therefore, in this systematic review, we summarized the available evidence on patient-centered digital health records. Our primary objective was to assess how patient-centered digital health records for nonhospitalized patients with chronic conditions affect clinical and patient-reported health outcomes and health care utilization. Our secondary objective was to evaluate patient satisfaction with and feasibility and acceptability of using patient-centered digital health records. Results of this systematic review may help guide future development and implementation.


The protocol for this study was registered in the International PROSPERO (International Prospective Register of Systematic Reviews) Register of Systematic Reviews (CRD42020213285) [29]. The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were followed [30].

Literature Search

A medical librarian (MB) conducted the original literature search using the following databases: MEDLINE, Cochrane Library, CINAHL, Embase, and PsycINFO. All original studies published between January 1, 2000, and December 1, 2020, were assessed. A search update in MEDLINE was performed for all studies published between December 1, 2020, and December 31, 2021. Multimedia Appendix 1 presents the full search strategy. Articles published before 2000 were excluded because of the rapidly changing field of digital health technology [30].

Eligibility Criteria

Patient-centered digital health records were defined as mobile health (mHealth) or eHealth technologies that enable a 2-way exchange of health information between patients and the health care system, such as patient portals, PHRs, or mHealth apps with a health record functionality. A patient-centered digital health record provides patients with the ability to view, download, or transmit their health information on the web. This health information was updated at regular intervals. In addition, a patient-centered digital health record allows for communication between patients and the health care system, either by adding or editing health information, exchanging patient-reported outcomes, or by using communication tools such as messaging. Several other functionalities are common, but were not considered essential; for example, appointment scheduling, requesting prescription refill, viewing educational material, using decision support tools, and using connected wearables. Exclusion criteria were nondigital health records, digital health records intended for hospitalized patients, and digital health records that are not accessible to patients, such as the clinician-facing components of the electronic health record (EHR).

Studies

Studies investigating patient-centered digital health records intended for nonhospitalized patients with a chronic health condition were included. Only studies published in English were included. Eligible studies included randomized controlled trials (RCTs), quasi-experimental studies, nonexperimental observational studies (including cohort and cross-sectional studies), and pilot or feasibility studies. Of mixed methods studies, only nonqualitative parts were used for data extraction. Studies that only described health care providers’ experiences were excluded.

Participants

Studies on patients with a chronic health condition of all age groups were considered. Chronic conditions included all diseases with a moderate to high disease burden and moderate to high impact on daily life. Consequently, these conditions demand considerable self-management skills from patients to manage the clinical, psychosocial, and societal aspects of chronic condition and its care. The selection of chronic conditions included in our search strategy was based on the Charlson Comorbidity Index, other literature, and clinical expertise [31,32]. Diseases included cancer, arthritis, HIV, AIDS, asthma, chronic obstructive pulmonary disease, chronic heart conditions, hematologic disease, chronic kidney disease, celiac disease, inflammatory bowel disease, cystic fibrosis, diabetes mellitus, and multiple sclerosis (MS).

Outcomes

Studies were required to report at least one primary or secondary outcome. Primary outcomes were clinical outcomes (including disease events and complications, vital parameters, and laboratory parameters), patient-reported outcomes (including self-management and self-efficacy, patient engagement, health-related quality of life (HRQoL), stress and anxiety, and treatment adherence), and health care utilization (including the number of emergency department [ED] visits and hospitalizations, the use of preventive or recommended care services by patients, and regular workload for health care professionals). Secondary outcomes included technology-related outcomes (including patient satisfaction, feasibility, and acceptability). Definitions and examples of these 13 outcomes are presented in Table 1.

Table 1. Definitions and examples of all health outcomes included in this systematic review.
Included study outcomesDefinitions and examples
Clinical outcomes

Disease events and complications
  • For example, asthma exacerbation, chronic kidney disease progression, and death

Vital parameters
  • For example, blood pressure, BMI, weight, and respiratory parameters

Laboratory parameters
  • For example, HbA1ca, LDLb, cholesterol, eGFRc, HIV viral load, and CD4+ T-cell count
Patient-reported outcomes

Self-management and self-efficacy
  • Self-management is a person’s ability to manage the clinical, psychosocial, and societal aspects of illness and its care.
  • Self-efficacy is the belief that a person can successfully execute this behavior (eg, measured by the validated Diabetes Empowerment Scale) [4]

Patient engagement
  • Patient engagement comprises 3 suboutcomes:
    • Patient activation: patients believe that their own role in managing their care is important, patients’ confidence and knowledge to take action, how much they take action, and if patients are capable of staying on course under stress (eg, measured by the Patient Activation Measure PAM13) [33]
    • Patient involvement: patients’ involvement and participation in treatment decisions, and patients’ involvement in sharing information, preparing and conducting a medical consultation, and accepting instructions from doctors and nurses [34] (eg, measured by the number of patients that is in possession of an Asthma Action Plan)
    • Disease knowledge: patients’ knowledge of a disease and its related care activities (eg, measured by the Brief Diabetes Knowledge Test) [35]

Health-related quality of life
  • All aspects of one’s quality of life that are health-related, including physical functioning, social functioning, and mental health (eg, measured by the 36-Item Short Form Survey SF-36) [36]
  • A reduction in anxiety or stress was considered a suboutcome (eg, measured by the parenting stress index) [37]

Treatment adherence
  • The extent to which a person’s behavior (taking medication, following a diet, or the execution of lifestyle changes) corresponds with health care providers’ recommendations [38] (eg, adherence to HIV medication)
Health care utilization: >all types of encounters between patients and health care providers, including EDd visits, hospitalizations, outpatient clinic appointments, and telephone calls

ED visits and hospitalizations
  • Reductions in undesirable events (eg, reductions in emergency department visits and hospitalizations)

Recommended care services
  • Increased use of recommended care services by people with uncontrolled disease, and the improved use of preventive care services (eg, follow-up outpatient clinic visits among people with uncontrolled HIV, eye examinations in people with diabetes)

Regular workload
  • A decrease in regular workload for health care professionals (eg, patients use email instead of interruptive telephone calls as a first method of contact)
Technology-related outcomes

Patient satisfaction
  • Patient satisfaction with accessing and using patient-centered digital health records
  • Patient satisfaction with the effects of using patient-centered digital health records (eg, sense of control, perceived quality of care)

Feasibility
  • Adherence to patient-centered digital health records and user retention rates, for which no universal cut-off values are available

Acceptability
  • The perceived usability of patient-centered digital health records and how these affect behavior, as well as identified facilitators and barriers

aHbA1c: glycated hemoglobin.

bLDL: low-density lipoprotein.

ceGFR: estimated glomerular filtration rate.

dED: emergency department.

Data Extraction

Two independent reviewers (MB and SB) assessed titles, abstracts, and full texts for eligibility. Disagreements were resolved by discussion, if necessary, with a third reviewer (SG).

A modified, electronic version of the standardized Cochrane data extraction form [39] was used to extract the following data items: first author’s name; publication year; study design; disease or diseases studied; study aim; country and setting; participants’ age and sex; sample size; inclusion and exclusion criteria; follow-up duration; description, features, and purpose of the patient-centered digital health record and (if applicable) of the comparator; size and description of the control group (if applicable); device used; description of health outcomes and results; and main study findings.

Quality Appraisal

For quality appraisal, Joanna Briggs Institute (JBI) critical appraisal tools for RCTs, cross-sectional studies, cohort studies, and quasi-experimental studies were used [40]. JBI tools were modified to better suit the assessment of digital health record studies. Several items were added, including adequate patient-centered digital health record descriptions and selection bias measures, as presented in Multimedia Appendix 2. As the JBI tools differed in the number of items, all scores were converted to a 15-point scale. Articles with a score of ³12 were considered of “high quality,” between 8.5 and 11.9 of “medium quality,” and <8.5 of “low quality.”

Data Synthesis

Associations between patient-centered digital health record use and health outcomes were categorized in 3 groups: “beneficial,” “neutral or clinically nonrelevant,” or “undesired.” Categorizations were determined by our interpretation of study findings, based on meaningful clinical effects and statistical significance (P<.05), and could therefore differ from the authors’ conclusions. Statistical significance was considered relevant only if the effect size were clinically significant. If available, minimal clinically important differences were used to assess effect sizes. The summarization of effects was based on the vote-counting method, as no meta-analysis could be performed. The findings were summarized for all conditions, grouped by disease category (diabetes mellitus, cardiopulmonary diseases, hematology-oncology diseases, and other diseases), and grouped according to outcome type (clinical outcomes, patient-reported outcomes, health care utilization, and technology-related outcomes).

Subgroup Analyses

Several subgroup analyses were performed. The first subgroup included conditions with a high disease burden. These included conditions with either impaired social participation or that require a high level of self-management skills. Impaired social participation was defined as being unable to participate in work or school or engage with friends and family as desired because of the condition or its treatment. High self-management skills are defined as recurrent actions demanded from patients to prevent or treat the disease or its consequences, including high disease-related knowledge needed to actively engage in decision-making. This subgroup was determined based on clinical expertise of the study team. Second, we assessed 2 subgroups: patient-centered digital health records that predominantly offered passive features and those that predominantly offered active features. Passive features are those through which the patient receives information but does not actively add information. Active features are those in which the patient performs an action and actively engages with the digital health record. The third subgroup of interest included studies with high methodological quality. A sensitivity analysis was performed to investigate whether our results were influenced by poor quality studies. Finally, the subgroups of interest were studies that included older participants (mean age >55 years), a high number of female participants (>45%), or a racially diverse population (<50% White participants).


Overview

The search yielded 7716 unique publications. After screening the titles and abstracts, 320 full-text articles were retrieved. A total of 81 articles met the inclusion criteria. No non-English articles that met the inclusion criteria were identified. Figure 1 shows the study PRISMA flowchart. In total, 1,639,556 participants were included in the studies of this systematic review. Most (74/81, 91%) studies included only adult participants. Of the total 1,369,913 participants, 99% (n=1,629,660) were adults. Nine studies included children or their parents, with a total number of 9297 children and 599 parents. Sample sizes of studies varied from 10 to 267,208 participants. Furthermore, 46% (747,370/1,639,556) of the participants were female. Of the 81 included studies, health literacy was reported by 7 (9%) studies and insurance status by 15 (20%) studies. Race distribution was reported by 74% (60/81) of studies, of which 47 (78%) studies included a population of which more than half were White and 26 (43%) studies of which >75% were White.

Figure 1. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram. PC-DHR: patient-centered digital health record.
View this figure

Study Characteristics

Study characteristics are presented in Tables 2-5 (36 studies are listed in Table 2; 11 studies are listed in Table 3, 14 studies are listed in Table 4, and 20 studies are listed in Table 5). Most investigated conditions were type 1 or 2 diabetes mellitus (37/81, 46%), cardiovascular conditions (14/81, 17%), and malignancies (11/81, 14%). Studies were mostly conducted in the following countries: United States (58/81, 72%), the Netherlands (7/81, 9%), Canada (5/81, 6%), and United Kingdom (3/81, 4%). In addition, 30% (24/81) of the studies were RCTs, 27% (22/81) were cross-sectional studies, 20% (16/81) were retrospective observational cohort studies, and 23% (18/81) were quasi-experimental studies, including pretest-posttest and feasibility studies. One study was a secondary data analysis of the intervention group in an RCT. Of the 55 studies that reported follow-up durations, 6 (7%) studies had a follow-up of less than a month, 25 (31%) studies between 1 and 6 months, 14 (17%) studied between 7 and 12 months, and 10 (12%) studies of >12 months.

Explanations of the patient-centered digital health records investigated in each study are presented in Tables 6-9. Patient-centered digital health records range from a pilot patient portal enabling patients to view a limited set of their medical data to comprehensive PHRs, offering extensive data access and enabling appointment scheduling and prescription refill requests. A minority (12/81, 15%) of studies specifically evaluated ≥1 digital health record features such as secure messaging or a medication adherence module. In addition, 15% (12/81) of studies used a hybrid approach to assess a combination of a digital health record with a connected device, or with training, coaching, or face-to-face visits.

Table 2. Study characteristics of studies investigating diabetes mellitus (of 37 studies investigating diabetes mellitus, 36 are listed in Table 2).a
Author, yearCountry, settingStudy population, disease, controlled?BurdenbStudy designSample sizeAge (years)c, mean (SD)Genderc (female), n (%)Racec (White), n (%)
Bailey et al [41], 2019United States, 2 academic hospitalsAdults with DMd, on high-risk medicationPilot or feasibility10056 (11)57 (57)48 (48)
Boogerd et al [42], 2017Netherlands, 7 medical centersParents of children <13 years with DM type 1+Pilot or feasibilityIe=54, Cf=519.1 (2.7): Children30 (56)NRg
Byczkowski et al [43], 2014United States, 1 academic hospitalParents of children with DM (or CFh or JIAi)±Cross-sectionalI=126, C=8911 (NR)69 (54.8)115 (91.3)
Chung et al [44], 2017United States, outpatient care organizationAdults with DMCohortI=12,485, C=283156 (12)5493 (44)5119 (41)
Conway et al [45], 2019United Kingdom, Scotland’s health systemPatients with DMCross-sectional109558 (12)405 (36.99)873 (78.73)
Devkota et al [46], 2016United States, 6 PCPsjPatients with DM type 2CohortI=409, C=110158 (12)k235 (57.5)250 (61.1)
Dixon et al [47], 2016United States, 3 community centersAdults with DM type 2Pilot or feasibility9653 (11)56 (58)47 (49)
Graetz et al [48], 2018United States, integrated health systemAdults with DMCross-sectional267,208NR127,458 (47.7)116,770 (43.7)
Graetz et al [49], 2020United States, integrated health systemAdults with DM with at least 1 oral drugCross-sectional111,46364 (13)51,545 (46.24)45,205 (40.56)
Grant et al [50], 2008United States, 11 PCPsAdults with DM using medicationRCTlI=126, C=11859 (10)54 (42.9)117 (92.9)
Lau et al [51], 2014Canada, 1 academic hospitalAdults with DMCohortI=50, C=10755 (14)22 (44)NR
Lyles et al [52], 2016United States, integrated health systemAdults with DM type 2 using statinsCohortI=8705, C=905561 (11)k4013 (46.1)3134 (36)k
Martinez et al [53], 2021United States, 4 medical centersAdults with DM type 2 using medicationPilot or feasibility6058 (13)33 (55)41 (68)
McCarrier et al [54], 2009United States, 1 diabetes clinicAdults <50 years with uncontrolled DM type 1+RCTI=41, C=3657 (8)15 (37)39 (95)
Osborn et al [55], 2013United States, 1 academic hospitalAdults with DM type 2 using medicationCross-sectionalI=62, C=1357 (8)39 (63)46 (74)
Price-Haywood and Luo [56], 2017United States, integrated health systemAdults with DM or HTmCohortI=10,497, C=90,522NR6205 (59.11)8055 (76.74)
Price-Haywood et al [57], 2018United States, integrated health systemAdults with DM or HTCohortI=11,138, C=89,88058 (13)6,204 (55.7)NR
Quinn et al [58], 2018United States, 26 PCPsAdults <65 years with DM type 2RCTI=82, C=2554 (8)39 (48)51 (62)
Reed et al [59], 2015United States, integrated health systemAdults with DM, HT, CADn, asthma, or CHFo±Cross-sectional1041NR587 (56.4)618 (59.4)
Reed et al [60], 2019United States, integrated health systemAdults with DM+HT, CAD, asthma, or CHF±Cross-sectional165,477NR79,594 (48.1)NR (60.9)
Reed et al [61], 2019United States, integrated health systemAdults with DM, asthma, HT, CAD, CHF or CV event risk±Cross-sectionalI=1392, C=407NR719 (51.7)816 (58.6)
Riippa et al [62], 2014Finland, 10 PCPsAdults with DM, HT or HCpRCTI=80, C=5761 (9)45 (56)NR
Riippa et al [63], 2015Finland, 10 PCPsAdults with DM, HT or HCRCTI=80, C=5761 (9)45 (56)NR
Robinson et al [64], 2020United States, 1 veteran hospitalVeterans with uncontrolled DM type 2Cross-sectionalI=446, C=75466 (8)28 (6.3)384 (86.1)
Ronda et al [65], 2014Netherlands, 62 PCPs+1 hospitalAdults with DMCross-sectionalI=413, C=75864 (12)154 (37.3)383 (93.6)
Ronda et al [66], 2015Netherlands, 62 PCPs+1 hospitalAdults with DMCross-sectionalI=413, C=21959 (13)154 (37.3)383 (93.6)
Sabo et al [67], 2021United States, 21 practicesAdults with DM type 2CohortI=189, C=14861 (13)75 (40.9)113 (72.9)
Sarkar et al [68], 2014United States, integrated health systemAdults with DMCohortI=8705, C=905561 (11)k4013 (46.1)5072 (58.27)
Seo et al [69], 2020South Korea, 1 academic hospitalPatients with DMCohortI=133, C=732054 (10)23 (17.3)NR
Sharit et al [70], 2018United States, 1 veterans centerOverweight veterans with prediabetesPilot or feasibility3858 (8)9 (24)8 (21)k
Shimada et al [71], 2016United States, Veteran registryVeterans with uncontrolled DM, HT or LDLqCohortI=50,482, C=61,20461 (10)2060 (4.08)35,761 (70.84)
Tenforde et al [72], 2012United States, 1 community hospitalAdults <75 years with DMCohortI=4036, C=671059 (10)1857 (46)k3,390 (84)k
van Vugt et al [73], 2016Netherlands, 52 PCPsPatients with DM type 2RCTI=66, C=6668 (10)54 (41)91 (69)
Vo et al [74], 2019United States, integrated health systemAdults <80 years with DM type 2RCTI=673, C=60361 (10)296 (44)394 (58.5)
Wald et al [75], 2009United States, 230 PCPsPatients with DM type 2RCT12659 (NR)53 (42.1)117 (92.9)
Zocchi et al [76], 2021United States, nationwidePatients with DM type 2, partly uncontrolledCohort95,04363 (10)4,339 (4.57)68,954 (72.55)

aAll studies are listed in Tables 2-5 and are reported in the disease category of the condition that is most prominently investigated. The study by Druss et al [77] is therefore listed in Table 5.

bIf conditions are considered to have a high disease burden or demand high self-management skills, a positive sign is shown. Otherwise, a sign is indicated. A ± sign indicates that multiple diseases have been studied, and only some of the diseases were considered to have a high disease burden.

cIf available, age (years), gender, and race were reported by digital health record users (“the intervention group”).

dDM: diabetes mellitus.

eI: intervention.

fC: control.

gNR: not reported.

hCF: cystic fibrosis.

iJIA: juvenile idiopathic arthritis.

jPCP: primary care practice.

kPresented numbers were estimated based on the data provided in the original articles.

lRCT: randomized controlled trial.

mHT: hypertension.

nCAD: coronary artery disease.

oCHF: congestive heart failure.

pHC: hypercholesterolemia.

qLDL: low-density lipoprotein.

Table 3. Study characteristics of studies investigating cardiopulmonary diseases (of 21 studies investigating cardiopulmonary diseases, 11 are listed in Table 3).a
Author, yearCountry, settingStudy population, disease, controlled?BurdenbStudy designSample sizeAge (years)c, mean (SD)Genderc (female), n (%)Racec (White), n (%)
Aberger et al [78], 2014United States, renal transplant clinicPostrenal transplant patients with HTd+Pilot or feasibility6654 (NRe)34 (52)f48 (72)f
Ahmed et al [79], 2016Canada, 2 academic hospitalsAdults with asthma using medication+RCTgIh=49, Ci=51NR32 (68)NR
Apter et al [80], 2019United States, multicenter hospitalsAdults with asthma using prednisone+RCTI=151, C=15049 (13)270 (89.7)4 (1.3)
Fiks et al [81], 2015United States, 3 PCPsjChildren aged 6-12 years with asthma, partly uncontrolled+RCTI=30, C=308.3 (1.9)26 (87) among parents13 (43)
Fiks et al [82], 2016United States, 20 PCPsChildren aged 6-12 years with asthma, partly uncontrolled+Pilot or feasibilityI=237, C=8896NR101 (42.8)144 (61.5)
Kogut et al [83], 2014United States, 1 community hospitalAdults aged >49 years with cardiopulmonary disorders±Pilot or feasibility30NR14 (47)NR
Kim et al [84], 2019South Korea, 1 academic hospitalPatients with obstructive sleep apneaRCTI=30, C=1343 (10)fNR (15)NR
Lau et al [85], 2015Australia, nationwideAdults with asthma+RCTI=154, C=17640 (14)124 (80.5)NR
Manard et al [86], 2016United States, PCP registryAdults with uncontrolled HTCohortI=400, C=117161 (12)262 (65.5)72
Toscos et al [87], 2020United States, 1 community hospitalPatients with nonvalvular AFk with OACl+RCTI=76, C=7771 (9)60 (37.5)153 (99.4)
Wagner et al [88], 2012United States, 24 PCPsPatients with hypertension, partly uncontrolledRCTI=193, C=25055 (12)145 (75.1)96 (50.5)

aAll studies are listed in Tables 2-5 and are reported in the disease category of the condition that is most prominently investigated. The studies by Price-Haywood and Luo [56], Price-Haywood et al [57], Reed et al [59], Reed et al [60], Reed et al [61], Riippa et al [62], Riippa et al [63], Shimada et al [71] are listed in Table 2. The study by Martinez Nicolás et al [89] is listed in Table 4. The study by Druss et al [77] is therefore listed in Table 5.

bIf conditions are considered to have a high disease burden or demand high self-management skills, a positive sign is shown. Otherwise, a sign is indicated. A ± sign indicates that multiple diseases have been studied, and only some of the diseases were considered to have a high disease burden.

cIf available, age (years), gender, and race were reported by digital health record users (“the intervention group”).

dHT: hypertension.

eNR: not reported.

fPresented numbers were estimated based on the data provided in the original articles.

gRCT: randomized controlled trial.

hI: intervention.

iC: control.

jPCP: primary care practice.

kAF: atrial fibrillation.

lOAC: oral anticoagulant drug.

Table 4. Study characteristics of studies investigating hematological and oncological diseases (n=14).
Author, yearCountry, settingStudy population, disease, controlled?BurdenaStudy designSample sizeAge (years)b, mean (SD)Genderb (female), n (%)Racec (White), n (%)
Cahill et al [90], 2014United States, cancer centerAdults with glioma+Cross-sectional18644 (13)87 (46.8)149 (86.1)
Chiche et al [91], 2012France, 1 community hospitalAdults with ITPc±RCTdIe=28, Cf=1548 (15)g21 (75)NRh
Collins et al [92], 2003United Kingdom, hemophilia centersPatients with hemophilia >11 years+Pilot or feasibility10NRNRNR
Coquet et al [93], 2020United States, cancer centerPatients with cancer+chemotherapy+CohortI=3223, C=322359 (15)1,554 (49.78)1,804 (49.68)
Groen et al [94], 2017Netherlands, cancer centerPatients with lung cancer+Pilot or feasibility3760 (8)16 (47)37 (100)
Hall et al [95],2014United States, Cancer CenterPatients with resection for CRCi or ECj+Pilot or feasibility4959 (12)g37 (76)48 (98)
Hong et al [96], 2016United States, academic pediatric hospitalChildren aged 13-17 years with cancer or a blood disorder+parents+Cross-sectional4615 (1.2)g10 (63) among childrenNR
Kidwell et al [97], 2019United States, multicenter hospitalsPatients aged 13-24 years with sickle cell disease+Pilot or feasibility4419 (NR)24 (55)0 (0)
Martinez Nicolás et al [89], 2019Spain, 4 community hospitalsPatients with COPDk, CHFl, or hematologic malignancy+Pilot or feasibility577,12142 (23)319,725g (55)NR
O’Hea et al [98], 2021United States, cancer centersAdult women with nonmetastatic breast cancer ending treatment+RCTI=100, C=10061 (11)100 (100)85 (85)
Pai et al [99], 2013Canada, cancer centerAdult men with prostate cancer+Cross-sectional1764 (7)g0 (0)16 (95)
Tarver et al [100], 2019United States, academic hospitalPatients with colorectal cancer+Cross-sectional2258 (10)10 (45)NR
Wiljer et al [101], 2010Canada, breast cancer registryPatients with breast cancer+Pilot or feasibility311NR303 (99.7)NR
Williamson et al [102], 2017United States, pediatric cancer centerPediatric cancer survivors+Cohort56NR27 (48)49 (88)

aIf conditions are considered to have a high disease burden or demand high self-management skills, a positive sign is shown. Otherwise, a sign is indicated. A ± sign indicates that multiple diseases have been studied, and only some of the diseases were considered to have a high disease burden.

bIf available, age (years), gender, and race were reported by digital health record users (“the intervention group”).

cITP: idiopathic thrombocytopenic purpura.

dRCT: randomized controlled trial.

eI: intervention.

fC: control.

gPresented numbers were estimated based on the data provided in the original articles.

hNR: not reported.

iCRC: colorectal cancer.

jEC: endometrial cancer.

kCOPD: chronic obstructive pulmonary disease.

lCHF: congestive heart failure.

Table 5. Study characteristics of studies investigating other diseases (of 21 studies investigating other diseases, 20 are listed in Table 5). Diseases include kidney disease (n=3, 15%), mental health disorders (n=3, 15%), multiple sclerosis (n=2, 10%), inflammatory bowel disease (n=2, 10%), rheumatologic conditions (n=2, 10%), and others (n=8, 40%).a
Author, yearCountry, settingStudy population, disease, controlled?BurdenbStudy designSample sizeAge (years)c, mean (SD)Genderc (female), n (%)Racec (White), n (%)
Anand et al [103], 2017Thailand, HIV clinicMSMd and transgender women with HIV, partly uncontrolled+RCTe18630 (10)f7 (4)0 (0)
Bidmead and Marshall [104], 2016United Kingdom, 1 community hospitalPatients with IBDg+Cross-sectional60NRhNRNR
Crouch et al [105], 2015United States, 1 HIV clinicVeterans with HIV, partly uncontrolled+Cross-sectionalIi=20, Cj=2043 (11)1 (5)19 (95)
Druss et al [106], 2014United States, 1 mental health centerPatients with a mental disorder+chronic condition+RCTI=85, C=8549 (7)42 (49)13 (15)
Druss et al [77], 2020United States, 2 mental health centersPatients with a mental disorder+DMk, HTl, or HCm+RCTI=156, C=15551 (6.5)95 (61)29 (19)
Jhamb et al [107], 2015United States, 4 nephrology clinicsAdults visiting nephrology clinics, partly uncontrolled+Cross-sectional109858 (16)549 (50)952 (86.7)
Kahn et al [108], 2010United States, HIV clinicPatients with HIV or AIDS+Pilot or feasibility136NR15 (11)f106 (78)f
Keith McInnes et al [109], 2013United States, 8 Veteran hospitalsVeterans with HIV, partly uncontrolled+Cross-sectional1871NR51 (2.73)342 (18.28)
Keith McInnes et al [110], 2017United States, Veterans care systemVeterans with HIV+detectable viral load, partly uncontrolled+Cohort3374NR128 (3.79)1130 (33.49)
Kiberd et al [111], 2018Canada, dialysis clinicAdult with home dialysis+Pilot or feasibility4157 (2)13 (48)NR
Lee et al [112], 2017South Korea, 1 surgery departmentPatients with cleft lip or cleft palate surgeryPilot or feasibility5036 (NR)33 (66)NR
Miller et al [113], 2011United States, MSn clinicPatients with MS+RCTI=104, C=10248 (9)73 (71.6)80 (78.4)
Navaneethanet al [114], 2017United States, multiple health centersAdults with chronic kidney disease, partly uncontrolled+RCTI=152, C=5768 (NR)f79 (52)117 (77)
Plimpton [115], 2020United States, HIV clinicWomen with HIV, partly uncontrolled+Pilot or feasibility2241 (11)22 (100)7 (32)
Reich et al [116], 2019United States, 1 community hospitalAdults with IBDo+RCTI=64, C=6342 (16)28 (46)48 (77)
Scott Nielsen et al [117], 2012United States, 1 academic centerAdults with MS+Cross-sectionalI=120, C=12045 (11)90 (75)115 (95.8)
Son and Nahm [118], 2019United States, online senior communityPatients >49 years with 1 or more chronic conditions±Secondary data analysis27270 (9)191 (70.2)213 (78.3)
Tom et al [119], 2012United States, integrated health systemParents of children age <6 years with 1 or more chronic conditions±Cross-sectionalI=166, C=903 (1)66 (39.8)113 (68.1)
van den Heuvel et al [120], 2018Netherlands, 3 hospitalsAdults with bipolar disorder+Cross-sectional3945 (11)44 (67)NR
van der Vaart et al [121], 2014Netherlands, 1 hospitalPatients with rheumatoid arthritis+Cross-sectional21462 (13)140 (65.4)NR

aAll studies are listed in Tables 2-5 and are reported in the disease category of the condition that is most prominently investigated. The study by Byczkowski et al [43] is therefore listed in Table 2.

bIf conditions are considered to have a high disease burden or demand high self-management skills, a positive sign is shown. Otherwise, a sign is indicated. A ± sign indicates that multiple diseases have been studied, and only some of the diseases were considered to have a high disease burden.

cIf available, age (years), gender, and race were reported by digital health record users (“the intervention group”).

dMSM: men who have sex with men.

eRCT: randomized controlled trial.

fPresented numbers were estimated based on the data provided in the original articles.

gIBD: inflammatory bowel disease.

hNR: not reported.

iI: intervention.

jC: control.

kDM: diabetes mellitus.

lHT: hypertension.

mHC: hypercholesterolemia.

nMS: multiple sclerosis.

oIBD: inflammatory bowel disease.

Table 6. Patient-centered digital health record descriptions for disease category diabetes mellitus (of 37 studies investigating diabetes mellitus, 36 are listed in Table 6).a
Author, yearNameTypeWhat is evaluated?bPassive featuresActive featuresFocusc
Bailey et al [41], 2019Electronic Medication Complete CommunicationPPdAdherence module aloneView health information (medical summary), read after-visit summary, read educational materialReport medication concerns, monitor medication useActive
Boogerd et al [42], 2017SugarspacePPPPView treatment goals, read educational materialParent-professional communication, peer supportActive
Byczkowski et al [43], 2014In-house developedPPPPView health information (including laboratory results, medication), view appointments, read disease-specific informationMessaging, upload documents, receive remindersPassive
Chung et al [44], 2017Not reportedPPMessagingView health informationMessagingActive
Conway et al [45], 2019My Diabetes My WayTethered PHRePHRView health information from primary and secondary care (including clinical parameters, medication, and correspondence), read educational materialReport self-measurementsPassive
Devkota et al [46], 2016MyChartPPPPView health information (including laboratory results, diagnoses, medication, vital signs), read educational materialMessaging, request prescription refills, schedule appointments, pay billsPassive
Dixon et al [47], 2016CareWebPPMedication module aloneView health information (including measurements, medication)Report barriers to medication adherencePassive
Graetz et al [48], 2018 and Graetz et al [49], 2020“Kaiser Permanente portal”PPPPView health information (including laboratory results)Messaging, schedule appointments, request prescription refills, pay billsActive
Grant et al [50], 2008Not reportedPPPPView health information (including medication, laboratory results)Edit medication lists, messaging, report adherence barriers or adverse effectsActive
Lau et al [121], 2014BCDiabetesPPPPView health information (including laboratory results), view care plan, read educational materialMessaging, use a journalPassive
Lyles et al [52], 2016“Kaiser Permanente portal”PPMedication module aloneView health information (including medical history, laboratory results, and visit summaries)Messaging, schedule appointments, request prescription refillsActive
Martinez et al [53], 2021My Diabetes Care, part of My Health at VanderbiltPPDiabetes moduleView health information (including laboratory results and vaccinations), visualize information, read educational materialMessaging, peer support, decision support toolsActive
McCarrier et al [54], 2009Living with Diabetes InterventionPPPP+case managerView health information (including correspondence, action plans, and laboratory results), read diabetes-related informationUpload blood glucose readings, use a journalActive
Osborn et al [55], 2013My Health At VanderbiltPPPPView health information (including vital signs, laboratory results, and medication), read educational informationMessaging, manage appointments, use health screening tools, pay billsPassive
Price-Haywood and Luo [56], 2017 and Price-Haywood et al [57], 2018MyOchsnerPPPPView health information (including an after-visit summary, allergies, and laboratory results)Messaging, request prescription refills, schedule appointmentsPassive
Quinn et al [58], 2018Not reportedPPPPView self-reported health information (including medication and measurements), read educational materialMessaging, report self-measurements and medication changes, receive automated feedbackActive
Reed et al [59], 2015“Kaiser Permanente portal”PPMessaging aloneView health information (including laboratory results and correspondence)Messaging, request prescription refills, schedule appointmentsActive
Reed et al [60], 2019 (1) and Reed et al [61], 2019“Kaiser Permanente portal”PPPPView health information from primary care and secondary care (including laboratory results and visit summaries)Messaging, request prescription refills, schedule visitsPassive
Riippa et al [62], 2014 and Riippa et al [63], 2015Not reportedPPPPView health information (including diagnoses, laboratory results, vaccinations, and medication), view care plan, read educational materialMessagingPassive
Robinson et al [64], 2020My HealtheVetPPMessaging aloneView health information (including medication and correspondence), view appointmentsMessaging, request prescription refills, receive reminders, upload notes and measurements, use a journalPassive
Ronda et al [65], 2014 and Ronda et al [66], 2015Digitaal logboekPPPPView diabetes-specific health information (including laboratory results, diagnoses, and medication), view treatment goals, view appointmentsMessaging, upload self-measurementsPassive
Sabo et al [67], 2021Diabetes Engagement and Activation PlatformPPPPView health information (including medication and self-reported glucose measurements)Report diet, physical activity, blood glucose measurements, complications, mental health and goals, receive alertsActive
Sarkar et al [68], 2014“Kaiser Permanente portal”PPPPView health information (including medical history, laboratory results, and visit summaries), view appointmentsMessaging, request prescription refillsPassive
Seo et al [69], 2020My Chart in My HandTethered PHRPHR+sugar functionView health information (including laboratory results, medication, allergies, diagnoses)Edit information, schedule appointment; sugar function: log treatment, food intake, and exerciseActive
Sharit et al [70], 2018My HealtheVetPPTrack Health module+wearableView health information (including medication and correspondence), view appointmentsMessaging, request prescription refills, receive reminders; track Health module: record diet and activity, upload data from connected accelerometerActive
Shimada et al [71], 2016My HealtheVetPPMessaging, prescription refillsView health information (including medication and correspondence), view appointmentsMessaging, request prescription refills, receive reminders, upload notes and self-measurements, use a journalActive
Tenforde et al [72], 2012MyChartPPPPView health information (including diagnoses and laboratory results), read diabetes educational materialMessaging, view glucometer readings, receive remindersPassive
van Vugt et al [73], 2016e-VitaTethered PHRPHR+personal coachView health information (measurements), read diabetes educationMessaging, self-management support program for personal goal setting and evaluationActive
Vo et al [74], 2019“Kaiser Permanente portal”PPPP+PreVisit Prioritization messagingView health information (including medical history, laboratory results, and visit summaries), view appointmentsPreVisit Prioritization messaging to report priorities before a clinic visit, request prescription refillsActive
Wald et al [75], 2009Patient GatewayTethered PHRPHRView health information (including medication, allergies, and laboratory results)Suggest corrections, report care concerns, ask for referrals, create care plans before visitsActive
Zocchi et al [76], 2021My HealtheVetPPPPView health information (including medication, laboratory results, imaging, and correspondence)Messaging, requesting prescription refills, download health informationActive

aAll studies are listed once in Tables 2-5 and are reported in the disease category of the condition that is most prominently investigated. We have included only the functionalities that the authors have reported in their articles. We have applied the taxonomy as presented in Textbox 1 on the information provided by the authors. Therefore, our classification of patient-centered digital health records might not correspond with the term used by the authors.

bIn this column, we indicated whether authors evaluated the complete patient-centered digital health record, or only part of it.

cBy definition, patient-centered digital health records have both passive and active features. In this column, we indicate whether patient-centered digital health records predominantly offer passive or active features. In passive features, patients receive information but do not actively add it. In terms of active features, patients perform an action and actively engage with the portal.

dPP: patient portal.

ePHR: personal health record.

Table 7. Patient-centered digital health record descriptions for disease category cardiopulmonary diseases (of 21 studies investigating cardiopulmonary diseases, 11 are listed in Table 7).a
Author, yearNameTypeWhat is evaluated?bPassive featuresActive featuresFocusc
Aberger et al [78], 2014Good Health GatewayPPdPP+BPe cuffView BP measurements, view treatment goalsCommunicate self-reported adherence, receive automated and tailored feedbackActive
Ahmed et al [79], 2016My Asthma PortalPPPPView health information (including medication and diagnoses), read general and tailored asthma informationMonitor and receive feedback on self-management practicesPassive
Apter et al [80], 2019MyChartPPPPView health information (including laboratory results, vaccinations, and medication), view appointmentsMessaging, request prescription refills, schedule appointmentsPassive
Fiks et al [81], 2015 and Fiks et al [82], 2016MyAsthmaPPPPView care plan, read educational materialReport symptoms, treatment adherence, concerns and side effectsActive
Kim et al [84], 2019MyHealthKeeperTethered PHRfPHR+activity trackerView previously uploaded self-reported dataUpload self-reported data (eg, diet, sleep, weight, BP, step count), connect with wearables, receive feedback from health care providersActive
Kogut et al [83], 2014ER-CardUntethered PHRPHR+home visits by pharmacistsView patient-reported medication listPharmacists view and review patient-reported medication lists, and discuss potential concerns in home visitsActive
Lau et al [85], 2015Healthy.meUntethered PHRPP+extra featureView Asthma Action Plan, read educational contentSchedule appointments, peer support, self-report medication, use a journalPassive
Manard et al [86], 2016Not reportedPPPP+BP cuffView health information (including laboratory results, vital signs, and diagnoses)Messaging, request prescription refills, upload measurements from connected BP cuffPassive
Toscos et al [87], 2020MyChartPPPP+smart pill bottleView health information (including laboratory results, vaccinations, and medication), view appointmentsMessaging, request prescription refills, schedule appointments Smart Pill Bottle: a device that sends notifications when a user opens or fails to open the lid, based on the dose scheduleActive
Wagner et al, 2012 [88]MyHealthLinkTethered PHRPHRView health information (including diagnoses, medication, and allergies), read educational materialMessaging, goal setting, upload self-measurements (including BP)Active

aAll studies are listed once in Tables 2-5 and are reported in the disease category of the condition that is most prominently investigated. We have included only the functionalities that the authors have reported in their articles. We have applied the taxonomy as presented in Textbox 1 on the information provided by the authors. Therefore, our classification of patient-centered digital health records might not correspond with the term used by the authors.

bIn this column, we indicated whether authors evaluated the complete patient-centered digital health record, or only part of it.

cBy definition, patient-centered digital health records have both passive and active features. In this column, we indicate whether patient-centered digital health records predominantly offer passive or active features. In passive features, patients receive information but do not actively add it. In terms of active features, patients perform an action and actively engage with the portal.

dPP: patient portal.

eBP: blood pressure.

fPHR: personal health record.

Table 8. Patient-centered digital health record descriptions for disease category hematological and oncological diseases (n=14).a
Author, yearNameTypeWhat is evaluated?bPassive featuresActive featuresFocusc
Cahill et al [90], 2014MyMDAndersonTethered PHRdPHRView health information (including correspondence, operative reports, laboratory results, and imaging), read education materialMessaging, request prescription refills, schedule appointmentsPassive
Chiche et al [91], 2012SanoiaPPePP+ITPf featuresView health information (including allergies, vaccinations, medication, and test results), ITP-specific educational material, read emergency protocolsMessagingPassive
Collins et al [92], 2003AdvoyPPPPView health information (treatment regimen), read educational materialRegistration of symptoms and medication use, automated alerts are sent to professionalsActive
Coquet et al [93], 2020MyHealth portalPPEmail useView health information (including laboratory results)Messaging, schedule appointments, request prescription refills, pay billsActive
Groen et al [94], 2017MyAVLPPPPView health information (including laboratory results, lung function, and correspondence), view appointments, read personalized informationUpload patient-reported outcomes, receive tailored physical activity adviceActive
Hall et al [95], 2014MyFoxChasePPGenetic screeningView health information (including laboratory results), view appointments, read educational materialMessaging, receive alerts if genetic screening results are availablePassive
Hong et al [96], 2016MyChartPPPPView health information (including laboratory results, medication, allergies)Messaging, schedule appointments, request prescription refills, use a journalPassive
Kidwell et al [97], 2019MyChartPPPPView health information (including laboratory results, medication, diagnoses, and allergies), view appointments, read information about sickle cell diseaseMessagingPassive
Martinez Nicolás et al [89], 2019Not reportedPPPPView health information (including laboratory results, imaging, and medication)Messaging, teleconsulting, schedule appointments, upload glucose measurementsActive
O’Hea et al [98], 2021Polaris Oncology Survivorship TransitionPPPPView health information (including diagnoses, operative reports, and medication), view appointments, read educational materialRequest a referralPassive
Pai et al [99], 2013PROVIDERTethered PHRPHRView health information (including laboratory results, medication, pathology, imaging, and correspondence), read educational materialMessaging, use decision support tools, fill in questionnairesPassive
Tarver et al [100], 2019OpenMRSTethered PHRPHR+extra featureView health information (including treatment history, diagnoses, and care plan), view a treatment summary, read educational materialMessaging, peer supportPassive
Wiljer et al [101], 2010InfoWellTethered PHRPHRView health information (including medication, laboratory results, imaging, and pathology), view appointmentsPatients can organize and upload care informationPassive
Williamson et al [102], 2017SurvivorLinkUntethered PHRPHRRead educational materialUpload health documents and share these with professionalsActive

aAll studies are listed once in Tables 2-5 and are reported in the disease category of the condition that is most prominently investigated. We have included only the functionalities that the authors have reported in their articles. We have applied the taxonomy as presented in Textbox 1 on the information provided by the authors. Therefore, our classification of patient-centered digital health records might not correspond with the term used by the authors.

bIn this column, we indicated whether authors evaluated the complete patient-centered digital health record, or only part of it.

cBy definition, patient-centered digital health records have both passive and active features. In this column, we indicate whether patient-centered digital health records predominantly offer passive or active features. In passive features, patients receive information but do not actively add it. In terms of active features, patients perform an action and actively engage with the portal.

dPHR: personal health record.

ePP: patient portal.

fITP: idiopathic thrombocytopenic purpura.

Table 9. Patient-centered digital health record descriptions for disease category other diseases (of 21 studies investigating other diseases, 20 are listed in Table 9).a
Author, yearNameTypeWhat is evaluated?bPassive featuresActive featuresFocusc
Anand et al [103], 2017Adam’s LovePPdPPView health information (HIV test results), receive appointment remindersSchedule HIV test appointments, use e-counseling, receive appointment remindersActive
Bidmead et al [104], 2016Patients Know BestTethered PHRePHRView health information (including medication, laboratory results, and correspondence), read educational materialCommunication with health care providers, upload and share health informationActive
Crouch et al [105], 2015My HealtheVetPPPPView health information (including laboratory results and correspondence)Messaging, request prescription refillsPassive
Druss et al [106], 2014MyHealthRecordPPPP+trainingView health information (including diagnoses, measurements, laboratory results, medication, and allergies), view treatment goalsPrompts remind patients of routine preventive servicePassive
Druss et al [77], 2020Not reportedPPPP+trainingView health information (including medication, allergies, measurements, and laboratory results)Formulate long-term goals, that are translated into action plans with progress trackingActive
Jhamb et al [107], 2015Not reportedPPPPView health information (including diagnoses, allergies, immunizations, and laboratory results)Messaging, schedule appointments, request prescription refillsPassive
Kahn et al [108], 2010MyHEROPPPPView health information (including diagnoses, medication, laboratory results, and allergies), view appointments, read information on interpreting test resultsUpload notes and self-measurementsPassive
Keith McInnes et al [109], 2013 and Keith McInnes et al [110], 2017My HealtheVetPPPPView health information (including medication and correspondence), view appointmentsMessaging, request prescription refills, receive reminders, upload notes and self-measurements, use a journalPassive
Kiberd et al [111], 2018RelayHealthPPPPView health information (including test results and medication)MessagingActive
Lee et al [112], 2017CoPHRPPPPView health information (including diagnoses, laboratory results, medication, allergies, vital signs, and correspondence), view appointments, view treatment plan, read educational informationManage and edit appointments and health informationPassive
Miller et al [113], 2011Mellen Center Care OnlineUntethered PHRPHRReview previously entered symptoms and HRQoLfMessaging, report symptoms and HRQoL and evaluate changes, preparation for appointmentsActive
Navaneethan et al [114], 2017MyChartPPPP+part of users received trainingView health information (including medication and laboratory results), read educational materialMessaging, schedule appointments, request prescription refillsPassive
Plimpton [115] 2020Not reportedPPPPView health informationMessagingPassive
Reich et al [116], 2019MyChartPPPPView health information (including laboratory results, diagnoses, medication, and vital signs)MessagingPassive
Scott Nielsen et al [117], 2012PatientSite10PPPPView health information (including laboratory results, and imaging), read educational materialMessaging, schedule appointments, request prescription refills, upload self-measurements, pay billsActive
Son and Nahm [118], 2019MyChartPPPP+trainingView health information (including medication and laboratory results), read educational materialMessaging, schedule appointments, request prescription refillsPassive
Tom et al [119], 2012MyGroupHealthPPPPView health information (including diagnoses, medication, and test results), read after-visit summaries, proxy accessMessaging, schedule appointmentsPassive
van den Heuvel et al [120], 2018“PHR-BD”Tethered PHRTethered PHR+mood chartView health information (including diagnoses, laboratory results, medication, and correspondence), read educational materialMessaging, report symptoms in a mood chart, view personal crisis planActive
van der Vaart et al [121], 2014Not reportedPPPPView health information (including diagnoses, medication, and laboratory results), read educational materialReport and monitor HRQoL outcomesActive

aAll studies are listed once in Tables 2-5 and are reported in the disease category of the condition that is most prominently investigated. We have included only the functionalities that the authors have reported in their articles. We have applied the taxonomy as presented in Textbox 1 on the information provided by the authors. Therefore, our classification of patient-centered digital health records might not correspond with the term used by the authors.

bIn this column, we indicated whether authors evaluated the complete patient-centered digital health record, or only part of it.

cBy definition, patient-centered digital health records have both passive and active features. In this column, we indicate whether patient-centered digital health records predominantly offer passive or active features. In passive features, patients receive information but do not actively add it. In terms of active features, patients perform an action and actively engage with the portal.

dPP: patient portal.

ePHR: personal health record.

fHRQoL: health-related quality of life.

Outcomes

An overview of reported associations for each health outcome is shown in Figure 2. The proportions of beneficial effects reported per health outcome are presented in Multimedia Appendices 3 and 4. For high-quality studies, proportions are presented in Multimedia Appendix 3. An overview of study conclusions and associated outcomes is presented in Tables 10-13. Studies were grouped according to disease group.

Figure 2. Health outcomes associated with patient-centered digital health record use. Associations refer to meaningful clinical effects or statistical significance. If studies report multiple health outcome within 1 category, each health outcome is included separately. *The proportion of health outcomes for which beneficial effects were reported. ED: emergency department.
View this figure
Table 10. Conclusions and health outcomes: all studies investigating diabetes (n=37), of which 8 (22%) are of high methodological quality.a
Author, yearParticipantsComparisonMain conclusionStudy designClinicalPatient reportedCare utilizationTechnologyQualityb
Boogerd et al [42], 2017Parents of children with DMc type 1PPd users versus PP nonusersPatient portal use is not associated with less parental stress. The more stress, the more parents use the portal.QEef
Lau et al [51], 2014Patients with DMPretest PP nonuse versus posttest PP usePatient portal use is associated with improved glycemic control.Cohort
Lyles et al [52], 2016Adults with DM type 2 using statins, registered for PPPrescription refill use versus no refill useRequesting prescription refills is associated with improved statin adherence.Cohort
McCarrier et al [54], 2009Adults aged <50 years with uncontrolled DM type 1Nurse-aided PP users versus PP nonusersPatient portal use results in improved self-efficacy, but not in improved glycemic control.RCTg
Price-Haywood and Luo [56], 2017Adults with DM (or HTh)PP users versus PP nonusersPatient portal use is associated with more primary care visits and telephone encounters, but not with less hospitalizations or EDi visits.Cohort
Sarkar et al [68], 2014Adults with DM, registered for PPRecurrent prescription refill use versus occasional refill use versus no refill useRecurrent use of prescription refills is associated with improvements in adherence and lipid control.Cohort
Shimada et al [71], 2016Veterans with uncontrolled DM, registered for PPMessaging and prescription refills users versus PP users who use neitherMessaging or requesting prescription refills is associated with improved glycemic control.Cohort
van Vugt et al [73], 2016Patients with DM type 2, registered for PHRjPHR+personal coach versus PHR use alonePHR use does not result in improved glycemic control, self-care, distress, nor well-being, regardless of personal coaching.RCT
Dixon et al [47], 2016Adults with DM type 2Pretest PP nonusers versus posttest PP usersPatient portal use is associated with improved adherence, but not with changes in clinical outcomes nor care utilization.QE
Druss et al [77], 2020Patients with a mental disorder+DM, HT or HCkPP users versus PP nonusersPatient portal use does not result in clinically relevant improvements in perceived quality of care, patient activation nor HRQoLl.RCT
Graetz et al [49], 2020Adults with DM with at least 1 oral drugPP users versus PP nonusersPatient portal use is associated with small, likely irrelevant improvements in glycemic control and medication adherence.Cross
Grant et al [50], 2008Adults with DM using medicationTethered PP use versus untethered PP useUsing a tethered patient portal results in increased patient participation, but not improved glycemic control.RCT
Reed et al [60], 2019Adults with DM+HT, asthma, CADm, or CHFnPP users versus PP nonusersPatient portal use is associated with more outpatient office visits, and with reduced ED visits and preventable hospitalizations.Cross
Riippa et al [62], 2014Adults with DM, HT, or HCPP users versus PP nonusersPatient portal use does not result in clinically relevant improvements in patient activation, except among adults with low baseline activation.RCT
Riippa et al [63], 2015Adults with DM, HT, or HCPP users versus PP nonusersPatient portal use does not result in clinically relevant improvement in patient activation nor HRQoL.RCT
Robinsonet al [64], 2020Veterans with uncontrolled DM type 2, registered for PPResponders on team-initiated messages versus nonrespondersResponding on messages is associated with improved self-management and self-efficacy.Cross
Ronda et al [65], 2014Adults with DMRecurrent PP users versus PP nonusersRecurrent patient portal use is associated with better self-efficacy and knowledge.Cross
Ronda et al [66], 2015Adults with DM, registered for PPPersistent users versus early quittersRecurrent users believe the patient portal increases disease knowledge, and they find it useful.Cross
Sabo et al [67], 2021Adults with DM type 2, registered for PPPP users versus PP nonusersPatient portal use has minor, clinically irrelevant effects on BMI, and no effects on glycemic control nor blood pressure.RCT
Seo et al [69], 2020Patients with DM, registered for PHRContinuous users versus noncontinuous usersContinuous use of a tethered PHR is associated with slightly improved glycemic control. Clinical implications are doubtful.Cohort
Sharit et al [70], 2018Overweight veterans with prediabetesPretest PP nonuse versus posttest PP useUsing an accelerometer-connected patient portal is associated with improvements in physical activity and blood pressure.QE
Tenforde et al [72], 2012Adults aged <75 years with DMPP users versus PP nonusersPatient portal use is associated with slightly improved diabetes control, lipid profile, and blood pressure. Clinical implications are doubtful.Cohort
Vo et al [74], 2019Adults aged <80 years with DM type 2, registered for PPPrevisit message use versus no previsit message useSending previsit prioritization messages does not result in improved glycemic control, but does result in improved perceived shared-decision-making.RCT
Zocchi et al [76], 2021Patients with DM type 2, registered for PPPP usersAmong existing patient portal users with uncontrolled DM or high LDLo, increased use is associated with improved control.Cohort
Bailey et al [41], 2019Adults with DM, on high-risk medicationPP usersPatients are satisfied with the patient portal.QE
Byczkowski et al [43], 2014Parents of children with DM (or CFp or JIAq)PP usersPatients consider the patient portal to be useful in managing and understand their child’s disease.Cross
Chung et al [44], 2017Adults with DM, registered for PPMessage users versus message nonusersUsing secure messaging is associated with better glycemic control.Cohort
Conway et al [45], 2019Patients with DM, registered for PPPP usersPatients believe the tethered diabetes PHR might improve their diabetes self-care.Cross
Devkota et al [46], 2016Patients with DM type 2PP users who read and write emails versus PP nonusersReading and writing emails is associated with improved glycemic control.Cohort
Graetz et al [48], 2018Adults with DMPP users versus PP nonusersPatient portal use is associated with improved adherence to medication and preventive care utilization.Cross
Martinez et al [53], 2021Adults with DM type 2 using medication, registered for PPPretest PP nonuse versus posttest PP usePatient portal use results in clinically not relevant improvements in patient activation and self-efficacy. This is related to the very short follow-up period of the study.QE
Osborn et al [55], 2013Adults with DM type 2 using medicationPP users versus PP nonusersPatient portal use is not associated with improved glycemic control, as compared with nonusers. However, among users, more frequent use is associated with improved glycemic control.Cross
Price-Haywood et al [57], 2018Adults with DM (or HT)PP users versus PP nonusersMessaging is associated with improved glycemic control.Cohort
Quinn et al [58], 2018Adults aged <65 years with DM type 2PP+extra module users versus PP usersMessaging is associated with better glycemic control. Note: glycemic parameters were predicted and not represent measurements.RCT
Reed et al [59], 2015Adults with DM, HT, asthma, CAD, or CHF, registered for PPPP usersOne-third of patients report that messaging in a patient portal results in less health care visits and improved overall health.Cross
Reed et al [61], 2019Adults with DM, asthma, HT, CAD, CHF, or CVr event riskPP users versus PP nonusersOne-third of patients report that using the patient portal improves overall health.Cross
Wald et al [75], 2009Patients with DM type 2PHR users who created a previsit planUsers who create a previsit care plan feel better prepared for visits.RCT

aStudies are listed multiple times in Tables 10-13. Per disease category, the relevant subconclusion and health outcomes are described. Associations with health outcomes are color-coded as green for beneficial, yellow for neutral or clinically nonrelevant, or red for undesired. The half green and half yellow symbol implies that one study investigated multiple outcomes in one category and reported beneficial associations for some outcomes and neutral associations for others.

bQuality appraisal—green: high quality; yellow: medium quality; red: low quality.

cDM: diabetes mellitus.

dPP: patient portal.

eQE: quasi-experimental, including pretest-posttest studies and feasibility studies.

fThe study did not assess any health outcome in a certain category.

gRCT: randomized controlled trial.

hHT: hypertension.

iED: emergency department.

jPHR: personal health record.

kHC: hypercholesteremia.

lHRQoL: health-related quality of life.

mCAD: coronary artery disease.

nCHF: congestive heart failure.

oLDL: low-density lipoprotein.

pCF: cystic fibrosis.

qJIA: juvenile idiopathic arthritis.

rCV: cardiovascular.

Table 11. Conclusions and health outcomes: studies investigating cardiopulmonary diseases (n=21), of which 6 (29%) are of high methodological quality.a
Author, yearParticipantsComparisonConclusionStudy designClinicalPatient reportedCare utilizationTechnologyQualityb
Ahmed et al [79], 2016Adults with asthma using medicationPPc users versus PP nonusersPatient portal use does not result in durable improvements in HRQoLd nor asthma control.RCTe
Fiks et al [81], 2015Children aged 6-12 years with asthmaPP users versus PP nonusersPatient portal use results in improved asthma control.RCT
Lau et al [85], 2015Adults with asthmaPHRf users versus PHR nonusersPHR use does not increase the use of asthma action plans, and does not affect asthma control, health care utilization nor work or school participation.RCTg
Manard et al [86], 2016Adults with uncontrolled HThPP users versus PP nonusersUsing a patient portal linked with a blood pressure cuff is not associated with improved blood pressure control.Cohort
Price-Haywood and Luo [56], 2017Adults with HT (or DMi)PP users versus PP nonusersPatient portal use is associated with more primary care visits and telephone encounters, but not hospitalizations or EDj visits. Effects on blood pressure control are not clinically relevant.Cohort
Shimada et al [71], 2016Veterans with uncontrolled HCk or HT, registered for PPUsers of both messaging and prescription refills versus nonusersMessaging or requesting prescription refills are both associated with improved lipid control. Requesting prescription refills is associated with improved blood pressure control.Cohort
Apter et al [80], 2019Adults with asthma using prednisonePP use+training versus PP use+assistance via home visitsPatient portal use results in minor improvements in asthma control and HRQoL. Conducting home visits results in more improvements in these outcomes.RCT
Druss et al [77], 2020Patients with a mental disorder+DMi, HTj, or HCkPP users versus PP nonusersPatient portal use does not result in clinically relevant improvements in perceived quality of care, patient activation, nor HRQoL.RCT
Fiks et al [82], 2016Children aged 6-12 years with asthmaPP users versus PP nonusersPatient portal use is associated with improved treatment adherence. Among patients with uncontrolled asthma, its use is associated with more care visits. Adoption is low.QEl
Martinez Nicolás et al [89], 2019Patients with COPDm or CHFnPretest PP nonuse versus posttest PP usePatient portal use is associated with less hospitalizations, readmissions, and ED visits among patients with CHF and COPD.QE
Reed et al [60], 2019Adults with DM+HT, asthma, CADm, or CHFnPP users versus PP nonusersPatient portal use is associated with more outpatient office visits, and with reduced ED visits and preventable hospitalizations.Cross
Riippa et al [62], 2014Adults with DM, HT, or HCPP users versus PP nonusersPatient portal use does not result in clinically relevant improvements in patient activation, except for patients with low baseline activation.RCT
Riippa et al [63], 2015Adults with DM, HT, or HCPatient portal versus usual carePatient portal use does not result in clinically relevant improvement in patient activation nor HRQoL.RCT
Toscos et al [87], 2020Patients with nonvalvular AFo with an oral anticoagulant drugPP users versus PP nonusersUsing a patient portal connected to a Smart Pill Bottle does not result in improved drug adherence.RCT
Wagner et al [88], 2012Patients with HTPHR users versus PHR nonusersUsing a tethered PHR does not result in clinically relevant improvements in blood pressure control, patient activation nor health care utilization. Adoption is low.RCT
Aberger et al [78], 2014Postrenal transplant patients with HTPP usersUsing a patient portal–linked blood pressure monitoring system is associated with improved blood pressure control.QE
Kim et al [84], 2019Patients with obstructive sleep apneaPHR+activity tracker versus PHR alone versus nonusersUsing a tethered PHR results in more weight loss, regardless of its connection to an activity tracker. No sleep-related outcome improvements are seen.RCT
Kogut et al [83], 2014Adults aged >49 years with cardiopulmonary disordersPHR users versus PHR nonusersPharmacists reviewing patient-reported medication lists in a PHR might identify more medication-related problems.QE
Price-Haywood et al [57], 2018Adults with HT or DMPP users versus PP nonusersMessaging is not associated with improved blood pressure control.Cohort
Reed et al [59], 2015Adults with DM, HT, asthma, CADp, or CHF, registered for PPPP usersOne-third of patients report that messaging in a patient portal results in less health care visits and improved overall health.Cross-sectional
Reed et al [61], 2019Adults with DM, asthma, HT, CAD, CHF, or CVq event riskPP users versus PP nonusersA third of patients reports that using the patient portal improves overall health.Cross-sectional

aStudies are listed multiple times in Tables 10-13. Per disease category, the relevant subconclusion and health outcomes are described.

bFor color coding of quality appraisal and health outcomes, see Table 10.

cPP: patient portal.

dHRQoL: health-related quality of life.

eRCT: randomized controlled trial.

fPHR: personal health record.

gThe study did not assess any health outcome in a certain category.

hHT: hypertension.

iDM: diabetes mellitus.

jED: emergency department.

kHC: hypercholesteremia.

lQE: quasi-experimental, including pilot or feasibility studies.

mCOPD: chronic obstructive pulmonary disease.

nCHF: Congestive heart failure.

oAF: atrial fibrillation.

pCAD: coronary artery disease.

qCV: cardiovascular.

Table 12. Conclusions and health outcomes: studies investigating hematological and oncological diseases (n=14), of which 2 are of high methodological quality (14%).a
Author, yearParticipantsComparisonConclusionStudy designClinicalPatient reportedCare utilizationTechnologyQualityb
Cahill et al [90], 2014Adults with a brain tumorPHRc users versus PHR nonusersUsing a tethered PHR is associated with improvements in patient uncertainty.Cross-sectionald
Coquet et al [93], 2020Patients with cancer+chemotherapy, registered for PPeEmail users versus email nonusersSending emails is associated with improved 2-year survival, less missed appointments, and less hospitalizations.Cohort
Chiche et al [91], 2012Adults with ITPfPP users versus PP nonusersPatient portal use does not result in improved HRQoLg. The portal is acceptable and feasible.RCTh
Groen et al [94], 2017Patients with lung cancerPP usersPatient portal use does not affect HRQoL nor patient engagement. It is feasible and acceptable.QEi
Hall et al [95], 2014Patients with cancer resectionPP usersDisclosing results of genetic cancer screening in a patient portal might be feasible and acceptable, and is not associated with more anxiety. Yet, few abnormal results were observed.QE
Kidwell et al [97], 2019Patients aged 13-24 years with sickle cell diseasePP usersPatient portal use is not associated with improved medical decision-making by patients. It is acceptable and easy to use.QE
Martinez Nicolás et al [89], 2019Patients with hematologic malignancyPretest PP nonuse versus posttest PP usePatient portal use is not associated with less hospitalizations, readmissions, nor EDj department visits.QE
Williamson et al [102], 2017Pediatric cancer survivorsPHR users versus PHR registrantsPatient portal use is not associated with less missed appointments.Cohort
Collins et al [92], 2003Patients with hemophilia >11 yearsUsersAn electronic treatment log is considered feasible and easy to use.QE
Hong et al [96], 2016Children aged 13-17 years with cancer or a blood disorder+parentsPP usersA small cohort considers a patient portal to be feasible and useful.Cross-sectional
O’Hea et al [98], 2021Women with breast cancerPP users versus PP nonusersPatient portal use does not result in improved HRQoL nor disease knowledge.RCT
Pai et al [99], 2013Men with prostate cancerPHR usersPatients are satisfied with a tethered PHR and find it increases disease knowledge.Cross-sectional
Tarver et al [100], 2019Patients with colorectal cancerTethered PHR usersPatients are satisfied with an integrated care plan and find it useful.Cohort
Wiljer et al [101], 2010Patients with breast cancerPretest PHR nonusers versus posttest PHR usersPHR use is not associated with improved self-efficacy, nor with a clinically relevant decrease in anxiety. Satisfaction is high.QE

aStudies are listed multiple times in Tables 10-13. Per disease category, the relevant subconclusion and health outcomes are described.

bFor color coding of quality appraisal# and health outcomes, see Table 10.

cPHR: personal health record.

dThe study did not assess any health outcome in a certain category.

ePP: patient portal.

fITP: idiopathic thrombocytopenic purpura.

gHRQoL: health-related quality of life.

hRCT: randomized controlled trial.

iQE: quasi-experimental, including pilot or feasibility studies.

jED: emergency department.

Table 13. Conclusions and health outcomes: studies investigating other diseases (n=21), of which 2 (10%) are of high methodological quality.a
Author, yearParticipantsComparisonConclusionStudy designClinicalPatient reportedCare utilizationTechnologyQualityb
Miller et al [113], 2011Patients with multiple sclerosisPHRc use versus PHR that only enables messagingUsing an untethered PHR results in slightly improved HRQoLd, but not in improved self-efficacy, disease control nor health care utilization.RCTef
Navaneethan et al [114], 2017Adults with chronic kidney diseasePPg users+coach versus PP users versus PP nonusersPatient portal use, regardless of added training, does not result in improved kidney function, nor altered health care utilization.RCT
Anand et al [103], 2017MSMh and transgender women with HIVPP usersThe patient portal is feasible and acceptable.RCT
Druss et al [106], 2014Patients with a mental disorder+chronic conditionPP users versus PP nonusersPatient portal use results in increased use of preventive health services and medical visits, but not in improved HRQoL.RCT
Druss et al [77], 2020Patients with a mental disorder+DMi, HTj, or HCkPP users versus PP nonusersPatient portal use does not result in clinically relevant improvements in perceived quality of care, patient activation, nor HRQoL.RCT
Jhamb et al [107], 2015Adults visiting nephrology clinicsPP users versus PP nonusersPatient portal use might be associated with improved blood pressure control, although its clinical relevance is unclear.Cross-sectional
Keith McInnes et al [109], 2013Veterans with HIVPP users versus PP nonusersPatient portal use is associated with improved adherence to HIV medication.Cross-sectional
Keith McInnes et al [110], 2017Veterans with HIV+detectable viral load, registered for PPMessaging or prescription refill users versus nonusersRequesting prescription refills is associated with improved HIV control, but messaging is not.Cohort
Kiberd et al [111], 2018Adult with home dialysisPretest PP nonuse versus posttest PP usePatient portal use is not associated with improvements in HRQoL nor perceived quality of care. Both were already high at baseline.QEl
Lee et al [112], 2017Patients with cleft lip or cleft palate surgeryPP users versus PP tailored for lip or cleft palate surgeryUsing a tailored, disease-specific patient portal is associated with increased disease knowledge.QE
Reich et al [116], 2019Patients with inflammatory bowel diseasePP users versus PP nonusersPatient portal use does not result in improved HRQoL, but results in a higher vaccination rate. Patient satisfaction is high.RCT
Scott Nielsen et al [117], 2012Patients with multiple sclerosisPP users versus PP nonusersMessaging in a patient portal is associated with more clinic visits, but not with less EDm visits nor hospitalizations.Cross-sectional
Tom et al [119], 2012Parents of children age <6 years with 1 ore more chronic condition(s)PP users versus PP nonusersPatient portal use is not associated with improved access to care, nor perceived quality of care. It is considered feasible.Cross-sectional
van den Heuvel et al [120], 2018Adults with bipolar disorderPretest PHR nonusers versus posttest PHR usersPHR use is not associated with improved HRQoL, patient empowerment, symptom reduction, nor disease burden.Cross-sectional
van der Vaart et al [121], 2014Patients with rheumatoid arthritisPretest PP nonusers versus posttest PP usersPatient portal use is not associated with improved patient empowerment. It is considered useful and understandable.Cross-sectional
Bidmead et al [104], 2016Patients with inflammatory bowel diseasePHR usersPHR use is not associated with improved self-management.Cross-sectional
Byczkowski et al [43], 2014Parents of children with CFo or JIAp (or DM)PP usersPatients consider the patient portal to be useful in managing and understand their child’s disease.Cross
Crouch et al [105], 2015Veterans with HIVPP users versus PP nonusersPatient portal use is associated with improved patient activation, disease knowledge, HIV load, but not with improved CD4-count nor treatment adherenceCross-sectional
Kahn et al [108], 2010Patients with HIV or aidsPP usersPatients are satisfied with the patient portal and consider it to be helpful in managing their problems.QE
Plimpton [115], 2020Women with HIVPretest PP nonuse versus posttest PP usePatient portal use is associated with an increase in planned visits, but not with a decrease in missed visits. A trend toward improved viral load is seen.QE
Son et al [118], 2019Patients aged >49 years with 1 or more chronic condition(s)PP usersPatients consider a patient portal to be helpful in increasing self-management.Cohort

aStudies are listed multiple times in Tables 10-13. Per disease category, the relevant subconclusion and health outcomes are described.

bFor color coding of quality appraisal and health outcomes, see Table 10.

cPHR: personal health record.

dHRQoL: health-related quality of life.

eRCT: randomized controlled trial.

fThe study did not assess any health outcome in a certain category.

gPP: patient portal.

hMSM: men who have sex with men.

iDM: diabetes mellitus.

jHT: hypertension.

kHC: hypercholesteremia.

lQE: quasi-experimental, including pilot or feasibility studies.

mED: emergency department.

oCF: cystic fibrosis.

pJIA: juvenile idiopathic arthritis.

Clinical Outcomes

In 44 studies investigating a total of 69 clinical outcomes, a beneficial association with digital health record use was reported for 42% (29/69) of the outcomes. Hospitalizations and exacerbations were the most frequently studied disease events and complications, with beneficial effects reported in half of the studies (2/4 and 2/4, respectively). Blood pressure was the most frequently studied vital parameter, with beneficial effects reported in 36% (5/14) of the studies. HbA1c and cholesterol levels were the most frequently studied laboratory parameters, with beneficial effects reported in 53% (10/19) and 57% (4/7) of the studies, respectively. No clinical outcomes were unfavorably affected by patient-centered digital health record use. In comparison with the total population, higher proportions of beneficial effects were reported for diabetes mellitus and cardiopulmonary diseases. When focusing on 14 high-quality studies, beneficial effects were observed less frequently, in only 30% (7/23) of the clinical outcomes.

Studies that assessed vital parameters generally reported few other health outcomes. However, among the studies that assessed disease events and complications, and laboratory parameters, beneficial effects were often associated with improved treatment adherence [52,68,71,81]. We hypothesize that this might be related to the removal of logistical barriers for patients in obtaining web-based prescription refills, as opposed to having to call health care providers or send them an email. Of the 6 high-quality studies that investigated treatment adherence, 2 studies assessed patient-centered digital health records that enabled patients to request prescription refills and found beneficial effects on adherence [52,68].

Patient-Reported Outcomes

Overall, in 53 studies investigating a total of 86 patient-reported outcomes, a beneficial association with digital health record use was reported for 45% (39/86) of the outcomes. Of the 18 studies investigating 19 self-management or self-efficacy outcomes, beneficial effects were reported in 53% (9/19). Of these 9 studies, 56% (5/9) used validated questionnaires. For patient engagement outcomes, large differences in the proportions of beneficial effects were observed: from 11% (1/9) for patient activation, to 56% (5/9) for patient involvement, and 70% (7/10) for disease knowledge. However, only in measuring patient activation, validated questionnaires were principally used (8/9, 88% of studies). For HRQoL, beneficial effects were reported in 27% (4/15) of the studies, of which half used validated HRQoL questionnaires. No patient-reported outcomes were unfavorably affected by patient-centered digital health record use. In comparison to the total population, higher proportions of beneficial effects were reported for diabetes mellitus, especially for patient engagement and treatment adherence. Lowest proportions were reported for cardiopulmonary diseases, especially for patient engagement. When focusing on 10 high-quality studies, a lower proportion (7/19, 37%) of beneficial effects was observed.

We observed that improvements in patient engagement were especially facilitated by strengthening patient-professional communication; for example, through secure messaging [71,81,93]. In addition, both self-efficacy and HRQoL primarily seemed to be reinforced through the use of 2 functionalities: patient-professional communication [54,90,113] and information on disease progression [90,113].

Health Care Utilization

For 24 studies investigating a total of 27 health care utilization outcomes, a beneficial association with digital health record use was observed for 59% (16/27) of the outcomes. The highest proportion (10/13, 77%) of beneficial effects was reported for an increased use of recommended care services. Of these 13 studies, 5 (38%) focused on recommended care services for people with uncontrolled disease, 4 (31%) on the use of preventive care services, and 4 (31%) on medical follow-up rates. In 25% (3/12) of the studies that assessed reductions in ED visits and hospitalizations, these were accompanied by an increased use of other care services, including outpatient clinic appointments and secure messaging. Compared with the total population, highest proportions of beneficial effects were reported for diabetes mellitus and hematological and oncological diseases. When focusing on 7 high-quality studies, lower proportions (3/9, 33%) of beneficial effects were observed.

Technology-Related Outcomes

For 39 studies investigating a total of 75 technology-related outcomes, a beneficial association with digital health record use was observed for 88% (66/75) of the outcomes. All (22/22, 100%) studies reported high patient satisfaction with accessing and using digital health records. Furthermore, 75% (6/8) of the studies reported high patient satisfaction with the effects of using digital health records. High feasibility was reported by 79% (15/19) of the studies, and high acceptability by 88% (23/26) of the studies. Highest feasibility was reported for digital health records intended for people with hematological and oncological diseases. Lowest feasibility and acceptability were reported for digital health records intended for people with cardiopulmonary diseases. When focusing on 6 high-quality studies, proportions of studies that found beneficial effects were similar.

High Disease Burden or Self-management

A subgroup of 47 studies that investigated patients with a high disease burden or high self-management was assessed. The following conditions were included: malignancies (11 studies), asthma (9 studies), HIV infection and AIDS (6 studies), hematologic conditions (5 studies), chronic kidney disease (3 studies), chronic heart failure (4 studies), mental disorders (3 studies), multiple sclerosis (2 studies), inflammatory bowel disease (2 studies), rheumatologic conditions (2 studies), insulin-dependent diabetes mellitus (2 studies), atrial fibrillation (1 study), cystic fibrosis (1 study), and posttransplant patients (1 study). In general, the digital health records assessed in this subgroup were more often tailored to specific patient populations through the addition of specialized functionalities or connected wearables.

In comparison with studies investigating patients with no high disease burden, studies investigating patients with a high disease burden reported considerably higher proportions of beneficial effects for vital parameters, patient engagement, reductions in ED visits and hospitalizations, and for all technology-related outcomes. Considerably lower proportions of beneficial effects were reported for laboratory parameters, health-related quality of life, treatment adherence, and increased use of recommended care services. For the 9 high methodological quality studies on high disease burden or self-management, the proportions of studies that found beneficial effects were roughly similar.

Focus on Passive Versus Active Features

Of the 81 studies, 41 (51%) of the studied patient-centered digital health records focused on passive features and 40 (49%) focused on active features. In comparison with digital health records with an active focus, more beneficial effects were observed among digital health records with a passive focus for laboratory parameters (9/16, 56% vs 7/17, 41%), self-management and self-efficacy (7/11, 64% vs 3/8, 38%), patient engagement (9/15, 60% vs 4/13, 31%), and for an increased use of recommended care services (5/6, 83% vs 5/7, 71%). Compared with digital health records with a passive focus, more beneficial effects were observed among digital health records with an active focus on disease events or complications (4/10, 40% vs 1/5, 20%) and reductions in ED visits and hospitalizations (4/6, 67% vs 1/6, 17%). However, when focusing on high-quality studies, higher proportions of beneficial effects were seen for digital health records with an active focus on all clinical outcomes, patient-reported outcomes, reductions in ED visits and hospitalizations, patient satisfaction, and acceptability.

Quality Appraisal

Of the 81 included studies, 27 (33%) studies were graded as low quality, 38 (47%) as medium quality, and 16 (20%) as high quality (Tables 10-13). Studies investigating cardiopulmonary conditions were of the highest quality, with 29% (6/21) of the studies graded as high quality. Of the 24 included RCTs, 7 (29%) were of high quality. Only 38% (9/24) of the RCTs concealed allocation to treatment groups, and 67% (16/24) used intention-to-treat analyses. Of the 57 studies with other designs, 9 (16%) were graded as high quality. Overall, 15% (12/81) of studies reported power calculations.

Among the 65 studies that were graded as medium or low quality, only 35% (23/65) used reliable or validated tools for the measurement of all their outcomes and 48% (31/65) for part of their outcomes. Of these 65 studies, 10 (15%) studies took adequate measures to limit selection bias and 17 (26%) studies used a control group or randomized participants.

When focusing on the 16 high-quality studies, 3 functionalities appeared to be the most effective: secure messaging to lower barriers in patient-professional interaction, prescription refill functions to improve medication adherence, and information provision on disease progression. In addition, in 16 high-quality studies, the proportions of beneficial effects were similar for a subgroup of studies that included older participants (mean age >55 years), which included a high number of female participants (>45%), or included a racially diverse population (<50% White participants), as compared with the total population.


Principal Findings

In this systematic review, we evaluated evidence on the effects of the use of patient-centered digital health records in nonhospitalized patients with chronic health conditions on clinical and patient-reported outcomes, health care utilization, and technology-related outcomes. Beneficial effects were most frequently reported for the use of recommended care services (10/13, 77%) and for 4 patient-reported outcomes: disease knowledge (7/10, 70%), patient involvement (5/9, 56%), treatment adherence (10/18, 56%), and self-management and self-efficacy (10/19, 53%). Regarding clinical outcomes, beneficial effects were reported in 42% (29/69) of the studies. Beneficial effects were least frequently reported for disease events and complications (5/15, 33%) and health-related quality of life (4/15, 27%). For digital health records that predominantly focused on active features, higher proportions of beneficial effects on nearly all health outcomes were observed among the high-quality studies.

In this study, we observed that patient-centered digital health record use may be associated with an increased use of recommended care services. Beneficial effects on ED visits and hospitalizations were mainly observed when accompanied by an increased rate of follow-up appointments or secure messaging [60,89,93]. This might imply that reducing ED visits and hospitalizations is primarily achieved by facilitating patient-professional communication.

Beneficial effects were most often reported for patients with diabetes or cardiopulmonary disorders. We suggest 2 explanations. First, the focus of digital health records has been directed toward patients with diabetes and asthma for some time because of the sheer number of people with these conditions. This could have resulted in higher-quality patient-centered digital health records and patients who were more accustomed to their use. Second, the relative improvements in health outcomes might be smaller among patients with a condition with a high disease burden because of a higher baseline level of self-management skills and disease knowledge.

The proportions of beneficial effects varied considerably between health outcomes, which may be explained by 2 reasons. First, outcomes with a higher proportion of beneficial effects were more often the primary study outcomes than the secondary outcomes. Digital health records were more frequently tailored for these outcomes, yielding higher beneficial effects. Second, outcome assessment was generally less robust for outcomes with a higher proportion of beneficial effects, such as self-management and patient engagement, which might have resulted in more false-positive effects.

Comparison With Earlier Evidence

Our results are more positive than those of the previous systematic reviews. This might be because of the increasing acceptance of digital health records, their improving quality, the increasing body of literature, or variations in digital health record definitions used. Two previous reviews found mixed effects on the use of portals on health outcomes and health care utilization [27] and reported positive effects on qualitatively assessed self-management in only one-third of the studies [25]. A recent systematic review that focused on portals intended for hospitalized patients found mixed results for patient engagement [26]. A systematic review that included only qualitative studies found that portal use was associated with positive effects on self-efficacy, treatment adherence, and disease knowledge [28]. In a review on eHealth interventions that aim to promote medication use, a weak association between digital health record use and health-related quality of life was observed [10]. This implies that digital health record engagement is not yet sufficient to affect patients’ overall health-related quality of life.

Strengths and Limitations

This systematic review has several strengths. Our search strategy was comprehensive, to account for the lack of consensus in digital health record terminology. In addition, a wide variety of health outcomes were considered relevant to determine the impact of digital health record use. However, several limitations of this study must be considered. First, comparisons between studies were difficult because of the variety in evaluated functionalities. A similar diversity was observed among the reported follow-up durations, participants’ ages, study sample sizes, and outcomes. Second, because it was not possible to perform a meta-analysis owing to the heterogeneity in reported (disease-specific) outcome measurements and effects, we used the vote-counting method. Therefore, we could not report the effect estimates and indicated directions of effects [122]. Third, owing to a lack of agreement on feasibility and acceptability thresholds, much is left to the authors’ discretion. Fourth, JBI critical appraisal tools rank every item equally despite being not equally important. Finally, publication bias could have resulted in overestimation of the positive effects of patient-centered digital health records. More studies with positive results have been published. In addition, many of the included studies assessed more “mature” patient-centered digital health records, which could have overestimated the effects.

We observed that high patient satisfaction rates did not fully reflect in other health outcomes. This can be partly attributed to acquiescence bias and satisficing [123]. Moreover, satisfaction was often reduced to a narrow ease-of-use questionnaire, instead of satisfaction with the contribution to overall disease management. Finally, several studies only included recurrent users in their analyses, which could falsely increase feasibility. Moreover, these recurrent users likely experienced positive effects of using digital health records, which would have resulted in an overestimation of effects in randomized studies with no intention-to-treat analysis and in all nonrandomized studies.

The voluntary adoption of patient-centered digital health records by patients might reflect an intrinsic, preexisting motivation for self-management and care engagement bias, which may overestimate their effects. Patient-centered digital health record use could even be considered a surrogate measure for engagement [109,124,125]. Thus, it might be best to consider digital health records as vehicles for empowerment, strengthening existing self-management capabilities [126,127].

The effects of using patient-centered digital health records on health outcomes are not always direct but often depend on intermediate steps. For example, requesting prescription refills might depend on the actions performed by (slow-responding) physicians, nurses, or pharmacies. Thus, if using a digital health record would have no observable effects on health outcomes, this could also be a result of these intermediate steps or unforeseen processes and may not be attributable to the use of the patient-centered digital health record.

The proportion of beneficial effects reported in high-quality studies was lower as compared with all included studies for clinical outcomes (30% vs 42%), patient-reported outcomes (37% vs 45%), and health care utilization (33% vs 59%). Nevertheless, the proportions are clinically relevant and promising considering this newly emerging field. The observed differences might be related to 4 factors. First, the selection of motivated, well-educated, digitally minded participants might have overestimated the results in most low- and moderate-quality studies. Second, most studies did not measure ongoing user activity, and assumed that registered users became recurrent users. Third, nearly all low- and moderate-quality studies reported high dropout rates, which could overestimate acceptance rates. Finally, the lack of consensus on digital health record terminology hindered the interpretation of findings. We would advocate the use of uniform definitions, such as those presented in Textbox 1 [10,17-20].

Future Research

Future studies should adopt additional measures to adhere to a uniform taxonomy, use log data, and limit selection bias. The exclusion of less-engaged people could further expand the digital divide between patients who are digitally proficient and those who are not, resulting in an increasingly unequal distribution of care services. We suggest that researchers include a diverse population based on age, gender, disease burden, race, education level, and health literacy [128]. Finally, further research should focus on determining which functionalities are mostly responsible for the effects on the outcomes.

Conclusions

The use of patient-centered digital health records in chronic conditions is potentially associated with beneficial effects on several patient-reported outcomes and recommended care services in a considerable number of studied digital health records. The rates of the effects were approximately similar for different patient groups. Feasibility and acceptability were high. Our findings support further implementation of patient-centered digital health records in clinical practice. Yet, higher-quality research is needed to identify effects per disease category and per health outcome and to learn which patients might benefit from specific functionalities.

Acknowledgments

This project was supported by grants K23HL150232 (principal investigator [PI]: SMB) and K23HL141447 (PI: RMC) from the National Heart, Lung, and Blood Institute of the National Institutes of Health and by grant NWA.1160.18.038 (PI: MH Cnossen, WP leader SCG) of the Netherlands Organization for Scientific Research (NWO) for the SYMPHONY consortium. The content is solely the responsibility of the authors and does not necessarily represent National Institutes of Health or NWO.

Authors' Contributions

All authors were involved in the design of the research protocol. MB performed the search strategy. MRB and SMB assessed all titles, abstracts, and full texts for eligibility. SCG helped resolve the discussion if necessary. MRB and SMB performed data extraction and synthesis. All authors provided feedback on the manuscript and approved the final manuscript.

Conflicts of Interest

SCG received an unrestricted medical research grant from Sobi. The authors have no futher interests to declare.

Multimedia Appendix 1

The search strategy used, that includes terms related to the search categories: “patient,” “intervention,” and “outcome.”.

DOCX File , 19 KB

Multimedia Appendix 2

The 4 modified Joanna Briggs Institute critical appraisal tools used in this study.

DOCX File , 24 KB

Multimedia Appendix 3

Proportion of beneficial effects reported per health outcome of all studies, presented per disease category.

DOCX File , 18 KB

Multimedia Appendix 4

The proportion of beneficial effects reported per health outcome of 16 high quality studies, presented per disease category.

DOCX File , 26 KB

  1. Noncommunicable diseases. World Health Organization. 2021 Sep 16.   URL: https://www.who.int/news-room/fact-sheets/detail/noncommunicable-diseases [accessed 2022-12-01]
  2. Benziger CP, Roth GA, Moran AE. The global burden of disease study and the preventable burden of NCD. Glob Heart 2016 Dec;11(4):393-397 [FREE Full text] [CrossRef] [Medline]
  3. Buttorff C, Ruder T, Bauman M. Multiple Chronic Conditions in the United States. Santa Monica, CA, USA: RAND Corporation; 2017.
  4. Schulman-Green D, Jaser S, Martin F, Alonzo A, Grey M, McCorkle R, et al. Processes of self-management in chronic illness. J Nurs Scholarsh 2012 Jun;44(2):136-144 [FREE Full text] [CrossRef] [Medline]
  5. Chen S, Kuhn M, Prettner K, Bloom DE. The macroeconomic burden of noncommunicable diseases in the United States: estimates and projections. PLoS One 2018 Nov 1;13(11):e0206702 [FREE Full text] [CrossRef] [Medline]
  6. The Complexities of Physician Supply and Demand: Projections From 2019 to 2034. Association of American Medical Colleges. 2021 Jun.   URL: https://tinyurl.com/yfren872 [accessed 2022-09-01]
  7. European Commission, Directorate-General for Employment, Social Affairs and Inclusion, McGrath J. Analysis of Shortage and Surplus Occupations 2020. Luxembourg, Luxembourg: Publications Office of the European Union; 2020.
  8. Medical staffing in England: a defining moment for doctors and patients. British Medical Association. 2021 Jul 11.   URL: https:/​/www.​pslhub.org/​learn/​improving-patient-safety/​workforce-and-resources/​safe-staffing-levels/​medical-staffing-in-england-a-defining-moment-for-doctors-and-patients-bma-11-july-2021-r4856/​ [accessed 2022-09-01]
  9. COVID-19 continues to disrupt essential health services in 90% of countries. World Health Organization. 2021 Apr 23.   URL: https:/​/www.​who.int/​news/​item/​23-04-2021-covid-19-continues-to-disrupt-essential-health-services-in-90-of-countries#:~:text=The%20second%20round%20of%20 a,since%20the%20first%20survey%20conducted [accessed 2022-09-01]
  10. Lancaster K, Abuzour A, Khaira M, Mathers A, Chan A, Bui V, et al. The use and effects of electronic health tools for patient self-monitoring and reporting of outcomes following medication use: systematic review. J Med Internet Res 2018 Dec 18;20(12):e294 [FREE Full text] [CrossRef] [Medline]
  11. Risling T, Martinez J, Young J, Thorp-Froslie N. Evaluating patient empowerment in association with eHealth technology: scoping review. J Med Internet Res 2017 Sep 29;19(9):e329 [FREE Full text] [CrossRef] [Medline]
  12. Barello S, Triberti S, Graffigna G, Libreri C, Serino S, Hibbard J, et al. eHealth for patient engagement: a systematic review. Front Psychol 2016 Jan 8;6:2013 [FREE Full text] [CrossRef] [Medline]
  13. Morton K, Dennison L, May C, Murray E, Little P, McManus RJ, et al. Using digital interventions for self-management of chronic physical health conditions: a meta-ethnography review of published studies. Patient Educ Couns 2017 Apr;100(4):616-635 [FREE Full text] [CrossRef] [Medline]
  14. Mc Namara KP, Versace VL, Marriott JL, Dunbar JA. Patient engagement strategies used for hypertension and their influence on self-management attributes. Fam Pract 2014 Aug;31(4):437-444. [CrossRef] [Medline]
  15. Greene J, Hibbard JH, Sacks R, Overton V, Parrotta CD. When patient activation levels change, health outcomes and costs change, too. Health Aff (Millwood) 2015 Mar;34(3):431-437. [CrossRef] [Medline]
  16. Peters AE, Keeley EC. Patient engagement following acute myocardial infarction and its influence on outcomes. Am J Cardiol 2017 Nov 01;120(9):1467-1471. [CrossRef] [Medline]
  17. What are the differences between EHMRs, EHRs and PHRs? HealthIT.gov. 2019.   URL: https:/​/www.​healthit.gov/​faq/​what-are-differences-between-electronic-medical-records-electronic-health-records-and-personal [accessed 2022-12-01]
  18. A HIMSS Guide to Participating in a Health Information Exchange: HIMSS Healthcare Information Exchange HIE Guide Work Group White Paper. Healthcare Information and Management Systems Society (HIMSS). 2009 Aug.   URL: https:/​/assets.​hln.com/​pdf/​HIMSS-HIEGuideWhitePaper.pdf?utm_source=legacy&utm_medium=redirect&utm_campaign=webmig21&utm_term=pdf/​HIMSS-HIEGuideWhitePaper.​pdf [accessed 2022-09-01]
  19. Tang PC, Ash JS, Bates DW, Overhage JM, Sands DZ. Personal health records: definitions, benefits, and strategies for overcoming barriers to adoption. J Am Med Inform Assoc 2006;13(2):121-126 [FREE Full text] [CrossRef] [Medline]
  20. Safran C, Bloomrosen M, Hammond WE, Labkoff S, Markel-Fox S, Tang PC, Expert Panel. Toward a national framework for the secondary use of health data: an American Medical Informatics Association White Paper. J Am Med Inform Assoc 2007;14(1):1-9 [FREE Full text] [CrossRef] [Medline]
  21. Cronin RM, Jimison H, Johnson KB. Personal health informatics. In: Shortliffe EH, Cimino JJ, editors. Biomedical Informatics: Computer Applications in Health Care and Biomedicine. Cham, Switzerland: Springer; 2021:363-389.
  22. MedMij | Dutch Personal Health Environment.   URL: https://medmij.nl/en/home/ [accessed 2022-12-01]
  23. Ammenwerth E, Schnell-Inderst P, Hoerbst A. The impact of electronic patient portals on patient care: a systematic review of controlled trials. J Med Internet Res 2012 Nov 26;14(6):e162 [FREE Full text] [CrossRef] [Medline]
  24. Andrikopoulou E, Scott P, Herrera H, Good A. What are the important design features of personal health records to improve medication adherence for patients with long-term conditions? A systematic literature review. BMJ Open 2019 Sep 26;9(9):e028628 [FREE Full text] [CrossRef] [Medline]
  25. Kruse CS, Bolton K, Freriks G. The effect of patient portals on quality outcomes and its implications to meaningful use: a systematic review. J Med Internet Res 2015 Feb 10;17(2):e44 [FREE Full text] [CrossRef] [Medline]
  26. Dendere R, Slade C, Burton-Jones A, Sullivan C, Staib A, Janda M. Patient portals facilitating engagement with inpatient electronic medical records: a systematic review. J Med Internet Res 2019 Apr 11;21(4):e12779 [FREE Full text] [CrossRef] [Medline]
  27. Goldzweig GL, Orshansky G, Paige NM, Towfigh AA, Haggstrom DA, Miake-Lye I, et al. Electronic patient portals: evidence on health outcomes, satisfaction, efficiency, and attitudes: a systematic review. Ann Intern Med 2013 Nov 19;159(10):677-687. [CrossRef] [Medline]
  28. Han HR, Gleason KT, Sun CA, Miller HN, Kang SJ, Chow S, et al. Using patient portals to improve patient outcomes: systematic review. JMIR Hum Factors 2019 Dec 19;6(4):e15038 [FREE Full text] [CrossRef] [Medline]
  29. Brands M, Gouw S, Beestrum M, Fijnvandraat K, Badawy S. Patient-centered digital health interventions and their effects on health outcomes: a systematic review. CRD42020213285. PROSPERO. 2020.   URL: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=213285 [accessed 2022-12-01]
  30. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021 Mar 29;372:n71 [FREE Full text] [CrossRef] [Medline]
  31. Price M, Bellwood P, Kitson N, Davies I, Weber J, Lau F. Conditions potentially sensitive to a personal health record (PHR) intervention, a systematic review. BMC Med Inform Decis Mak 2015 Apr 18;15:32 [FREE Full text] [CrossRef] [Medline]
  32. Quan H, Li B, Couris CM, Fushimi K, Graham P, Hider P, et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol 2011 Mar 15;173(6):676-682. [CrossRef] [Medline]
  33. Hibbard JH, Stockard J, Mahoney ER, Tusler M. Development of the Patient Activation Measure (PAM): conceptualizing and measuring activation in patients and consumers. Health Serv Res 2004 Aug;39(4 Pt 1):1005-1026 [FREE Full text] [CrossRef] [Medline]
  34. Vahdat S, Hamzehgardeshi L, Hessam S, Hamzehgardeshi Z. Patient involvement in health care decision making: a review. Iran Red Crescent Med J 2014 Jan;16(1):e12454 [FREE Full text] [CrossRef] [Medline]
  35. Fitzgerald JT, Funnell MM, Hess GE, Barr PA, Anderson RM, Hiss RG, et al. The reliability and validity of a brief diabetes knowledge test. Diabetes Care 1998 May;21(5):706-710. [CrossRef] [Medline]
  36. Shmueli A. The SF-36 profile and health-related quality of life: an interpretative analysis. Qual Life Res 1998 Apr;7(3):187-195. [CrossRef] [Medline]
  37. Barroso NE, Hungerford GM, Garcia D, Graziano PA, Bagner DM. Psychometric properties of the Parenting Stress Index-Short Form (PSI-SF) in a high-risk sample of mothers and their infants. Psychol Assess 2016 Oct;28(10):1331-1335 [FREE Full text] [CrossRef] [Medline]
  38. Adherence to Long-Term Therapies: Evidence for Action. World Health Organization. 2003.   URL: http://apps.who.int/iris/bitstream/handle/10665/42682/9241545992.pdf?sequence=1 [accessed 2022-09-01]
  39. Data collection form for intervention reviews for RCTs and non-RCTs - template. Version 3. Cochrane Collaboration. 2014.   URL: https:/​/dplp.​cochrane.org/​sites/​dplp.cochrane.org/​files/​public/​uploads/​CDPLPG%20data%20collection%20form%20for%20intervention%20reviews%20for%20RCTs%20and%20non-RCTs.​doc [accessed 2022-09-01]
  40. Critical Appraisal Tools. Joanna Briggs Institute.   URL: https://jbi.global/critical-appraisal-tools [accessed 2022-09-01]
  41. Bailey SC, Wallia A, Wright S, Wismer GA, Infanzon AC, Curtis LM, et al. Electronic health record-based strategy to promote medication adherence among patients with diabetes: longitudinal observational study. J Med Internet Res 2019 Oct 21;21(10):e13499 [FREE Full text] [CrossRef] [Medline]
  42. Boogerd E, Maas-Van Schaaijk NM, Sas TC, Clement-de Boers A, Smallenbroek M, Nuboer R, et al. Sugarsquare, a Web-based patient portal for parents of a child with type 1 diabetes: multicenter randomized controlled feasibility trial. J Med Internet Res 2017 Aug 22;19(8):e287 [FREE Full text] [CrossRef] [Medline]
  43. Byczkowski TL, Munafo JK, Britto MT. Family perceptions of the usability and value of chronic disease web-based patient portals. Health Informatics J 2014 Jun;20(2):151-162 [FREE Full text] [CrossRef] [Medline]
  44. Chung S, Panattoni L, Chi J, Palaniappan L. Can secure patient-provider messaging improve diabetes care? Diabetes Care 2017 Oct;40(10):1342-1348. [CrossRef] [Medline]
  45. Conway NT, Allardice B, Wake DJ, Cunningham SG. User experiences of an electronic personal health record for diabetes. J Diabetes Sci Technol 2019 Jul;13(4):744-750 [FREE Full text] [CrossRef] [Medline]
  46. Devkota B, Salas J, Sayavong S, Scherrer JF. Use of an online patient portal and glucose control in primary care patients with diabetes. Popul Health Manag 2016 Apr;19(2):125-131. [CrossRef] [Medline]
  47. Dixon BE, Alzeer AH, Phillips EO, Marrero DG. Integration of provider, pharmacy, and patient-reported data to improve medication adherence for type 2 diabetes: a controlled before-after pilot study. JMIR Med Inform 2016 Feb 08;4(1):e4 [FREE Full text] [CrossRef] [Medline]
  48. Graetz I, Huang J, Brand RJ, Hsu J, Yamin CK, Reed ME. Bridging the digital divide: mobile access to personal health records among patients with diabetes. Am J Manag Care 2018 Jan;24(1):43-48 [FREE Full text] [Medline]
  49. Graetz I, Huang J, Muelly ER, Fireman B, Hsu J, Reed ME. Association of mobile patient portal access with diabetes medication adherence and glycemic levels among adults with diabetes. JAMA Netw Open 2020 Mar 05;3(2):e1921429 [FREE Full text] [CrossRef] [Medline]
  50. Grant RW, Wald JS, Schnipper JL, Gandhi TK, Poon EG, Orav EJ, et al. Practice-linked online personal health records for type 2 diabetes mellitus: a randomized controlled trial. Arch Intern Med 2008 Sep 08;168(16):1776-1782 [FREE Full text] [CrossRef] [Medline]
  51. Lau M, Campbell H, Tang T, Thompson DJ, Elliott T. Impact of patient use of an online patient portal on diabetes outcomes. Can J Diabetes 2014 Mar;38(1):17-21. [CrossRef] [Medline]
  52. Lyles CR, Sarkar U, Schillinger D, Ralston JD, Allen JY, Nguyen R, et al. Refilling medications through an online patient portal: consistent improvements in adherence across racial/ethnic groups. J Am Med Inform Assoc 2016 Apr;23(e1):e28-e33 [FREE Full text] [CrossRef] [Medline]
  53. Martinez W, Hackstadt AJ, Hickson GB, Knoerl T, Rosenbloom ST, Wallston KA, et al. The my diabetes care patient portal intervention: usability and pre-post assessment. Appl Clin Inform 2021 May;12(3):539-550 [FREE Full text] [CrossRef] [Medline]
  54. McCarrier KP, Ralston JD, Hirsch IB, Lewis G, Martin DP, Zimmerman FJ, et al. Web-based collaborative care for type 1 diabetes: a pilot randomized trial. Diabetes Technol Ther 2009 Apr;11(4):211-217 [FREE Full text] [CrossRef] [Medline]
  55. Osborn CY, Mayberry LS, Wallston KA, Johnson KB, Elasy TA. Understanding patient portal use: implications for medication management. J Med Internet Res 2013 Jul 03;15(7):e133 [FREE Full text] [CrossRef] [Medline]
  56. Price-Haywood EG, Luo Q. Primary care practice reengineering and associations with patient portal use, service utilization, and disease control among patients with hypertension and/or diabetes. Ochsner J 2017;17(1):103-111 [FREE Full text] [Medline]
  57. Price-Haywood EG, Luo Q, Monlezun D. Dose effect of patient-care team communication via secure portal messaging on glucose and blood pressure control. J Am Med Inform Assoc 2018 Jun 01;25(6):702-708 [FREE Full text] [CrossRef] [Medline]
  58. Quinn CC, Butler EC, Swasey KK, Shardell MD, Terrin MD, Barr EA, et al. Mobile diabetes intervention study of patient engagement and impact on blood glucose: mixed methods analysis. JMIR Mhealth Uhealth 2018 Mar 02;6(2):e31 [FREE Full text] [CrossRef] [Medline]
  59. Reed M, Graetz I, Gordon N, Fung V. Patient-initiated e-mails to providers: associations with out-of-pocket visit costs, and impact on care-seeking and health. Am J Manag Care 2015 Dec 01;21(12):e632-e639 [FREE Full text] [Medline]
  60. Reed ME, Huang J, Brand RJ, Neugebauer R, Graetz I, Hsu J, et al. Patients with complex chronic conditions: health care use and clinical events associated with access to a patient portal. PLoS One 2019 Jun 19;14(6):e0217636 [FREE Full text] [CrossRef] [Medline]
  61. Reed ME, Huang J, Millman A, Graetz I, Hsu J, Brand R, et al. Portal use among patients with chronic conditions: patient-reported care experiences. Med Care 2019 Oct;57(10):809-814. [CrossRef] [Medline]
  62. Riippa I, Linna M, Rönkkö I. The effect of a patient portal with electronic messaging on patient activation among chronically ill patients: controlled before-and-after study. J Med Internet Res 2014 Nov 19;16(11):e257 [FREE Full text] [CrossRef] [Medline]
  63. Riippa I, Linna M, Rönkkö I. A patient portal with electronic messaging: controlled before-and-after study. J Med Internet Res 2015 Nov 09;17(11):e250 [FREE Full text] [CrossRef] [Medline]
  64. Robinson SA, Zocchi MS, Netherton D, Ash A, Purington CM, Connolly SL, et al. Secure messaging, diabetes self-management, and the importance of patient autonomy: a mixed methods study. J Gen Intern Med 2020 Oct;35(10):2955-2962 [FREE Full text] [CrossRef] [Medline]
  65. Ronda MC, Dijkhorst-Oei LT, Rutten GE. Reasons and barriers for using a patient portal: survey among patients with diabetes mellitus. J Med Internet Res 2014 Nov 25;16(11):e263 [FREE Full text] [CrossRef] [Medline]
  66. Ronda MC, Dijkhorst-Oei LT, Rutten GE. Patients' experiences with and attitudes towards a diabetes patient web portal. PLoS One 2015 Jun 18;10(6):e0129403 [FREE Full text] [CrossRef] [Medline]
  67. Sabo R, Robins J, Lutz S, Kashiri P, Day T, Webel B, et al. Diabetes engagement and activation platform for implementation and effectiveness of automated virtual type 2 diabetes self-management education: randomized controlled trial. JMIR Diabetes 2021 Mar 29;6(1):e26621 [FREE Full text] [CrossRef] [Medline]
  68. Sarkar U, Lyles CR, Parker MM, Allen J, Nguyen R, Moffet HH, et al. Use of the refill function through an online patient portal is associated with improved adherence to statins in an integrated health system. Med Care 2014 Mar;52(3):194-201 [FREE Full text] [CrossRef] [Medline]
  69. Seo D, Park YR, Lee Y, Kim JY, Park JY, Lee JH. The use of mobile personal health records for hemoglobin A1c regulation in patients with diabetes: retrospective observational study. J Med Internet Res 2020 Jun 02;22(6):e15372 [FREE Full text] [CrossRef] [Medline]
  70. Sharit J, Idrees T, Andrade AD, Anam R, Karanam C, Valencia W, et al. Use of an online personal health record's Track Health function to promote positive lifestyle behaviors in Veterans with prediabetes. J Health Psychol 2018 Apr;23(5):681-690. [CrossRef] [Medline]
  71. Shimada SL, Allison JJ, Rosen AK, Feng H, Houston TK. Sustained use of patient portal features and improvements in diabetes physiological measures. J Med Internet Res 2016 Jul 01;18(7):e179 [FREE Full text] [CrossRef] [Medline]
  72. Tenforde M, Nowacki A, Jain A, Hickner J. The association between personal health record use and diabetes quality measures. J Gen Intern Med 2012 Apr;27(4):420-424 [FREE Full text] [CrossRef] [Medline]
  73. van Vugt M, de Wit M, Sieverink F, Roelofsen Y, Hendriks SH, Bilo HJ, et al. Uptake and effects of the e-vita personal health record with self-management support and coaching, for type 2 diabetes patients treated in primary care. J Diabetes Res 2016;2016:5027356 [FREE Full text] [CrossRef] [Medline]
  74. Vo MT, Uratsu CS, Estacio KR, Altschuler A, Kim E, Alexeeff SE, et al. Prompting patients with poorly controlled diabetes to identify visit priorities before primary care visits: a pragmatic cluster randomized trial. J Gen Intern Med 2019 Jun;34(6):831-838 [FREE Full text] [CrossRef] [Medline]
  75. Wald JS, Grant RW, Schnipper JL, Gandhi TK, Poon EG, Businger AC, et al. Survey analysis of patient experience using a practice-linked PHR for type 2 diabetes mellitus. AMIA Annu Symp Proc 2009 Nov 14;2009:678-682 [FREE Full text] [Medline]
  76. Zocchi MS, Robinson SA, Ash AS, Vimalananda VG, Wolfe HL, Hogan TP, et al. Patient portal engagement and diabetes management among new portal users in the Veterans Health Administration. J Am Med Inform Assoc 2021 Sep 18;28(10):2176-2183 [FREE Full text] [CrossRef] [Medline]
  77. Druss BG, Li J, Tapscott S, Lally CA. Randomized trial of a mobile personal health record for behavioral health homes. Psychiatr Serv 2020 Aug 01;71(8):803-809 [FREE Full text] [CrossRef] [Medline]
  78. Aberger EW, Migliozzi D, Follick MJ, Malick T, Ahern DK. Enhancing patient engagement and blood pressure management for renal transplant recipients via home electronic monitoring and web-enabled collaborative care. Telemed J E Health 2014 Sep;20(9):850-854 [FREE Full text] [CrossRef] [Medline]
  79. Ahmed S, Ernst P, Bartlett SJ, Valois MF, Zaihra T, Paré G, et al. The effectiveness of web-based asthma self-management system, my asthma portal (MAP): a pilot randomized controlled trial. J Med Internet Res 2016 Dec 01;18(12):e313 [FREE Full text] [CrossRef] [Medline]
  80. Apter AJ, Localio AR, Morales KH, Han X, Perez L, Mullen AN, et al. Home visits for uncontrolled asthma among low-income adults with patient portal access. J Allergy Clin Immunol 2019 Sep;144(3):846-53.e11 [FREE Full text] [CrossRef] [Medline]
  81. Fiks AG, Mayne SL, Karavite DJ, Suh A, O'Hara R, Localio AR, et al. Parent-reported outcomes of a shared decision-making portal in asthma: a practice-based RCT. Pediatrics 2015 Apr;135(4):e965-e973 [FREE Full text] [CrossRef] [Medline]
  82. Fiks AG, DuRivage N, Mayne SL, Finch S, Ross ME, Giacomini K, et al. Adoption of a portal for the primary care management of pediatric asthma: a mixed-methods implementation study. J Med Internet Res 2016 Jun 29;18(6):e172 [FREE Full text] [CrossRef] [Medline]
  83. Kogut SJ, Goldstein E, Charbonneau C, Jackson A, Patry G. Improving medication management after a hospitalization with pharmacist home visits and electronic personal health records: an observational study. Drug Healthc Patient Saf 2014 Jan 17;6:1-6 [FREE Full text] [CrossRef] [Medline]
  84. Kim JW, Ryu B, Cho S, Heo E, Kim Y, Lee J, et al. Impact of personal health records and wearables on health outcomes and patient response: three-arm randomized controlled trial. JMIR Mhealth Uhealth 2019 Jan 04;7(1):e12070 [FREE Full text] [CrossRef] [Medline]
  85. Lau AY, Arguel A, Dennis S, Liaw ST, Coiera E. "Why didn't it work?" Lessons from a randomized controlled trial of a web-based personally controlled health management system for adults with asthma. J Med Internet Res 2015 Dec 15;17(12):e283 [FREE Full text] [CrossRef] [Medline]
  86. Manard W, Scherrer JF, Salas J, Schneider FD. Patient portal use and blood pressure control in newly diagnosed hypertension. J Am Board Fam Med 2016;29(4):452-459 [FREE Full text] [CrossRef] [Medline]
  87. Toscos T, Coupe A, Wagner S, Ahmed R, Roebuck A, Flanagan M, et al. Engaging patients in atrial fibrillation management via digital health technology: the impact of tailored messaging. J Innov Card Rhythm Manag 2020 Aug;11(8):4209-4217 [FREE Full text] [CrossRef] [Medline]
  88. Wagner PJ, Dias J, Howard S, Kintziger KW, Hudson MF, Seol Y, et al. Personal health records and hypertension control: a randomized trial. J Am Med Inform Assoc 2012;19(4):626-634 [FREE Full text] [CrossRef] [Medline]
  89. Martínez Nicolás I, Lê Cook B, Flores M, Del Olmo Rodriguez M, Hernández Rodríguez C, Llamas Sillero P, et al. The impact of a comprehensive electronic patient portal on the health service use: an interrupted time-series analysis. Eur J Public Health 2019 Jun 01;29(3):413-418. [CrossRef] [Medline]
  90. Cahill JE, Lin L, LoBiondo-Wood G, Armstrong TS, Acquaye AA, Vera-Bolanos E, et al. Personal health records, symptoms, uncertainty, and mood in brain tumor patients. Neurooncol Pract 2014 Jun;1(2):64-70 [FREE Full text] [CrossRef] [Medline]
  91. Chiche L, Brescianini A, Mancini J, Servy H, Durand JM. Evaluation of a prototype electronic personal health record for patients with idiopathic thrombocytopenic purpura. Patient Prefer Adherence 2012;6:725-734 [FREE Full text] [CrossRef] [Medline]
  92. Collins PW, Bolton-Maggs P, Stephenson D, Jenkins B, Loran C, Winter M. Pilot study of an Internet-based electronic patient treatment record and communication system for haemophilia, Advoy.com. Haemophilia 2003 May;9(3):285-291. [CrossRef] [Medline]
  93. Coquet J, Blayney DW, Brooks JD, Hernandez-Boussard T. Association between patient-initiated emails and overall 2-year survival in cancer patients undergoing chemotherapy: evidence from the real-world setting. Cancer Med 2020 Nov;9(22):8552-8561 [FREE Full text] [CrossRef] [Medline]
  94. Groen WG, Kuijpers W, Oldenburg HS, Wouters MW, Aaronson NK, van Harten WH. Supporting lung cancer patients with an interactive patient portal: feasibility study. JMIR Cancer 2017 Aug 08;3(2):e10 [FREE Full text] [CrossRef] [Medline]
  95. Hall MJ, Herda MM, Handorf EA, Rybak CC, Keleher CA, Siemon M, et al. Direct-to-patient disclosure of results of mismatch repair screening for Lynch syndrome via electronic personal health record: a feasibility study. Genet Med 2014 Nov;16(11):854-861 [FREE Full text] [CrossRef] [Medline]
  96. Hong MK, Wilcox L, Feustel C, Wasileski-Masker K, Olson TA, Simoneaux SF. Adolescent and caregiver use of a tethered personal health record system. AMIA Annu Symp Proc 2016 Feb 10;2016:628-637 [FREE Full text] [Medline]
  97. Kidwell KM, Peugh J, Westcott E, Nwankwo C, Britto MT, Quinn CT, et al. Acceptability and feasibility of a disease-specific patient portal in adolescents with sickle cell disease. J Pediatr Hematol Oncol 2019 Oct;41(7):561-567 [FREE Full text] [CrossRef] [Medline]
  98. O'Hea EL, Creamer S, Flahive JM, Keating BA, Crocker CR, Williamson SR, et al. Survivorship care planning, quality of life, and confidence to transition to survivorship: a randomized controlled trial with women ending treatment for breast cancer. J Psychosoc Oncol 2022;40(5):574-594. [CrossRef] [Medline]
  99. Pai HH, Lau F, Barnett J, Jones S. Meeting the health information needs of prostate cancer patients using personal health records. Curr Oncol 2013 Dec;20(6):e561-e569 [FREE Full text] [CrossRef] [Medline]
  100. Tarver WL, Robb BW, Haggstrom DA. Usefulness and usability of a personal health record and survivorship care plan for colorectal cancer survivors: survey study. JMIR Cancer 2019 Aug 20;5(2):e10692 [FREE Full text] [CrossRef] [Medline]
  101. Wiljer D, Leonard KJ, Urowitz S, Apatu E, Massey C, Quartey NK, et al. The anxious wait: assessing the impact of patient accessible EHRs for breast cancer patients. BMC Med Inform Decis Mak 2010 Sep 01;10:46 [FREE Full text] [CrossRef] [Medline]
  102. Williamson RS, Cherven BO, Gilleland Marchak J, Edwards P, Palgon M, Escoffery C, et al. Meaningful use of an electronic personal health record (ePHR) among pediatric cancer survivors. Appl Clin Inform 2017 Mar 15;8(1):250-264 [FREE Full text] [CrossRef] [Medline]
  103. Anand T, Nitpolprasert C, Kerr SJ, Apornpong T, Ananworanich J, Phanuphak P, et al. Implementation of an online HIV prevention and treatment cascade in Thai men who have sex with men and transgender women using Adam's Love Electronic Health Record system. J Virus Erad 2017 Jan 01;3(1):15-23 [FREE Full text] [Medline]
  104. Bidmead E, Marshall A. A case study of stakeholder perceptions of patient held records: the Patients Know Best (PKB) solution. Digit Health 2016 Sep 21;2:2055207616668431 [FREE Full text] [CrossRef] [Medline]
  105. Crouch PB, Rose CD, Johnson M, Janson SL. A pilot study to evaluate the magnitude of association of the use of electronic personal health records with patient activation and empowerment in HIV-infected veterans. PeerJ 2015 Mar 19;3:e852 [FREE Full text] [CrossRef] [Medline]
  106. Druss BG, Ji X, Glick G, von Esenwein SA. Randomized trial of an electronic personal health record for patients with serious mental illnesses. Am J Psychiatry 2014 Mar;171(3):360-368. [CrossRef] [Medline]
  107. Jhamb M, Cavanaugh KL, Bian A, Chen G, Ikizler TA, Unruh ML, et al. Disparities in electronic health record patient portal use in nephrology clinics. Clin J Am Soc Nephrol 2015 Nov 06;10(11):2013-2022 [FREE Full text] [CrossRef] [Medline]
  108. Kahn JS, Hilton JF, Van Nunnery T, Leasure S, Bryant KM, Hare CB, et al. Personal health records in a public hospital: experience at the HIV/AIDS clinic at San Francisco General Hospital. J Am Med Inform Assoc 2010;17(2):224-228 [FREE Full text] [CrossRef] [Medline]
  109. Keith McInnes D, Shimada SL, Rao SR, Quill A, Duggal M, Gifford AL, et al. Personal health record use and its association with antiretroviral adherence: survey and medical record data from 1871 US veterans infected with HIV. AIDS Behav 2013 Nov;17(9):3091-3100. [CrossRef] [Medline]
  110. McInnes DK, Shimada SL, Midboe AM, Nazi KM, Zhao S, Wu J, et al. Patient use of electronic prescription refill and secure messaging and its association with undetectable HIV viral load: a retrospective cohort study. J Med Internet Res 2017 Mar 15;19(2):e34 [FREE Full text] [CrossRef] [Medline]
  111. Kiberd J, Khan U, Stockman C, Radhakrishnan A, Phillips M, Kiberd BA, et al. Effectiveness of a web-based eHealth portal for delivery of care to home dialysis patients: a single-arm pilot study. Can J Kidney Health Dis 2018 Sep 7;5:2054358118794415 [FREE Full text] [CrossRef] [Medline]
  112. Lee J, Kim JG, Jin M, Ahn K, Kim B, Kim S, et al. Beneficial effects of two types of personal health record services connected with electronic medical records within the hospital setting. Comput Inform Nurs 2017 Nov;35(11):574-581. [CrossRef] [Medline]
  113. Miller DM, Moore SM, Fox RJ, Atreja A, Fu AZ, Lee JC, et al. Web-based self-management for patients with multiple sclerosis: a practical, randomized trial. Telemed J E Health 2011;17(1):5-13 [FREE Full text] [CrossRef] [Medline]
  114. Navaneethan SD, Jolly SE, Schold JD, Arrigain S, Nakhoul G, Konig V, et al. Pragmatic randomized, controlled trial of patient navigators and enhanced personal health records in CKD. Clin J Am Soc Nephrol 2017 Sep 07;12(9):1418-1427 [FREE Full text] [CrossRef] [Medline]
  115. Plimpton E. A quality improvement project to increase patient portal enrollment and utilization in women living with HIV at risk for disengagement in care. J Assoc Nurses AIDS Care 2020;31(1):60-65. [CrossRef] [Medline]
  116. Reich J, Canakis A, Shankar D, Harrington J, Apte M, Weinberg J, et al. The use of an EHR patient portal (Mychart-Epic) in patients with inflammatory bowel disease. Crohn's Colitis 360 2019 Oct;1(3):otz039. [CrossRef]
  117. Nielsen AS, Halamka JD, Kinkel RP. Internet portal use in an academic multiple sclerosis center. J Am Med Inform Assoc 2012;19(1):128-133 [FREE Full text] [CrossRef] [Medline]
  118. Son H, Nahm ES. Older adults' experience using patient portals in communities: challenges and opportunities. Comput Inform Nurs 2019 Jan;37(1):4-10. [CrossRef] [Medline]
  119. Tom JO, Mangione-Smith R, Solomon C, Grossman DC. Integrated personal health record use: association with parent-reported care experiences. Pediatrics 2012 Jul;130(1):e183-e190. [CrossRef] [Medline]
  120. van den Heuvel SC, Meije D, Regeer EJ, Sinnema H, Riemersma RF, Kupka RW. The user experiences and clinical outcomes of an online personal health record to support self-management of bipolar disorder: a pretest-posttest pilot study. J Affect Disord 2018 Oct 01;238:261-268. [CrossRef] [Medline]
  121. van der Vaart R, Drossaert CH, Taal E, Drossaers-Bakker KW, Vonkeman HE, van de Laar MA. Impact of patient-accessible electronic medical records in rheumatology: use, satisfaction and effects on empowerment among patients. BMC Musculoskelet Disord 2014 Mar 26;15:102 [FREE Full text] [CrossRef] [Medline]
  122. Campbell M, McKenzie JE, Sowden A, Katikireddi SV, Brennan SE, Ellis S, et al. Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline. BMJ 2020 Jan 16;368:l6890 [FREE Full text] [CrossRef] [Medline]
  123. Dunsch F, Evans DK, Macis M, Wang Q. Bias in patient satisfaction surveys: a threat to measuring healthcare quality. BMJ Glob Health 2018 Apr 12;3(2):e000694 [FREE Full text] [CrossRef] [Medline]
  124. Hanna L, Gill SD, Newstead L, Hawkins M, Osborne RH. Patient perspectives on a personally controlled electronic health record used in regional Australia. Health Inf Manag 2017 Jan;46(1):42-48. [CrossRef] [Medline]
  125. Fylan F, Caveney L, Cartwright A, Fylan B. Making it work for me: beliefs about making a personal health record relevant and useable. BMC Health Serv Res 2018 Jun 14;18(1):445 [FREE Full text] [CrossRef] [Medline]
  126. Greenberg AJ, Falisi AL, Finney Rutten LJ, Chou WS, Patel V, Moser RP, et al. Access to electronic personal health records among patients with multiple chronic conditions: a secondary data analysis. J Med Internet Res 2017 Jun 02;19(6):e188 [FREE Full text] [CrossRef] [Medline]
  127. Stewart M, Brown JB, Donner A, McWhinney IR, Oates J, Weston WW, et al. The impact of patient-centered care on outcomes. J Fam Pract 2000 Sep;49(9):796-804. [Medline]
  128. Antonio MG, Petrovskaya O, Lau F. The state of evidence in patient portals: umbrella review. J Med Internet Res 2020 Nov 11;22(11):e23851 [FREE Full text] [CrossRef] [Medline]


ED: emergency department
JBI: Joanna Briggs Institute
PHR: personal health record
PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
PROSPERO: International Prospective Register of Systematic Reviews
RCT: randomized controlled trial


Edited by A Mavragani; submitted 30.09.22; peer-reviewed by M Prietula, M Kapsetaki, F Lau, D Kalra; comments to author 24.10.22; revised version received 14.11.22; accepted 15.11.22; published 22.12.22

Copyright

©Martijn R Brands, Samantha C Gouw, Molly Beestrum, Robert M Cronin, Karin Fijnvandraat, Sherif M Badawy. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 22.12.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.