This paper is in the following e-collection/theme issue:

Personal Health Records, Patient-Accessible Electronic Health Records, Patient Portals (540) Demographics of Users, Social & Digital Divide (678) Equity and Digital Divide (172) Health Services Research (409) Clinical Informatics (908) Digital Health, Telehealth and e-Innovation in Clinical Settings (340)

Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/44399, first published .
An Assessment of Patient Portal Messaging Use by Patients With Multiple Chronic Conditions Living in Rural Communities: Retrospective Analysis

An Assessment of Patient Portal Messaging Use by Patients With Multiple Chronic Conditions Living in Rural Communities: Retrospective Analysis

An Assessment of Patient Portal Messaging Use by Patients With Multiple Chronic Conditions Living in Rural Communities: Retrospective Analysis

Authors of this article:

Fernando L Chivela1 Author Orcid Image ;   Ashley E Burch1, 2 Author Orcid Image ;   Oghale Asagbra1 Author Orcid Image
Article Authors Cited by (1) Tweetations (2) Metrics

    Original Paper

    1Department of Health Services and Information Management, East Carolina University, Greenville, NC, United States

    2Department of Internal Medicine, Brody School of Medicine, East Carolina University, Greenville, NC, United States

    *these authors contributed equally

    Corresponding Author:

    Ashley E Burch, PhD

    Department of Health Services and Information Management

    East Carolina University

    4340N Health Sciences Building

    2150 West 5th Street

    Greenville, NC, 27834

    United States

    Phone: 1 2527441205

    Email: burchas15@ecu.edu


    Background: Patient portals can facilitate the delivery of health care services and support self-management for patients with multiple chronic conditions. Despite their benefits, the evidence of patient portal use among patients with multimorbidity in rural communities is limited.

    Objective: This study aimed to explore the factors associated with portal messaging use by rural patients.

    Methods: We assessed patient portal use among patients with ≥1 chronic diagnoses who sent or received messages via the Epic MyChart (Epic Systems Corporation) portal between January 1, 2015, and November 9, 2021. Patient portal use was defined as sending or receiving a message through the portal during the study period. We fit a zero-inflated negative binomial model to predict portal use based on the patient’s number of chronic conditions, sex, race, age, marital status, and insurance type. County-level characteristics, based on the patient’s home address, were also included in the model to assess the influence of community factors on portal use. County-level factors included educational attainment, smartphone ownership, median income, and primary care provider density.

    Results: A total of 65,178 patients (n=38,587, 59.2% female and n=21,454, 32.92% Black) were included in the final data set, of which 38,380 (58.88%) sent at least 1 message via the portal during the 7-year study period. As the number of chronic diagnoses increased, so did portal messaging use; however, this relationship was driven primarily by younger patients. Patients with 2 chronic conditions were 1.57 times more likely to send messages via the portal than those with 1 chronic condition (P<.001). In comparison, patients with ≥7 chronic conditions were approximately 11 times more likely to send messages than patients with 1 chronic condition (P<.001). A robustness check confirmed the interaction effect of age and the number of diagnoses on portal messaging. In the model including only patients aged <65 years, there was a significant effect of increased portal messaging corresponding to the number of chronic conditions (P<.001). Conversely, this relationship was not significant for the model consisting of older patients. Other significant factors associated with increased portal use include being female; White; married; having private insurance; and living in an area with a higher average level of educational attainment, greater medical provider density, and a lower median income.

    Conclusions: Patients’ use of the portal to send messages to providers was incrementally related to their number of diagnoses. As the number of chronic diagnoses increased, so did portal messaging use. Patients of all ages, particularly those living in rural areas, could benefit from the convenience and cost-effectiveness of portal communication. Health care systems and providers are encouraged to increase the use of patient portals by implementing educational interventions to promote the advantages of portal communication, particularly among patients with multimorbidity.

    J Med Internet Res 2023;25:e44399

    doi:10.2196/44399

    Keywords

    patient portal; multimorbidity; chronic disease; patient messaging; rural; mobile phone 


    Background

    Multimorbidity or multiple chronic conditions are common among adults in the United States and dramatically increase the complexity of patient care [1,2]. Multimorbidity represents the co-occurrence of ≥2 chronic conditions, which may or may not be associated [3-5]. Chronic conditions are characterized as diseases that last 1 or multiple years, require continuous medical attention, or challenge activities of daily living [6]. As of 2022, chronic conditions remain the leading driver of health care costs in the United States [1], and conditions such as heart disease, cancer, diabetes, and obesity are among the most frequent causes of disability and death in adults in the United States [1,7]. For patients living in rural areas, the rate of multimorbidity is higher than that of their urban counterparts [8]; in addition, they experience more barriers to care, including the means to reach and use health care services, such as transportation, health literacy, and health insurance status [8,9]. The continued development and implementation of health information technologies, such as patient portals, can facilitate the delivery of health care services in rural communities by enabling communication between patients and providers without the need for in-person visits.

    Since their inception in the late 1990s, patient portals have held the potential to be valuable tools for enhancing the quality of patient involvement in health care [10,11]. Health care systems are able to use patient portals to provide patients with secure web-based access to their personal health information, and the portal allows patients to schedule appointments, receive educational resources, manage medications, and message providers [11]. Current research shows that patients are interested in using patient portals and that the availability of a patient portal is essential to some patients when choosing providers [12,13]. Patient portals improve patient satisfaction, engagement, medication adherence, health status awareness, and communication with providers [14-17]. Furthermore, patient portals have been associated with health care efficiency, resulting in increased profitability of health care organizations [18,19].

    Despite the overwhelming evidence of potential benefits, the number of studies investigating the adoption of portals by specific patient groups is limited. Although patient portal use has increased over time, only a fraction of the overall patient population uses patient portals [12,13,15,16,20-24]. Most studies, including systematic reviews conducted between 2015 and 2021, indicate that sociodemographic factors may explain why some patients do not use patient portals [13,15,16,21-25]. These studies suggest that patient characteristics such as age, sex, race, ethnicity, marital status, income, and insurance status constitute barriers to portal use. A limited number of studies have explored patient portal use among patients with >1 chronic condition [12,26,27]. In an investigation of 32,274 urban-dwelling portal adopters, Yamin et al [26] found higher odds of messages sent to physicians’ practices via a portal among patients with ≥2 chronic conditions. Portal use rates among patients with multimorbidity have also increased in recent years because of the Centers for Medicare and Medicaid Services’ implementation of Meaningful Use Stage 2 for electronic health records that requires health care systems to use electronic health records to document care and share health information with other providers and the patient [12].

    Increased patient portal use has also been identified among rural and underserved patients with multimorbidities. Among patients aged ≥45 years, Powell and Deroche [27] noted that as the physical distance separating patients from their providers increased, portal logins and use among patients with at least 2 chronic conditions increased. However, most studies examining the relationship between the chronic diagnoses and patient portal use have restricted age ranges; neglected rural patients; or focused on specific, related chronic diseases [12,26]. Only up to 4 chronic conditions were included in these studies, such as hypertension, heart failure, coronary artery disease, and diabetes [12,26,27]. Although previous studies have assessed the use of patient portals, most studies focused on access to medical records, provision of email services, and transactional features [12,14,28,29]. Relatively few studies have assessed the messaging feature of patient portals, but these studies did not explore messaging in the context of multimorbidity or rurality [11,13,15].

    Therefore, the current literature on portal use among patients with multimorbidity does not generalize to those with other prevalent chronic conditions such as cancer, obesity, stroke, or arthritis and may not be applicable to younger patients or those living in rural areas. We focused on the messaging feature of the patient portal because of the level of engagement and the potential impact of using this feature in a rural population that could benefit significantly from additional interactions with health care providers that did not require an in-person visit. Our study contributes to the gaps in the literature by analyzing patient portal messaging use among adults living in rural areas with multiple chronic conditions.

    Theoretical Framework

    Overview

    This study draws from the Diffusion of Innovation Theory by Rogers [30-32] and the intersectionality theory by Crenshaw [33,34]. Both theories are appropriate in this context, as they allow us to consider the characteristics of the innovation, the characteristics of the individual patient, and how contextual factors impact the patients’ choice to use the innovation. The innovation of interest in this study was the messaging feature of the patient portal.

    Diffusion of Innovation Theory

    The Diffusion of Innovation Theory suggests that for an innovation to be adopted, it must have several characteristics. First, the innovation must have a relative advantage over other existing methods. Second, it must be compatible and consistent with the users’ values, past experiences, and current needs. Finally, the innovation must also possess a trialability and observability characteristic. In other words, it must be easy to understand by users who can then test the innovation as well as the experience its results. Therefore, how patients with multiple chronic conditions assess the characteristics of the patient portal as an innovation will impact their decision to use the portal.

    Patients must assess whether the patient portal offers them an easier and more convenient means to communicate with their providers about their health. If the patient portal provides an advantage over the other methods of communication and if it meets their need for receiving more updated information about their health, then the patient will be more likely to adopt portal use. Given that the patient portal is analogous to using the internet and other applications that are now ubiquitous in society [35], these patients could find the use of the portal consistent with their expectations and experiences. Although trialability and observability can only be achieved over time, it is expected that patients will continue to use the portals if they continue to be satisfied with their interaction. Furthermore, the Diffusion of Innovation Theory suggests that adopters will generally follow the innovation-decision process: knowledge, persuasion, decision, implementation, and confirmation [30]. It is likely that patients who interact frequently with health care providers, such as those with chronic conditions, will become aware of the patient portal and can be persuaded of its benefits. Moreover, patients with multimorbidity may feel a greater need to adopt the patient portal for the purposes of communication with their provider given their health risk. The Diffusion of Innovation Theory also indicates that the innovation-decision process for individuals is influenced by several socioeconomic and community factors, including their education, media exposure, social status, and participation. For individuals with multiple chronic conditions, it is expected that similar factors should be considered as affecting their adoption and use of the patient portal.

    Intersectionality Theory

    It is generally accepted that societal-, community-, and system-level contextual factors can come together to determine a person’s willingness to adopt an innovation. In addition, individual-level characteristics also contribute to the decision to adopt an innovation—in this study, the patient portal. Rogers [31] described the importance of individual characteristics in determining one’s adoption of an innovation. Previous studies have also characterized the importance of socioeconomic and demographic factors in explaining why patients use the patient portal [4,17,36]. They suggest that these patient characteristics could constitute a disadvantage or barrier to using the patient portal.

    The intersectionality theory further adds that there exists interdependencies between social categories to which individuals belong, for example, age, race, sex, marital status, and geographic setting (eg, rural vs urban). The theory suggests that these social categories should not be considered in isolation from each other; rather, social categories intersect to produce complex forms of privilege and inequalities in a society. As such, each individual of a society will have experiences that are shaped by the combined effects of the social categories to which they are affiliated. In the health care literature, the intersectionality theory has been applied to examine systemic barriers that impact the health and well-being of individuals [36-38]. Although this theory is akin to the social determinants of health, which is based on the socioeconomic and demographic characteristics of individuals, it further considers the interaction effects of these social categories and how they combine to impact the overall health of the individual [39]. As such, it is important to consider the combined effects across the social categories to which an individual belongs in determining their choice to use the patient portal (Figure 1).

    ‎
    Figure 1. Conceptual model for patient portal use.

    Hypotheses

    On the basis of the theories discussed in the Theoretical Framework section above, the following hypotheses are presented:

    1. Having a greater number of chronic diagnoses will be associated with greater use of the patient portal messaging feature.
    2. A patient’s social group, as defined by their socioeconomic and demographic characteristics, will be significantly associated with their decision to use the patient portal messaging feature to communicate with their health care provider.

    We anticipate that a patient’s social group, determined by their age, sex, race, marital status, insurance status, education, and income level, will be significantly associated with their use of the patient portal to communicate with their health care provider. On the basis of the literature, we would expect that patients who are female, White, younger, and married will demonstrate higher portal messaging use [13,16]. However, the association between these patient characteristics and portal messaging is yet to be confirmed among rural patients with multimorbidity.


    Overview

    In this retrospective, cross-sectional study, we investigated the relationship between multimorbidity and patient portal messaging use. We sought to determine the effect of having multiple chronic diagnoses on the use of the messaging feature of the patient portal as a way to communicate with care providers. Chronic diagnoses were based on the International Classification of Diseases, Ninth and Tenth Revisions, Clinical Modification codes for arthritis, asthma, cardiovascular conditions, chronic kidney disease, chronic obstructive pulmonary disease, diabetes, heart diseases, nutritional deficiencies, obesity, sleep disorders, and stroke. These conditions were isolated from the Healthy North Carolina 2030 project, which serves as the population health improvement plan for the North Carolina Division of Public Health [40].

    Ethics Approval

    This study (UMCIRB 21-000545) was reviewed and approved by the East Carolina University and Medical Center Institutional Review Board in accordance with federal research regulations.

    Sample

    Patient-level data and portal use were extracted through a query from the data warehouse of a hospital system in eastern North Carolina, United States. Although North Carolina contains several urban areas, the primary catchment area of the queried hospital system is eastern North Carolina, a largely rural, agricultural area. Using patients’ home address, they were classified as residing in a rural or primarily suburban county or an urban county based on the population density of the county. The hospital system offers multispecialty care and serves >1 million primarily rural residents. It uses the Epic electronic health record and MyChart patient portal by Epic Systems Corporation [41].

    Patients were eligible for inclusion if they (1) were aged between 18 and 89 years, (2) had a home address in North Carolina, (3) had at least 1 of the chronic conditions listed in Table 1, and (4) had received or sent messages via Epic MyChart between January 1, 2015, and November 9, 2021. Patients were excluded if they did not have any of the selected chronic diagnoses or had no portal use.

    Table 1. Number of people in the final sample diagnosed with a given chronic condition (N=65,178).
    Chronic conditionPatients, n (%)
    Heart diseases39,893 (61.21)
    Obesity20,070 (30.79)
    Diabetes17,289 (26.53)
    Nutritional deficiencies13,219 (20.28)
    Chronic kidney disease13,151 (20.18)
    Sleep disorders11,623 (17.83)
    Arthritis11,517 (17.67)
    Cardiovascular conditions11,081 (17)
    Stroke5023 (7.71)
    Chronic obstructive pulmonary disease4877 (7.48)
    Asthma3999 (6.14)

    Definitions

    We defined patient portal use as sending or receiving a message through the patient portal. We assigned the level of portal use into two groups: (1) no interaction and (2) interaction. We defined the no interaction group as patients who received ≥1 messages from their providers but did not reply or send messages via the portal. We defined the interaction group as patients who sent ≥1 messages via the portal, regardless of receiving messages from their providers.

    Variables

    Variables from the electronic health record included patient age, sex, race, marital status, insurance type, chronic diagnoses, and received or sent messages. Variables from external data sources included county-level educational attainment, smartphone ownership, primary care physician (PCP) density, and median income. We used external data sources to supplement our analysis with relevant information on common public health indicators and targets.

    County-level data were obtained from external data sources and merged with the patient-level data based on the patients’ county of residence as recorded in the medical record. Ease of physician access was defined as PCP density (ie, the number of PCPs per 100,000 people at the county level). This variable was obtained from the 2018 Area Health Resource File, released by the Bureau of Health Workforce, a division of the Health Resources and Services Administration [42]. The Health Resources and Services Administration tracks trends in the national health care workforce and releases county-level data sourced annually from the American Medical Association Masterfile, American Dental Association Masterfile, and the Centers for Medicare and Medicaid Services National Provider Identification File.

    To obtain data on income, education, and smartphone access, we used the American Community Survey (ACS) 5-year estimates. The ACS is conducted annually by the US Census Bureau to provide detailed information on a broad range of population characteristics to help guide the distribution of federal and state resources. The current data releases of the ACS include 1-year, supplemental, and 5-year estimates. The 5-year estimates were used in this study; these estimates aggregate responses from previous years to balance geographic and temporal fluctuations, thus increasing the statistical reliability of the data for less populated (ie, rural) areas. For this study, we included 3 variables collected by the ACS: smartphone ownership (percentage of households in the county with a smartphone, 2016-2020 ACS), educational attainment (percentage of persons aged ≥25 years with less than a high school diploma, 2013-2017 ACS), and median income (2013-2017 ACS) [43].

    Statistical Analysis

    Descriptive statistics characterizing the sample are reported as count (percentage) and mean (SD) as appropriate, unless otherwise noted. To investigate group differences in demographic characteristics between those who sent 0 messages (no interaction group) and those who sent ≥1 messages (interaction group), chi-square tests and 2-tailed t tests were used for categorical and continuous variables, respectively.

    Several models were evaluated to test the relationship between the number of chronic diagnoses and patient portal use, conceptualized as the number of messages sent by the patient through the portal. Models tested included ordinary least squares, Poisson, and negative binomial models. Fit indices, specifically Akaike and Bayesian information criterion, were compared with each other to identify the model distribution that would provide the best fit for the data while minimizing the potential of inflated variance estimates. The zero-inflated negative binomial model was chosen for the primary analysis as this model demonstrated superior fit indices and could accommodate the prevalence of 0 counts and overdispersion of our dependent variable, number of messages sent (mean 10.92, SD 29.17). In the final model, the dispersion parameter was 3.67 (95% CI 3.60-3.74).

    The zero-inflated negative binomial model simultaneously estimates 2 equations. The first equation is based on a negative binomial distribution and was used to estimate the count of portal messages sent by patients in the portal interaction group (ie, patients who sent at least 1 message via the portal). The second equation provided by the model is based on a logistic distribution and is used to estimate the odds of having excess zeros beyond what would be expected by random chance. In other words, this second equation is the probability that a patient would not use the portal (ie, that the patient would send 0 messages through the portal) based on the evaluated predictors.

    The model was adjusted for individual- and community-level predictors. Individual-level predictors included patients’ age, sex, race, insurance status, and marital status. County-level covariates were based on the participants’ county of residence and included percentage of the population with an educational attainment of a high school diploma or greater, percentage of the population reporting smartphone ownership, PCP density, and median income.

    All missing values were excluded from multivariate analysis. Analyses were performed using SPSS statistics (version 28.0; IBM Corp) and SAS (version 9.5; SAS Institute). All tests are 2 tailed. P values <.05 were considered statistically significant.


    Participants

    Given the location of the hospital in eastern North Carolina, approximately all the participants resided in a rural or suburban county (64,656/65,178, 99.2%). Table 2 provides sample characteristics for the full sample (N=65,178), for participants who did not send any messages during the study period (no interaction group: n=26,798, 41.12%), and for those who sent at least 1 message during the study period (interaction group: n=38,380, 58.88%). On the basis of the univariate analysis, patients who interacted with the portal were more likely to be female; White; younger; married; have private insurance; and live in an area with a higher average level of educational attainment, more prevalent smartphone ownership, higher PCP density, and a higher median income.

    Table 2. Demographic factors and social determinants of health for the full sample, those who sent no messages (no interaction), and those who sent ≥1 messages (interaction)a.
    DemographicsFull sample (N=65,178)No interaction (n=26,798, 41.12%)Interaction (n=38,380, 58.88%)P value
    Sex, n (%)<.001

    		Female38,587 (59.2)14,898 (55.59)23,689 (61.72)

    		Male26,591 (40.8)11,900 (44.41)14,691 (38.28)
    Race, n (%)<.001

    		Black21,454 (32.92)10,313 (38.48)11,141 (29.03)

    		White41,840 (64.19)15,741 (58.74)26,099 (68)

    		Other1139 (1.75)395 (1.47)744 (1.94)

    		Missing745 (1.14)349 (1.3)396 (1.03)
    Age (years), mean (SD)57.09 (15.33)59.40 (15.23)55.48 (15.19)<.001
    Marital status, n (%)<.001

    		Single27,824 (42.69)12,681 (47.32)15,143 (39.46)

    		Married37,104 (56.93)13,995 (52.22)23,109 (60.21)

    		Missing250 (0.38)122 (0.46)128 (0.33)
    Insurance, n (%)<.001

    		Private27,597 (42.34)9313 (34.75)18,284 (60)

    		Government19,820 (30.41)9779 (36.49)10,041 (33.2)

    		Uninsured2101 (3.22)1008 (3.76)1093 (3.6)

    		Other1660 (2.55)793 (2.96)867 (2.9)

    		Missing14,000 (21.48)5905 (22.04)8095 (21.09)
    Educational attainment (%), mean (SD)<.001

    		High school diploma or greater84.93 (5.51)83.86 (5.65)85.68 (5.29)
    Smartphone ownership (%), mean (SD)<.001

    		Household with a smartphone78.11 (6.89)77.07 (6.93)78.84 (6.77)
    PCPa density, mean (SD)<.001

    		PCP/100,000 population60.43 (27.98)56.20 (27.05)63.37 (28.23)
    Median income (US $), mean (SD)<.001

    		Median household income44,488.82 (6955.39)43,534.86 (6882.22)45,154.91 (6928.67)

    aPCP: primary care physician.

    Portal Use

    Table 3 presents the results of the zero-inflated negative binomial model. Model estimates, SEs, and incidence rate ratios (the exponentiation of the regression coefficient) or odds ratios for the logit model were reported. As expected, patients diagnosed with more chronic conditions were more likely to use the portal than those diagnosed with fewer chronic conditions. The relationship between chronic disease and portal use was exponential, with additional diagnoses resulting in an increased use of the portal messaging feature. The expected sent message count for patients diagnosed with 2 chronic diseases was 1.57 times higher than that for a patient with 1 chronic condition. The sent message count for a patient with ≥7 chronic diseases was considerably higher, approximately 11 times the message count of a patient with 1 chronic condition. Additional significant predictors of increased portal use were female sex; White race; being married; having private insurance; younger age; and living in an area with higher educational attainment, greater PCP density, and a lower median income.

    Table 3. Zero-inflated negative binomial results predicting the number of sent messages.
    ParameterCount modelLogit model

    		Estimate (SE; 95% CI)P valueIRRaEstimate (SE; 95% CI)P valueOdds ratio (95% CI)
    Number of chronic diseases (reference: 1)

    		72.3917 (0.2134; 1.9734 to 2.8100)<.00110.930.0719 (0.2807; −0.4782 to 0.6221).801.07 (0.62 to 1.86)

    		62.0868 (0.1655; 1.7624 to 2.4111)<.0018.060.8547 (0.1612; 0.5387 to 1.1707)<.0012.35 (1.71 to 3.22)

    		51.5392 (0.1219; 1.3003 to 1.7781)<.0014.660.2448 (0.1430; −0.0355 to 0.5251).091.28 (0.97 to 1.69)

    		41.1668 (0.0893; 0.9918 to 1.3418)<.0013.210.4185 (0.1114; 0.2002 to 0.6368)<.0011.52 (1.22 to 1.89)

    		30.7715 (0.0598; 0.6543 to 0.8887)<.0012.160.2995 (0.1006; 0.1024 to 0.4966).0031.35 (1.11 to 1.64)

    		20.4497 (0.0354; 0.3804 to 0.5191)<.0011.570.1586 (0.0965; −0.0306 to 0.3477).101.17 (0.97 to 1.42)
    Sex (reference: male)

    		Female0.2605 (0.0211; 0.2191 to 0.3018)<.0011.30−0.5168 (0.0738; −0.6614 to −0.3722)<.0010.60 (0.52 to 0.69)
    Race (reference: White)

    		Black−0.5409 (0.0234; −0.5867 to −0.4951)<.0010.58−0.0319 (0.4233; −0.8616 to 0.7978).940.97 (0.42 to 2.22)

    		Other−0.0510 (0.0782; −0.2042 to 0.1021).510.951.1497 (0.0762; 1.0002 to 1.2991)<.0013.16 (2.72 to 3.67)
    Marital status (reference: single)

    		Married0.1541 (0.0211; 0.1127 to 0.1955)<.0011.17−0.5348 (0.0750; −0.6818 to −0.3877)<.0010.59 (0.51 to 0.68)

    Insurance status (reference: insured)

    		Government−0.0434 (0.0218; −0.0862 to −0.0006).0470.961.1913 (0.0916; 1.0117 to 1.3709)<.0013.29 (2.75 to 3.94)

    		Uninsured−0.4225 (0.0516; −0.5236 to −0.3215)<.0010.661.3464 (0.1715; 1.0102 to 1.6826)<.0013.84 (2.75 to 5.38)

    		Other−0.1816 (0.0578; −0.2948 to −0.0683).0020.831.1321 (0.1620; 0.8146 to 1.4496)<.0013.10 (2.26 to 4.26)
    Age−0.0108 (0.0013; −0.0133 to −0.0083)<.0010.990.0375 (0.0025; 0.0326 to 0.0423)<.0011.04 (1.03 to 1.04)
    Education0.0326 (0.0046; 0.0236 to 0.0415)<.0011.03−0.13 (0.0201; −0.1695 to −0.0906)<.0010.88 (0.84 to 0.91)
    PCPb density0.0027 (0.0007; 0.0014 to 0.0041)<.0011.000.0091 (0.0039; 0.0015 to 0.0167).021.01 (1.00 to 1.02)
    Smartphone−0.0062 (0.0037; −0.0135 to 0.0010).090.99−0.1162 (0.0138; −0.1431 to −0.0892)<.0010.89 (0.87 to 0.91)
    Median income−0.0058 (0.0015; −0.0088 to −0.0028)<.0010.990.0247 (0.0060; 0.0130 to 0.0364)<.0011.03 (1.01 to 1.04)
    Age × number of chronic diseases−0.0040 (0.0005; −0.0050 to −0.0031)<.0011.00N/AcN/AN/A
    Dispersion3.6683 (0.0364; 3.5977 to 3.7402)N/AN/AN/AN/AN/A

    aIRR: incidence risk ratio.

    bPCP: primary care physician.

    cN/A: not applicable.

    Given that the incidence of chronic disease increases as a person ages and the direction of the significant relationship between age and portal use in our sample, we added a parameter to explore the interaction of chronic disease and age on portal use. This interaction term was significant in our model. Results from the excess zero model (logit model) are presented in Table 3. The outcome of the multivariate analysis supports the findings from the univariate analysis.

    Model Robustness

    A robustness check using 2 models was performed to verify the interaction effect of age and the number of diagnoses on portal use. In the first model, only patients aged <65 years were included. Excluding patients aged ≥65 years from this model allows us to obtain more accurate estimates of the relationship between chronic disease and portal use, as portal use by older patients did not appear to be significantly influenced by the number of diagnoses and including them in the comprehensive model likely caused an underestimation in the results. In the second model, we excluded younger patients (those aged <65 years) to confirm the results from our main analysis, specifically, that portal use was not related to the number of diagnoses for the older patients in our sample. Results are presented in Table 4. The robustness check revealed results consistent with our main analysis, verifying the importance of age when considering the relationship between multimorbidity and the use of the electronic messaging feature of patient health portals. Figure 2 shows the predicted values for the number of sent messages from the negative binomial model based on the number of chronic diagnoses and age.

    Table 4. Zero-inflated negative binomial results predicting the number of sent messages.
    ParameterAged <65 yearsAged ≥65 years

    		Estimate (SE; 95% CI)P valueIRRaEstimate (SE; 95% CI)P valueIRR
    Number of chronic diseases (reference: 1)

    		72.7288 (0.301; 2.1388 to 3.3188)<.00115.310.4592 (0.8011; −1.1110 to 2.0294).571.58

    		62.3191 (0.2282; 1.8719 to 2.7663)<.00110.170.5559 (0.6439; −0.7060 to 1.8179).391.74

    		51.7701 (0.1703; 1.4363 to 2.1039)<.0015.870.3066 (0.5031; −0.6795 to 1.2927).541.36

    		41.3227 (0.1247; 1.0782 to 1.5671)<.0013.750.2639 (0.3784; −0.4778 to 1.0056).491.30

    		30.9165 (0.0834; 0.7531 to 1.0800)<.0012.500.0784 (0.253; −0.4175 to 0.5744).761.08

    		20.5073 (0.0467; 0.4158 to 0.5987)<.0011.660.1402 (0.1321; −0.1186 to 0.3991).291.15

    aIRR: incidence risk ratio.

    ‎
    Figure 2. Number of messages sent based on the number of diagnosed chronic diseases by age group.

    Principal Findings

    In this study, we assessed the relationship between multimorbidity and patient portal messaging use, controlling for several individual- and community-level characteristics known to influence portal use. We found that patients diagnosed with multiple chronic conditions were significantly more likely to use patient portal messaging than those diagnosed with fewer chronic conditions. Consistent with previous studies, the findings of our study indicate that there are still disparities in patient portal use based on demographic factors such as age, race, and marital status. Notably, we found that insurance coverage and several county-level factors, namely, PCP density, education, income, and access to technology, are significantly associated with patient portal use for sending messages. We describe the underlying meaning of our findings in the discussion below and provide recommendations for future research.

    Our analysis showed that as the number of chronic diagnoses increased, so did patient portal messaging use; however, this relationship was driven primarily by younger patients. The Diffusion of Innovation Theory suggests that the perceived advantage offered by an innovation, such as a patient portal, is an important factor in determining its use [30]. Studies have found that patients use portals if they perceive them to offer a relative advantage over existing practices such as calling or traveling for an inpatient visit with their provider [44]. Given that patients with multimorbidity tend to have complex health needs, rely on a network of providers, and consume more medical services than those without chronic diseases [45-47], theory suggests that they would be able to recognize the benefits and anticipated advantages that portal messaging could offer [48,49]. However, it is possible that such advantages are not yet fully realized by older patients or that they may focus more on the portal’s incompatibility with their values or experiences. Additional qualitative or survey exploration should be conducted for the specific reasons that portal adoption is delayed, as this may provide clarification and identify actions that could be taken to improve engagement (eg, one-on-one coaching).

    Younger patients have been identified as more frequent users of patient portals than their older counterparts [12,13,17]. The slower adoption of portals by older patients is because of several factors, including physical barriers, lack of experience, interest, and access to the necessary technologies [50]. However, portal use among older patients is increasing because of patients’ overall comfort with technology, chronic condition management needs, and social motivation [16,50-53]. Although less frequent use of the patient portal by older patients has been associated with medical care avoidance [54], previous research conducted within our patient population suggests that younger patients in our region may be more likely to avoid care [55]. In addition, all patients included in our sample received or sent at least 1 portal message, suggesting that they had a visit or some interaction with a care provider during the study period. Therefore, the truly medically avoidant population is unlikely to be represented in our sample. From the perspective of the Diffusion of Innovation Theory, health care systems seeking to increase the adoption and use of patient portals across different demographic groups are encouraged to implement educational interventions to promote the advantages of portal communication, particularly among patients with multimorbidity [44].

    We also found that significant predictors of increased patient portal messaging use included demographic factors such as sex, marital status, race, educational attainment, provider density, and income. These findings can be viewed through the lens of the intersectionality theory, which suggests that the combined individual characteristics of the patient must be considered when evaluating disparities and how they might constitute an advantage or disadvantage to the patient. Hence, our findings suggest that female, younger, married, and White patients and patients who live in areas with a higher educational attainment, greater PCP density, and lower median income are more likely to communicate with their providers via the patient portal. These findings align with those of the previous studies examining sociodemographic differences in patient portal use. Similar results highlight disparities among patient portal users, with rural, male, older, single, uninsured, publicly insured, and racial minority patients being disadvantaged [12,13,15,16,20-24,56,57]. Some studies, however, showed mixed results regarding sex and age differences in patient portal use [11,58,59]. A systematic review conducted to evaluate the use and impact of access to electronic medical records among patients with type 2 diabetes found increased portal adoption and use rate among older male patients [58]. They also noted that women aged >65 years were less likely to access electronic health–related services than older men, who reported being more familiar with the internet through employment [58].

    In our sample, Black patients sent fewer messages than White patients. This finding is consistent with previous studies reporting that patient portal use is commonly lower among Black, Hispanic, and Asian patients [20,57,60]. Patients reporting good internet access, higher income, and living in urban areas have been identified as more frequent users of patient portals [61,62]. In contrast, we found increased portal use among patients living in areas with a lower median income. It is plausible that patients with lower income view the portal as a way to communicate with their providers that does not require additional resources. For example, patients with low-income status may have employment that does not provide paid time off, they may not have reliable transportation for an in-person visit, or they may not have the financial resources to pay copays and deductibles. Therefore, our findings may indicate that, for these patients, the benefit of an in-person visit may be outweighed by the convenience and cost-effectiveness of communication through the patient portal.

    Limitations

    This study offers important insights for health care administrators and researchers. However, there are several limitations that must be considered. First, this study was limited to patients of a major medical center in the eastern region of North Carolina; therefore, the results may not be generalizable to all individuals in the United States and other countries. Second, given that most of the counties in the region are rural, the results may be more relevant to individuals living in rural areas who typically have some resistance to innovation and fewer resources available to allow them to access and use the relevant technology. Third, this study was limited by the unavailability of certain variables that have been shown to contribute to the use of patient portals [63]. For example, variables that measure the associated costs of using the technology and the availability of technical support were not controlled for in this study. Future studies should consider extending their models to include these and other additional variables when examining the association between the patient portal use and multimorbidity. Fourth, the sample for this study was restricted to patients diagnosed with physical conditions selected a priori based on recommendations from the Healthy North Carolina 2030 project. Consequently, mental health diagnoses were not included in our data set; however, given the known association between mental health diagnoses and physical multimorbidity, future studies should explore mental health conditions as an element of multimorbidity and its impact on portal messaging use [64-67]. Fifth, this study primarily assessed portal messages sent by patients to providers, which does not explore potential biases in providers’ engagement with patients via the patient portal. It is possible that providers may be less likely to message older patients believing that older patients may be less comfortable with technology compared with younger patients [23,68]. Finally, this study investigated use of the messaging feature of the patient portal. It is important to note that several other features are available in many patient portals (eg, access to test results and transactional services), and the use of these features may or may not correlate with use of the messaging feature.

    Notwithstanding, this study contributes to the health information technology and patient portal use literature by emphasizing the characteristics of patients with multimorbidity that are more likely to use patient portals for sending messages. It also highlights the challenges that key stakeholders must consider when encouraging patients with multimorbidity to use the patient portal. By better understanding how the characteristics of individual patients with multimorbidity influence their use of the patient portal while also considering the combined effects of these characteristics, administrators and policy makers may gauge their outreach decisions as well as how they allocate resources to encourage the use of patient portals to achieve their maximum potential.

    Conclusions

    Managing multimorbidity is challenging for the patient, the provider, and the larger health care system. Electronic patient portals are a valuable tool for enhancing patient engagement and have the capacity to improve health care delivery by allowing patients to access their medical records, schedule and manage appointments, and communicate directly with their care providers. In our study, patients’ use of the portal to send messages to providers was incrementally related to their number of diagnoses. We found that as the number of chronic diagnoses increased, so did patient portal use; however, this relationship was driven primarily by younger patients. As a person ages, their likelihood of experiencing multimorbidity increases, whereas their capacity for adopting new technologies may decline. Given these considerations, tailored interventions, such as the use of peer advisors, coaches, and educational videos shown in clinic waiting areas, could be used to encourage and advocate for the use of patient portals among older patients. Furthermore, patients of all ages living in rural areas could benefit from the convenience and cost-effectiveness of portal communication. Future studies should investigate portal use among patients with multimorbidity in the context of additional social determinates of health, and prospective studies should be designed to test interventions to improve portal use in this population.

    Data Availability

    The data used in this study are not publicly available. The data set was obtained from East Carolina University (ECU) Health, and privacy and security concerns prevent the redistribution of data to investigators outside of the institutional review board–approved study team. Researchers can apply for access to the individual-level data set by submitting a request to the ECU Health Center for Research and Grants.

    Conflicts of Interest

    None declared.

    1. Chronic diseases in America. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/chronicdisease/resources/infographic/chronic-diseases.htm [accessed 2022-08-04]
    2. Whitson HE, Boyd CM. Multiple chronic conditions. UpToDate. URL: https://www.uptodate.com/contents/multiple-chronic-conditions [accessed 2022-08-04]
    3. Mercer SW, Smith SM, Wyke S, O'Dowd T, Watt GC. Multimorbidity in primary care: developing the research agenda. Fam Pract. Apr 2009;26(2):79-80. [CrossRef] [Medline]
    4. McPhail SM. Multimorbidity in chronic disease: impact on health care resources and costs. Risk Manag Healthc Policy. Jul 5, 2016;9:143-156. [FREE Full text] [CrossRef] [Medline]
    5. Uijen AA, van de Lisdonk EH. Multimorbidity in primary care: prevalence and trend over the last 20 years. Eur J Gen Pract. 2008;14 Suppl 1:28-32. [CrossRef] [Medline]
    6. About chronic diseases. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/chronicdisease/about/index.htm [accessed 2022-08-07]
    7. Murray CJ, Atkinson C, Bhalla K, Birbeck G, Burstein R, Chou D, Foreman; Lopez; Murray; Dahodwala; Jarlais; Fahami; Murray; Jarlais; Foreman; Lopez; Murray; et al. U.S. Burden of Disease Collaborators. The state of US health, 1990-2010: burden of diseases, injuries, and risk factors. JAMA. Aug 14, 2013;310(6):591-608. [FREE Full text] [CrossRef] [Medline]
    8. Coughlin SS, Clary C, Johnson JA, Berman A, Heboyan V, Benevides T, et al. Continuing challenges in rural health in the United States. J Environ Health Sci. 2019;5(2):90-92. [FREE Full text] [Medline]
    9. Healthcare access in rural communities overview. Rural Health Information Hub. URL: https://www.ruralhealthinfo.org/topics/healthcare-access [accessed 2022-09-20]
    10. Van den Bulck SA, Hermens R, Slegers K, Vandenberghe B, Goderis G, Vankrunkelsven P. Designing a patient portal for patient-centered care: cross-sectional survey. J Med Internet Res. Oct 01, 2018;20(10):e269. [FREE Full text] [CrossRef] [Medline]
    11. Irizarry T, DeVito Dabbs A, Curran CR. Patient portals and patient engagement: a state of the science review. J Med Internet Res. Jun 23, 2015;17(6):e148. [FREE Full text] [CrossRef] [Medline]
    12. Turner K, Hong YR, Yadav S, Huo J, Mainous AG. Patient portal utilization: before and after stage 2 electronic health record meaningful use. J Am Med Inform Assoc. Oct 01, 2019;26(10):960-967. [FREE Full text] [CrossRef] [Medline]
    13. Dendere R, Slade C, Burton-Jones A, Sullivan C, Staib A, Janda M. Patient portals facilitating engagement with inpatient electronic medical records: a systematic review. J Med Internet Res. Apr 11, 2019;21(4):e12779. [FREE Full text] [CrossRef] [Medline]
    14. Turner K, Clary A, Hong YR, Alishahi Tabriz AA, Shea CM. Patient portal barriers and group differences: cross-sectional national survey study. J Med Internet Res. Sep 17, 2020;22(9):e18870. [FREE Full text] [CrossRef] [Medline]
    15. Han HR, Gleason KT, Sun CA, Miller HN, Kang SJ, Chow S, et al. Using patient portals to improve patient outcomes: systematic review. JMIR Hum Factors. Dec 19, 2019;6(4):e15038. [FREE Full text] [CrossRef] [Medline]
    16. Carini E, Villani L, Pezzullo AM, Gentili A, Barbara A, Ricciardi W, et al. The impact of digital patient portals on health outcomes, system efficiency, and patient attitudes: updated systematic literature review. J Med Internet Res. Sep 08, 2021;23(9):e26189. [FREE Full text] [CrossRef] [Medline]
    17. Mold F, de Lusignan S, Sheikh A, Majeed A, Wyatt JC, Quinn T, et al. Patients' online access to their electronic health records and linked online services: a systematic review in primary care. Br J Gen Pract. Mar 2015;65(632):e141-e151. [FREE Full text] [CrossRef] [Medline]
    18. Asagbra OE, Zengul FD, Burke D. Patient engagement functionalities in U.S. hospitals: is early adoption associated with financial performance? J Healthc Manag. 2019;64(6):381-396. [CrossRef] [Medline]
    19. Asagbra OE, Burke D, Liang H. The association between patient engagement HIT functionalities and quality of care: does more mean better? Int J Med Inform. Oct 2019;130:103893. [CrossRef] [Medline]
    20. Liu SK, Osborn AE, Bell S, Mecchella JN, Hort S, Batsis JA. Patient characteristics and utilization of an online patient portal in a rural academic general internal medicine practice. BMC Med Inform Decis Mak. Feb 16, 2022;22(1):42. [FREE Full text] [CrossRef] [Medline]
    21. Oest SE, Hightower M, Krasowski MD. Activation and utilization of an electronic health record patient portal at an academic medical center-impact of patient demographics and geographic location. Acad Pathol. Oct 4, 2018;5:2374289518797573. [FREE Full text] [CrossRef] [Medline]
    22. Greenberg AJ, Haney D, Blake KD, Moser RP, Hesse BW. Differences in access to and use of electronic personal health information between rural and urban residents in the United States. J Rural Health. Feb 2018;34 Suppl 1(Suppl 1):s30-s38. [FREE Full text] [CrossRef] [Medline]
    23. Arcury TA, Quandt SA, Sandberg JC, Miller DP, Latulipe C, Leng X, et al. Patient portal utilization among ethnically diverse low income older adults: observational study. JMIR Med Inform. Nov 14, 2017;5(4):e47. [FREE Full text] [CrossRef] [Medline]
    24. Tsai R, Bell EJ, Woo H, Baldwin K, Pfeffer MA. How patients use a patient portal: an institutional case study of demographics and usage patterns. Appl Clin Inform. Jan 2019;10(1):96-102. [FREE Full text] [CrossRef] [Medline]
    25. Kruse CS, Argueta DA, Lopez L, Nair A. Patient and provider attitudes toward the use of patient portals for the management of chronic disease: a systematic review. J Med Internet Res. Feb 20, 2015;17(2):e40. [FREE Full text] [CrossRef] [Medline]
    26. Yamin CK, Emani S, Williams DH, Lipsitz SR, Karson AS, Wald JS, et al. The digital divide in adoption and use of a personal health record. Arch Intern Med. Mar 28, 2011;171(6):568-574. [CrossRef] [Medline]
    27. Powell KR, Deroche C. Predictors and patterns of portal use in patients with multiple chronic conditions. Chronic Illn. Dec 04, 2020;16(4):275-283. [CrossRef] [Medline]
    28. Johnson C, Richwine C, Patel V. Individuals’ access and use of patient portals and smartphone health apps, 2020. Office of the National Coordinator for Health Information Technology. Sep 2021. URL: https:/​/www.​healthit.gov/​data/​data-briefs/​individuals-access-and-use-patient-portals-and-smartphone-health-apps-2020 [accessed 2022-08-17]
    29. Milani RV, Lavie CJ, Bober RM, Milani AR, Ventura HO. Improving hypertension control and patient engagement using digital tools. Am J Med. Jan 2017;130(1):14-20. [CrossRef] [Medline]
    30. Rogers EM. Diffusion of Innovations 5th edition. New York, NY. Free Press; 2003.
    31. Rogers EM. Diffusion of Innovations, 3rd edition. New York City, NY. Free Press; 1983.
    32. Rogers EM. Diffusion of Innovations First Edition. Glencoe, NY. The Free Press; 1962.
    33. Crenshaw K. Demarginalizing the intersection of race and sex: a Black feminist critique of antidiscrimination doctrine, feminist theory, and antiracist politics. In: Bartlett KT, Kennedy R, editors. Feminist Legal Theory Readings In Law And Gender. Milton Park, Abingdon-on-Thames, Oxfordshire, England, UK. Routledge; 1991.
    34. Crenshaw K. Mapping the margins: intersectionality, identity politics, and violence against women of color. Stanford Law Rev. Jul 1991;43(6):1241-1299. [CrossRef]
    35. Jones S, Fox S. Generations online in 2009. Pew Research Center. Jan 28, 2009. URL: https://www.pewresearch.org/internet/2009/01/28/generations-online-in-2009/ [accessed 2023-06-24]
    36. Bauer GR. Incorporating intersectionality theory into population health research methodology: challenges and the potential to advance health equity. Soc Sci Med. Jun 2014;110:10-17. [FREE Full text] [CrossRef] [Medline]
    37. Cho S, Crenshaw KW, McCall L. Toward a field of intersectionality studies: theory, applications, and praxis. Signs (Chic). Jun 2013;38(4):785-810. [CrossRef]
    38. Ruiz AM, Luebke J, Klein K, Moore K, Gonzalez M, Dressel A, et al. An integrative literature review and critical reflection of intersectionality theory. Nurs Inq. Dec 21, 2021;28(4):e12414. [CrossRef] [Medline]
    39. Social determinants of health at CDC. Centers for Disease Control and Prevention. URL: https://www.cdc.gov/socialdeterminants/index.htm [accessed 2022-11-29]
    40. Healthy North Carolina 2030. North Carolina Institute of Medicine. URL: https://nciom.org/healthy-north-carolina-2030/ [accessed 2022-07-27]
    41. About us. Epic. URL: https://www.epic.com/about [accessed 2022-08-24]
    42. Data downloads. Health Resources & Services Administration. URL: https://data.hrsa.gov/data/download?data=AHRF#AHRF [accessed 2022-08-24]
    43. American community survey 5-year data (2009-2020). United States Census Bureau. Jun 15, 2023. URL: https://www.census.gov/data/developers/data-sets/acs-5year.html [accessed 2022-08-24]
    44. Emani S, Peters E, Desai S, Karson AS, Lipsitz SR, LaRocca R, et al. Perceptions of adopters versus non-adopters of a patient portal: an application of diffusion of innovation theory. J Innov Health Inform. Oct 25, 2018;25(3):149-157. [FREE Full text] [CrossRef] [Medline]
    45. Schubart JR, Stuckey HL, Ganeshamoorthy A, Sciamanna CN. Chronic health conditions and internet behavioral interventions: a review of factors to enhance user engagement. Comput Inform Nurs. Feb 2011;29(2):81-92. [FREE Full text] [CrossRef] [Medline]
    46. Bhandari N, Shi Y, Jung K. Seeking health information online: does limited healthcare access matter? J Am Med Inform Assoc. 2014;21(6):1113-1117. [FREE Full text] [CrossRef] [Medline]
    47. Ayers SL, Kronenfeld JJ. Chronic illness and health-seeking information on the internet. Health (London). Jul 2007;11(3):327-347. [CrossRef] [Medline]
    48. Asagbra OE, Burch A, Chivela FL. The association between information technology sophistication and patient portal use: a cross sectional study in Eastern North Carolina. Health Informatics J. 2023;29(1):14604582231154478. [FREE Full text] [CrossRef] [Medline]
    49. Kruse CS, Bolton K, Freriks G. The effect of patient portals on quality outcomes and its implications to meaningful use: a systematic review. J Med Internet Res. Feb 10, 2015;17(2):e44. [FREE Full text] [CrossRef] [Medline]
    50. Haase KR, Cosco T, Kervin L, Riadi I, O'Connell ME. Older adults' experiences with using technology for socialization during the COVID-19 pandemic: cross-sectional survey study. JMIR Aging. Apr 23, 2021;4(2):e28010. [FREE Full text] [CrossRef] [Medline]
    51. Wildenbos GA, Maasri K, Jaspers M, Peute L. Older adults using a patient portal: registration and experiences, one year after implementation. Digit Health. Sep 2, 2018;4:2055207618797883. [FREE Full text] [CrossRef] [Medline]
    52. Or C, Tao D. Usability study of a computer-based self-management system for older adults with chronic diseases. JMIR Res Protoc. Nov 08, 2012;1(2):e13. [FREE Full text] [CrossRef] [Medline]
    53. Anderson M, Perrin A. Tech adoption climbs among older adults. Pew Research Center. May 17, 2017. URL: https://www.pewresearch.org/internet/2017/05/17/tech-adoption-climbs-among-older-adults/ [accessed 2022-09-27]
    54. Leyva B, Taber JM, Trivedi AN. Medical care avoidance among older adults. J Appl Gerontol. Jan 18, 2020;39(1):74-85. [CrossRef] [Medline]
    55. Burch AE. Factors responsible for healthcare avoidance among rural adults in the Eastern Region of North Carolina. J Community Health. Oct 08, 2022;47(5):737-744. [FREE Full text] [CrossRef] [Medline]
    56. Anthony DL, Campos-Castillo C, Lim PS. Who isn't using patient portals and why? Evidence and implications from a national sample of US adults. Health Aff (Millwood). Dec 2018;37(12):1948-1954. [CrossRef] [Medline]
    57. Chang E, Blondon K, Lyles CR, Jordan L, Ralston JD. Racial/ethnic variation in devices used to access patient portals. Am J Manag Care. Jan 01, 2018;24(1):e1-e8. [FREE Full text] [Medline]
    58. Mold F, Raleigh M, Alharbi NS, de Lusignan S. The impact of patient online access to computerized medical records and services on type 2 diabetes: systematic review. J Med Internet Res. Jul 06, 2018;20(7):e235. [FREE Full text] [CrossRef] [Medline]
    59. Weppner WG, Ralston JD, Koepsell TD, Grothaus LC, Reid RJ, Jordan L, et al. Use of a shared medical record with secure messaging by older patients with diabetes. Diabetes Care. Nov 2010;33(11):2314-2319. [FREE Full text] [CrossRef] [Medline]
    60. Goldzweig CL, Orshansky G, Paige NM, Towfigh AA, Haggstrom DA, Miake-Lye I, et al. Electronic patient portals: evidence on health outcomes, satisfaction, efficiency, and attitudes: a systematic review. Ann Intern Med. Nov 19, 2013;159(10):677-687. [CrossRef] [Medline]
    61. Parker R, Goldbloom EB, Mitsakakis N, Terekhov I, Zuijdwijk C. Social determinants of health associated with patient portal use in pediatric diabetes. Can J Diabetes. Aug 2022;46(6):586-593. [CrossRef] [Medline]
    62. Singh P, Jonnalagadda P, Morgan E, Fareed N. Outpatient portal use in prenatal care: differential use by race, risk, and area social determinants of health. J Am Med Inform Assoc. Jan 12, 2022;29(2):364-371. [FREE Full text] [CrossRef] [Medline]
    63. Ryan BL, Brown JB, Terry A, Cejic S, Stewart M, Thind A. Implementing and using a patient portal: a qualitative exploration of patient and provider perspectives on engaging patients. J Innov Health Inform. Jul 04, 2016;23(2):848. [FREE Full text] [CrossRef] [Medline]
    64. Stickley A, Koyanagi A. Physical multimorbidity and loneliness: a population-based study. PLoS One. Jan 24, 2018;13(1):e0191651. [FREE Full text] [CrossRef] [Medline]
    65. Ishida M, Hulse ES, Mahar RK, Gunn J, Atun R, McPake B, et al. The joint effect of physical multimorbidity and mental health conditions among adults in Australia. Prev Chronic Dis. Dec 10, 2020;17:E157. [FREE Full text] [CrossRef] [Medline]
    66. Romain AJ, Marleau J, Baillot A. Association between physical multimorbidity, body mass index and mental health/disorders in a representative sample of people with obesity. J Epidemiol Community Health. Sep 2019;73(9):874-880. [CrossRef] [Medline]
    67. Mercer SW, Gunn J, Bower P, Wyke S, Guthrie B. Managing patients with mental and physical multimorbidity. BMJ. Sep 03, 2012;345:e5559. [CrossRef] [Medline]
    68. Miller Jr DP, Latulipe C, Melius KA, Quandt SA, Arcury TA. Primary care providers' views of patient portals: interview study of perceived benefits and consequences. J Med Internet Res. Jan 15, 2016;18(1):e8. [CrossRef] [Medline]

    ‎
    ACS: American Community Survey
    PCP: primary care physician

    Edited by T Leung; submitted 13.12.22; peer-reviewed by T Risling, H Miller, S Manzanero; comments to author 06.02.23; revised version received 26.03.23; accepted 31.05.23; published 01.08.23.

    Copyright

    ©Fernando L Chivela, Ashley E Burch, Oghale Asagbra. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 01.08.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.