This paper is in the following e-collection/theme issue:

Personal Health Records, Patient-Accessible Electronic Health Records, Patient Portals (573) Participatory Medicine & E-Patients (773) User Needs and Competencies (303) Demographics of Users, Social & Digital Divide (739) Electronic Health Records (1053)

Published on in Vol 23, No 8 (2021): August

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/19820, first published .
Effects of Patient Portal Use on Patient Satisfaction: Survey and Partial Least Squares Analysis

Effects of Patient Portal Use on Patient Satisfaction: Survey and Partial Least Squares Analysis

Effects of Patient Portal Use on Patient Satisfaction: Survey and Partial Least Squares Analysis

Authors of this article:

Aaron P Kinney1 Author Orcid Image ;   Balaji Sankaranarayanan2 Author Orcid Image
Article Authors Cited by (9) Tweetations (2) Metrics

    Original Paper

    1Herma Heart Institute, Children's Wisconsin, Milwaukee, WI, United States

    2Department of Information Technology and Supply Chain Management, College of Business and Economics, University of Wisconsin - Whitewater, Whitewater, WI, United States

    Corresponding Author:

    Balaji Sankaranarayanan, PhD

    Department of Information Technology and Supply Chain Management, College of Business and Economics, University of Wisconsin - Whitewater

    800 W. Main Street

    Whitewater, WI, 53190

    United States

    Phone: 1 262 472 5467

    Email: sankarab@uww.edu


    Background: With digital delivery of health care services gaining prominence, patient portals have become a mainstay of many health care organizations. Despite the importance of patient portals, inconclusive data exist regarding the effect of patient portal use on patient satisfaction.

    Objective: The aim of this study is to understand the relationship between the postadoptive use of patient portals and patient satisfaction outcomes.

    Methods: Postadoptive use of patient portals has a positive relationship with the 3 dimensions of patient satisfaction, mediated by gratification, health self-awareness, and health perceptions. A total of 504 valid patient portal user responses were collected, and partial least squares analysis was performed to analyze the data.

    Results: Patient satisfaction was captured using three dimensions: care team interaction, atmosphere, and instruction effectiveness. The results show that postadoptive use of patient portals has a positive influence on all 3 dimensions of patient satisfaction through the mediating variables of gratification, health self-awareness, and health perceptions. Specifically, postadoptive use had significant positive influence on gratification, health self-awareness, and health perceptions. Each of the 3 patient perceptions had significant positive influence on all 3 dimensions of patient satisfaction: care team interaction, atmosphere, and instruction effectiveness. Specifically, our model explained 31.8% of the care team interaction, 40.6% of the atmosphere, and 39.1% of the instruction effectiveness.

    Conclusions: Our model shows that patient portal use can influence patient satisfaction through the mediating effects of gratification, health self-awareness, and health perception. Patient satisfaction is an important outcome for health care organizations. Therefore, by promoting effective patient portal use and fostering patient perceptions, health care organizations can improve patient satisfaction.

    J Med Internet Res 2021;23(8):e19820

    doi:10.2196/19820

    Keywords

    patient portal; patient satisfaction; gratification; health self-awareness; post-adoptive use; health perceptions 


    Background

    Increasingly, as health care digital services have gained prominence, patient portals have become a mainstay of many health care organizations. The impetus for implementing patient portals can be traced to the Affordable Care Act and Health Information Technology for Economic and Clinical Health Act, which tied reimbursements to the implementation of health information infrastructure and achievement of benchmark patient satisfaction scores [1]. Practitioner reports state that 90% of the health care organizations had implemented a patient portal in some form by 2018 [2]. The portals’ services range from providing offline health records, messaging, and alerts to providing web-based real-time doctor consultations [3]. However, this leads to the key research question: does a patient’s use of a portal lead to increased patient satisfaction?

    As a performance metric, patient satisfaction scores are extremely important for health care organizations. Patient satisfaction scores, also known as Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) scores [4], affect the payments made to health care organizations [1]. In addition, clinical benefits such as improved clinical outcomes and improvement in overall clinical care constitute a significant benefit of higher patient satisfaction [4]. Although satisfied patients gain these significant benefits, dissatisfied patients can ignore—or worse, completely abandon—the care provided. As patient portals continue to gain prominence, improved patient satisfaction can enable organizations to provide effective health services through patient portals. Thus, studying the link between patient portal use and patient satisfaction becomes an extremely interesting and important research problem [5].

    Despite strong academic interest in patient satisfaction as a performance metric, up to 45% of the current studies on the effect of portals on patient satisfaction have either shown no effect or have been inconclusive [6]. Although patient portals have been found to be associated with better patient retention [7], increased patient care compliance [8], reduction of medication errors [9], and improvement in communication [10], these relationships do not seem to have a direct link to the HCAHPS dimensions of patient satisfaction. Although prior findings on the benefits of patient portals are unequivocal, the relationship between portal use and patient satisfaction is still unclear.

    Our study seeks to address this research gap in 2 ways. We theorized and tested a research model linking patient portal use and the HCAHPS dimensions of patient satisfaction. Furthermore, to address the research gap in our understanding of the link between portal use and satisfaction, we theorized on the mediators that link portal use and patient satisfaction. Using the Adaptive Structuration Theory (AST) and prior studies, we modeled patient perceptions as mediators of the relationship between patient portal use and patient satisfaction. In the following section, we elaborate on the prior studies on patient portals. Next, we describe how we built and tested a research model of patient portal use, patient perceptions, and patient satisfaction.

    Prior Work

    Our literature review revealed several important themes regarding patient portal use and its impacts. Some key articles on patient portals and their impacts are presented in Multimedia Appendix 1 [1,3,6,7,9-20]. The factors that predict the adoption and use of patient portals have received extensive attention in the literature. The Technology Acceptance Model (TAM) and the Unified Theory of Acceptance and Use of Technology (UTAUT) offer interesting theoretical perspectives to study the implementation of patient portals. Research applying this framework shows that perceived value and ease of use are important predictors of portal adoption [5-8]. The rationale is that patient portals offer the ability to access data, scheduling, and reports at any time (perceived usefulness), in addition to allowing certain functionalities without any of the previous barriers (ease of use), such as scheduling an appointment without waiting on a callback. Recent research also acknowledges that adoption is different from use and that adoption may not necessarily translate into the use of a patient portal [9].

    Although the UTAUT and TAM provide an excellent framework to examine the phenomena of adoption, there is a significant gap in this research regarding the impacts of the system after use, that is, postadoptive use. Several studies have attempted to address this research gap by focusing on the relationship between patient portal use and patient outcomes. The portal benefits of improving care and communication between patients and providers [10,11], discovering medical errors, and ensuring that patients take medication on time [12] have been documented in the literature. However, findings from review studies also confirm the inconsistency in patient satisfaction studies [6]. Although some studies have found improved patient satisfaction when electronic patient access to medical information was used [6,13,14,21], other studies have found mixed results [7,15,22], and a few have found that patient satisfaction data remained unchanged [23,24].

    Two important aspects of prior research on patient satisfaction must be mentioned. First, although using HCAHPS measures are considered the standard way to measure patient satisfaction at health care organizations, patient satisfaction has not been measured consistently, or it has been measured using only 1 or 2 HCAHPS measures [14,16]. This implies that patient satisfaction needs to be studied more comprehensively by enumerating its underlying dimensions. This will provide a richer description of the influence of patient portals.

    Second, because of the research gap in the literature regarding the link between patient portal use and patient satisfaction, the mediators linking these factors need to be considered. Prior research suggests that patient perceptions could play a mediating role in determining patient satisfaction through patient portal use [7,14]. Patient portal use can influence a positive patient experience for patients [3]. Patients with chronic disease have mixed attitudes regarding patient portal use [17]. This suggests that studying the mediating role of patient perceptions could help address the link between patient portal use and patient satisfaction.

    Goal of This Study

    Prior studies show that patient satisfaction and patient portals have many important intertwined relationships to be explored. Although patient portals have been explored in terms of their impact on different aspects of the care continuum, there remains an inconsistent understanding of the relationship between portal use and patient satisfaction. As explained earlier, an understanding of the mediating influences of patient perceptions will shed light on the links between patient portals and patient satisfaction. Therefore, the 2 research questions addressed in this study are as follows:

    1. What are the influences of patient portal use on patient satisfaction?
    2. What are the influences of patient portal use on patients’ perceptions of their own health and portal?

    Research Model and Hypotheses Development

    The AST [25] serves as the theoretical perspective for our research model. The AST has been applied to study adoption perceptions and behaviors in a variety of contexts such as group decision support systems and enterprise systems. Drawing upon the structuration theory formulated by Giddens [26], the AST offers a theoretical framework that delves into the dynamic relationship that connects structures provided by technology and the ways in which these structures are appropriated or adapted by a user. Traditionally, the AST had been applied in the organizational or group context [25]. However, recent research has adapted this framework to the individual level [27]. Applying the AST to the individual level, the input-process-output framework of the AST can be explained as follows: (1) input: technology in use affords certain features or structures; (2) process: technology is adapted by users to accomplish a task, and users develop certain attitudes, perceptions, and behaviors; and (3) output: processes can influence decision-making or performance outcomes [27].

    Adapting the AST’s input-process-output framework in our study, we posited that (1) patient portals afford certain technology features for use, (2) portal use can influence patient perceptions, and (3) patient perceptions can influence patient satisfaction outcomes. The research model of patient portal use and patient satisfaction is presented in Figure 1. The model shows that postadoptive use will have a positive influence on health self-awareness, gratification, and health perceptions. We classified them as cognitive factor (knowledge-based) and affective factor (emotion-based). These patient perceptions are posited to have a positive influence on patient satisfaction.

    ‎
    Figure 1. Influences of postadoptive use of electronic portals on patient perceptions and satisfaction.
    View this figure

    Dimensions of Patient Satisfaction

    As noted earlier, patient satisfaction has not been conceptualized or measured consistently as an outcome variable in prior research. It is common for numerous measures of patient satisfaction to be used, including likeliness to recommend [28], satisfaction with nursing [29], and satisfaction with physician communication [30]. Some studies have only used 1 or 2 items from the HCAHPS survey (either overall satisfaction or willingness to recommend) to measure patient satisfaction [14,16].

    We diverged from these studies to conceptualize patient satisfaction as a multidimensional construct using multiple measures. The conceptualization and measures used in this study for patient satisfaction were based on the HCAHPS survey. This is the national survey used by health care organizations to capture patient perceptions of hospital experience and is used by the Centers for Medicare & Medicare Services to standardize medical reimbursement [4]. This survey is typically used to gauge patient satisfaction at hospitals [31] and has been a critical component in bringing about transparency to patient perceptions of care [32]. On the basis of the HCAHPS survey, patient satisfaction was theorized in this study as consisting of three dimensions: care team interaction, atmosphere, and instruction effectiveness. Care team interaction refers to any communication between a patient and a member of the care team, such as providers and nurses. Atmosphere refers to the evaluation of the health encounter with respect to the environment around the patient, notably cleanliness, quietness, and staff responsiveness. Instruction effectiveness captures the care team’s ability to convey pertinent information to the patient, including communication about medicines and discharge information.

    Health Self-awareness

    In this study, health self-awareness was defined as the extent of knowledge and skill sets of patients in relation to their own health. Prior research has shown that patients are more informed about their health through patient portal use [11,33]. As patients continue to use patient portals, these technology features [25] provide them with access to accurate information about their health status [34]. In addition, patient portals provide detailed explanations of the test results and associated health conditions [19]. Patients can therefore compare such information (eg, blood work results) against established benchmarks, in addition to obtaining a detailed understanding of their health condition. As patients accumulate knowledge about their health, they are more likely to be informed and involved in their health care decisions [35]. Informed patients can proactively request specific health services from their providers [36], which can reduce medical errors [12,34], improve decision-making [37], and subsequently influence the 3 dimensions of patient satisfaction (care team interaction, atmosphere, and instruction effectiveness). Hence, we postulated the following hypotheses:

    • H1: Health self-awareness mediates the positive influence of postadoptive use on patient satisfaction.
    • H1a: Postadoptive use will have a positive influence on health self-awareness.
    • H1b: Health self-awareness will have a positive influence on patient satisfaction.

    Gratification

    Gratification has been defined in numerous ways, particularly in relation to the Uses and Gratification Theory [38,39]. In this study, we defined gratification as a feeling of pleasure directly related to achieving a desired task such as scheduling, reviewing medical information, or using the patient portal. Patient portal use provides a near-instant ability to achieve health-related tasks [40,41], rather than limiting individuals to accomplishing such tasks only during business hours [42]. As the goal of portal use is information seeking or knowledge gathering [41], the immediate sharing of information is likely to gratify the patient. Gratified patients will reflect positively upon their care experience [41,43], which will have a positive influence on their satisfaction with overall health care delivery. Hence, we posited the following:

    • H2: Gratification mediates the positive influence of postadoptive use on patient satisfaction.
    • H2a: Postadoptive use will have a positive influence on gratification.
    • H2b: Gratification will have a positive influence on patient satisfaction.

    Health Perceptions

    In this study, health perceptions were defined as having positive emotions about a person’s health. Prior work in psychology literature has shown the importance of positive emotions as they improve creative problem solving [44] and satisfaction [45] and increase the likelihood of success [46]. Research in information systems literature has also pointed to the centrality of positive emotions in predicting the use of systems. For instance, knowledge gained through the UTAUT [47] pointed to affect and associated constructs such as computer playfulness as antecedents of behavioral intention to use a system.

    We posited that health perceptions would mediate the relationship between postadoptive use and patient satisfaction. First, prior studies have informed us that health perceptions can influence outcome variables, including practice satisfaction in physicians [45,46,48]. As users gather information, they experience positive health perceptions, and this affective attitude component directly contributes to their satisfaction attitudes. As long as the information technology system (ie, portal) continues to enable this behavior [25], it has the potential to allow users to feel more positive about their health. As patients have more positive feelings about their health status, they are more likely to rate the status of their health experience higher, leading to higher patient satisfaction scores. Hence, we posited the following:

    • H3: Health perceptions mediate the positive influence of postadoptive use on patient satisfaction.
    • H3a: Postadoptive use will have a positive influence on health perceptions.
    • H3b: Health perceptions will have a positive influence on patient satisfaction.

    Indirect Effects of Health Self-awareness

    Health self-awareness can have a positive impact on gratification and health perceptions, thereby indirectly influencing patient satisfaction. On the basis of social cognitive theory [49], prior research in different contexts has shown that cognitive factors can influence affective factors. For example, in a learning context, working memory skills (cognitive factor) can influence writing anxiety and self-efficacy (affective factors), further affecting writing performance [50]. Similarly, in a health care context, mindfulness, a cognitive factor, can have a positive impact on affective empathy, leading to improved engagement in nursing [51]. As explained earlier, as a patient’s knowledge increases, they are more likely to be informed and involved in their own health care decisions [35]. As patients begin to make informed decisions, it can lead to a higher level of gratification (ie, satisfaction with learning through technology use) and health perceptions (ie, a positive feeling about taking control of their own health). On the other hand, as health self-awareness decreases, the patients’ capacity to make informed decisions also decreases, which can lead to lower levels of gratification and health perceptions. Hence, we posited the following:

    • H4: Health self-awareness will have an indirect influence on patient satisfaction through gratification and health perceptions.
    • H4a: Health self-awareness will have a positive influence on gratification.
    • H4b: Health self-awareness will have a positive influence on health perceptions.

    Recruitment

    As part of a larger research study, this survey was designed as a nationwide electronic survey to be disseminated within the United States. This study used a Qualtrics panel (Qualtrics) with a financial incentive provided to the respondents (the negotiated rate with Qualtrics was a little less than US $5 per respondent). Qualtrics is a highly reputed experience management company that provides a platform for survey design and execution. It maintains a panel of respondents and recruits them depending on the purpose of the survey. For our study, we sought respondents who had visited their regular health care facility and used an electronic patient portal within the last 12 months. Respondents were excluded from participating in the survey if they did not meet these 2 criteria. Regular health care facilities were defined in the survey as health care facilities (eg, primary care provider’s office and hospital) that the respondents typically visit for health care services. The survey was expected to take approximately 15 minutes to complete.

    Electronic patient portals were defined as the secure websites of the regular health care facilities that provide patients with convenient 24-hour access to their personal health information such as recent or upcoming medical visits, prescriptions, and vaccinations. Furthermore, the instructions also stated that participation in this research was anonymous and voluntary. The exclusion criteria also included respondents failing to consent to take the survey, failing to confirm that they were aged above 18 years, or failing to complete the survey. A final sample of 504 responses was obtained.

    Item Development and Expert Review

    Item development for this study began by using established measures. When the established measures could not be used or were modified to the extent that the expert review suggested that they be treated as new items, new items were established in a rigorous process (Textbox 1). Prior research has laid clear blueprints for item development for this survey [52,53]. For each new item, initial development was informed by a literature review and the close collaboration with an experienced information technology professor with experience in health care research. A panel of subject matter experts related to the topic at hand was then created, including physicians, nurses, health care administrators, and health care researchers. After gaining insight from the expert review and making adjustments, a pilot study was completed, consisting of 20 health care staff members, 9 of whom completed the survey. These results were used to modify and finalize the survey instruments. Subsequently, an additional pilot survey was conducted using 43 surveys completed by doctoral students.

    Measures and sources.

    Patient satisfaction (17 Items)

    • Adapted from [4]

    Postadoptive portal use (4 Items)

    • Adapted from [54]

    Health self-awareness (3 Items)

    • Adapted from [54]

    Gratification (3 Items)

    • Developed new items based on [38]

    Health perceptions (4 Items)

    • Adapted from [54]
    Textbox 1. Measures and sources.

    Common Method Bias

    As this study measured predictor and criterion variables using the same system, time, and source [55,56], it was necessary to test for common method bias as it increases the possibility of inflated results [55,56]. Statistical tests for common method bias [56] suggested that it may not be a significant concern in this study.

    Control Variables

    The control variables measured in this survey included age, gender, income, education, and race. We also modeled health anxiety as a control variable. Health anxiety was captured by the item I am very anxious about my health on a strongly disagree to strongly agree scale. Race was modeled as a 0-1 variable, with 1 representing Caucasian. Table 1 shows the demographic characteristics of the respondents.

    Table 1. Demographic characteristics of the respondents (N=504)a.
    CharacteristicsRespondents, n (%)
    Age (years)

    		18-2561 (12.1)

    		26-3068 (13.5)

    		31-3560 (11.9)

    		36-4061 (12.1)

    		41-4550 (9.9)

    		46-5037 (7.3)

    		51-5536 (7.1)

    		56-6032 (6.3)

    		61-6531 (6.2)

    		>6566 (13.1)
    Gender

    		Male159 (31.5)

    		Female343 (68.1)
    Education

    		Eighth grade or less15 (2.9)

    		Some high school but did not graduate115 (22.8)

    		High school graduate or General Educational Development certificate182 (36.1)

    		Some college or 2-year degree122 (24.2)

    		4-year college graduate70 (13.9)
    Income (US $)

    		≤25,000107 (21.2)

    		25,001-50,000150 (29.8)

    		50,001-75,000116 (23)

    		75,001-10,00057 (11.3)

    		100,001-125,00033 (6.5)

    		125,001-150,00014 (2.8)

    		150,001-200,00012 (2.4)

    		200,001-250,0002 (0.4)

    		>250,0006 (1.2)
    Race

    		Caucasian390 (77.4)

    		African American53 (10.5)

    		Asian12 (2.4)

    		American Indian or Alaska Native8 (1.6)

    		Native Hawaiian or Pacific Islander0 (0)

    		Mixed race7 (1.4)

    		Other26 (5.2)

    aFor each of the demographic variables, missing data constituted the remaining percentage.


    Overview

    We used SmartPLS (version 3.3.2, SmartPLS GmbH) structural equation modeling to analyze the data. The measurement model was first examined to evaluate reliability, convergent validity, and discriminant validity. The structural model was then evaluated to test the specific hypotheses. The measurement model and structural model analysis are presented below.

    Measurement Model

    Confirmatory factor analysis was performed to establish the reliability and validity of the measures [57]. The measures and loadings are presented in Table 2. Composite reliabilities were above the threshold of 0.7, and all item loadings were statistically significant and above the acceptable threshold of 0.70 [58]. Table 3 shows the validation of the measurement model for the constructs in this study.

    The diagonal elements (Table 3) show the square root of the average variance extracted (AVE). The second-order constructs were modeled in partial least squares following the procedure described in the study by Pavlou and El-Sawy [59]. The dimensions of care team interaction, instruction effectiveness, and atmosphere (Table 2) were modeled as first-order constructs. The model then calculates the path weights from the first-order constructs to the second-order constructs, and latent factor scores are calculated for each second-order construct. As each second-order construct is represented by a latent factor score and not by multiple items, the AVE for all second-order constructs is 1. The off-diagonal elements show correlations among the constructs. The AVE values were found to be greater than 0.5 [60]. This establishes the convergent validity of the constructs. The item-to-construct correlations for each construct were found to be less than the square root of the corresponding AVE, thus establishing discriminant validity [60].

    Table 2. Constructs, measures, and loadings.
    ItemIndicatorLoadingComposite reliability
    GRa,b0.951

    		GR1I feel satisfied when I receive information regarding my health via the electronic patient portal0.920

    		GR2Accomplishing health care related tasks via the electronic patient portal when it is convenient for me is satisfying (eg, scheduling appointments, checking test results, etc)0.930

    		GR3I feel satisfied about my experiences completing health care related tasks via the electronic patient portal (eg, scheduling appointments, checking test results, etc)0.941
    HSAb,c0.947

    		HSA1I have a good understanding of my health status0.947

    		HSA2I am informed regarding ideal targets for indicators of my health (eg, weight, cholesterol, blood sugar, etc)0.917

    		HSA3I am knowledgeable about my health status0.942
    PAUb,d0.915

    		PAU1Please select your usage frequency - scheduling appointments0.865

    		PAU2Please select your usage frequency - emailing my provider0.884

    		PAU3Please select your usage frequency - checking test results0.845

    		PAU4The electronic patient portal is used frequently by me0.818
    HPb,e0.924

    		HP1I lead an active and healthy life0.846

    		HP2I feel optimistic about my health0.876

    		HP3I feel satisfied with my latest health check-up results (eg, blood pressure, cholesterol, glucose levels)0.854

    		HP4In general, I am enthusiastic about my health0.891
    Care team interactionf

    		DCg0.944


    		DC1How often did providers (eg, doctors) treat you with courtesy and respect?0.918


    		DC2How often did providers (eg, doctors) listen carefully to you?0.919


    		DC3How often did providers (eg, doctors) explain things in a way you could understand?0.927

    		NCh0.936


    		NC1How often did nurses treat you with courtesy and respect?0.907


    		NC2How often did nurses listen carefully to you?0.931


    		NC3How often did nurses explain things in a way you could understand?0.897
    Atmospheref

    		CQi0.916


    		CQ1How often were public restrooms found clean?0.919


    		CQ2How often was the noise level quiet during appointments?0.919

    		SRj0.866


    		SR1How often did you get help from any staff as soon as you wanted it?0.818


    		SR2How often did you get an appointment as soon as you needed?0.858


    		SR3When contacting my typical health care facility with a question, I typically received an answer the same day0.802
    Instruction effectivenessf

    		CMk0.844


    		CM1How often did hospital staff describe possible side effects?0.810


    		CM2How often did hospital staff tell you what the medicine was for?0.864


    		CM3I clearly understood the purpose for taking each of my medications0.730

    		DIl0.910


    		DI1Staff took my preferences into account in deciding what my health care needs would be0.904


    		DI2Whenever I left my typical health care facility, I had a good understanding of the things I was responsible for in managing my health0.888


    		DI3I received information in writing summarizing the visits and describing any symptoms or health problems to look out for0.840

    aGR: gratification.

    bScale used for use frequency questions: 1=never to 7=multiple times a day; scale used for all other questions: 1=strongly disagree to 7=strongly agree.

    cHSA: health self-awareness.

    dPAU: postadoptive use.

    eHP: health perceptions.

    fPatient satisfaction dimensions: second-order constructs: scale used for “how often” questions: 1=never to 7=always; scale used for other questions: 1=strongly disagree to 7=strongly agree.

    gDC: doctor communication.

    hNC: nurse communication.

    iCQ: cleanliness and quietness.

    jSR: staff responsiveness.

    kCM: communication about medicines.

    lDI: discharge information.

    Table 3. Measurement model validationa.
    ConstructsValue, mean (SD)ATMOSbCTIcIEdGReHSAfHPgPAUh
    ATMOS5.82 (0.98)1i—j—————
    CTI6.07 (0.99)0.7761—————
    IE5.78 (1.05)0.7870.6961————
    GR5.32 (1.41)0.4530.3840.4750.930———
    HSA5.89 (1.16)0.5400.4960.5280.5150.925——
    HP5.19 (1.31)0.3980.3210.4440.3860.5200.867—
    PAU3.54 (1.47)0.076−0.0120.1480.4580.1550.2370.853

    aLatent scores of second-order constructs (atmosphere [ATMOS], care team interaction [CTI], and instruction effectiveness [IE]) are standardized scores. Hence mean and SD are 0 and 1, respectively. However, in this table, we have provided the mean and SD of all the corresponding items for ATMOS, CTI, and IE.

    bATMOS: atmosphere.

    cCTI: care team interaction.

    dIE: instruction effectiveness.

    eGR: gratification.

    fHSA: health self-awareness.

    gHP: health perceptions.

    hPAU: postadoptive use.

    iThe diagonals show the square root of the average variance extracted. Diagonal values for second-order constructs (atmosphere, care team interaction, and instruction effectiveness) are 1 because these are modeled using latent factor scores. Off-diagonal elements show correlation among the constructs.

    jNot applicable.

    Structural Model

    Figure 2 shows the structural model with all the β values and significance of the paths. Care team interaction, instruction effectiveness, and atmosphere were modeled and validated as second-order factors [59]. The items associated with the second-order construct were first checked for convergent and discriminant validity. Next, the path coefficients from the first-order constructs to the second-order constructs were checked for significance. The corresponding path coefficients were found to be significant at P<.001: doctor communication to care team interaction (β=.537); nurse communication to care team interaction (β=.523); cleanliness and quietness to atmosphere (β=.488); staff responsiveness to atmosphere (β=.633); discharge instructions to instruction effectiveness (β=.597); and communication about medicines to instruction effectiveness (β=.482). This established the second-order constructs, and the latest factor scores were obtained for each dimension of patient satisfaction. The model was then tested with all constructs and latent scores of the second-order constructs.

    ‎
    Figure 2. Structural model of influences of postadoptive use.
    View this figure

    Table 4 shows the β values and P values for each hypothesis. All hypotheses in the research model were supported. Furthermore, the Sobel test for each mediating relationship showed that all mediating influences were statistically significant (Multimedia Appendix 2 [61]). Among the control variables, numerous significant relationships were observed. Age had a significant relationship with atmosphere (β=.209; P<.001), care team interaction (β=.201; P<.001), and instruction effectiveness (β=.110; P=.006). Gender was significantly related to atmosphere (β=.091; P=.01), care team interaction (β=.088; P=.03), and instruction effectiveness (β=.088; P=.02). Race was significantly related to atmosphere (β=.088; P=.02) and instruction effectiveness (β=.091; P=.004). Education, income, and health anxiety were not significantly related to any of the dimensions.

    Table 4. Results of hypothesis testing.
    HypothesisβP value
    H1a

    		Postadoptive use to health self-awareness.155<.001
    H1b

    		Health self-awareness to care team interaction.297<.001

    		Health self-awareness to atmosphere.271<.001

    		Health self-awareness to instruction effectiveness.243<.001
    H2a

    		Postadoptive use to gratification.388<.001
    H2b

    		Gratification to care team interaction.198<.001

    		Gratification to atmosphere.248<.001

    		Gratification to instruction effectiveness.259<.001
    H3a

    		Postadoptive use to health perceptions.160<.001
    H3b

    		Health perceptions to care team interaction.122.009

    		Health perceptions to atmosphere.186<.001

    		Health perceptions to instruction effectiveness.230<.001
    H4a

    		Health self-awareness to gratification.455<.001
    H4b

    		Health self-awareness to health perceptions.495<.001

    Principal Findings

    Our findings show that patient portal use has a positive influence on the three mediators: health self-awareness, gratification, and health perceptions. Each of the 3 mediators also has positive influences on the 3 dimensions of patient satisfaction: care team interaction, atmosphere, and instruction effectiveness. This study contributes to our understanding of the influence of patient portal use on patient satisfaction in 3 distinct ways. First, this study addressed an important research question regarding the link between patient portal use and patient satisfaction [25]. This study diverged from earlier studies that have used few select items to measure patient satisfaction by using multiple dimensions of the HCAHPS measures for patient satisfaction (Multimedia Appendix 3 [14,16,28,29]). This is a novel contribution to extant research because it helps us to discern the portal use influences on the various facets of patient satisfaction. Future studies can use this conceptualization of patient satisfaction not just for patient portal use, but also for other applications.

    Second, this study extends prior work on the use of the TAM and UTAUT on patient portals and postadoptive use by highlighting the pathways through which portal use can influence patient satisfaction. We have enumerated the role played by three mediators: health self-awareness, gratification, and health perceptions. Through these mediators, this study makes novel contributions to the extant literature and practice in terms of how postadoptive use influences patient satisfaction. Notably, our study confirmed the role of health self-awareness as a critical mediator. This study used the AST as the underlying theory because it deals with technology adoption and use behaviors. However, psychological theories such as the Mere Exposure Effect [62-64] could also serve as a broader theoretical underpinning for our study. The Mere Exposure Effect as espoused in the study by Zajanc [62-64] states that a person’s familiarity with, for example, an object would make them develop a preference for it. Applied to the context of the patient portal, a patient’s familiarity with the patient portal can influence them to develop affective reactions, which can lead to patient satisfaction. In other words, efforts to design technologies that facilitate learning and knowledge acquisition can play a critical role in higher patient satisfaction scores.

    Furthermore, we defined gratification as a feeling of pleasure directly related to achieving a desired task through technology use, as informed by the Uses and Gratification Theory [38]. In an era when research has demonstrated that consumers seek computer-mediated interactions and that such use can provide gratification [40], it is not surprising to find gratification playing such a critical mediating role. Our study found that as the feeling of gratification is achieved, this affective component directly affects the patient’s satisfaction with the entire care experience, thereby expanding the Uses and Gratification Theory into the patient portal domain. As the patient portal is used extensively, ways to influence this variable seem critically important with regard to influencing patient satisfaction.

    Finally, health perceptions were found to play a key mediating role between postadoptive use and patient satisfaction. Prior studies show that health perceptions have an impact on the satisfaction variables [45,46,48]. By empirically validating the influence of patient portal use on health perceptions, this study shows that portals have the potential to allow users to feel more positive about their health. This is an interesting finding because it suggests that information on the patient portal can emotionally engage patients. Researchers and practitioners can strive to understand the nuances in health perceptions because they can lead to higher patient satisfaction scores and potentially higher reimbursement for health care providers.

    Limitations

    Despite the many significant relationships discovered in this study, it includes several limitations. We used the AST as a theoretical perspective in this study. Other theoretical perspectives such as the Mere Exposure Effect could be used in future studies to build the research model. Our study included 504 survey responses collected through a cross-sectional survey. Measuring responses through a cross-sectional survey presents concerns of common method bias because the independent and dependent variables are gathered from the same respondent at the same survey session. Although common method bias was not found to be a concern in this study, it is possible that the respondents may not have fully understood the system’s capabilities or may have overestimated or underestimated their use habits. In addition, survey respondents who participate in web-based surveys may be more technologically savvy than the general population. Some of the measures were adapted to the patient portal context, and some new items were created to measure the constructs. Although we followed a rigorous process of survey development and testing, specific follow-up to expand and generalize these definitions is needed. In this study, we adapted the HCAHPS measures used in US hospitals as the measure for patient satisfaction. As the scale used ranges from never to always, the relationship between the hypothesized constructs and patient satisfaction may be reflective of frequency-based measurement. Future studies can choose to pursue a different scale to measure patient satisfaction. Furthermore, the HCAHPS measures were adapted to suit the context of this study because we sought respondents who had visited their regular health care facility and used an electronic patient portal in the last 12 months. We acknowledge that patient satisfaction can be measured using different methods. Future studies can modify the existing measures or introduce new ways to measure patient satisfaction. We used health anxiety as a proxy for measuring the health status of the patient. Future studies can directly measure the emotional and physical health of the patient to use as control variables, taking into account the response bias with such measurements. Furthermore, this study did not include chronic disease status, health care use, digital literacy, and overall internet use as part of the analysis. Finally, a novel data collection approach that allows actual feedback of users’ habits would greatly illuminate this discussion on patient portals.

    Implications for Research

    This study presents several important opportunities for future research. First, the study of gratification has an extensive history [42,65]. This research points to a pivotal role played by gratification in mediating all 3 patient satisfaction outcome variables used in this research (care team interaction, atmosphere, and instruction effectiveness). Future work combining the Uses and Gratification Theory and other constructs such as digital self-efficacy may yield important insights and help to continue the expansion of knowledge in this area.

    Second, this research highlights the opportunity to take the validated survey results of self-reported data and determine a way to attempt a similar study using actual reports of user actions from the information systems themselves, rather than reports from patients. This could provide either strong confirmation of this study or yield important new research streams into how the cognitive and affective variables actually affect patient satisfaction and postadoptive use.

    Third, efforts to specifically facilitate or enable health self-awareness and health perceptions offer the potential to greatly expand the understanding of patient satisfaction research. Other constructs that might have an interaction effect on postadoptive use and health self-awareness, in particular, offer the potential to shed light on key variables within the nomological network of patient satisfaction.

    Implications for Practice

    Our study has several important practical implications regarding the postadoptive use of patient portals, patient perceptions, and patient satisfaction. First, our study findings clearly establish a relationship between patient portal use and patient perceptions. This implies that efforts to increase patient portal enrollment by health care systems are worthwhile, especially because portal use improves the perceptions of satisfaction with the care received. There are several ways in which hospitals are rated on care provided: HCAHPS and Net Promoter scores. Therefore, any insights into improving patient perceptions of the care received become critical.

    Second, from a logistics standpoint, this research suggests that patient portal use could reduce medical inefficiencies and wasted time for patients and providers alike. Patients can use the time saved by not having to make phone calls to follow up on tests, schedule appointments, and ask questions. Care providers can handle such requests more efficiently through these portals, thereby reducing errors. With the added benefit of improving patient perceptions of care provided, the mutual benefit would be remarkable.

    A third practitioner implication lies in the way in which the outcome variable of patient satisfaction was measured. By measuring three factors of patient satisfaction derived directly from standard HCAHPS scoring, this research was able to identify important antecedents to these outcomes, including key variables such as instruction effectiveness. Therefore, health care organizations can focus on emerging techniques to improve their instruction effectiveness, such as coordinating with web-based apps and providing short postcheckup surveys and audio or video instructions.

    Finally, given the current reality of the COVID-19 pandemic, patient portals will continue to remain a top priority for health care organizations. Our study showcases the important role played by patient portals, which enable increased exchange of health-related information without requiring face-to-face support. At this juncture, by improving the portals’ capabilities and by engaging patients to use patient portals, health care organizations can enhance health choices, improving patient satisfaction in the process.

    Conclusions

    In this study, we sought to address a key research gap in extant studies by studying the link between patient portal use and the different dimensions of patient satisfaction. We also sought to understand the influence of patient perceptions as mediators of the link between patient portal use and patient satisfaction. Our model shows that patient portal use can influence patient satisfaction through the mediating effects of gratification, health self-awareness, and health perceptions. Future research can seek to take a more nuanced perspective on the mediators highlighted in this study. Patient satisfaction is an important outcome for health care organizations. Therefore, the findings of this study can be used by health care organizations and practitioners to promote effective patient portal use and foster patient perceptions to improve patient satisfaction.

    Acknowledgments

    This study benefited from the support of the Herma Heart Institute-Children's Wisconsin, Milwaukee, Wisconsin.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Key articles on patient portal use.

    PDF File (Adobe PDF File), 61 KB
    ‎
    Multimedia Appendix 2

    Mediation analysis.

    PDF File (Adobe PDF File), 37 KB
    ‎
    Multimedia Appendix 3

    Reflective measures model.

    PDF File (Adobe PDF File), 99 KB
    1. Aljabri D, Dumitrascu A, Burton MC, White L, Khan M, Xirasagar S, et al. Patient portal adoption and use by hospitalized cancer patients: a retrospective study of its impact on adverse events, utilization, and patient satisfaction. BMC Med Inform Decis Mak 2018 Jul 27;18(1):70 [FREE Full text] [CrossRef] [Medline]
    2. Heath S. Patient portal adoption tops 90%, but strong patient use is needed. Patient Engagement HIT. 2018.   URL: https:/​/patientengagementhit.​com/​news/​patient-portal-adoption-tops-90-but-strong-patient-use-is-needed2018 [accessed 2020-09-05]
    3. Graham TA, Ali S, Avdagovska M, Ballermann M. Effects of a web-based patient portal on patient satisfaction and missed appointment rates: survey study. J Med Internet Res 2020 May 19;22(5):e17955 [FREE Full text] [CrossRef] [Medline]
    4. HCAHPS: Patients' perspectives of care survey. Centers for Medicare & Medicaid Services.   URL: https:/​/www.​cms.gov/​Medicare/​Quality-Initiatives-Patient-Assessment-Instruments/​HospitalQualityInits/​HospitalHCAHPS [accessed 2021-08-03]
    5. Portz JD, Bayliss EA, Bull S, Boxer RS, Bekelman DB, Gleason K, et al. Using the technology acceptance model to explore user experience, intent to use, and use behavior of a patient portal among older adults with multiple chronic conditions: descriptive qualitative study. J Med Internet Res 2019 Apr 08;21(4):e11604 [FREE Full text] [CrossRef] [Medline]
    6. Lin C, Wittevrongel L, Moore L, Beaty BL, Ross SE. An internet-based patient-provider communication system: randomized controlled trial. J Med Internet Res 2005 Aug 05;7(4):e47 [FREE Full text] [CrossRef] [Medline]
    7. Hassol A, Walker JM, Kidder D, Rokita K, Young D, Pierdon S, et al. Patient experiences and attitudes about access to a patient electronic health care record and linked web messaging. J Am Med Inform Assoc 2004 Nov 01;11(6):505-513. [CrossRef]
    8. Tavares J, Oliveira T. Electronic health record patient portal adoption by health care consumers: an acceptance model and survey. J Med Internet Res 2016 Mar 02;18(3):e49 [FREE Full text] [CrossRef] [Medline]
    9. Zhong X, Park J, Liang M, Shi F, Budd PR, Sprague JL, et al. Characteristics of patients using different patient portal functions and the impact on primary care service utilization and appointment adherence: retrospective observational study. J Med Internet Res 2020 Feb 25;22(2):e14410 [FREE Full text] [CrossRef] [Medline]
    10. McAlearney AS, Sieck CJ, Gaughan A, Fareed N, Volney J, Huerta TR. Patients' perceptions of portal use across care settings: qualitative study. J Med Internet Res 2019 Jun 06;21(6):e13126 [FREE Full text] [CrossRef] [Medline]
    11. Fix GM, Hogan TP, Amante DJ, McInnes DK, Nazi KM, Simon SR. Encouraging patient portal use in the patient-centered medical home: three stakeholder perspectives. J Med Internet Res 2016 Nov 22;18(11):e308 [FREE Full text] [CrossRef] [Medline]
    12. Dendere R, Slade C, Burton-Jones A, Sullivan C, Staib A, Janda M. Patient portals facilitating engagement with inpatient electronic medical records: a systematic review. J Med Internet Res 2019 Apr 11;21(4):e12779 [FREE Full text] [CrossRef] [Medline]
    13. Winstanley EL, Burtchin M, Zhang Y, Campbell P, Pahl J, Beck S, et al. Inpatient experiences with MyChart bedside. Telemed J E Health 2017 Aug;23(8):691-693 [FREE Full text] [CrossRef] [Medline]
    14. Silver RA, Subramaniam C, Stylianou A. The impact of portal satisfaction on portal use and health-seeking behavior: structural equation analysis. J Med Internet Res 2020 Mar 27;22(3):e16260 [FREE Full text] [CrossRef] [Medline]
    15. Goldzweig CL, Orshansky G, Paige NM, Towfigh AA, Haggstrom DA, Miake-Lye I, et al. Electronic patient portals: evidence on health outcomes, satisfaction, efficiency, and attitudes: a systematic review. Ann Intern Med 2013 Nov 19;159(10):677-687. [CrossRef] [Medline]
    16. Hoogenbosch B, Postma J, de Man-van Ginkel JM, Tiemessen NA, van Delden JJ, van Os-Medendorp H. Use and the users of a patient portal: cross-sectional study. J Med Internet Res 2018 Sep 17;20(9):e262 [FREE Full text] [CrossRef] [Medline]
    17. Kruse CS, Argueta DA, Lopez L, Nair A. Patient and provider attitudes toward the use of patient portals for the management of chronic disease: a systematic review. J Med Internet Res 2015;17(2):e40 [FREE Full text] [CrossRef] [Medline]
    18. Dumitrascu AG, Burton MC, Dawson NL, Thomas CS, Nordan LM, Greig HE, et al. Patient portal use and hospital outcomes. J Am Med Inform Assoc 2018 Apr 01;25(4):447-453 [FREE Full text] [CrossRef] [Medline]
    19. Al-Ramahi M, Wahbeh A, Noteboome C. Features related to patient portal user satisfaction: N-gram-based analysis of users' feedback. In: Proceedings of the 2018 ACM SIGMIS Conference on Computers and People Research. 2018 Presented at: SIGMIS-CPR '18: 2018 Computers and People Research Conference; June 18 - 20, 2018; Buffalo-Niagara Falls NY USA p. 1-152. [CrossRef]
    20. Rozenblum R, Donzé J, Hockey PM, Guzdar E, Labuzetta MA, Zimlichman E, et al. The impact of medical informatics on patient satisfaction: a USA-based literature review. Int J Med Inform 2013 Mar;82(3):141-158. [CrossRef] [Medline]
    21. Cathala N, Brillat F, Mombet A, Lobel E, Prapotnich D, Alexandre L, et al. Patient followup after radical prostatectomy by internet medical file. J Urol 2003 Dec;170(6 Pt 1):2284-2287. [CrossRef] [Medline]
    22. Noteboom C, Abdel-Rahman M. Toward actionable knowledge: a systematic analysis of mobile patient portal use. In: Wickramasinghe N, Bodendorf F, editors. Delivering Superior Health and Wellness Management with IoT and Analytics. Cham: Springer; 2019:587-602.
    23. Griffin A, Skinner A, Thornhill J, Weinberger M. Patient Portals: Who uses them? What features do they use? And do they reduce hospital readmissions? Appl Clin Inform 2017 Dec 16;07(02):489-501. [CrossRef]
    24. Ross SE, Moore LA, Earnest MA, Wittevrongel L, Lin C. Providing a web-based online medical record with electronic communication capabilities to patients with congestive heart failure: randomized trial. J Med Internet Res 2004 May 14;6(2):e12 [FREE Full text] [CrossRef] [Medline]
    25. DeSanctis G, Poole MS. Capturing the complexity in advanced technology use: adaptive structuration theory. Organ Sci 1994 May;5(2):121-147. [CrossRef]
    26. Giddens A. The Constitution of Society: Outline of the Theory of Structuration. Berkeley, California: University of California Press; 1986:1-440.
    27. Schmitz KW, Teng JT, Webb KJ. Capturing the complexity of malleable it use: adaptive structuration theory for individuals. MIS Q 2016 Mar 3;40(3):663-686. [CrossRef]
    28. Tsai T, Orav E, Jha A. Patient satisfaction and quality of surgical care in US hospitals. Ann Surg 2015 Jan;261(1):2-8 [FREE Full text] [CrossRef] [Medline]
    29. Kutney-Lee A, McHugh MD, Sloane DM, Cimiotti JP, Flynn L, Neff DF, et al. Nursing: a key to patient satisfaction. Health Aff (Millwood) 2009 Jan;28(4):669-677 [FREE Full text] [CrossRef] [Medline]
    30. Fenton JJ, Jerant AF, Bertakis KD, Franks P. The cost of satisfaction: a national study of patient satisfaction, health care utilization, expenditures, and mortality. Arch Intern Med 2012 Mar 12;172(5):405-411. [CrossRef] [Medline]
    31. Tevis SE, Kennedy GD, Kent KC. Is there a relationship between patient satisfaction and favorable surgical outcomes? Adv Surg 2015 Sep;49(1):221-233 [FREE Full text] [CrossRef] [Medline]
    32. Kahn C, Sandberg C. The next generation of measuring patient experience. Health Affairs. 2019.   URL: https://www.healthaffairs.org/do/10.1377/hblog20190307.766083/full/ [accessed 2021-08-05]
    33. Halaska C, Sachs P, Sanfilippo K, Lin C. Patient attitudes about viewing their radiology images online: preintervention survey. J Med Internet Res 2019 Jul 18;21(7):e12595 [FREE Full text] [CrossRef] [Medline]
    34. Ammenwerth E, Schnell-Inderst P, Hoerbst A. The impact of electronic patient portals on patient care: a systematic review of controlled trials. J Med Internet Res 2012 Nov 26;14(6):e162 [FREE Full text] [CrossRef] [Medline]
    35. van der Vaart R, Drossaert CH, Taal E, Drossaers-Bakker KW, Vonkeman HE, van de Laar MA. Impact of patient-accessible electronic medical records in rheumatology: use, satisfaction and effects on empowerment among patients. BMC Musculoskelet Disord 2014 Mar 26;15(1):102 [FREE Full text] [CrossRef] [Medline]
    36. Tuil WS, Verhaak CM, Braat DD, de Vries Robbé PF, Kremer JA. Empowering patients undergoing in vitro fertilization by providing Internet access to medical data. Fertil Steril 2007 Aug;88(2):361-368. [CrossRef] [Medline]
    37. Goldberg HI, Ralston JD, Hirsch IB, Hoath JI, Ahmed KI. Using an internet comanagement module to improve the quality of chronic disease care. The Joint Commission Journal on Quality and Safety 2003 Sep;29(9):443-451. [CrossRef]
    38. Ruggiero TE. Uses and gratifications theory in the 21st century. Mass Commun Soc 2000 Feb;3(1):3-37. [CrossRef]
    39. Weaver DH. Communication research in the 1990s: new directions and new agendas. In: Gaunt P, editor. Beyond Agendas: New Directions in Communication Research. Westport, CT: Greenwood Press; 1993:199-220.
    40. Cho J, De Zuniga H, Rojas H, Shah D. Beyond access: The digital divide and Internet uses and gratifications. It & Society. 2003.   URL: https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.119.5673&rep=rep1&type=pdf [accessed 2021-08-05]
    41. Grellhesl M, Punyanunt-Carter NM. Using the uses and gratifications theory to understand gratifications sought through text messaging practices of male and female undergraduate students. Comput Hum Behav 2012 Nov;28(6):2175-2181. [CrossRef]
    42. Acquisti A. Privacy in electronic commerce and the economics of immediate gratification. In: Proceedings of the 5th ACM conference on Electronic commerce. 2004 Presented at: EC04: Fifth ACM Conference on Electronic Commerce 2004; May 17 - 20, 2004; New York NY USA p. 21-29. [CrossRef]
    43. Carlston D. The Oxford Handbook of Social Cognition. Oxford, United Kingdom: Oxford University Press; 2013:1-948.
    44. Isen AM, Daubman KA, Nowicki GP. Positive affect facilitates creative problem solving. J Personal Soc Psychol 1987;52(6):1122-1131. [CrossRef]
    45. Estrada CA, Isen AM, Young MJ. Positive affect improves creative problem solving and influences reported source of practice satisfaction in physicians. Motiv Emot 1994 Dec;18(4):285-299. [CrossRef]
    46. Lyubomirsky S, King L, Diener E. The benefits of frequent positive affect: does happiness lead to success? Psychol Bull 2005 Nov;131(6):803-855. [CrossRef] [Medline]
    47. Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: toward a unified view. MIS Q 2003;27(3):425. [CrossRef]
    48. Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: The PANAS scales. J Personal Soc Psychol 1988;54(6):1063-1070. [CrossRef]
    49. Bandura A. Social cognitive theory. In: Van Lange P, Kruglanski A, Higgins E, editors. Handbook of Theories of Social Psychology. Thousand Oaks, California, United States: SAGE Publications Ltd; 2012:349-373.
    50. Zabihi R. The role of cognitive and affective factors in measures of L2 writing. Writ Commun 2017 Nov 13;35(1):32-57. [CrossRef]
    51. Pérez-Fuentes MD, Linares JJ, Jurado MD, Márquez MD, Martínez ÁM. The mediating role of cognitive and affective empathy in the relationship of mindfulness with engagement in nursing. BMC Public Health 2020 Jan 07;20(1):16 [FREE Full text] [CrossRef] [Medline]
    52. DeVellis R. Scale Development: Theory and Applications. Thousand Oaks, California, United States: SAGE Publications, Inc; 2016:1-280.
    53. Netemeyer R, Bearden W, Sharma S. Scaling Procedures: Issues and Applications. Thousand Oaks, California, United States: Sage Publications Inc; 2003:1-224.
    54. Health Information National Trends Survey (HINTS). National Cancer Institute.   URL: https://hints.cancer.gov/ [accessed 2021-08-05]
    55. Jarvis C, MacKenzie S, Podsakoff P. A critical review of construct indicators and measurement model misspecification in marketing and consumer research. J Consum Res 2003 Sep;30(2):199-218. [CrossRef]
    56. Podsakoff PM, MacKenzie SB, Lee J, Podsakoff NP. Common method biases in behavioral research: a critical review of the literature and recommended remedies. J Appl Psychol 2003 Oct;88(5):879-903. [CrossRef] [Medline]
    57. Gefen D, Straub D. A practical guide to factorial validity using PLS-Graph: tutorial and annotated example. Commun Asso Info Syst 2005;16:5. [CrossRef]
    58. Nunnally J. Psychometric Theory. New York: McGraw-Hill; 1978:1-640.
    59. Pavlou PA, El Sawy OA. From IT leveraging competence to competitive advantage in turbulent environments: the case of new product development. Info Syst Res 2006 Sep;17(3):198-227. [CrossRef]
    60. Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Mark Res 2018 Nov 28;18(1):39-50. [CrossRef]
    61. Lowry PB, Gaskin J. Partial Least Squares (PLS) Structural Equation Modeling (SEM) for building and testing behavioral causal theory: when to choose it and how to use it. IEEE Trans Profess Commun 2014 Jun;57(2):123-146. [CrossRef]
    62. Zajonc RB. Attitudinal effects of mere exposure. J Personal Soc Psychol 1968;9(2, Pt.2):1-27. [CrossRef]
    63. Zajonc R. Mere exposure: a gateway to the subliminal. Curr Dir Psychol Sci 2016 Jun 23;10(6):224-228. [CrossRef]
    64. Zajonc R. Exposure effects. In: Manstead A, Frijda N, Fischer A, editors. Feelings and Emotions: The Amsterdam Symposium. Cambridge: Cambridge University Press; 2004:194-203.
    65. Dimmick J, Kline S, Stafford L. The gratification niches of personal e-mail and the telephone. Commun Res 2016 Jun 30;27(2):227-248. [CrossRef]

    ‎
    AST: Adaptive Structuration Theory
    AVE: average variance extracted
    HCAHPS: Hospital Consumer Assessment of Healthcare Providers and Systems
    TAM: Technology Acceptance Model
    UTAUT: Unified Theory of Acceptance and Use of Technology

    Edited by R Kukafka; submitted 03.05.20; peer-reviewed by Anonymous, M Keller, S Bassett, S Bidmon; comments to author 25.05.20; revised version received 15.09.20; accepted 13.07.21; published 27.08.21

    Copyright

    ©Aaron P Kinney, Balaji Sankaranarayanan. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 27.08.2021.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.