This paper is in the following e-collection/theme issue:

Physician and Health Services Rating by Consumers (126)

Published on in Vol 22, No 6 (2020): June

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/14417, first published .
Factors Associated With the Actual Behavior and Intention of Rating Physicians on Physician Rating Websites: Cross-Sectional Study

Factors Associated With the Actual Behavior and Intention of Rating Physicians on Physician Rating Websites: Cross-Sectional Study

Factors Associated With the Actual Behavior and Intention of Rating Physicians on Physician Rating Websites: Cross-Sectional Study

Authors of this article:

Xi Han1 Author Orcid Image ;   Bei Li2 Author Orcid Image ;   Tingting Zhang3 Author Orcid Image ;   Jiabin Qu4 Author Orcid Image
Article Authors Cited by (14) Tweetations (2) Metrics

    Original Paper

    1School of Business Administration, Guangdong University of Finance & Economics, Guangzhou, China

    2School of Health Service Management, Southern Medical University, Guangzhou, China

    3School of Information Engineering, Nanjing Audit University, Nanjing, China

    4Library of Yantai University, Yantai, China

    Corresponding Author:

    Xi Han, PhD

    School of Business Administration

    Guangdong University of Finance & Economics

    Luntou Road 21

    Haizhu District

    Guangzhou, 510320

    China

    Phone: 86 13512791305

    Email: hanx015@163.com


    Background: Although online physician rating information is popular among Chinese health consumers, the limited number of reviews greatly hampers the effective usage of this information. To date, little has been discussed on the variables that influence online physician rating from the users’ perspective.

    Objective: This study aims to investigate the factors associated with the actual behavior and intention of generating online physician rating information in urban China.

    Methods: A web-based cross-sectional survey was conducted, and the valid responses of 1371 Chinese health consumers were recorded. Using a pilot interview, we analyzed the effects of demographics, health variables, cognitive variables, and technology-related variables on online physician rating information generation. Binary multivariate logistic regression, multiple linear regression, one-way analysis of variance analyses, and independent samples t test were performed to analyze the rating behavior and the intentions of the health consumers. The survey instrument was designed based on the existing literature and the pilot interview.

    Results: In this survey, 56.7% (778/1371) of the responders used online physician rating information, and 20.9% (287/1371) of the responders rated the physicians on the physician rating website at least once (posters). The actual physician rating behavior was mainly predicted by health-related factors and was significantly associated with seeking web-based physician information (odds ratio [OR] 5.548, 95% CI 3.072-10.017; P<.001), usage of web-based physician service (OR 2.771, 95% CI 1.979-3.879; P<.001), health information-seeking ability (OR 1.138, 95% CI 0.993-1.304; P=.04), serious disease development (OR 2.699, 95% CI 1.889-3.856; P<.001), good medical experience (OR 2.149, 95% CI 1.473-3.135; P<.001), altruism (OR 0.612, 95% CI 0.483-0.774; P<.001), self-efficacy (OR 1.453, 95% CI 1.182-1.787; P<.001), and trust in online physician rating information (OR 1.315, 95% CI 1.089-1.586; P=.004). Some factors influencing the intentions of the posters and nonposters rating the physicians were different, and the rating intention was mainly determined by cognitive and health-related factors. For posters, seeking web-based physician information (β=.486; P=.007), using web-based medical service (β=.420; P=.002), ability to seek health information (β=.193; P=.002), rating habits (β=.105; P=.02), altruism (β=.414; P<.001), self-efficacy (β=.102; P=.06), trust (β=.351; P<.001), and perceived ease of use (β=.275; P<.001) served as significant predictors of the rating intention. For nonposters, ability to seek health information (β=.077; P=.003), chronic disease development (β=.092; P=.06), bad medical experience (β=.047; P=.02), rating habits (β=.085; P<.001), altruism (β=.411; P<.001), self-efficacy (β=.171; P<.001), trust (β=.252; P<.001), and perceived usefulness of rating physicians (β=.109; P<.001) were significantly associated with the rating intention.

    Conclusions: We showed that different factors affected the physician rating behavior and rating intention. Health-related variables influenced the physician rating behavior, while cognitive variables were critical in the rating intentions. We have proposed some practical implications for physician rating websites and physicians to promote online physician rating information generation.

    J Med Internet Res 2020;22(6):e14417

    doi:10.2196/14417

    Keywords

    online physician rating; user-generated content; physician rating website; behavioral intention; actual behavior 


    With the development of user-generated content and prevalent use of mobile devices, some industries (ie, food service, travel, and e-commerce) have begun gathering web-based reviews, because of which many websites of these industries have now become reliable and effective [1]. The health care system has also started garnering web-based reviews, even though the development of the review platform was slow in the initial years. Similar to how people review products, health consumers can post their opinions on the health care received and have access to other patients’ opinions on the care they received from physicians. In particular, information on physician rating websites seems to play an increasingly important role in the life of health consumers and has attracted the attention of medical practitioners. A study [2] showed that in 2007, only 3%-7% of the health consumers in the United States used physician rating websites, but the proportion increased to 23% in 2012 [3], 25% in 2013 in Germany [4], 42% in 2014 in the United States [5], and 43.6% in 2016 in Germany [6]. Online physician rating information is an important factor that seems to increasingly influence a patient’s choice of medical practitioners [7]. On the contrary, physicians have always reported a negative attitude toward online physician rating information [8-10] because they fear that limited reviews could produce bias and negative web-based reviews could ruin their reputation [11,12]. Previous studies have shown the content analyses of physician rating websites in different clinical specialties [13-16], and the average number of reviews per physician was found to be low [17-19], even though the number of reviews has increased rapidly in the past few years [20]. Emmert et al [4] reported that only 11.03% of the Germans had posted ratings on a physician rating website in 2013, while this percentage increased to 23% in 2016 [6]. The limited number of reviews is the key factor that has affected the adoption of online physician rating information by both physicians and consumers. Thus, it is important to investigate the factors that predict the generation of online physician rating information from the perspective of health consumers.

    Previous studies have mainly focused on the usage of online physician rating information and the related factors. Terlutter et al [21] reported that women, young adults, and people with higher education levels or chronic diseases used physician rating websites more than their counterparts. Galizzi et al [22] found that white British people and people with high incomes were less likely to use physician rating websites. Further, female participants, widows, and those with high health care utilization showed a significantly high likelihood of being aware of physician rating websites [4]. In China, due to the promotion of the “internet + health care” strategy by the government, physician rating websites are becoming increasingly popular among urban citizens. Hao et al [23-25] conducted a content analysis of Chinese physician rating websites and identified factors that were related to physician ratings. Zhang et al [26] analyzed the negative comments on physician rating websites to identify the possible solutions for improving patient satisfaction. Li et al [27] developed a hierarchical topic taxonomy to uncover the latent structure of the physician reviews and illustrated its application in mining data on patients’ interests. Deng et al [28], Han et al [29], and Li and Hubner [30] investigated how web-based ratings and other factors influence the selection of physicians by the Chinese consumers. However, studies on physician rating websites in the Chinese context are still limited and little is known about the factors influencing the generation of online physician rating information.

    To fill this research gap, we first conducted a web-based pilot interview and recruited 30 Chinese citizens with different education levels, occupational backgrounds, and hometowns. We introduced several Chinese physician rating websites at the beginning of the interview; thereafter, the participants reported their experience of using the physician rating websites. Only 5 of the 30 participants generated online physician rating information. Finally, participants were asked why they did or did not generate online physician rating information. Following the procedure of qualitative analysis, 3 researchers transcribed and coded the data, and we finally identified the factors related to the generation of online physician rating information. These factors were divided into three dimensions, namely, health and habit-related factors (ie, usage of web-based physician service, ability to seek health information, health conditions, experience of medical service, and rating habits in the e-commerce context), cognitive factors (ie, altruism, self-efficacy, and trust in online physician rating information), and technology-related factors (ie, perceived usefulness and perceived ease of use). Cognitive factors were often reported to be associated with knowledge-sharing behavior [31], and technology-acceptance factors were often associated with system adoption [32]. The use of physician rating websites to rate physicians signifies knowledge-sharing and system-adoption behavior. In this study, we applied a similar procedure used by Terlutter et al [21], Galizzi et al [22], and Emmert et al [4] to empirically explore the significant factors that predict the actual behavior and intention of rating the physicians on the physician rating websites. The results of this study will be useful for understanding the web-based rating behavior of health consumers and for further promoting the development of physician rating websites.


    Participant Recruitment

    Since physicians in rural areas are seldom rated on physician rating websites [23], our study focused on physicians in the urban regions of China. We used the snowball sampling method to recruit participants through web-based social networking. First, we selected 160 WeChat friends with varying gender, education levels, and occupational backgrounds to complete the web-based questionnaire. Second, we requested these participants to invite friends with varying genders, education levels, and occupational backgrounds to participate in the web-based survey. In total, we received 1556 responses from September 2018 to October 2018 and from August 2019 to October 2019. Among the total number of responders, 185 were excluded from the analysis because of inconsistent answer patterns (eg, flatliners, contradictions) or because the participants tried to complete the questionnaire quickly with incomplete answers in a short span of time. Finally, this study considered the responses of 1371 valid respondents. We paid each participant 2 RMB (US $0.3) to compensate for their time.

    Questionnaire Design

    The researchers designed a survey based on the existing literature [21,22] and their pilot interview. All items, except categorical variables, were measured using a 7-point Likert scale, with the options ranging from “strongly disagree” to “strongly agree” (Multimedia Appendix 1). To ensure the validity of the scale in our questionnaire, we adopted measurement items from the existing literature and we modified some items to adapt to the online physician rating scenario based on our first pilot study with 30 Chinese citizens. We calculated the mean values of the multiple items as predictor scores after checking the measurement’s internal reliability.

    The questionnaire was created in English. One researcher translated it into Chinese, and then another researcher translated it back into English to ensure the consistency of the content. After developing the Chinese questionnaire, 3 researchers in health informatics were invited to assess the ease of understanding, logical consistencies, item sequence, and contextual relevance of the items in the questionnaire. We made some minor modifications based on their suggestions. Furthermore, a pilot test was conducted with 20 participants, and the items were modified slightly.

    Measurements

    Rating Behavior, Rating Intention, and Demographic Variables

    To ensure that the respondents understood the online physician rating system, a screenshot of a physician rating website was presented in the introductory phase before the respondents answered the questions. The actual behavior of rating a physician was assessed by asking if the respondents had rated physicians on physician rating websites previously (0=no, 1=yes). We defined participants as posters if they had rated a physician on a physician rating website at least once and we defined participants as nonposters if they had never rated a physician on the physician rating website. The intention of rating a physician was assessed using a 3-item scale adapted from the study of Ajzen [33]. This scale was found to be reliable (mean 5.064, SD 1.189; Cronbach α=.949). Additionally, data on demographic variables such as age, gender, education level, marital status, monthly income, daily internet use, and the number of vulnerable family members were also collected (Multimedia Appendix 1).

    Health and Habit-Related Variables

    The usage of web-based physician information was assessed by asking respondents if they had ever sought physician information on the internet (0=no, 1=yes). The usage of web-based physician service was assessed by asking participants if they had ever booked or consulted a physician on the internet (0=no, 1=yes). The ability to seek health information was assessed using 2 items adapted from the model developed by Richard et al [34]. The scale (mean 4.649, SD 1.350; Cronbach α=.890) assessed the participant’s ability to search for web-based health information. The health conditions of the participants or their family members were measured using the following 2 questions: “Did you or your family members develop any chronic disease in the past 2 years?” and “Did you or your family members develop any serious disease in the past 2 years?” (0=no, 1=yes). Medical experience was measured using the following questions: “I had a very good medical experience in the past 2 years” and “I had a very bad medical experience in the past 2 years” (0=no, 1=yes). In the e-commerce era, some consumers have the habit of posting reviews after performing web-based transactions, and the habit was found to be effective in the online physician rating scenario in our pilot interview. The following rating habit in the e-commerce context was assessed using an item adapted from a previous study [35]: “Rating the product after a web-based transaction has become a habit for me” (1=strongly disagree, 7=strongly agree).

    Cognitive Variables

    Altruism is a behavior intended to benefit another, even when this action may involve sacrificing one’s welfare [36]. A 3-item scale on altruism was adapted from previous studies [37,38] and applied in our pilot interview. This scale was found to be reliable (mean 5.438, SD 1.042; Cronbach α=.910). Self-efficacy refers to the belief or the estimate of an individual about his/her own ability to perform a particular task [39]. The self-efficacy scale was adapted from prior studies and applied in our pilot interview [40,41], and the scale was found to be reliable (mean 4.594, SD 1.202; Cronbach α=.770). Trust refers to a situation in which one party willingly relies on the actions of the other party [42]. The scale for trust in online physician rating information was adapted from a previous study [43], and this scale was also found to be reliable (mean 4.711, SD 1.224; Cronbach α=.885).

    Technology-Related Variables

    Perceived usefulness refers to the usefulness of using physician rating websites to rate physicians, and perceived ease of use refers to the ease of using physician rating websites to rate physicians. Based on our pilot interview and previous studies [44,45], we adapted reliable scales for perceived usefulness (mean 5.147, SD 1.162; Cronbach α=.842) and perceived ease of use (mean 4.405, SD 1.127; Cronbach α=.742).

    Data Analysis

    Data were downloaded from the web-based questionnaire database to computers in our laboratory in Nanjing University, China. Two independent research assistants examined the data and removed 185 unqualified cases. Data analyses were conducted using the SPSS 23.0 software (IBM Corp). We examined the descriptive statistics for all the variables. Since we focused on participants who were aware of physician rating websites before completing our survey, binary logistic regression analysis was performed to examine the effect of the variables on the likelihood of generating online physician rating information. Multiple linear regression, one-way analysis of variance (ANOVA), and independent samples t test (two-tailed) were performed to investigate the different factors influencing the physician rating intentions of the posters and nonposters. We applied data screening procedures to identify problematic patterns within the data set before performing linear regression. Linear relationship, multivariate normality, multicollinearity tested by variance inflation factors (VIFs), autocorrelations tested by Durbin-Watson, and homoscedasticity were tested, and we found that the data could be used for further linear regression. A bootstrapping procedure (with 5000 bootstrap samples) was used in our regression models.


    Demographic Data of the Participants

    The demographic characteristics of the participants are presented in Table 1. The age range of most of the participants was between 25 and 40 years. Out of the 1371 participants, 789 (57.6%) were women and 980 (71.5%) were married. The monthly income of 69.1% (947/1371) of the participants ranged between 3000 RMB (US $435) and 12,000 RMB (US $1740). With respect to the education level, 68.5% (939/1371) of the participants had completed college or higher level of education. Of the 1371 participants, 778 (56.7%) used online physician rating information and 287 (20.9%) rated the physicians on physician rating websites.

    Table 1. Demographic characteristics of the sample (n=1371).
    Demographic characteristicsValue, n (%）
    Age (years)

    		≤24160 (11.7)

    		25-30251 (18.3)

    		31-35278 (20.3)

    		36-40242 (17.7)

    		41-45204 (14.9)

    		≥46236 (17.2)
    Gender

    		Female789 (57.5)

    		Male582 (42.5)
    Income (RMB ¥)a

    		≤3000164 (12.0)

    		3001-6000337 (24.6)

    		6001-9000326 (23.8)

    		9001-12,000284 (20.7)

    		≥12,001260 (19.0)
    City level

    		County/bureau level337 (24.6)

    		Provincial level402 (29.3)

    		Metropolitan632 (46.1)
    Education

    		Middle school432 (31.5)

    		Undergraduate527 (38.4)

    		Postgraduate412 (30.1)
    Marital status

    		Unmarried391 (28.5)

    		Married980 (71.5)
    Children and elders

    		0240 (17.5)

    		1235 (17.1)

    		2317 (23.1)

    		3209 (15.2)

    		4178 (13.0)

    		≥5192 (14.0)
    Daily internet use

    		Tb≤3 h158 (11.5)

    		3<T≤5 h303 (22.1)

    		5<T≤7 h292 (21.3)

    		7<T≤9 h294 (21.4)

    		9<T≤11 h324 (23.6)
    Online physician rating awareness

    		Aware972 (70.9)

    		Unaware399 (29.1)
    Online physician rating usage

    		Nonusers593 (43.3)

    		Users778 (56.7)
    Online physician rating generation

    		Nonposters1084 (79.1)

    		Posters287 (20.9)

    aA currency exchange rate of RMB ¥1=US $0.14 is applicable.

    bT: Time.

    Factors Associated With the Actual Behavior of Rating Physicians on Physician Rating Websites

    We focused on participants who were aware of physician rating websites before our survey (n=972), and Table 2 and Table 3 show the results of 4 binary logistic regressions. In the first step, a binary logistic regression between having rated a physician or not (yes=1, no=0) as the criterion and demographic variables was performed (Model 1). Model 1 was significant. Age (β=.146; P=.06), monthly income (β=.197; P=.003), and education level (β=–.308; P=.02) were significantly associated with the likelihood of rating a physician on physician rating websites. However, we also noticed that Nagelkerke R2 (.041) was quite low, and –2 log-likelihood (1130.138) was high. The results indicated that demographic variables only explained a small part of the actual rating behavior.

    Then, we entered the health- and habit-related variables into regression Model 2. The model improved with a Nagelkerke R2 change of 0.238. The regression coefficients were significant for the following variables: experience of seeking physician information on the internet (β=1.713; P<.001), usage of web-based physician service (β=1.019; P<.001), ability to seek health information (β=.129; P=.04), development of serious diseases (β=.993; P<.001), and good medical experience (β=.765; P<.001). We also noticed that gender (β=.410; P=.02) and marital status (β=–.441; P=.047) were significant factors associated with the actual rating behavior, while age (β=.116; P=.16) was not significant after health-related factors were considered.

    Following Model 2, cognitive variables were entered into Model 3, which were also significant (P<.001). Furthermore, Model 3 showed a minor improvement over Model 2, with increased Nagelkerke R2 change of 0.035. The significant factors in Model 2 mentioned above were still significant. Altruism was negatively (β=–.492; P<.001) related to the likelihood of rating physicians. Self-efficacy (β=.374; P<.001) and trust in online physician rating information (β=.274; P=.004) were significantly and positively related to the likelihood of the rating behavior.

    Based on Model 3, technology-related variables were entered into Model 4. However, no improvement was observed in Nagelkerke R2 and the regression coefficients of perceived usefulness (P=.42) and perceived ease of use (P=.33) were not significant. Significant variables in Model 2 and Model 3 were also significant in Model 4.

    Besides the reliability indices mentioned above, collinearity statistics using VIF and tolerance values were tested. The results showed that VIF scores did not exceed 2.479, and tolerance values were not lower than 0.411. According to the criteria proposed by Montgomery and Peck [46] that VIF should be lower than 10 and tolerance value should be more than 0.1, our results indicated that multicollinearity was not a big concern.

    Table 2. Binary logistic regressions for online physician rating behavior (Model 1-2).

    		Model 1aModel 2b

    		βSig.cORd95% CI of ORβSig.OR95% CI of OR
    Constant–1.267.0020.293—e–3.612<.0010.027—
    Demographic variables

    		Age.146.061.1380.990-1.308.116.161.1230.954-1.322

    		Gender.190.211.2090.896-1.633.410.011.5071.076-2.110

    		Monthly income.197.0031.2181.071-1.384.183.011.2011.041-1.387

    		Marital status–.257.210.7730.518-1.155–.441.0470.6440.411-1.009

    		Number of children and elders.080.091.0840.985-1.192.042.441.0430.938-1.159

    		Education level–.308.020.7350.564-0.958–.700<.0010.4960.365-0.674

    		Daily internet use–.046.400.9550.858-1.063–.086.150.9170.815-1.033
    Health- and habit-related variables

    		Seeking physician information————1.713<.0015.5483.072-10.017

    		Usage of web-based medical service————1.019<.0012.7711.979-3.879

    		Health information seeking ability————.129.041.1380.993-1.304

    		Chronic disease————–.104.540.9010.646-1.258

    		Serious disease————.993<.0012.6991.889-3.856

    		Good medical experience————.765<.0012.1491.473-3.135

    		Bad medical experience————.267.131.3060.926-1.843

    		Rating habit————.028.591.029 0.928-1.140

    aχ2 /Sig.: 27.887 (df=7) /<.001; –2 log-likelihood: 1130.138; Nagelkerke R2: 0.041.

    bχ2 /Sig.: 210.132 (df=15) /<.001; –2 log-likelihood: 947.892; Nagelkerke R2: 0.279.

    cSig.: significance probability.

    dOR: odds ratio.

    eNot available.

    Table 3. Binary logistic regressions for online physician rating behavior (Model 3-4).

    		Model 3aModel 4b

    		βSig.cORd95% CI of ORβSig.OR95% CI of OR
    Constant–3.273<.0010.038—e–3.405<.0010.033—
    Demographic variables

    		Age.141.091.1510.976-1.359.139.101.1490.972-1.358

    		Gender.395.021.4841.053-2.092.408.021.5041.065-2.123

    		Monthly income.158.041.1711.009-1.358.161.031.1741.011-1.364

    		Marital status–.526.020.5910.373-0.937–.527.030.5900.371-0.940

    		Number of children and elders.019.731.0190.915-1.136.019.741.0190.914-1.135

    		Education level–.763<.0010.4660.338-0.643–.764<.0010.4660.337-0.645

    		Daily internet use–.068.270.9350.829-1.054–.068.270.9340.828-1.054
    Health and habit-related variables

    		Seeking physician information1.810<.0016.1133.355-11.1371.812<.0016.1213.357-11.159

    		Usage of web-based medical service.951<.0012.5891.838-3.647.939<.0012.5591.814-3.610

    		Health information seeking ability.147.041.1581.009-1.330.150.041.1621.010-1.336

    		Chronic disease–.111.520.8950.638-1.256–.117.4990.8890.633-1.249

    		Serious disease.958<.0012.6071.812-3.751.979<.0012.6621.845-3.842

    		Good medical experience.800<.0012.2271.515-3.273.788<.0012.2001.372-2.849

    		Bad medical experience.325.071.3840.971-1.971.322.071.3800.968-1.967

    		Rating habit–.070.230.9330.831-1.046–.077.200.9260.823-1.042
    Cognitive variables

    		Altruism–.492<.0010.6120.483-0.774–.437.0020.6460.489-0.853

    		Self-efficacy.374<.0011.4531.182-1.787.383.0011.4661.167-1.843

    		Trust.274.0041.3151.089-1.586.263.0071.3011.073-1.577
    Technology-related variables

    		Perceived usefulness————–.102.420.9030.703-1.160

    		Perceived ease of use————.087.331.0910.917-1.298

    aχ2 /Sig.: 240.174 (df=18) / <.001; –2 log-likelihood: 917.851; Nagelkerke R2: 0.314.

    bχ2 /Sig.: 241.789 (df=20) / <.001; –2 log-likelihood: 916.236; Nagelkerke R2: 0.316.

    cSig.: significance probability.

    dOR: odds ratio.

    eNot available.

    Predictive Factors for the Intention of Rating a Physician on Physician Rating Websites

    To investigate how the variables influence the rating intention of the participants differently, we divided the samples into 2 groups, namely, posters group and nonposters group. Using hierarchical multiple regression analyses, we tested the effects of different dimensions of the factors on the rating intention. By controlling the demographic variables, we found that health-, cognitive-, and technology-related variables explained 21.3%, 38.1%, and 5.5% of the increased variance in the rating intention of the posters and 12.8%, 48.1%, and 0.4% of the increased variance for nonposters, respectively. The VIF and tolerance values showed that multicollinearity was not a concern in any model.

    Table 4 displays the final models. For posters who rated the physicians on the physician rating websites, health and habit-related variables, that is, seeking physician information on the internet (β=.486; P=.007), using web-based medical services (β=.420; P=.002), ability to seek health information (β=.193; P=.002), and habits of ratings (β=.105; P=.02) were found to be significantly and positively related to the rating intention. The cognitive variables, that is, altruism (β=.414; P<.001), self-efficacy (β=.102; P=.06), and trust in online physician rating information (β=.351; P<.001) were also significant predictors of the rating intention. Perceived usefulness was not significantly associated with the rating intention (β=–.031; P=.63), while perceived ease of use (β=.271; P<.001) was a significant predictor.

    For nonposters who did not rate the physicians on the physician rating websites, usage of web-based medical service (β=.077; P=.003), development of chronic disease (β=.092; P=.06), bad medical experience (β=.047; P=.02), and habits of ratings (β=.085; P<.001) were found to be significantly associated with the rating intention. Similar to that observed in the posters group, altruism (β=.411; P<.001), self-efficacy (β=.171; P<.001), and trust (β=.252; P<.001) were also found to be the predictors of the rating intentions of nonposters. Since nonposters did not post web-based physician reviews, perceived ease of use (β=.017; P=.505) was not significantly associated with the rating intention, but perceived usefulness (β=.109; P=.001) was a significant predictor of the rating intention.

    Table 4. Linear regressions of the rating intentions of posters and nonposters.

    		Postersa (n=287)Nonpostersb (n=1084)

    		βSig.c95% CIβSig.95% CI
    LowerUpperLowerUpper
    Constant–.636.045–1.258–0.014.129.49–0.2380.496
    Demographic variables

    		Age–.091.03–0.172–0.010.015.51–0.0300.061

    		Gender.148.08–0.0180.313–.004.93–0.0990.090

    		Monthly income.018.64–0.0560.091–.005.80–0.0450.034

    		Marital status.004.90–0.0520.059.016.37–0.0190.050

    		Number of children and elders.180.13–0.0540.414–.063.31–0.1840.058

    		Education level–.016.56–0.0700.038–.004.81–0.0340.026

    		Daily internet use.010.89–0.1420.162–.004.93–0.0910.083
    Health- and habit-related variables

    		Seeking physician information.486.0070.1340.838–.075.14–0.1730.024

    		Usage of web-based medical service.420.0020.1570.684.030.53–0.0650.126

    		Health information seeking ability.193.0020.0710.316.077.0030.0250.128

    		Chronic disease–.013.87–0.1680.142.092.06–0.0040.188

    		Serious disease.036.65–0.1220.194.015.86–0.1560.187

    		Good medical experience–.005.96–0.2080.198.000.99–0.0940.093

    		Bad medical experience.034.68–0.1240.191.047.020.0210.232

    		Rating habit.105.020.0180.193.085<.0010.0550.114
    Cognitive variables

    		Altruism.414<.0010.2940.535.411<.0010.3490.474

    		Self-efficacy.102.061–0.0050.208.171<.0010.1160.225

    		Trust.351<.0010.2600.441.252<.0010.2020.301
    Technology-related variables

    		Perceived usefulness–.031.635–0.1590.097.109.0010.0470.171

    		Perceived ease of use.275<.0010.1990.350.017.505–0.0320.066

    aF /Sig.: 123.812 (df=20)/ <.001; Nagelkerke R2: 0.617.

    bF /Sig.: 114.296 (df=20)/ <.001; Nagelkerke R2: 0.623.

    cSig.: significance probability.

    Furthermore, we used one-way ANOVA and independent samples t test to compare the differences between posters (n=287) and nonposters (n=1084) on the rating intention and related factors. Following the suggestion by Fritz et al [47], Cohen d was used to estimate the effect size. It can be seen from Table 5 that posters had a higher level of rating intention than nonposters (t1369=5.569; P<.001). Regarding self-efficacy, the 2 groups differed as expected (t1369=5.771; P<.001), with posters ascribing higher self-efficacy than the nonposters. Table 5 also indicated that posters trusted the information on physician rating websites to a greater extent than nonposters (t1369=5.549; P<.001). The 2 groups did not differ significantly in altruism at P<.05 level (t1369=1.697; P=.09). Additionally, posters perceived higher levels of usefulness (t1369=3.020; P=.003) and ease of use (t1369=3.928; P<.001) than nonposters. With regard to the effect size, a Cohen d value of 0.2 indicated a small effect and a value of 0.5 indicated a medium effect. Thus, the effect sizes for rating intention, self-efficacy, and trust were found to be medium, while the effect sizes for perceived usefulness and perceived ease of use were found to be small.

    Table 5. Differences between posters and nonposters in the rating intention and related factors.
    VariablesPoster, mean (SD)Nonposter, mean (SD)t (df)P valueCohen d
    Rating intention5.495 (1.120)5.064 (1.189)5.569 (1369)<.0010.373
    Altruism5.556 (1.074)5.438 (1.042)1.697 (1369).090.112
    Self-efficacy5.052 (1.229)4.594 (1.202)5.771 (1369)<.0010.377
    Trust5.150 (1.058)4.711 (1.224)5.549 (1369)<.0010.358
    Perceived usefulness5.380 (1.150)5.147 (1.162)3.020 (1369).0030.202
    Perceived ease of use4.700 (1.085)4.405 (1.127)3.928 (1369)<.0010.267

    Principal Findings

    Previous studies on online physician rating information mainly focused on the usage of online physician ratings and related factors [2-4,21], and only 2 studies [4,6] have shown the proportion (11% and 23%) of people who rated the physicians on physician rating websites. Our study focused on the urban Chinese population and found that 20.9% (287/1371) of the respondents rated the physicians on physician rating websites at least once. An important aspect of our study was that we investigated the factors that predicted the actual behavior of rating the physicians on the physician rating websites. Since only 56.7% (778/1371) of the participants had used online physician rating information, we examined the effects of different factors on the rating intentions of the posters and nonposters. Our results also show that the factors affecting the actual rating behavior and rating intention were different, even though the rating behavior was positively related to the rating intention in our partial correlation analysis (r=.148; P<.001).

    Our study shows that only sociodemographic variables cannot produce a satisfying model to predict the actual behavior of rating physicians on the physician rating websites. Even though monthly income and education level were significantly correlated with the rating behavior (Model 1 in Table 2), the Nagelkerke R2 (0.041) of the logistic regression model was low. We also found that gender and marital status were significantly associated with the rating behavior when health and cognitive variables were included. The change in Nagelkerke R2 indicated that it was necessary to integrate additional health and cognitive variables to predict the rating behavior to a more satisfying extent. Health-related factors played an important role in predicting the likelihood of the rating behavior. In our study, participants with the experience of seeking physician information on the internet, who used web-based physician service, and who had higher ability to seek health information were more prone to rate physicians on the physician rating websites. Since there have been incidents of poor physician-patient relationships and severe cases of vicious attacks on medical professionals particularly in China [48], many health consumers choose to check physician information on the internet and seek web-based health information to avoid unpleasant medical experiences. Seeking web-based health information increased their awareness of the online physician rating information and motivated them to rate physicians. Development of serious diseases and good medical experience were also predictors of the rating behavior. This result corroborated that of previous studies that showed a large number of positive reviews on physician rating websites [49-52]. Further, altruism was negatively related to the rating behavior, indicating that egoistic motivation played a role, and nonposters showed exaggerated level of altruism in their behavior of generating online physician rating information. Self-efficacy reflects an optimistic self-belief that one can perform a task, and it was found to be positively related to the rating behavior. In a web-based context, trust is always a big concern, and it was found to be positively related to the usage of online physician rating information [21]. In our study, trust in online physician rating information was also positively related to the rating behavior. However, as most participants had not used physician rating websites, perceived usefulness and perceived ease of use were not significantly associated with the rating behavior.

    Regarding the rating intention, cognitive factors explained the largest variance in the rating intention, and factors influencing the rating intention of posters and nonposters were different. The common factors were health information-seeking ability, rating habit, altruism, self-efficacy, and trust in online physician rating information. However, most health- and technology-related variables that predicted the rating intentions of the posters and nonposters were different. For health-related variables, the rating intention of the posters was mainly predicted by the usage of web-based health information or service, while the rating intention of the nonposters was associated with the health status and medical experience. Although the results in Table 2 indicated that serious disease development and good medical experience predicted the actual rating behavior, our linear regression model demonstrated that chronic disease and bad medical experience were associated with the rating intentions of the nonposters after they became aware of physician rating websites. Additionally, perceived usefulness was associated with the rating intention of the nonposters and perceived ease of use was associated with the rating intention of the posters. Further, we noticed that the posters judged the rating intention, altruism, trust in online physician rating information, perceived usefulness, and perceived ease of use higher than the nonposters.

    Practical Implications

    Based on the results in our study, we have some recommendations for physician rating websites and physicians who are the stakeholders of online physician rating information generation. Commercial physician rating websites are the main sources for health consumers to access online physician rating information; thus, a large amount of online physician rating information is necessary and critical for the development of physician rating websites. Large amount of online physician rating information can be generated as follows. First, physician rating websites need to cooperate with widely used search engines and social media to increase the awareness of these websites among health consumers, since our results indicated that many consumers were unaware of these websites, and usage of web-based physician information could improve online physician rating information generation behavior and rating intention. Although Chinese physician rating websites have provided services for many years and are top-ranked in the search engine results page, most health consumers are still unfamiliar with these physician rating websites and are uncertain about their reliability. Second, physician rating websites need to cooperate with hospitals officially. Health consumers have high levels of trust in public hospitals. Thus, cooperation with hospitals would enhance consumers’ trust and improve the usability of commercial physician rating websites. Our findings suggested that trust was positively related to the physician rating behavior and intention. In fact, reviews on some physician rating websites in China increased greatly after physician rating websites provided booking services for hospitals. These physician rating websites are becoming increasingly popular among health consumers in cities. Third, physician rating websites must provide additional incentives for health consumers to generate online physician rating information. Knowledge sharing is an altruistic behavior. However, our results indicated altruism to be negatively related to the actual rating behavior. Egoism may play an important role in the actual rating behavior. Thus, a better incentive mechanism is needed for attracting health consumers to rate physicians on the physician rating websites. Fourth, physician rating websites need to cooperate with physicians and provide web-based medical services, besides online physician rating information. In the past 2 years, many physicians in China have begun to use physician rating websites to provide web-based medical services, which have greatly increased the number of reviews and the usability of these websites.

    The results of our study could also be interesting for physicians. Online physician rating information is important for physicians to boost their reputation and to enjoy success in their careers. Thus, physicians need to actively encourage patients to generate online physician ratings by performing the following measures. First, physicians should be concerned about patients’ medical experiences. We found that good medical experience predicted the actual behavior of rating the physician on the physician rating websites. This finding is consistent with that reported in previous studies that showed positive reviews for physicians [20,48]. Physicians need not worry about negative reviews ruining their reputation, even though a bad medical experience was positively related to the rating intention of nonposters. Physicians are encouraged to show empathy to their patients, who may consequently provide positive reviews about them. Second, physicians should recommend physician rating websites to their patients and encourage them to provide online physician ratings after receiving the medical service. Physician recommendations would increase patients’ trust in online physician rating information and directly lead to the generation of more reviews. Even though it is embarrassing to be rated by patients, physicians should accept that online physician rating information could lead to their medical service improvement.

    Limitations and Future Direction

    This study has some limitations. First, we used a snowball sampling method and focused on well-educated people who were younger than 46 years in China. There is a possibility of selection bias among respondents, even though they are the potential online physician rating information users. Thus, a large randomized sample would certainly be desirable in future studies. Second, we only tested the altruistic motivation, which was found to be negatively related to the rating behavior. Future studies should analyze how egoistic motivation directly affects the rating behavior. Third, we did not differentiate people with bad medical experience from people with good medical experience. Medical experience could be an interesting variable to focus on, considering the special patient-physician relationship in China. Researchers should explore if the kind of medical experience has nuanced the effect on the intention to post online physician rating information with regard to the unsatisfying physician-patient relationships in China. Finally, factors influencing the actual behavior and intention of rating physicians were quite different in our study. Since many participants were unaware of physician rating websites before our survey, it would be better to examine how these factors affect their actual rating behavior. Even though the intention is predictive of future behavior, the self-reported intention might be exaggerated. A long-term follow-up study is needed in the future to investigate how different factors affect the actual rating behavior after health consumers become aware of the online physician rating information.

    Conclusion

    Since the limited number of web-based reviews greatly hampers the effective usage of physician rating information, it is important to discuss the variables that influence the generation of physician rating information from the health consumer’s perspective. Our cross-sectional study shows that factors affecting the physician rating behavior and rating intention are different. We found that health-related variables influenced the physician rating behavior while cognitive variables were critical in the rating intentions. Based on our findings, we have provided some practical suggestions for physician rating websites and physicians to promote the generation of online physician rating information.

    Acknowledgments

    The research was supported by the Philosophy and Social Science Foundation of the Guangdong Province (GD19YTS01), MOE (Ministry of Education in China) Project of Humanities and Social Sciences (20YJCZH039), Guangdong Basic and Applied Basic Research Joint Foundation (2019A1515110347), and Guangzhou Philosophy and Social Sciences Foundation (2020GZQN38). We sincerely appreciate the research participants in this study. We also thank the editors and the anonymous reviewers for their thoughtful comments and constructive suggestions during the review process.

    Authors' Contributions

    XH was the project leader and a major contributor to drafting the manuscript. BL was responsible for data collection and was another major contributor to drafting the manuscript. TZ and JQ were responsible for data collection and data analysis. All authors read and approved the final manuscript.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Survey questionnaire.

    DOCX File , 360 KB
    1. Pasternak A, Scherger J. Online reviews of physicians: what are your patients posting about you? Fam Pract Manag 2009;16(3):9-11 [FREE Full text] [Medline]
    2. Tu H, Lauer J. Word of mouth and physician referrals still drive health care provider choice. Res Brief 2008 Dec(9):1-8. [Medline]
    3. Hanauer DA, Zheng K, Singer DC, Gebremariam A, Davis MM. Public awareness, perception, and use of online physician rating sites. JAMA 2014 Feb 19;311(7):734-735. [CrossRef] [Medline]
    4. Emmert M, Meier F, Pisch F, Sander U. Physician Choice Making and Characteristics Associated With Using Physician-Rating Websites: Cross-Sectional Study. J Med Internet Res 2013 Aug 28;15(8):e187. [CrossRef]
    5. Leslie J. Software Advice. 2014 Nov 19. Patient Use of Online Reviews   URL: http://www.softwareadvice.com/medical/industryview/online-reviews-report-2014/ [accessed 2019-04-23]
    6. McLennan S, Strech D, Meyer A, Kahrass H. Public Awareness and Use of German Physician Ratings Websites: Cross-Sectional Survey of Four North German Cities. J Med Internet Res 2017 Nov 09;19(11):e387. [CrossRef]
    7. McBride DL. Parental use of online physician rating sites. J Pediatr Nurs 2015;30(1):268-269. [CrossRef] [Medline]
    8. Wangler J, Jansky M. How Family Practitioners Judge Physician Rating Websites - Assessments, Experiences, Effects. ZFA 2017;93(5):216-220. [CrossRef]
    9. Samora JB, Lifchez SD, Blazar PE, American Society for Surgery of the Hand EthicsProfessionalism Committee. Physician-Rating Web Sites: Ethical Implications. J Hand Surg Am 2016 Jan;41(1):104-110.e1. [CrossRef] [Medline]
    10. Holliday AM, Kachalia A, Meyer GS, Sequist TD. Physician and Patient Views on Public Physician Rating Websites: A Cross-Sectional Study. J GEN INTERN MED 2017 Feb 1;32(6):626-631. [CrossRef] [Medline]
    11. Gordon HS. Consider Embracing the Reviews from Physician Rating Websites. J Gen Intern Med 2017 Jun;32(6):599-600 [FREE Full text] [CrossRef] [Medline]
    12. Ellimoottil C, Leichtle S, Wright C, Fakhro A, Arrington A, Chirichella T, et al. Online physician reviews: the good, the bad and the ugly. Bull Am Coll Surg 2013 Sep;98(9):34-39. [Medline]
    13. McLennan S. Quantitative Ratings and Narrative Comments on Swiss Physician Rating Websites: Frequency Analysis. J Med Internet Res 2019 Jul 26;21(7):e13816 [FREE Full text] [CrossRef] [Medline]
    14. Liu J, Hou S, Evans R, Xia C, Xia W, Ma J. What Do Patients Complain About Online: A Systematic Review and Taxonomy Framework Based on Patient Centeredness. J Med Internet Res 2019 Aug 07;21(8):e14634 [FREE Full text] [CrossRef] [Medline]
    15. Hong YA, Liang C, Radcliff TA, Wigfall LT, Street RL. What Do Patients Say About Doctors Online? A Systematic Review of Studies on Patient Online Reviews. J Med Internet Res 2019 Apr 8;21(4):e12521. [CrossRef]
    16. Pike CW, Zillioux J, Rapp D. Online Ratings of Urologists: Comprehensive Analysis. J Med Internet Res 2019 Jul 02;21(7):e12436 [FREE Full text] [CrossRef] [Medline]
    17. Kirkpatrick W, Abboudi J, Kim N, Medina J, Maltenfort M, Seigerman D, et al. An Assessment of Online Reviews of Hand Surgeons. Arch Bone Jt Surg 2017 May;5(3):139-144 [FREE Full text] [Medline]
    18. Okike K, Peter-Bibb TK, Xie KC, Okike ON. Association Between Physician Online Rating and Quality of Care. J Med Internet Res 2016 Dec 13;18(12):e324 [FREE Full text] [CrossRef] [Medline]
    19. Lagu T, Metayer K, Moran M, Ortiz L, Priya A, Goff SL, et al. Website Characteristics and Physician Reviews on Commercial Physician-Rating Websites. JAMA 2017 Feb 21;317(7):766-768 [FREE Full text] [CrossRef] [Medline]
    20. Emmert M, Halling F, Meier F. Evaluations of dentists on a German physician rating Website: an analysis of the ratings. J Med Internet Res 2015 Jan 12;17(1):e15 [FREE Full text] [CrossRef] [Medline]
    21. Terlutter R, Bidmon S, Röttl J. Who uses physician-rating websites? Differences in sociodemographic variables, psychographic variables, and health status of users and nonusers of physician-rating websites. J Med Internet Res 2014 Mar 31;16(3):e97 [FREE Full text] [CrossRef] [Medline]
    22. Galizzi MM, Miraldo M, Stavropoulou C, Desai M, Jayatunga W, Joshi M, et al. Who is more likely to use doctor-rating websites, and why? A cross-sectional study in London. BMJ Open 2012;2(6):e001493 [FREE Full text] [CrossRef] [Medline]
    23. Hao H. The development of online doctor reviews in China: an analysis of the largest online doctor review website in China. J Med Internet Res 2015 Jun 01;17(6):e134 [FREE Full text] [CrossRef] [Medline]
    24. Hao H, Zhang K. The Voice of Chinese Health Consumers: A Text Mining Approach to Web-Based Physician Reviews. J Med Internet Res 2016 May 10;18(5):e108 [FREE Full text] [CrossRef] [Medline]
    25. Hao H, Zhang K, Wang W, Gao G. A tale of two countries: International comparison of online doctor reviews between China and the United States. Int J Med Inform 2017 Mar;99:37-44. [CrossRef]
    26. Zhang W, Deng Z, Hong Z, Evans R, Ma J, Zhang H. Unhappy Patients Are Not Alike: Content Analysis of the Negative Comments from China's Good Doctor Website. J Med Internet Res 2018 Jan 25;20(1):e35 [FREE Full text] [CrossRef] [Medline]
    27. Li J, Liu M, Li X, Liu X, Liu J. Developing Embedded Taxonomy and Mining Patients' Interests From Web-Based Physician Reviews: Mixed-Methods Approach. J Med Internet Res 2018 Aug 16;20(8):e254 [FREE Full text] [CrossRef] [Medline]
    28. Deng Z, Hong Z, Zhang W, Evans R, Chen Y. The Effect of Online Effort and Reputation of Physicians on Patients' Choice: 3-Wave Data Analysis of China's Good Doctor Website. J Med Internet Res 2019 Mar 08;21(3):e10170 [FREE Full text] [CrossRef] [Medline]
    29. Han X, Qu J, Zhang T. Exploring the impact of review valence, disease risk, and trust on patient choice based on online physician reviews. Telemat Informatics 2019 Dec;45:101276. [CrossRef]
    30. Li S, Hubner A. The Impact of Web-Based Ratings on Patient Choice of a Primary Care Physician Versus a Specialist: Randomized Controlled Experiment. J Med Internet Res 2019 Jun 28;21(6):e11188 [FREE Full text] [CrossRef] [Medline]
    31. Ma WW, Chan A. Knowledge sharing and social media: Altruism, perceived online attachment motivation, and perceived online relationship commitment. Comput Human Behav 2014 Oct;39:51-58. [CrossRef]
    32. Szajna B. Software Evaluation and Choice: Predictive Validation of the Technology Acceptance Instrument. MIS Q 1994 Sep;18(3):319-324. [CrossRef]
    33. Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process 1991 Dec;50(2):179-211. [CrossRef]
    34. Richard M, Chebat J, Yang Z, Putrevu S. A proposed model of online consumer behavior: Assessing the role of gender. J Bus Res 2010 Sep;63(9-10):926-934. [CrossRef]
    35. Shiau W, Luo MM. Continuance intention of blog users: the impact of perceived enjoyment, habit, user involvement and blogging time. Behav Inf Technol 2013 Jun;32(6):570-583. [CrossRef]
    36. Harris J. Altruism: Should it be Included as an Attribute of Medical Professionalism? Heal Prof Educ 2018 Mar;4(1):3-8. [CrossRef]
    37. Zhang X, Liu S, Deng Z, Chen X. Knowledge sharing motivations in online health communities: A comparative study of health professionals and normal users. Comput Human Behav 2017 Oct;75:797-810. [CrossRef]
    38. Chang HH, Chuang S. Social capital and individual motivations on knowledge sharing: Participant involvement as a moderator. Inf Manag 2011 Jan;48(1):9-18. [CrossRef]
    39. Bandura A. Self-efficacy: Toward a unifying theory of behavioral change. Adv Behav Res Ther 1978 Jan;1(4):139-161. [CrossRef]
    40. Zhang X, de Pablos PO, Xu Q. Culture effects on the knowledge sharing in multi-national virtual classes: A mixed method. Comput Human Behav 2014 Feb;31:491-498. [CrossRef]
    41. Tamjidyamcholo A, Bin Baba MS, Tamjid H, Gholipour R. Information security – Professional perceptions of knowledge-sharing intention under self-efficacy, trust, reciprocity, and shared-language. Comput Educ 2013 Oct;68:223-232. [CrossRef]
    42. Mayer RC, Davis JH, Schoorman FD. An Integrative Model Of Organizational Trust. AMR 1995 Jul;20(3):709-734. [CrossRef]
    43. Sparks BA, Browning V. The impact of online reviews on hotel booking intentions and perception of trust. Tour Manag 2011 Dec;32(6):1310-1323. [CrossRef]
    44. Karahanna E, Straub DW. The psychological origins of perceived usefulness and ease-of-use. Inf Manag 1999 Apr;35(4):237-250. [CrossRef]
    45. Davis FD. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Q 1989 Sep;13(3):319. [CrossRef]
    46. Montgomery DC, Peck EA, Vining G. Introduction to Linear Regression Analysis. New York: Wiley-Interscience; Feb 26, 2007:323-341.
    47. Fritz CO, Morris PE, Richler JJ. Effect size estimates: Current use, calculations, and interpretation. J Exp Psychol Gen 2012;141(1):2-18. [CrossRef]
    48. The Lancet. Protecting Chinese doctors. The Lancet 2020 Jan;395(10218):90. [CrossRef]
    49. Emmert M, Meier F. An analysis of online evaluations on a physician rating website: evidence from a German public reporting instrument. J Med Internet Res 2013 Aug 06;15(8):e157 [FREE Full text] [CrossRef] [Medline]
    50. Emmert M, Sander U, Esslinger AS, Maryschok M, Schöffski O. Public Reporting in Germany: the Content of Physician Rating Websites. Methods Inf Med 2018 Jan 19;51(02):112-120. [CrossRef]
    51. Ellimoottil C, Hart A, Greco K, Quek ML, Farooq A. Online Reviews of 500 Urologists. J Urol 2013 Jun;189(6):2269-2273. [CrossRef]
    52. Lagu T, Hannon NS, Rothberg MB, Lindenauer PK. Patients' evaluations of health care providers in the era of social networking: an analysis of physician-rating websites. J Gen Intern Med 2010 Sep;25(9):942-946 [FREE Full text] [CrossRef] [Medline]

    ‎
    ANOVA: analysis of variance
    VIF: variance inflation factor

    Edited by G Eysenbach; submitted 17.04.19; peer-reviewed by M Duplaga, S Bidmon; comments to author 03.10.19; revised version received 17.12.19; accepted 29.03.20; published 04.06.20

    Copyright

    ©Xi Han, Bei Li, Tingting Zhang, Jiabin Qu. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 04.06.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.