Original Paper
Abstract
Background: Although online health communities are acknowledged for their role in bridging the supply-demand gap in mental health services, the client decision-making process in these environments remains underexplored.
Objective: This study aimed to explore the impact of different signals presented on psychological counselors’ home pages on clients’ choices.
Methods: Adopting signaling theory as the framework, this study classified information into online and offline signals and developed a theoretical model to examine client choice behaviors. We collected data from 487 psychological counselors in a leading Chinese online mental health community during March, June, September, and December 2023. Based on these data, we constructed a 4-period balanced panel dataset. A fixed effects model was used to analyze which signals influence clients’ choices of psychological counselors.
Results: Regarding online signals, the service price (β=0.186, P<.001) and online reputation (β=0.489, P=.002) of psychological counselors positively influence clients’ choices. Concerning offline signals, psychological counselors’ practical experience (β=0.007, P<.001) is positively related to clients’ choices. Moreover, the results indicate that the relationship between a counselor’s prosocial behavior and clients’ choices is not linear but rather exhibits an inverted U-shape.
Conclusions: This study reveals that the varied information provided by psychological counselors has distinct impacts on clients’ choices in online health communities. It broadens the application of signaling theory to online behaviors and emphasizes the importance of both online and offline signals. These insights offer strategic guidance for counselors and online platforms to better meet potential clients’ needs by optimizing the information presented on psychological counselors’ home pages.
doi:10.2196/58428
Keywords
Introduction
Background
Mental health constitutes a fundamental aspect of overall health and is recognized as a basic human right [
]. According to a report from the World Health Organization (WHO), an estimated 970 million people worldwide have mental disorders, such as depression, anxiety, and eating disorders, creating a substantial demand for mental health services [ ]. However, nearly half of the global population resided in countries where there was only 1 psychiatrist available for every 200,000 individuals or more [ ]. The severe imbalance between the supply and demand for mental health professionals poses a significant challenge to global public health.The development of Web 2.0 has facilitated the emergence of online health communities (OHCs), greatly bridging the accessibility gap in mental health services [
]. These platforms serve as a novel channel for individuals to access information and emotional support [ ], aligning with the delivery of mental health services. First, compared to physical diseases, mental health issues are less tangible and can often be mitigated through psychological counseling [ , ]. Online counseling, a central component of OHCs, uses video, voice, and text to overcome geographical and temporal barriers [ ], thereby enhancing the accessibility of mental health services. Second, the societal stigma associated with mental health issues may cause individuals to avoid professional health services or hesitate to seek help [ ]. Online counseling presents an advantage in this context by ensuring anonymity, enabling individuals to undergo counseling privately without the fear of recognition by acquaintances.OHCs for mental health have been increasingly acknowledged and used, especially in emerging economies like China, where medical resources are limited but internet access is prevalent [
]. In recent years, driven by a significant increase in demand, OHCs for psychological counseling in China have experienced rapid development. According to the China Internet Network Information Center, by the end of 2023, the number of internet users in China had exceeded 1 billion, providing a solid foundation for the promotion of OHC services [ ]. Moreover, the cultural background and social structure in China differ from those in Western countries, which may influence the acceptance and implementation of online psychological counseling [ ]. For example, mental health issues carry a significant stigma in Chinese society, making the anonymity of online counseling more appealing [ ]. In addition, mental health resources in China are unevenly distributed, particularly in rural and remote areas where these resources are scarce [ ]. The advancement of internet technology has enabled OHCs to provide convenient mental health services to residents in these areas, making them particularly relevant in the Chinese context [ ]. Thus, choosing China as the focus of this study not only helps to reveal unique phenomena in the field of OHCs in China but also provides experience and references for the global development of online psychological counseling.Unlike offline services, online services frequently occur between parties lacking any prior transaction history [
]. This absence of prior interaction usually leaves consumers without the opportunity to evaluate or trial the service, thereby compelling them to assume the “risk of prior performance” [ ]. In the health care sector, information asymmetry is more marked: whereas health professionals understand the characteristics of their services, consumers possess limited insight [ ]. Therefore, the decision-making processes of individuals in selecting among numerous online psychological counselors have become a critical issue. Signaling theory provides a theoretical framework for understanding this information asymmetry and suggests potential solutions [ ]. According to signaling theory, information asymmetry can be mitigated when the parties with more information share some signals with the other parties, and the recipient of these signals can interpret them and adjust their behavior accordingly [ ]. Within the environment of OHCs, health care providers disclose information to potential users, such as price and reputation, and people can use this information to make what they perceive to be the appropriate choice for their situations [ ].Objective
Existing research has demonstrated the positive impact of online psychological counseling. For example, studies have shown that online counseling can significantly improve clients’ emotional and behavioral issues [
, - ]. However, little research addresses the decision-making process clients undergo when selecting online counselors. At the same time, although previous studies have demonstrated that online information in OHCs can influence consumer choices, few have applied signaling theory to online psychological counseling. In addition, given that OHCs cover a wide range of diseases, the needs and preferences of signal receivers may vary [ ]. Therefore, the research question for this study is as follows: What factors influence clients’ choice of counselors in OHCs? To answer this question, this paper constructs a theoretical model based on signaling theory. Furthermore, we chose to study both online and offline signals to systematically identify the factors that influence clients’ choices of online psychological counselors.Research Framework and Hypothesis Development
Signaling Theory
Signaling theory aims to reduce information asymmetries among different parties across varied socioeconomic contexts [
]. This theoretical framework is composed of 3 core elements: the signaler (service provider), the receiver (consumer), and the signal itself [ ]. In the context of the online service market, signals are divided into online and offline categories, thereby providing a mechanism for users to evaluate service quality [ ]. Online signals originate from virtual consultation–based platforms, including factors like price [ ], prosocial behaviors [ , ], and online reputation [ , ]. Offline signals derive from sellers’ attributes [ ], such as professional titles [ , ], practical experience [ ], and education level [ ].Within OHCs, the disparity in knowledge between professionals and clients is profound, making signaling particularly vital [
]. Research has demonstrated the impact of different signals on clients in OHCs. For instance, Deng et al [ ] found that online effort and reputation of physicians greatly influence patients’ decisions on the Good Doctor website. Hsu et al [ ] observed that the offline promotion of physicians positively affects patient choices in OHCs and leads them to give higher online ratings. Moreover, Zhang et al [ ] found that physicians’ offline expertise negatively affects user adoption decisions, while online experience has a positive impact. This study builds on existing research by applying signaling theory to the context of psychological counseling within OHCs, examining how different signals drive clients’ choices in online mental health services.Price
In the framework of signaling theory, price is regarded as a crucial signal of product quality, particularly for intangible services such as health care [
]. Unlike traditional health care services with pricing set by institutions or governments, OHCs allow psychological counselors to set their service prices [ ]. This market-driven pricing strategy helps eliminate less competent providers, encouraging the rest to enhance their service quality [ ].Consumers often struggle to assess service quality and rely on price as a quality indicator [
] due to a prevalent belief in market economies that associates high prices with superior quality and greater consumption value. Numerous studies show that despite viewing price as a sacrifice, consumers tend to pay more for what they deem reasonable pricing, especially when purchasing intangible services that are costly, infrequently bought, and require complex decision-making [ , , ]. Therefore, we propose the following hypothesis:- H1: The psychological counselors’ service price is positively related to clients’ choices.
Prosocial Behavior
Prosocial behavior, also known as altruism, refers to actions that align with societal expectations, where the performer willingly engages in these behaviors despite lacking apparent personal benefits [
- ]. Health professionals’ prosocial behavior can manifest through diverse actions, such as providing free answers to patients’ questions, sharing knowledge articles, and transparently sharing diagnostic and treatment details [ ]. These behaviors influence doctor-patient trust [ , ], financial rewards [ , ], and patient satisfaction, among other outcomes [ , ].Previous research suggests that it is unlikely for a psychological counselor’s prosocial behavior to have a consistent linear relationship with clients’ selection criteria [
]. In this study, excessive prosocial behavior refers to situations where the counselor’s actions exceed typical expectations of helpfulness and altruism, potentially leading clients to question the genuineness and motives behind these behaviors. In other words, when a counselor exhibits such excessive prosocial behavior, clients may doubt the intent and authenticity of these actions. This is consistent with the signaling theory, which posits that signals intended to convey quality or trustworthiness can lose their effectiveness if perceived as exaggerated or insincere. For example, clients might doubt whether the prosocial behavior displayed on the website is genuine or if it serves as a marketing strategy [ ]. Consequently, we propose the following hypothesis:- H2: There exists a reverted U-shaped relationship between psychological counselors’ prosocial behavior and clients’ choices.
Online Reputation
Online reputation is a complex and dynamic concept that reflects the past behavior of individuals or organizations [
, ]. It empowers consumers to peruse and assess the experiences and reviews of others, thereby enhancing their ability to accurately ascertain the quality of a product or service [ , ]. Online reputation appears in many forms, including product or service ratings, reviews, testimonials, and records of the seller’s transaction history and performance [ ].Research has confirmed that the online reputation of individuals and organizations significantly influences consumer purchasing behavior [
, ]. Given the complexity and professionalism of health information, consumers often rely on others’ experiences and evaluations when making decisions [ ]. Therefore, we propose the following hypothesis:- H3: The psychological counselors’ online reputation is positively related to clients’ choices.
Psychological Counselor’s Characteristics
In traditional health care environments, clients typically evaluate a service provider’s professional competence and technical skills based on personal characteristics such as professional titles, education level, and practical experience [
- ].First, from the consumer’s perspective, a service provider’s professional titles often endorse their professionalism [
]. In situations with information asymmetry, the professional titles granted by authoritative organizations are considered a reliable competence indicator. Second, management studies have shown that experience is crucial for improving work effectiveness and customer satisfaction [ ]. Therefore, practical experience reflects a psychological counselor’s competence, as longer tenure often indicates better problem-solving abilities. Finally, education significantly influences clients’ choices of psychological counselors. As mental health is interdisciplinary, higher-educated counselors are perceived as more adept at handling complex psychological issues. Therefore, we propose the following hypothesis:- H4a: The psychological counselors’ professional titles are positively related to clients’ choices.
- H4b: The psychological counselors’ practical experience is positively related to clients’ choices.
- H4c: The psychological counselors’ education level is positively related to clients’ choices.
Based on the above assumptions, we construct a research model, as shown in
.Methods
Research Context
We selected YiDianLing as our data sampling community for several reasons. First, YiDianLing is one of the largest OHCs in China dedicated to mental health, with approximately 39 million registered users and 42,000 resident professional psychological counselors. This extensive user base ensures a diverse and comprehensive dataset, which increases the generalizability of the results. Second, the platform’s services are available nationwide, providing a broad geographic representation of clients and counselors from different regions across China. This geographic diversity further enhances the generalizability of our study’s findings within the context of the Chinese mental health landscape. Third, YiDianLing offers both chargeable services and free consultations, providing data to support our research on the prosocial behavior of psychological counselors. Fourth, YiDianLing maintains high certification standards for mental health service providers. All applicants must submit relevant offline information, and only those who meet the platform’s certification criteria can establish their home pages. This ensures the reliability and professionalism of the counselors included in the study. Fifth, psychological counselors registered on YiDianLing have personal home pages that contain quantitative data relevant to this study, such as the total number of consultations, service price, and free consultations.
and provide detailed views of a counselor’s home page. Therefore, YiDianLing provides a robust and reliable data source that aligns well with the objectives of our research.Data Collection
We developed a web crawler program to collect information from the personal home pages of psychological counselors on YiDianLing. Although there are many registered counselors on YiDianLing, the platform only showcases approximately the top 1000 active counselors. To ensure the representativeness of our study subjects, we used a 3-step selection process. First, the counselors must have provided services to at least 1 client on the platform. Second, these counselors must have available services for booking within the next 5 days to confirm their active status on the platform. Finally, their information on the home pages had to be complete and include all the target data for our research. Based on these criteria, we initially identified 667 counselors on the YiDianLing platform as our research sample.
To further ensure the validity of the sample data, we collected profile information of the same counselors at 4 different time points (March, June, September, and December 2023). This phased data collection method allowed us to account for potential time-related effects. It enabled us to capture a more comprehensive picture of user behavior and service demand dynamics, avoiding the randomness and partiality associated with data from a single time point.
Following data collection, we conducted comprehensive data cleaning and preprocessing to eliminate missing and duplicate data. Ultimately, we reduced the initial sample of 667 counselors to 487 psychological counselors as the final sample. We used this final sample to create a balanced 4-period panel dataset.
Ethical Considerations
The data for this study were sourced from publicly accessible information available to all users of the online platform. We did not collect any personal information about the clients and anonymized data about counselors. The study was approved by the Ethics Committee of Tongji Medical College of Huazhong University of Science & Technology (IORG0003571).
Variables
Dependent Variable: Clients’ Choices
We measured clients’ choices by the total number of consultations per counselor. This variable was selected as it serves as a robust indicator of clients’ choices of counselors. Specifically, if a counselor has a high total number of consultations, this may indicate that they have a high popularity among clients.
Independent Variables
Price
We chose the price per service as the measure for the independent variable of price. The price per service is typically prominently displayed on the counselor’s home page, potentially forming the client’s first impression of the counselor’s service cost.
Prosocial Behavior
According to the definition of prosocial behavior, we used the number of questions answered for free by counselors as its indicator. This action reflects the counselor’s willingness to share their professional knowledge and offer help without any direct financial return.
Online Reputation
The counselor’s reputation was represented by a system-generated rating, computed from feedback provided by all previous clients who have used the counselor’s services. The online rating system operates on a scale from 0 to 5, accurate to 1 decimal place.
Professional Titles
In China, there are 3 primary professional titles associated with psychological counselors: counselor, psychotherapist, and psychiatrist. Each of these titles is further categorized into 3 levels: junior, intermediate, and senior. For the purpose of our study, we assigned numerical codes to these levels: 1 for junior, 2 for intermediate, and 3 for senior. As a counselor may hold multiple titles, the variable professional titles or PT we used in our analysis represented the sum of the codes for all the titles held by the counselor:
PT = PTcounselor + PTpsychotherapist + PTpsychiatrist
Practical Experience
Practical experience can be reflected by the number of hours of service, which is directly extracted from the counselor’s home page and measured in hours. Although the number of hours of service is displayed online, it primarily reflects the service duration proof provided by the counselor when registering on the platform. Therefore, we classified practical experience as an offline signal, as it mainly showcases the counselor’s professional experience outside the online platform.
Educational Level
The educational levels of counselors were classified into 4 categories and assigned corresponding numerical codes. The categories and codes used were as follows: “1 for college and below,” “2 for a bachelor’s degree,” “3 for a master’s degree,” and “4 for a doctorate and above.”
Control Variables
City Level
The variability in internet coverage across China’s vast regions could affect clients’ behavior in choosing online psychological counselors. Due to the stigma associated with mental health issues, the platform does not display clients’ personal information. To control for regional differences, we included the city tier of the psychological counselors as a control variable. According to the latest Chinese city classification standards [
], we coded city level classes into 3 categories: “3 for first-tier cities,” “2 for second-tier cities,” and “1 for others.”Gender
Gender was coded as “1 for male” and “2 for female.”
Estimation Model
The descriptive statistics for all variables (see
) reveal that clients’ choices, price, prosocial behavior, and practical experience exhibit significantly larger extremum and SD. Such variability might result in biased and inefficient model estimations. Thus, we choose to log-transform these variables to mitigate the impact of extreme values in our model construction.Variable | Value, mean (SD) | Value, minimum | Value, maximum |
CCa | 2075.21 (2569.61) | 1 | 14,408 |
Prb | 317.38 (248.57) | 10 | 1600 |
PBc | 276.44 (223.95) | 10 | 990 |
ORd | 4.90 (0.16) | 3 | 5 |
PTe | 2.20 (0.98) | 0 | 7 |
PEf | 2084.87 (2565.08) | 0 | 14,552 |
ELg | 1.59 (0.91) | 1 | 4 |
CLh | 2.27 (0.83) | 1 | 3 |
Geni | 1.75 (0.43) | 1 | 2 |
aCC: clients’ choices.
bPr: price.
cPB: prosocial behavior.
dOR: online reputation.
ePT: professional titles.
fPE: practical experience.
gEL: educational level.
hCL: city level.
iGen: gender.
In order to control for unobservable heterogeneity that might influence clients’ choices, we used a dynamic panel data model for our analysis. We used the Hausman test to contrast the fixed and random effects models. Given that the resulting P value was below the conventional level of significance (.05), we opted for a fixed effects model for our subsequent analysis. The advantage of the fixed effects model is that it controls for time-invariant characteristics of individuals, allowing us to isolate the effects of variables that change over time. The empirical model is presented as follows:
log(CCit) = β0 + β1log(Prit) + β2log(PBit) + β3[(log(PBit))2] + β4(ORit) + β5(PTit) + β6log(PEit) + β7(ELit) + β8(CLit) + β9(Genit) + λt + νi + εit
where i is the index of the counselor and t represents the time point. β1 to β9 are the parameters to be estimated. λt represents the time fixed effects, which controls for common changes in mental health needs over time (eg, seasonal variations, holidays). νi represents the individual fixed effect, which controls for the stable characteristics of each counselor that do not change over time (eg, registration duration on the platform, counseling style). ε is the error term. CC is clients’ choices, Pr is price, PB is prosocial behavior, OR is online reputation, PT is professional titles, PE is practical experience, EL is educational level, CL is city level, and Gen is gender.
Results
Research Model Results
presents the correlation coefficients of all variables for the analysis. The results show that almost all of the independent variables exhibit a correlation with the dependent variable. The correlations among the independent variables are significantly low. Moreover, the variance inflation factor values of the independent and control variables are less than 2, indicating that multicollinearity is not a concern in our model.
presents the results of our empirical models. Throughout our analysis, we systematically incorporated variables, culminating in the construction of 4 distinct models. We observed a consistent increase in R² from 0.337 in Model 1 to 0.962 in Model 4 with the inclusion of variables. The significance levels of the key variables remained consistent across all models. Therefore, we chose to interpret our research results using the final model.
As shown in Model 4, in the online signals category, both price (β1=.186, P<.001) and online reputation (β4=.489, P=.002) positively affect the clients’ choices, thereby supporting H1 and H3. Based on our previous assumptions, we incorporated prosocial behavior and its quadratic term into the empirical model. We find a significant inverted U-shaped relationship between prosocial behavior and the clients’ choices (β2=.190, P=.002; β3=–.018, P=.001). After conducting the fixed effects model analysis, we used the U-shape test estimation algorithm by Lind and Mehlum [
] to verify the stability of the inverted U-shaped relationship. The procedure involved 4 main steps. First, we used the Wald test to assess the significance of the linear and nonlinear combinations of prosocial behaviors. The P value of the Wald test was .004, indicating that these variables significantly contributed to the model. Second, we calculated the slope of the curve at the low and high points of prosocial behavior. According to our research data, the low point was 2.40 and the high point was 6.90. The results showed that the slope of prosocial behavior at the low point was 0.102, and at the high point, it was –0.060. Third, we used the likelihood ratio test to verify whether the influence of prosocial behavior on clients’ choices increased monotonically at low levels of prosocial behavior and decreased monotonically at high levels. The P value of the likelihood ratio test was .001, indicating that this nonlinear relationship was significant. Fourth, we used the Delta confidence interval test to verify whether the poles of the curve fell within the range of high and low values of prosocial behaviors. The results showed that the poles fell within the interval between the 2 values, indicating that the inverted U-shape was considered stable. Therefore, H2 is supported. In the offline signals category, we discovered that practical experience (β6=.911, P<.001) has a positive impact on clients’ choices, supporting H4b. However, the effect of professional titles and educational levels on the clients’ choices was found to be insignificant; thus, H4a and H4c are not supported.Variable | log(CCa) | log(Prb) | log(PBc) | ORd | PTe | log(PEf) | ELg | CLh | Geni | ||||||||||
log(CC) | |||||||||||||||||||
r | 1 | 0.369 | 0.276 | 0.370 | 0.197 | 0.957 | –0.040 | –0.011 | 0.170 | ||||||||||
P value | —j | <.001 | <.001 | <.001 | <.001 | <.001 | .08 | .64 | <.001 | ||||||||||
log(Pr) | |||||||||||||||||||
r | 0.369 | 1 | 0.094 | 0.103 | 0.083 | 0.397 | –0.004 | 0.131 | 0.098 | ||||||||||
P value | <.001 | — | <.001 | <.001 | <.001 | <.001 | .85 | <.001 | <.001 | ||||||||||
log(PB) | |||||||||||||||||||
r | 0.276 | 0.094 | 1 | 0.061 | 0.055 | 0.247 | –0.052 | –0.058 | 0.021 | ||||||||||
P value | <.001 | <.001 | — | .01 | .02 | <.001 | .02 | .01 | .36 | ||||||||||
OR | |||||||||||||||||||
r | 0.37 | 0.103 | 0.061 | 1 | 0.095 | 0.403 | –0.079 | 0.007 | 0.202 | ||||||||||
P value | <.001 | <.001 | 0.01 | — | <.001 | <.001 | <.001 | .75 | <.001 | ||||||||||
PT | |||||||||||||||||||
r | 0.197 | 0.083 | 0.055 | 0.095 | 1 | 0.195 | 0.054 | 0.001 | 0.045 | ||||||||||
P value | <.001 | <.001 | .02 | <.001 | — | <.001 | .02 | .99 | .049 | ||||||||||
log(PE) | |||||||||||||||||||
r | 0.957 | 0.397 | 0.247 | 0.403 | 0.195 | 1 | –0.047 | 0.001 | 0.200 | ||||||||||
P value | <.001 | <.001 | <.001 | <.001 | <.001 | — | .04 | .99 | <.001 | ||||||||||
EL | |||||||||||||||||||
r | –0.040 | –0.004 | –0.052 | –0.079 | 0.054 | –0.047 | 1 | 0.042 | 0.076 | ||||||||||
P value | .08 | .85 | .02 | <.001 | .02 | .04 | — | .06 | <.001 | ||||||||||
CL | |||||||||||||||||||
r | –0.011 | 0.131 | –0.058 | 0.007 | 0.001 | 0.001 | 0.042 | 1 | 0.095 | ||||||||||
P value | .64 | <.001 | .01 | .75 | .99 | .99 | .06 | — | <.001 | ||||||||||
Gen | |||||||||||||||||||
r | 0.170 | 0.098 | 0.021 | 0.202 | 0.045 | 0.200 | 0.076 | 0.095 | 1 | ||||||||||
P value | <.001 | <.001 | .36 | <.001 | .049 | <.001 | <.001 | <.001 | — |
aCC: clients’ choices.
bPr: price.
cPB: prosocial behavior.
dOR: online reputation.
ePT: professional titles.
fPE: practical experience.
gEL: educational level.
hCL: city level.
iGen: gender.
jNot applicable.
Variable | Model 1 | P value | Model 2 | P value | Model 3 | P value | Model 4 | P value |
log(Pra), mean (SE) | —b | 0.421 (0.154) | .01 | — | 0.186 (0.042) | <.001 | ||
log(PBc), mean (SE) | — | 0.148 (0.028) | <.001 | — | 0.190 (0.063) | .002 | ||
(log(PB))2, mean (SE) | — | — | — | –0.018 (0.006) | .01 | |||
ORd, mean (SE) | — | 9.820 (0.517) | <.001 | — | 0.489 (0.157) | .002 | ||
PTe, mean (SE) | — | — | 0.027 (0.023) | .24 | 0.024 (0.023) | .29 | ||
log(PEf), mean (SE) | — | — | 0.920 (0.006) | <.001 | 0.911 (0.007) | <.001 | ||
ELg, mean (SE) | — | — | 0.005 (0.010) | .63 | 0.007 (0.010) | .50 | ||
CLh, mean (SE) | –0.937 (0.488) | <.001 | –0.675 (0.216) | .002 | –0.291 (0.059) | <.001 | –0.267 (0.059) | <.001 |
Geni, mean (SE) | –2.125 (0.488) | <.001 | –2.314 (0.436) | <.001 | –0.121 (0.119) | .31 | –0.200 (0.119) | .09 |
Time fixed effect | Yes | Yes | Yes | Yes | ||||
Individual fixed effect | Yes | Yes | Yes | Yes | ||||
R2 | 0.337 | 0.485 | 0.961 | 0.962 | ||||
Number of time periods, T | 4 | 4 | 4 | 4 | ||||
Observations, N | 1948 | 1948 | 1948 | 1948 |
aPr: price.
bNot applicable.
cPB: prosocial behavior.
dOR: online reputation.
ePT: professional titles.
fPE: practical experience.
gEL: educational level.
hCL: city level.
iGen: gender.
Robustness Check
In the robustness check section, we divided the dataset into 2 groups based on service duration. These two subsamples included (1) psychological counselors with fewer than 1000 hours of service and (2) those with 1000 hours or more. As service duration is consistent within each group, we did not include this factor in the model.
shows that the findings from these subsamples correspond with the primary results from the full dataset. Therefore, research findings exhibit high robustness and reliably support our preliminary results.Variable | Model 5 (group 1) | P value | Model 6 (group 2) | P value |
log(Pra), mean (SE) | 0.207 (0.333) | <.001 | 0.497 (0.070) | <.001 |
log(PBb), mean (SE) | 1.261(0.342) | <.001 | 0.331 (0.146) | .02 |
(log(PB))2, mean (SE) | –0.140 (0.036) | <.001 | –0.029 (0.014) | .04 |
ORc, mean (SE) | 7.866 (0.636) | <.001 | 4.105 (1.774) | .02 |
PTd, mean (SE) | –0.139 (0.042) | .42 | 0.028 (0.036) | .44 |
ELe, mean (SE) | 0.006 (0.086) | .94 | 0.004 (0.015) | .04 |
CLf, mean (SE) | –0.672 (0.443) | .13 | –0.711 (0.101) | <.001 |
Geng, mean (SE) | –1.475 (0.539) | .01 | –0.377 (0.667) | .27 |
Time fixed effect | Yes | Yes | ||
Individual fixed effect | Yes | Yes | ||
R2 | 0.694 | 0.177 | ||
Number of time periods, T | 4 | 4 | ||
Observations, N | 800 | 1148 |
aPr: price.
bPB: prosocial behavior.
cOR: online reputation.
dPT: professional titles.
ePE: practical experience.
fEL: educational level.
gCL: city level.
hGen: gender.
Discussion
Analysis of Results
In this paper, we draw on signaling theory to investigate how information on psychological counselors’ home pages influences clients’ choices. The findings highlight the crucial role of online and offline signals in shaping decision-making processes and demonstrate that effective information disclosure can encourage consumers to select a psychological counselor.
In the context of online signals, it has been found that both price and online reputation affect a client’s choice of psychological counselor, aligning with the findings of previous relevant studies [
, , , - ]. On the one hand, given that consumers might not possess the requisite expertise to evaluate professional services, clients are often willing to pay a premium in exchange for the assurance of higher service quality [ ]. As prices increase, consumers expect better services from a counselor, and thus are more inclined to select that counselor. On the other hand, a strong online reputation can boost consumers’ trust in a counselor’s professional skills. Demonstrating an online reputation highlights the consistency and professionalism of a counselor’s service quality and reveals the professional attitude and commitment they maintain during service delivery.In the context of offline signals, it was determined that practical experience has a positive impact on a client’s choice of a psychological counselor. Offline signals mainly offer insights into a counselor’s personal attributes, thus often considered reflective of their skills and professional standards. Although offline signals originate from a physical environment, this study demonstrates that consumers attribute significant value to them and recognize their essential role in decision making. In other words, even in the digital sphere, the importance and impact of offline signals are preserved.
Interestingly, we discovered an inverted U-shaped relationship between a psychological counselor’s prosocial behavior and clients’ choices. This suggests that while clients appreciate a certain level of prosocial behavior, an overly excessive display may arouse suspicion and negatively affect their choices. Specifically, moderate prosocial behavior can improve a counselor’s image and online reputation, thus enhancing client trust. However, exceeding a certain threshold of prosocial behavior may be perceived as insincere, resulting in increased client skepticism toward the counselor.
Theoretical Implications
Our study broadens the scope of theoretical research on signaling theory. First, we introduce signaling theory into the specific service domain of online psychological counseling and establish a theoretical framework to clarify the role of online and offline signals in the process of clients choosing a psychological counselor. The results of this study align with Zhou et al [
], which highlights the significance of both demonstration and description signals in online mental health markets and demonstrates how various types of signals can influence clients’ choices.Second, this study considers the service price, online reputation, and prosocial behavior as signals and incorporates them into the research framework, which is an approach previously unexplored in previous studies. Previous studies have often focused on isolated online signals, such as online reviews and ratings [
, , ]. Our research integrates both online signals and offline signals, offering a more comprehensive framework that enhances the understanding of how different signals interact to influence clients’ choices.Finally, our research results reveal an inverted U-shaped relationship between a psychological counselor’s prosocial behavior and client’s choices. This finding addresses a gap in the literature, where prosocial behavior was generally considered to have a linear positive effect [
- ]. Our study shows that there is an optimal level of prosocial behavior, beyond which client skepticism may arise, thus contributing to a more nuanced understanding of the dynamics at play.Managerial Implications
For psychological counselors in OHCs, our study reveals the positive influence of service price on clients’ choices. Consequently, psychological counselors should leverage their pricing autonomy in OHCs, using their service price as a signal of their capability to convey accurate quality signals to potential clients. Moreover, considering the significant impact of an online reputation on client’s choice, it is crucial for psychological counselors to carefully manage client relationships and maintain their online reputation. This suggests that, besides providing high-quality services, psychological counselors should proactively respond to client feedback, engage in OHC activities, and enhance their online visibility to gain a competitive edge in the domain of online psychological counseling [
]. Finally, our research exposes an inverted U-shaped relationship between a psychological counselor’s prosocial behavior and clients’ choices. This finding suggests that psychological counselors must adeptly balance and temper their prosocial behavior in practice, aiming for an ideal equilibrium that attracts clients while maintaining a professional image.For OHC platforms, despite operating in a digital environment, offline signals from psychological counselors still play a significant role in client selection. Therefore, platforms may consider displaying more offline personal information on the counselors’ profile pages, such as their affiliated institutions and accolades, which can enhance information transparency and boost client trust. At the same time, platforms need to recognize the high level of user attention given to key signals such as price, online reputation, and prosocial behavior. As a result, when designing web and app interfaces, platforms should strategically position this information prominently, allowing users to quickly and efficiently access these details.
Limitations
We admit some limitations in our study. First, this study uses data from a single platform, YiDianLing, collected at 4 intervals throughout the year. While YiDianLing is a reliable source, relying on one website may limit the generalizability of our findings. The 4 data collection periods were chosen to cover key times of the year, providing a representative snapshot. However, future research should incorporate data from multiple platforms and extend the observation period to enhance the findings’ robustness and applicability. Second, although our study on online psychological counseling in China offers valuable insights, there is significant variability in counseling services across different countries, particularly in terms of providers and content. Future research should include data from multiple countries to capture a more comprehensive view of global trends and differences in online psychological counseling. Third, this study focuses on using signaling theory to explore clients’ decision-making processes when choosing online psychological counselors, emphasizing the behaviors prior to engaging in online counseling. However, psychological counseling is inherently a long-term and complex process. Future research should incorporate assessments of the long-term outcomes and effectiveness of counseling sessions to comprehensively evaluate the overall process of online psychological counseling. Additionally, the results and effectiveness of clients’ previous psychological counseling sessions may also influence their choices to some extent. Due to privacy protections, YiDianLing has not disclosed data regarding these past experiences. Future research should consider addressing this limitation by finding ways to incorporate such data while ensuring privacy protection. Fourth, while we considered regional diversity in our sample selection and controlled for the city tiers of psychological counselors in our data analysis, the lack of direct data on clients’ locations may impact the generalizability of our results. Under the condition of complying with relevant regulations, future research should collect and analyze data on clients’ locations to enhance the study’s comprehensiveness. Fifth, counselors’ home pages also contain some textual data that disclose clients’ experiences, but this paper only analyzed some quantitative data and future research can do deeper mining of textual data of OHCs.
Conclusions
This study uses signaling theory to investigate client preferences for psychological counselors. We segmented the information displayed on counselors’ home pages into online and offline signals and established a theoretical model for client decision making using data derived from a Chinese online health community. The findings reveal that service price, online reputation, professional titles, and practical experience positively influence clients’ choices. Additionally, we discovered an inverted U-shaped correlation between a psychological counselor’s prosocial behavior and clients’ choices. Fundamentally, this study unravels a complex client selection process influenced by different signals, providing valuable guidance for both researchers and practitioners.
Acknowledgments
This study was funded by the National Natural Science Foundation of China (grant 72274068).
Data Availability
The datasets generated during and analyzed during this study are available from the corresponding author on reasonable request.
Authors' Contributions
XF contributed to writing the original draft, methodology, formal analysis, data curation, and conceptualization. YH was responsible for writing, review and editing, validation, supervision, methodology, and conceptualization. HP contributed to conceptualization, methodology, and writing. SL was responsible for conceptualization, methodology, and data curation. JX and ZZ contributed to data curation and writing. Generative artificial intelligence was not used in any portion of the manuscript writing. All authors have read and approved the final manuscript.
Conflicts of Interest
None declared.
References
- Choudhury MD, De S. Mental Health Discourse on reddit: Self-Disclosure, Social Support, and Anonymity. 2014. Presented at: Proceedings of the International AAAI Conference on Web and Social Media; 2014 May 16:71-80; USA. [CrossRef]
- Freeman M. The world mental health report: transforming mental health for all. World Psychiatry. 2022;21(3):391-392. [FREE Full text] [CrossRef] [Medline]
- Deng Z, Hong Z, Zhang W, Evans R, Chen Y. The effect of online effort and reputation of physicians on patients' choice: 3-wave data analysis of China's good doctor website. J Med Internet Res. 2019;21(3):e10170. [FREE Full text] [CrossRef] [Medline]
- Zhang Y, Li X, Fan W. User adoption of physician's replies in an online health community: an empirical study. Asso for Info Science & Tech. 2020;71(10):1179-1191. [CrossRef]
- Alleman JR. Online counseling: the Internet and mental health treatment. Psychotherapy: Theory, Research, Practice, Training. 2002;39(2):199-209. [CrossRef]
- Feijt MA, de Kort YA, Bongers IM, IJsselsteijn WA. Perceived drivers and barriers to the adoption of eMental health by psychologists: the construction of the levels of adoption of eMental health model. J Med Internet Res. 2018;20(4):e153. [FREE Full text] [CrossRef] [Medline]
- Zhou J, Liu F, Zhou T. Exploring the factors influencing consumers to voluntarily reward free health service contributors in online health communities: empirical study. J Med Internet Res. 2020;22(4):e16526. [FREE Full text] [CrossRef] [Medline]
- Vogel DL, Wester SR, Larson LM. Avoidance of counseling: psychological factors that inhibit seeking help. Jour of Counseling & Develop. 2011;85(4):410-422. [CrossRef]
- YU Y, MEI QY, WANG QH. From offline to online: how health insurance policies drive the demand for online healthcare service? 2016. Presented at: Proceedings of the 20th Pacific Asia Conference on Information Systems; 2016 Jul 1:1-13; Chaiyi, Taiwan.
- The 52nd Statistical Report on China's Internet Development. China. China Internet Network Information Center; 2023. URL: https://www.cnnic.com.cn/IDR/ReportDownloads/202311/P020231121355042476714.pdf [accessed 2024-09-12]
- Xiang YT, Yu X, Sartorius N, Ungvari GS, Chiu HFK. Mental health in China: challenges and progress. Lancet. 2012;380(9855):1715-1716. [CrossRef] [Medline]
- Chen J, Zhu S. Online information searches and help seeking for mental health problems in Urban China. Adm Policy Ment Health. 2016;43(4):535-545. [CrossRef] [Medline]
- Que J, Lu L, Shi L. Development and challenges of mental health in China. Gen Psychiatr. 2019;32(1):e100053. [FREE Full text] [CrossRef] [Medline]
- Yang Y, Li W, Zhang Q, Zhang L, Cheung T, Xiang YT. Mental health services for older adults in China during the COVID-19 outbreak. Lancet Psychiatry. 2020;7(4):e19. [FREE Full text] [CrossRef] [Medline]
- Mavlanova T, Benbunan-Fich R, Koufaris M. Signaling theory and information asymmetry in online commerce. Information & Management. 2012;49(5):240-247. [CrossRef]
- Jøsang A, Ismail R, Boyd C. A survey of trust and reputation systems for online service provision. Decision Support Systems. 2007;43(2):618-644. [CrossRef]
- Huang X, Sun P, Zhang X, Wu J. What affects patients’ choice of consultant: an empirical study of online doctor consultation service. Electron Commer Res. 2022:625. [CrossRef]
- Connelly BL, Certo ST, Ireland RD, Reutzel CR. Signaling theory: a review and assessment. Journal of Management. 2010;37(1):39-67. [CrossRef]
- Li J, Tang J, Yen DC, Liu X. Disease risk and its moderating effect on the e-consultation market offline and online signals. ITP. 2019;32(4):1065-1084. [CrossRef]
- Zhang M, Guo X, Wu T. Impact of free contributions on private benefits in online healthcare communities. International Journal of Electronic Commerce. 2019;23(4):492-523. [CrossRef]
- Pulat M, Barutçu-Yıldırım F. Online counseling and ethics: A systematic review of empirical research. Online Counseling and Ethics: A Systematic Review of Empirical Research. 2021:1-12.
- Zeren G, Erus SM, Amanvermez Y, Genç AB, Duy B. Client's experiences of online counseling: satisfaction and therapeutic alliance. Cukurova University Faculty of Education Journal Cukurova University. 2022;51(1):658. [CrossRef]
- Khan S, Shapka JD, Domene JF. Counsellors’ experiences of online therapy. British Journal of Guidance & Counselling. 2021;50(1):43-65. [CrossRef]
- Shah AM, Naqvi RA, Jeong OR. The impact of signals transmission on patients' choice through e-consultation websites: an econometric analysis of secondary datasets. Int J Environ Res Public Health. 2021;18(10):5192. [FREE Full text] [CrossRef] [Medline]
- Li J, Tang J, Jiang L, Yen DC, Liu X. Economic success of physicians in the online consultation market: a signaling theory perspective. International Journal of Electronic Commerce. 2019;23(2):244-271. [CrossRef]
- Wu H, Deng Z, Wang B, Gupta S. How does service price influence patients’ decisions? An examination of the free-market pricing mechanism in online health communities. Electron Markets. 2021;31(4):877-893. [CrossRef]
- Meng F, Zhang X, Liu L, Ren C. Converting readers to patients? From free to paid knowledge-sharing in online health communities. Information Processing & Management. 2021;58(3):102490. [CrossRef]
- Chen S, Guo X, Wu T, Ju X. Exploring the online doctor-patient interaction on patient satisfaction based on text mining and empirical analysis. Information Processing & Management. 2020;57(5):102253. [CrossRef]
- Li L, Tadelis S, Zhou X. Buying reputation as a signal of quality: evidence from an online marketplace. The RAND J of Economics. 2020;51(4):965-988. [CrossRef]
- Reuber AR, Fischer E. Signalling reputation in international online markets. Strategic Entrepreneurship. 2009;3(4):369-386. [CrossRef]
- Al-Hasan A. Online social stock picking: an empirical examination. International Journal of Electronic Commerce. 2018;22(1):66-97. [CrossRef]
- Wan Y, Zhang Y, Yan M. What influences patients' willingness to choose in online health consultation? An empirical study with PLS–SEM. IMDS. 2020;120(12):2423-2446. [CrossRef]
- Guo S, Guo X, Fang Y, Vogel D. How doctors gain social and economic returns in online health-care communities: a professional capital perspective. Journal of Management Information Systems. 2017;34(2):487-519. [CrossRef]
- Wang J, Liu H, Ye J. The impact of individual and team professional capital on physicians’ performance in online health-care communities: a cross-level investigation. Internet Research. 2022;33(1):152-177. [CrossRef]
- Yang H, Du HS, Shang W. Understanding the influence of professional status and service feedback on patients' doctor choice in online healthcare markets. Internet Research. 2020;31(4):1236-1261. [CrossRef]
- Zhang S, Wang JN, Chiu YL, Hsu YT. Exploring types of information sources used when choosing doctors: observational study in an online health care community. J Med Internet Res. 2020;22(9):e20910. [FREE Full text] [CrossRef] [Medline]
- Hsu YT, Chiu YL, Wang JN, Liu HC. Impacts of physician promotion on the online healthcare community: using a difference-in-difference approach. Digit Health. 2022;8:20552076221106319. [FREE Full text] [CrossRef] [Medline]
- Campo S, Jesús YM. Exploring non-linear effects of determinants on tourists' satisfaction. International Journal of Culture, Tourism and Hospitality Research Emerald. 2009;3(2):127-138. [CrossRef]
- Wu H, Lu N. Service provision, pricing, and patient satisfaction in online health communities. Int J Med Inform. 2018;110:77-89. [CrossRef] [Medline]
- Li J, Hu F, Yan T, Cai X, Song X. How to charge doctors and price medicines in a two-sided online healthcare platform with network externalities? International Journal of Production Research. 2022;61(9):3052-3070. [CrossRef]
- Bolle S, van Weert JCM, Daams JG, Loos EF, de Haes HCJM, Smets EMA. Online health information tool effectiveness for older patients: a systematic review of the literature. J Health Commun. 2015;20(9):1067-1083. [CrossRef] [Medline]
- Conrad DA, Sales A, Liang SY, Chaudhuri A, Maynard C, Pieper L, et al. The impact of financial incentives on physician productivity in medical groups. Health Serv Res. 2002;37(4):885-906. [FREE Full text] [CrossRef] [Medline]
- Zeithaml VA, Berry LL, Parasuraman A. Communication and control processes in the delivery of service quality. Journal of Marketing. 2018;52(2):35-48. [CrossRef]
- Zhang S, Fu YN, Liu Q, Turel O, He Q. Psychological capital mediates the influence of meaning in life on prosocial behavior of university students: a longitudinal study. Children and Youth Services Review. 2022;140:106600. [CrossRef]
- Jing D, Jin Y, Liu J. The impact of monetary incentives on physician prosocial behavior in online medical consulting platforms: evidence from China. J Med Internet Res. 2019;21(7):e14685. [FREE Full text] [CrossRef] [Medline]
- Feng L, Guo Q. Beneficial effect of altruism on well-being among Chinese college students: the role of self-esteem and family socioeconomic status. Journal of Social Service Research. 2016;43(3):416-431. [CrossRef]
- Zhou J, Zuo M, Ye C. Understanding the factors influencing health professionals' online voluntary behaviors: evidence from YiXinLi, a Chinese online health community for mental health. Int J Med Inform. 2019;130:103939. [CrossRef] [Medline]
- Gong Y, Wang H, Xia Q, Zheng L, Shi Y. Factors that determine a patient's willingness to physician selection in online healthcare communities: a trust theory perspective. Technol Soc. 2021;64:101510. [FREE Full text] [CrossRef] [Medline]
- Qiu C, Zhang Y, Wang X, Gu D. Trust-based research: influencing factors of patients' medical choice behavior in the online medical community. Healthcare (Basel). 2022;10(5):938. [FREE Full text] [CrossRef] [Medline]
- Gregg DG, Scott JE. The role of reputation systems in reducing on-line auction fraud. International Journal of Electronic Commerce. 2014;10(3):95-120. [CrossRef]
- Lambert MJ, Barley DE. Research summary on the therapeutic relationship and psychotherapy outcome. Psychotherapy: Theory, Research, Practice, Training. 2001;38(4):357-361. [CrossRef]
- Gärtner M, Andersson D, Västfjäll D, Tinghög G. Affect and prosocial behavior: the role of decision mode and individual processing style. Judgm Decis Mak. 2023;17(1):1-13. [CrossRef]
- Wang JJ, Liu H, Cui X, Ye J, Chen H. Impact of a physician's prosocial behavior on the patient's choice: an empirical investigation in online health community. Information Technology & People Emerald. 2022;36(4):1703-1725. [CrossRef]
- Filieri R, Mariani M. The role of cultural values in consumers' evaluation of online review helpfulness: a big data approach. International Marketing Review Emerald. 2021;38(6):1267-1288. [CrossRef]
- Zervas G, Proserpio D, Byers JW. A first look at online reputation on Airbnb, where every stay is above average. Mark Lett. 2020;32(1):1-16. [CrossRef]
- Djafarova E, Trofimenko O. ‘Instafamous’ – credibility and self-presentation of micro-celebrities on social media. Information, Communication & Society. 2018;22(10):1432-1446. [CrossRef]
- Utz S, Matzat U, Snijders C. On-line reputation systems: the effects of feedback comments and reactions on building and rebuilding trust in on-line auctions. International Journal of Electronic Commerce. 2014;13(3):95-118. [CrossRef]
- Cioppi M, Curina I, Forlani F, Pencarelli T. Online presence, visibility and reputation: a systematic literature review in management studies. Journal of Research in Interactive Marketing. 2019;13(4):547-577. [CrossRef]
- Qiao W, Yan Z, Wang X. Join or not: the impact of physicians’ group joining behavior on their online demand and reputation in online health communities. Information Processing & Management. 2021;58(5):102634. [CrossRef]
- Ba Z, Zhao Y, Song S, Zhu Q. Does the involvement of charities matter? Exploring the impact of charities’ reputation and social capital on medical crowdfunding performance. Information Processing & Management. 2022;59(3):102942. [CrossRef]
- Delgadillo J, Moreea O, Lutz W. Different people respond differently to therapy: a demonstration using patient profiling and risk stratification. Behav Res Ther. 2016;79:15-22. [CrossRef] [Medline]
- Evans L. Professionalism, professionality and the development of education professionals. British Journal of Educational Studies. 2008;56(1):20-38. [CrossRef]
- Hemsley B, Balandin S, Togher L. Narrative analysis of the hospital experience for older parents of people who cannot speak. Journal of Aging Studies. 2007;21(3):239-254. [CrossRef]
- Tyler TR. Psychological perspectives on legitimacy and legitimation. Annu Rev Psychol. 2006;57:375-400. [CrossRef] [Medline]
- List of cities in China. Wikipedia. 2024. URL: https://en.wikipedia.org/w/index.php?title=List_of_cities_in_China&oldid=1211361304 [accessed 2024-03-15]
- Lind JT, Mehlum H. With or without U? The appropriate test for a u-shaped relationship*. Oxford Bulletin of Economics and Statistics. 2010;72(1):118. [CrossRef]
- Anagnostopoulou SC, Buhalis D, Kountouri IL, Manousakis EG, Tsekrekos AE. The impact of online reputation on hotel profitability. International Journal of Contemporary Hospitality Management. 2020;32(1):20-39. [CrossRef]
- Chen T, Samaranayake P, Cen X, Qi M, Lan Y. The impact of online reviews on consumers' purchasing decisions: evidence from an eye-tracking study. Front Psychol. 2022;13:865702. [FREE Full text] [CrossRef] [Medline]
- Liu X, Guo X, Wu H, Wu T. The impact of individual and organizational reputation on physicians’ appointments online. International Journal of Electronic Commerce. 2016;20(4):551-577. [CrossRef]
- Zhou J, Kishore R, Amo L, Ye C. Description and demonstration signals as complements and substitutes in an online market for mental health care. MIS Quarterly. 2022;46(4):2055-2084. [CrossRef]
- Chen L, Baird A, Straub D. A linguistic signaling model of social support exchange in online health communities. Decision Support Systems. 2020;130:113233. [CrossRef]
- Liu J, Gao L. Analysis of topics and characteristics of user reviews on different online psychological counseling methods. Int J Med Inform. 2021;147:104367. [CrossRef] [Medline]
- Kawamura Y, Ohtsubo Y, Kusumi T. Effects of cost and benefit of prosocial behavior on reputation. Social Psychological and Personality Science. 2020;12(4):452-460. [CrossRef]
- Liu X, Guo H, Wang L, Hu M, Wei Y, Liu F, et al. Effect of prosocial behaviors on e-consultations in a web-based health care community: panel data analysis. J Med Internet Res. 2024;26:e52646. [FREE Full text] [CrossRef] [Medline]
- Gherghel C, Nastas D, Hashimoto T, Takai J, Cargile AC. Culture, morality, and the effect of prosocial behavior motivation on positive affect. Ethics & Behavior. 2019;30(2):126-149. [CrossRef]
- Aknin LB, van de Vondervoort JW, Hamlin JK. Positive feelings reward and promote prosocial behavior. Curr Opin Psychol. 2018;20:55-59. [CrossRef] [Medline]
- Yang H, Guo X, Wu T, Ju X. Exploring the effects of patient-generated and system-generated information on patients’ online search, evaluation and decision. Electronic Commerce Research and Applications. 2015;14(3):192-203. [CrossRef]
Abbreviations
OHC: online health community |
WHO: World Health Organization |
Edited by T de Azevedo Cardoso; submitted 15.03.24; peer-reviewed by Y-T Hsu, Y-L Chiu; comments to author 24.05.24; revised version received 25.06.24; accepted 12.08.24; published 10.10.24.
Copyright©Xiandong Feng, Yinhuan Hu, Holger Pfaff, Sha Liu, Jinzhu Xie, Zemiao Zhang. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 10.10.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.