Published on in Vol 24 , No 12 (2022) :December

Preprints (earlier versions) of this paper are available at, first published .
What Patients Find on the Internet When Looking for Information About Percutaneous Coronary Intervention: Multilanguage Cross-sectional Assessment

What Patients Find on the Internet When Looking for Information About Percutaneous Coronary Intervention: Multilanguage Cross-sectional Assessment

What Patients Find on the Internet When Looking for Information About Percutaneous Coronary Intervention: Multilanguage Cross-sectional Assessment

Original Paper

1George Emil Palade University of Medicine, Pharmacy, Science, and Technology of Targu Mures, Targu Mures, Romania

2Lucian Blaga University of Sibiu, Sibiu, Romania

Corresponding Author:

Valentin Nădășan, MD, PhD

George Emil Palade University of Medicine, Pharmacy, Science, and Technology of Targu Mures

38 Gheorghe Marinescu Street

Targu Mures, 540142


Phone: 40 265215551


Background: The internet provides general users with wide access to medical information. However, regulating and controlling the quality and reliability of the considerable volume of available data is challenging, thus generating concerns about the consequences of inaccurate health care–related documentation. Several tools have been proposed to increase the transparency and overall trustworthiness of medical information present on the web.

Objective: We aimed to analyze and compare the quality and reliability of information about percutaneous coronary intervention on English, German, Hungarian, Romanian, and Russian language websites.

Methods: Following a rigorous protocol, 125 websites were selected, 25 for each language sub-sample. The websites were assessed concerning their general characteristics, compliance with a set of eEurope 2002 credibility criteria, and quality of the informational content (namely completeness and accuracy), based on a topic-specific benchmark. Completeness and accuracy were graded independently by 2 evaluators. Scores were reported on a scale from 0 to 10. The 5 language subsamples were compared regarding credibility, completeness, and accuracy. Correlations between credibility scores on the one hand, and completeness and accuracy scores, on the other hand, were tested within each language subsample.

Results: The websites’ compliance with credibility criteria was average at best with scores between 3.0 and 6.0. In terms of completeness and accuracy, the website subsets qualified as poor or average, with scores ranging from 2.4 to 4.6 and 3.6 to 5.3, respectively. English language websites scored significantly higher in all 3 aspects, followed by German and Hungarian language websites. Only German language websites showed a significant correlation between credibility and information quality.

Conclusions: The quality of websites in English, German, Hungarian, Romanian, and Russian languages about percutaneous coronary intervention was rather inadequate and may raise concerns regarding their impact on informed decision-making. Using credibility criteria as indicators of information quality may not be warranted, as credibility scores were only exceptionally correlated with content quality. The study brings valuable descriptive data on the quality of web-based information regarding percutaneous coronary intervention in multiple languages and raises awareness about the need for responsible use of health-related web resources.

J Med Internet Res 2022;24(12):e41219



On account of its accessibility and interactivity, the internet has become a popular and widely used tool for independent medical documentation among the general public. The proportion of people who turn to the web-based environment in search of health-related information has been steadily increasing [1]. This practice, although regarded as convenient from the consumers’ point of view, has raised concerns among physicians, as the quality of the web-based medical information and the patients’ or caregivers’ ability to select relevant information are often seen as questionable [2]. Therefore, the negligent use of the internet may impact the physician-patient relationship and consumers’ medical decision-making, leading to unjustified fears (also known as ‘cyberchondria’), defiance of medical advice, or inclination toward self-diagnosis and self-treatment [3-6].

The interventional treatment of coronary artery disease is one of the topics of high interest among patients and caregivers, as the condition is one of the leading causes of morbidity and mortality globally [7]. The quality and reliability of the information available online on the subject of percutaneous coronary intervention (PCI) may have a considerable impact on the general public’s understanding of the technique, compliance, and outcomes of their therapeutic decisions. Hence, this study aimed to assess and compare the quality of information about PCI on a sample of English, German, Hungarian, Romanian, and Russian websites and to evaluate the reliability of credibility criteria as indicators of information quality. These aspects are hoped to provide valuable insight into the quality of web-based health information, not only on behalf of internet users and medical practitioners but also website owners and policy makers, to serve as foundation for the effective education of the general population on the topic of internet health-related documentation.

Sample Selection

The research was designed as an observational cross-sectional study. Its sample consisted of 125 PCI-related websites intended for the general population in 5 languages (25 for each included language)—English, German, Hungarian, Romanian, and Russian. The Google Search engine was used to identify eligible websites, using “stent” as query term (used as such in English, German, and Romanian; “sztent” in Hungarian; and “стент” in Russian). The query terms were selected based on their popularity as shown by Google Trends, a tool that analyzes the frequency of top search queries in Google Search across various regions and languages. The links returned by the Google Search engine were screened according to a set of preestablished inclusion and exclusion criteria. To be included, a website had to address the subject of coronary stenting, presenting the information in the desired language and a minimum of 300 words. The information had to be targeted at internet users without medical education. Pages addressing subjects other than PCI, sponsored pages appearing in the top hierarchical positions in the results list, and infected or inaccessible pages were excluded. Websites consisting exclusively of audio or video content and websites allowing access only after registration or payment of a fee were also excluded. Similarly, web pages that presented the topic of interest in the form of news or comments on forums and social networks—in other words, pieces of information not meant to thoroughly present the subject of PCI—were not included in the sample. Websites deemed fit for inclusion were consecutively analyzed following a rigorous protocol, briefly illustrated in Figure 1.

The Google searches were performed in April 2019 for English, Hungarian, and Romanian language websites, while the Russian language inquiry took place in June 2019. German language websites were subsequently added to the study in November 2020. A total number of 83, 39, 121, 167, and 94 websites in English, German, Hungarian, Romanian, and Russian language, respectively, were screened until the acquisition of the 25 eligible links for each of the subsamples.

Figure 1. Flowchart representing the main steps of the study.
View this figure

Data Collection

Firstly, the examination was aimed at the websites’ general characteristics and their compliance with 12 general credibility criteria derived from the eEurope 2002 core quality criteria for health-related websites supported by the Commission of the European Communities [8] (Figure 1). Next, the selected pages underwent an exhaustive evaluation of their informational content based on a topic-specific benchmark (Multimedia Appendix 1) [9]. The benchmark was developed using published literature and evidence-based guidelines on the subject of interest as sources of information, in such a way that it covered the topic of PCI to an extent considered sufficient and comprehensible for nonprofessionals. It included information on the following aspects: definitions and introductory notions about PCI, types of coronary stents, indications for the procedure, preprocedural preparation of the patient, description of the procedure, the postprocedural period, what to know or do at home, risks, benefits, costs, other treatment options, general prevention and prophylaxis methods, as well as general warnings regarding alternative treatments. To ensure a practical grading manner, the benchmark was divided logically into 50 items. Their presence on the studied websites was evaluated regarding completeness (ie, the presence of the item on the studied website, evaluated in a binary fashion) and accuracy (ie, the extent to which the item was correctly presented on the studied website, graded on a 3-point scale). The benchmark was reviewed by medical professionals, specialists in the fields of cardiology and interventional radiology, from both Romania and the United States.

The data on the websites’ general characteristics and compliance with credibility criteria were collected by one operator, while the assessments regarding the websites’ informational content were performed independently by 2 evaluators for all websites. The websites’ compliance with the 12 selected eEurope 2002 credibility criteria was assessed in a binary fashion, with 1 point given to every criterion that was met. Based on the obtained sum, the relative credibility score of the given web page was calculated as previously described by Nădăşan et al [9]. Similarly, based on the points awarded for completeness and accuracy for each website, their relative completeness and accuracy scores were computed. All relative scores were reported on a 0-10 scale. The resulting scores were categorized as very poor (0-2), poor (2.1-4), average (4.1-6), good (6.1-8), or very good (8.1-10). The analyzed data are available in Multimedia Appendix 2.

Statistical Analysis

For each included website, the degree of agreement between the 2 evaluators was assessed using the Cohen kappa statistic, a test that measures interrater reliability and is regarded as more robust than simply computing the percentage of agreement, as it adjusts for agreement occurring by chance. Kappa coefficients may range from −1 to 1. A kappa value of 1 indicates perfect agreement, while a value of 0 corresponds to the rate of agreement expected by chance alone. In our study, a coefficient of less than 0.8 prompted a reevaluation to reach a consensus. The Kolmogorov-Smirnov test was used to analyze the normality of the data, based on which the comparisons of data with normal and nonnormal distributions were performed using the 2-tailed Student t test and the 2-tailed Mann-Whitney test, respectively. The correlations between credibility scores on the one hand and completeness and accuracy scores on the other hand were analyzed using the Spearman rank correlation test.

The statistical analyses were conducted using IBM SPSS Statistics for Windows (version 22.0; IBM Corp). The threshold value for statistical significance was set at a value of α=.05. The obtained scores are presented as mean (SD).

Of the 125 included websites, nearly two-thirds had a general medical approach, comprising information belonging to multiple medical specialties. Most of the web pages were owned by private or state medical service providers. In terms of purpose, the pages were predominantly educational. As far as their format was concerned, the most often identified were company presentation pages. Most websites were characterized by a conventional medicine approach. The detailed distribution of the studied websites according to their general characteristics is shown in Table 1.

Table 1. The absolute (n) and relative (%) frequencies of the websites based on their general characteristics.
General characteristicsValues, n (%)

Single medical specialty40 (32)

Multiple medical specialties85 (68)
Website ownership

Foundation or nongovernmental organization15 (12)

Private or state health care provider43 (34.4)

Commercial company23 (18.4)

Manufacturer or distributor of medical supplies and equipment6 (4.8)

Private person3 (2.4)

Educational or research institution9 (7.2)

Unidentifiable26 (20.8)
Main purpose

Educational68 (54.4)

Commercial48 (38.4)

Socialization or support9 (7.2)
Website format

Thematic8 (6.4)

Medical or general portal37 (29.6)

Electronic publication21 (16.8)

Company presentation page or web-based shop52 (41.6)

Blog or personal page3 (2.4)

Other4 (3.2)
Medical paradigm

Conventional medicine108 (86.4)

Mixed (ie, alternative and conventional) approach5 (4)

Unidentifiable12 (9.6)

The websites’ overall compliance with the selected eEurope 2002 credibility criteria was highly variable, with some criteria being fulfilled to a greater extent (providing a direct contact mechanism: 87.2%; including the owner’s name and address: 81.6%; and providing a mission statement: 76%), while others were identified on few of the included web pages (providing a quality procedure statement: 10.4%; including referencing sources: 15.2%; and displaying the date of last update: 16%). The remaining credibility criteria were identified on approximately one to two-thirds of the studied pages (displaying the publication date of the articles and a consultation disclaimer: 31.2% each; including disclosure of commercial interest: 36%; including the authors’ credentials and accreditations: 38.4%; providing a declaration of funding: 43.2%; and offering a confidentiality statement: 62.4%). Figure 2 illustrates the compliance of each of the 5 groups of websites with the selected credibility criteria.

Figure 2. The websites’ level of compliance with the credibility criteria by language subsample.
View this figure

The overall mean relative credibility, completeness, and accuracy scores were 4.4 (SD 2.2), 3.2 (SD 1.6), and 4.3 (SD 1.6), respectively. The mean scores of the 5 language subsamples are summarized in Figure 3. The results of the comparison and correlation tests are presented in Table 2 and Table 3, respectively.

Figure 3. The websites’ relative credibility, completeness, and accuracy scores by language subsample.
View this figure
Table 2. The results of the comparison tests between language subsamples regarding the relative credibility score (RQS), relative completeness score (RCS), and relative accuracy score (RAS). P values with statistical significance are emphasized in italics.
Compared language subsamplesP values

English vs German.19a.002a.004a
English vs Hungarian.001a.04a.11a
English vs Romanian<.001b<.001b<.001a
English vs Russian<.001b<.001a.001a
German vs Hungarian.01a.33a.18a
German vs Romanian<.001b.01b.06a
German vs Russian<.001b.01a.18a
Hungarian vs Romanian.37b.002b.004a
Hungarian vs Russian.94b.002a.02a
Romanian vs Russian.16b.94b.88a

aStudent t test.

bMann-Whitney test.

Table 3. The results of the Spearman rank correlation tests between the credibility scores and informational content quality scores for all the language subsamples (P values with statistical significance are emphasized in italics).
Language subsamplesTested variablesCorrelation coefficientP values

Credibility vs completeness0.3439.09

Credibility vs accuracy0.0578.78

Credibility vs completeness0.4672.01

Credibility vs accuracy0.3994.04

Credibility vs completeness–0.3507.08

Credibility vs accuracy–0.1940.35

Credibility vs completeness–0.2592.21

Credibility vs accuracy–0.3169.12

Credibility vs completeness0.1280.54

Credibility vs accuracy–0.0645.75

Principal Findings

As far as the websites’ credibility is concerned, the obtained scores were average at best, with English and German language websites acquiring the highest results (mean 6.0, SD 1.8 and mean 5.4, SD 1.3, respectively), significantly higher than those of Hungarian, Romanian, and Russian language websites, which were graded as poor. Although certain criteria (eg, displaying the owner’s name and contact information as well as providing a direct contact modality) were largely met by web pages in all 5 languages, other criteria (eg, providing authors’ credentials and accreditations, bibliographic references, articles’ dates of publication and last update, or offering a quality procedure statement) were scarcely included. This may raise a red flag since authorship and providing references are perceived as important indicators of medical information reliability. Apparently, Hungarian, Romanian, and Russian language websites’ owners may not pay enough attention to credibility or are unaware of this aspect. These findings are consistent with previously published literature investigating the credibility of web-based information about different medical topics [10-12]. Moreover, compliance with the credibility criteria for health-related websites as measured by the Health on the Net Code of Conduct has been shown to vary largely depending on the type of organization and health conditions [13].

Regarding the evaluation of the websites’ informational content, the completeness and accuracy of the data about PCI in the 5 studied languages were found to be rather unsatisfactory, with the obtained scores only getting average and poor labels. In terms of completeness, English language websites acquired the highest scores (mean 4.6, SD 1.6), significantly higher than those of the websites in the other 4 language subsamples. German and Hungarian language websites also performed significantly better than the Romanian and Russian websites. In terms of accuracy of data, English language websites had significantly higher scores than German, Romanian, and Russian but not Hungarian websites, which had significantly higher accuracy scores than Romanian and Russian websites. A relative superiority of English language health-related websites compared to Spanish ones has been observed as early as 2001 in a study covering multiple medical conditions (ie, breast cancer, depression, obesity, and childhood asthma), and it was more recently compared to Turkish websites focusing on an orthopaedic intervention [14,15]. Leaving aside methodological differences, the results of these studies call attention to possible language-mediated inequities and suggest that a multilingual approach to web-based documentation may provide more complete coverage of the topic. Apparently, in some countries such as Romania, the low quality of web-based information about PCI seems to be in line with the low number of PCIs per million individuals, as shown by the latest statistics published by the European Society of Cardiology [16]. Efforts to increase the quality of web-based information about PCI would be a reasonable step in countries where access to these interventions is wanting.

The correlation assessments did not find statistically significant relationships between the credibility of the PCI-related websites and the quality of their informational content, with one exception. In the case of German language websites, the compliance with credibility criteria exhibited statistically significant, moderate strength correlations with the websites’ coverage of the topic (ie, completeness and accuracy). The lack of consistent correlations between credibility and content quality has been previously reported in investigations focusing on various medical conditions, such as stroke and depression or procedures such as first aid instructions in case of choking [17-19]. The results may suggest that the selected credibility criteria are not reliable indicators of information quality on PCI-related websites in the studied languages, and therefore, cannot be recommended to nonprofessionals as marks of trustworthiness.


Despite the growing demand for web-based medical information, the recognition of the importance of patient participation in medical decision-making, and the impact of health-related web content on consumer health [20,21], the credibility and quality of websites about PCI—a procedure globally used to mitigate the consequences of the most common type of heart disease—has not yet been rigorously analyzed. To the best of our knowledge, this is the first study analyzing and comparing the quality of information about PCI on English, German, Hungarian, Romanian, and Russian websites aimed at the general population. The results of this study may be used to raise awareness among internet users about the limitations and potential hazards of using the web as a source of information about PCI. Engaging in safe internet browsing is crucial, as it may prevent poor decision-making and potential complications caused by delayed intervention as well as a deterioration of the physician-patient relationship [20,22]. Although the web-based environment is easily accessible and convenient, it is highly advisable that consumers engage in web-based medical documentation with precaution and always turn to medical professionals for advice. Furthermore, medical practitioners should fully acknowledge the reality of e-patients and handle it appropriately [23,24]. In this regard, the involvement of health professionals in the development of plain language and accurate web-based health resources and their involvement in providing guidance to patients with inadequate health literacy in accessing proper information on the internet could prove beneficial [25].

Strengths and Limitations

It is worth noting the strengths of this study. First, the inclusion of multiple languages, of which at least three are spoken by vast numbers of individuals worldwide, allows for the extrapolation of the results and recommendations to a large population. For instance, according to Ethnologue [26], English is the most widely used language around the globe, being spoken by approximately 1.5 billion people across more than 140 countries. Moreover, both Russian and German are among the top 15 most widely spoken languages, with nearly 260 and 135 million speakers, respectively.

Second, most of the previously published studies focus on assessing health-related web-based sources based on credibility (reliability), readability, or design criteria (eg, the Health on the Net Code, JAMA score, DISCERN score, Flesch-Kincaid readability test, and SMOG Readability Index) [27]. As acknowledged by the authors of the DISCERN instrument [28], not even this tool was designed to actually measure the scientific fidelity of the information. Our study addresses not only the credibility or reliability dimension but also the quality of the content by evaluating the completeness and accuracy of information based on an evidence-based, topic-specific quality benchmark.

Third, to minimize subjectivity and the human error factor, the content quality assessments were conducted by 2 independent evaluators.

The main limitations of the study are related to some inherent traits of web-based research. Internet users may turn to various search engines or use different keywords, consecutively obtaining different search results [29]. Moreover, the continuously changing dynamics of the web-based environment make it virtually impossible for the results of this study to be precisely replicated. Additionally, the sample size may be argued as small. However, most internet users limit their inquiries to the first Google Search results page (on average, the first 10 search results) [30]. Therefore, by simulating a popular search strategy among lay internet users, we are confident that our results are likely to reflect common experiences. The study brings valuable descriptive data on the quality of web-based PCI-related information in multiple languages and has the potential to raise awareness about the need for responsible use of health-related web resources.


The quality and reliability of the web-based information about PCI on English, German, Hungarian, Romanian, and Russian websites are rather unsatisfactory, and there are significant differences in the quality of information across the studied languages. It is safe to say that the internet does not provide the general public with good-quality medical information on the aforementioned topic. Moreover, the selected credibility criteria cannot be recommended as consistent indicators of information quality. Further efforts ought to be made by website developers to improve the trustworthiness of web-based health information. Since medical websites have become one of the most trusted sources of health-related documentation, it is crucial to both parties involved in the medical act (ie, lay users and medical practitioners) to develop awareness of the potential dangers internet documentation may pose. Our results could contribute to advances in the fields of preventive medicine or public health, supporting the importance of internet education among the general population.


The authors wish to thank Steven S Maxood, MD, PhD, cardiologist at Providence Saint Mary Heart and Vascular Center, Walla Walla, WA, United States; and László Hadadi, MD, PhD, cardiologist at Targu Mures County Emergency Clinical Hospital, Romania, for their input in the elaboration of the benchmark. We would also like to thank Márta Szabó, MD; László Szabó, MD; and Teodora Sibinovska, MD, at the time medical students at the George Emil Palade University of Medicine, Pharmacy, Science, and Technology of Targu Mures, for their contribution to data acquisition.

This research received no specific grant from any funding agency in the public, commercial, or nonprofit sectors.

Authors' Contributions

CMȘ contributed to the conception of the study; the elaboration of the benchmark; the acquisition, analysis, and interpretation of data; and drafted the manuscript. VN designed and coordinated the study, contributed to the analysis and interpretation of data, and critically revised the manuscript. TU and PCT were involved in the acquisition of data and contributed to the drafting of the manuscript. TB contributed to the elaboration of the benchmark and revised the manuscript. All authors read and approved the final manuscript.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Topic-specific benchmark for assessing the quality of information about percutaneous coronary intervention.

PDF File (Adobe PDF File), 499 KB

Multimedia Appendix 2

Quality assessment data and the results of statistical analyses.

XLSX File (Microsoft Excel File), 154 KB

  1. Zhao Y, Zhang J. Consumer health information seeking in social media: a literature review. Health Info Libr J 2017 Dec;34(4):268-283. [CrossRef] [Medline]
  2. Kim J, Kim S. Physicians' perception of the effects of Internet health information on the doctor-patient relationship. Inform Health Soc Care 2009 Sep 13;34(3):136-148. [CrossRef] [Medline]
  3. Fox S, Duggan M. Health Online 2013. Pew Research Center.   URL: [accessed 2022-11-18]
  4. Ahmad F, Hudak PL, Bercovitz K, Hollenberg E, Levinson W. Are physicians ready for patients with Internet-based health information? J Med Internet Res 2006 Sep 29;8(3):e22 [FREE Full text] [CrossRef] [Medline]
  5. White RW, Horvitz E. Cyberchondria. ACM Trans Inf Syst 2009 Nov 01;27(4):1-37. [CrossRef]
  6. Starcevic V, Berle D. Cyberchondria: towards a better understanding of excessive health-related Internet use. Expert Rev Neurother 2013 Feb;13(2):205-213. [CrossRef] [Medline]
  7. Khan MA, Hashim MJ, Mustafa H, Baniyas MY, Al Suwaidi SKBM, AlKatheeri R, et al. Global epidemiology of Ischemic heart disease: results from the global burden of disease study. Cureus 2020 Jul 23;12(7):e9349 [FREE Full text] [CrossRef] [Medline]
  8. Commission OTECB. eEurope 2002: quality criteria for health related websites. J Med Internet Res 2002 Dec;4(3):E15 [FREE Full text] [CrossRef] [Medline]
  9. Nădăşan V, Roşca AN, Tarcea M, Ábrám Z, Măruşteri M. The quality of Romanian breast cancer websites: a five-year longitudinal assessment. J Cancer Educ 2018 Jun;33(3):703-707. [CrossRef] [Medline]
  10. Lovett J, Gordon C, Patton S, Chen CX. Online information on dysmenorrhoea: an evaluation of readability, credibility, quality and usability. J Clin Nurs 2019 Oct 20;28(19-20):3590-3598 [FREE Full text] [CrossRef] [Medline]
  11. Weber AS, Verjee M, Rahman ZH, Ameerudeen F, Al-Baz N. Typology and credibility of Internet health websites originating from Gulf Cooperation Council countries. East Mediterr Health J 2015 Feb 02;20(12):804-811 [FREE Full text] [Medline]
  12. Lawrentschuk N, Sasges D, Tasevski R, Abouassaly R, Scott AM, Davis ID. Oncology health information quality on the Internet: a multilingual evaluation. Ann Surg Oncol 2012 Mar;19(3):706-713. [CrossRef] [Medline]
  13. Daraz L, Morrow AS, Ponce OJ, Beuschel B, Farah MH, Katabi A, et al. Can patients trust online health information? A meta-narrative systematic review addressing the quality of health information on the internet. J Gen Intern Med 2019 Sep 21;34(9):1884-1891 [FREE Full text] [CrossRef] [Medline]
  14. Berland GK, Elliott MN, Morales LS, Algazy JI, Kravitz RL, Broder MS, et al. Health information on the internet: accessibility, quality, and readability in English and Spanish. JAMA 2001 May 23;285(20):2612-2621 [FREE Full text] [CrossRef] [Medline]
  15. Küçükdurmaz F, Mutlu S, Mutlu H, Parvizi J. A comparison of the quality of online information about total knee arthroplasty available in turkish and english:a cross-sectional study. Acta Orthop Traumatol Turc 2015;49(4):370-374. [CrossRef] [Medline]
  16. Timmis A, Townsend N, Gale C, Torbica A, Lettino M, Petersen SE, European Society of Cardiology. European society of cardiology: cardiovascular disease statistics 2019. Eur Heart J 2020 Jan 01;41(1):12-85. [CrossRef] [Medline]
  17. Nadasan V, Vancea G, Georgescu PA, Tarcea M, Abram Z. The credibility, completeness and accuracy of information about first aid in case of choking on the Romanian websites. JAQM 2011;6(3):18-26 [FREE Full text]
  18. Griffiths KM, Christensen H. Quality of web based information on treatment of depression: cross sectional survey. BMJ 2000 Dec 16;321(7275):1511-1515 [FREE Full text] [CrossRef] [Medline]
  19. Popescu S, Popescu A, Maior D, Dănilă M, Dobria M, Nădășan V. Widely accepted credibility criteria for online health-related information are not correlated with content quality of stroke webpages in two languages of Central and Eastern European countries. JIM 2018;3(3):196-201 [FREE Full text] [CrossRef]
  20. Couper MP, Singer E, Levin CA, Fowler FJ, Fagerlin A, Zikmund-Fisher BJ. Use of the Internet and ratings of information sources for medical decisions: results from the DECISIONS survey. Med Decis Making 2010 Sep;30(5 Suppl):106S-114S. [CrossRef] [Medline]
  21. Smith R, Devine P, Jones H, DeNittis A, Whittington R, Metz J. Internet use by patients with prostate cancer undergoing radiotherapy. Urology 2003 Aug;62(2):273-277. [CrossRef] [Medline]
  22. Murray E, Lo B, Pollack L, Donelan K, Catania J, Lee K, et al. The impact of health information on the Internet on health care and the physician-patient relationship: national U.S. survey among 1.050 U.S. physicians. J Med Internet Res 2003;5(3):e17 [FREE Full text] [CrossRef] [Medline]
  23. Ferguson T, Frydman G. The first generation of e-patients. BMJ 2004 May 15;328(7449):1148-1149 [FREE Full text] [CrossRef] [Medline]
  24. Cotten SR, Gupta SS. Characteristics of online and offline health information seekers and factors that discriminate between them. Soc Sci Med 2004 Nov;59(9):1795-1806. [CrossRef] [Medline]
  25. Arif N, Ghezzi P. Quality of online information on breast cancer treatment options. Breast 2018 Feb;37:6-12. [CrossRef] [Medline]
  26. Eberhard D, Simons G, Fennig CD. Ethnologue: languages of the world. Ethnologue. 2022.   URL: [accessed 2022-10-27]
  27. Battineni G, Baldoni S, Chintalapudi N, Sagaro GG, Pallotta G, Nittari G, et al. Factors affecting the quality and reliability of online health information. Digit Health 2020 Aug 30;6:2055207620948996 [FREE Full text] [CrossRef] [Medline]
  28. Background to discern. DISCERN.   URL: [accessed 2022-11-06]
  29. Dy CJ, Taylor SA, Patel RM, McCarthy MM, Roberts TR, Daluiski A. Does the quality, accuracy, and readability of information about lateral epicondylitis on the internet vary with the search term used? Hand (N Y) 2012 Dec 30;7(4):420-425 [FREE Full text] [CrossRef] [Medline]
  30. Eysenbach G, Köhler C. How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. BMJ 2002 Mar 09;324(7337):573-577 [FREE Full text] [CrossRef] [Medline]

PCI: percutaneous coronary intervention

Edited by G Eysenbach; submitted 19.07.22; peer-reviewed by I Iqbal, E Nichele; comments to author 27.09.22; revised version received 07.11.22; accepted 17.11.22; published 06.12.22


©Cristina M Șulea, Valentin Nădășan, Tatiana Ursachi, Paul-Cătălin Toboltoc, Theodora Benedek. Originally published in the Journal of Medical Internet Research (, 06.12.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.