Published on in Vol 26 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/51635, first published .
Engine of Innovation in Hospital Pharmacy: Applications and Reflections of ChatGPT

Engine of Innovation in Hospital Pharmacy: Applications and Reflections of ChatGPT

Engine of Innovation in Hospital Pharmacy: Applications and Reflections of ChatGPT

Authors of this article:

Xingang Li1 Author Orcid Image ;   Heng Guo1 Author Orcid Image ;   Dandan Li1 Author Orcid Image ;   Yingming Zheng1 Author Orcid Image

Viewpoint

Department of Pharmacy, Beijing Friendship Hospital, Capital Medical University, Beijing, China

Corresponding Author:

Xingang Li, PhD

Department of Pharmacy, Beijing Friendship Hospital

Capital Medical University

No 95, Yongan Road, Xicheng District

Beijing, 100050

China

Phone: 86 1081608511

Email: lxg198320022003@163.com


Hospital pharmacy plays an important role in ensuring medical care quality and safety, especially in the area of drug information retrieval, therapy guidance, and drug-drug interaction management. ChatGPT is a powerful artificial intelligence language model that can generate natural-language texts. Here, we explored the applications and reflections of ChatGPT in hospital pharmacy, where it may enhance the quality and efficiency of pharmaceutical care. We also explored ChatGPT’s prospects in hospital pharmacy and discussed its working principle, diverse applications, and practical cases in daily operations and scientific research. Meanwhile, the challenges and limitations of ChatGPT, such as data privacy, ethical issues, bias and discrimination, and human oversight, are discussed. ChatGPT is a promising tool for hospital pharmacy, but it requires careful evaluation and validation before it can be integrated into clinical practice. Some suggestions for future research and development of ChatGPT in hospital pharmacy are provided.

J Med Internet Res 2024;26:e51635

doi:10.2196/51635

Keywords



Hospital pharmacists play an important role in ensuring the safe and effective use of medications in hospitals. However, pharmacists also face many challenges, such as the increasing complexity of patients’ medication regimens, the potential risks of medication errors and drug-drug interactions, the constant updating of pharmaceutical knowledge, and the growing volume of pharmaceutical literature [1-4]. Due to the large volume of medical-related literature, pharmacists spend a lot of time searching, analyzing, and applying relevant information in clinics. In addition, it takes a lot of effort to keep up with the latest information on new drugs, clinical guidelines, adverse drug reactions, and drug-drug interactions. Therefore, how to quickly and effectively obtain and interpret medication-related information has emerged as a challenge for pharmacists.

With progress in deep learning and natural language processing technologies, generative large language models like ChatGPT have come to the forefront. Its outstanding performance in understanding context and generating text lays a good foundation for its wide application in various fields [5-9]. If ChatGPT is applied to hospital pharmacy, it may become a new tool for hospital pharmacists to solve the aforementioned problems and challenges, improve work efficiency, ensure safe and rational use of drugs, and even greatly change the status quo of hospital pharmacy operations and research [10].

This article aims to explore the application potential of ChatGPT in daily hospital pharmacy operations and research, and analyze the challenges and problems faced by ChatGPT. Simultaneously, we provide our suggestions for the development of artificial intelligence (AI) in this field.


The ChatGPT system is built upon a generative pretrained transformer (GPT) model, which has advantages in natural language processing (NLP). GPT pretrains a large amount of text data, such as books, articles, website content, etc, from which it acquires the ability to understand natural language deeply. The transformer architecture within GPT captures long-distance dependencies and contextual relationships in text through a self-attention mechanism, which enables ChatGPT to generate coherent and context-relevant responses, outputting content similar to human-written content. The working principle underlying its generation of text can be summarized as follows (Figure 1):

Figure 1. ChatGPT’s working principle of generating text.
  1. User input: ChatGPT receives user input information in text form, including single sentences and longer dialogue contexts.
  2. Understanding context: ChatGPT processes the input text and uses pretrained parameters to understand the context and extract relevant information.
  3. Response generation: based on its understanding of the context, ChatGPT uses its knowledge base and language patterns to construct replies and generate coherent and context-relevant responses.
  4. Iterative interaction: in continuous dialogue, ChatGPT can retain dialogue history and context, enabling it to use previous interactions to generate more appropriate responses and ensure smooth dialogue.
  5. Output delivery: ChatGPT presents the generated response to the user in human-readable text to complete the dialogue.

Due to its advanced transformer model, ChatGPT excels at understanding and generating language. This capability expands its application potential across diverse fields, notably enhancing interactions and decision support. In medicine, it promises improvements in patient care, telehealth, information retrieval, and education, etc [11-13].


Daily Operations in Hospital Pharmacy

Drug Information Retrieval and Interpretation

In daily hospital pharmacy operations, pharmacists often need to quickly and accurately retrieve the latest pharmaceutical information. ChatGPT could be used as an auxiliary tool for drug information retrieval and interpretation [14]. Pharmacists can enter specific information for querying, such as drug name, indication, contraindication, medication regimen, adverse reactions, clinical guideline, etc, and provide relevant information [15], thus helping pharmacists save time on information retrieval, improve learning efficiency, and keep their pharmaceutical knowledge up-to-date [16]. In a recent study assessing ChatGPT’s proficiency in clinical pharmacy knowledge, the AI language model was presented with 264 multiple-choice questions commonly used to maintain clinical pharmacists’ basic knowledge. ChatGPT not only achieved a higher accuracy rate of 79% in answering these questions but also demonstrated excellent reproducibility and quality of substantiation, surpassing the performance of pharmacists by a notable margin [17].

Prescription Review and Medication Guidance

ChatGPT can assist pharmacists in the review of prescriptions and offer guidance for the rational use of medications. When used for prescription review, ChatGPT can interact with prescribers, feedback-inappropriate prescriptions or medication orders, and improve the work efficiency of prescription review. For controversial prescriptions or medication orders, they are then submitted to clinical pharmacists for manual review. In terms of medication guidance, pharmacists can enter relevant information of specific patients, such as medical history, laboratory test results and comorbidities, and seek advice from ChatGPT on the most appropriate drug therapy regimen for the patient. By considering the patient’s individual factors, drug information, and evidence-based guidelines and other comprehensive factors, ChatGPT supports pharmacists in making decisions regarding drug selection, medication regimen adjustment, and individualized treatment [18]. Finally, pharmacists integrate the relevant suggestions with their own professional medical knowledge and provide individualized medication guidance and optimized medication regimen for patients [15]. The potential of ChatGPT in proactive polypharmacy management was explored. By processing clinical scenarios, ChatGPT demonstrated an ability to make deprescribing decisions, suggesting it can assist in reviewing prescriptions and guiding medication use. The findings indicate that with specialized training, ChatGPT could offer valuable clinical assistance to primary care physicians in managing complex medication regimens for older patients [19].

Drug Interaction Management

For patients with multiple medications, managing drug interactions is important and could reduce the potential risks. Upon receiving detailed clinical information and medication profiles from patients, an in-depth analysis can be conducted to identify and prevent possible drug interactions. By accessing specialized databases, a comprehensive evaluation of these drug interactions can be carried out, providing professional advice to patients on how to avoid harmful interactions [15]. This helps pharmacists optimize medication regimens, minimize the risk of adverse reactions, and improve the safety of patient medication. There have been reports that ChatGPT has achieved 95% accuracy in predicting and explaining drug-drug interactions. It can generate logical and coherent text output, rather than simply listing the types and mechanisms of interactions [20]. The application of ChatGPT in medication therapy management has the potential to enhance patient safety and involvement, lower health care costs, and assist health care providers in medication management and identifying drug interactions [21]. In a comparative analysis of AI chatbots’ ability to predict drug-drug interactions, Bing AI outperformed others, including different versions of ChatGPT. Despite some limitations, these AI tools showed promise, with ChatGPT demonstrating potential in accurately identifying drug-drug interactions. This underscores the budding utility of AI, and specifically ChatGPT, in streamlining drug interaction management to bolster patient safety [22].

Medication Education and Consultation

Effective medication education and consultation are essential for encouraging patients to actively participate in drug therapy, which is important for promoting the safe and effective use of drugs, improving medication adherence, and optimizing treatment outcomes. However, the reality is that clinical pharmacists have limited time and resources, which limited the extent of medication education and consultation they can provide. ChatGPT could be used as a virtual resource for patient medication education [23], providing information on drug indications, usage, dosage, potential adverse effects, precautions, etc [24]. By serving as a digital assistant, ChatGPT can support pharmacists in consulting on information related to drugs and diseases [25]. It can answer common questions raised by patients and provide professional explanations, such as when to take medicine, how many times a day, what dose to take, whether some foods or alcohol have any effect on medicine, etc, to help patients reduce the risk of medication errors.

ChatGPT’s language processing ability is outstanding, which can solve the language barrier problem in the process of medication education and consultation. ChatGPT’s multilingual support ensures comprehensive medication guidance for patients, regardless of their language preferences [26]. A real-world study found that ChatGPT exhibited a higher appropriateness rate in responding to public medication consultation questions compared to those asked by health care providers in a hospital setting [27]. It is particularly important to note that the medication education and consultation services provided by ChatGPT need to be reviewed by pharmacists to ensure the accuracy of information [28]. Pharmacists support the use of ChatGPT in pharmacy practice but have concerns about its use due to ethical reasons, legal problems, privacy concerns, worries about the accuracy of the data generated, data learning, and bias risk [29]. A summary of the application of ChatGPT in daily work of hospital pharmacy is provided in Figure 2.

Figure 2. Summary of the application of ChatGPT in daily work in hospital pharmacy.

Application of ChatGPT in Research

Literature Review and Analysis

ChatGPT serves as a tool for pharmacists delving into literature, as it aids in the reviews and analyses process [14]. When presented with specific research topics or questions by researchers, it facilitates the retrieval of relevant literature and synthesizes findings, innovations, future trends, and current research gaps. With ChatGPT’s NLP ability, researchers can accelerate the screening, learning, and summarization of related literature and relevant knowledge and development trends in specific fields. For nondomain knowledge, it is possible to sort out relevant knowledge points through progressive questioning, quickly understand the field, and build a knowledge system. By summarizing and abstracting in a concise way, it provides a way for researchers to quickly understand the research achievements of predecessors, saving time for consulting a large volume of literature. In a systematic review assessing medication adherence improvement in patients with ischemic stroke via mobile health interventions, ChatGPT was pitted against human researchers for identifying relevant studies. While human researchers showed a slightly higher precision (0.86) and relevance percentage (9.8%), ChatGPT demonstrated significant efficiency by identifying a substantial number of relevant studies, including a majority of studies that reported adherence improvements, in a fraction of the time required by human researchers. This case illustrates the utility of ChatGPT in literature review and analysis, suggesting that its speed and broad search capabilities can augment traditional research methods, particularly in the initial stages of study identification [30].

Research Topic Selection and Research Design

Researchers can engage in role-playing to consult ChatGPT on a range of questions related to specific field-related research topics, including representative literature, study design, inclusion and exclusion criteria, sample size calculation, research methods, quality control, etc. By offering expert-level insights, ChatGPT serves as a reference for researchers [31]. With ChatGPT’s guidance, researchers not only enrich the research process but also enhance the overall integrity and impact of the scholarly work produced. A study explores the utility of AI-based transformers, specifically ChatGPT, in aiding epidemiological research. By converting STROBE (Strengthening the Reporting of Observational Studies in Epidemiology) guidelines into prompts, ChatGPT was assessed on its ability to generate coherent and relevant responses for observational studies. With mean scores of 3.6 for coherence and 3.3 for relevance, ChatGPT proved to be a valuable asset, particularly in adhering to recognized research standards. However, the study underscores the need for a critical approach to AI-generated content, highlighting the importance of user expertise and awareness of ethical considerations in scientific research [31].

Data Statistical Analysis and Plotting

ChatGPT offers a robust suite of support for data statistical analysis, enabling researchers to extract meaningful information from datasets. ChatGPT’s Code Interpreter plugin is a powerful tool that can translate natural language into executable code for data statistical analysis and plotting. After entering datasets or specific research questions, ChatGPT suggests suitable statistical techniques and interprets the data accordingly. ChatGPT is adept at generating code in programming languages such as Python, SAS, R, etc, and then using Python and other tools for data mining, analysis, and plotting [32]. ChatGPT can work with interactive plotting software to assist researchers in generating various types of figures, including scatter plots, bar charts, line charts, heat maps, and network graphs. By understanding researchers’ input or description of data, ChatGPT could offer plotting suggestions based on the research objectives of the data, recommending the most appropriate graphic types, layouts, and color schemes that best represent the information conveyed. One study compared the statistical analysis capabilities of ChatGPT-4 with traditional biostatistical software (SAS, SPSS, and R) using data from the China Health and Nutrition Survey. ChatGPT-4 demonstrated high consistency, efficiency, and user-friendliness in descriptive statistics, and maintained these advantages in intergroup and correlational analyses despite minor discrepancies with the traditional software. ChatGPT-4 is a powerful tool for epidemiological data analysis, particularly for researchers with intermediate data analysis experience. It suggests that AI’s integration with data analysis platforms can simplify operations and enhance research focus on result interpretation, potentially revolutionizing epidemiological and medical research [33].

Academic Writing

ChatGPT has a very obvious advantage in assisting paper writing [34]. It offers strategic advice on the structure of the paper, guiding researchers in the logical arrangement of the sections and content. In academic paper writing, the accuracy and fluency of language expression are very important. ChatGPT aids in polishing the manuscript’s language and improving the paper’s quality and readability [28,35,36]. However, it should be noted that although ChatGPT can provide a lot of help in paper writing, there is the potential for misunderstandings or errors [37]. It should not supplant the professional knowledge and judgment of researchers [38,39]. Therefore, when using ChatGPT, researchers should verify the reliability of its output results [40]. Simultaneously, ChatGPT should not be used to write entire papers, but rather be used as an auxiliary tool to assist researchers in research and writing [41,42]. ChatGPT serves as a versatile technological tool, one whose influence can be profoundly positive or negative, depending on the wisdom and discretion with which it is used. It holds significant promise as an asset to scientific writing; yet, it lacks the ability to supersede the irreplaceable qualities of human composition and the nuanced faculties of critical thought. Hence, the use of AI in academic writing should be conducted with unwavering adherence to the foundational principles of honesty, rigor, and originality [43]. A summary of the application of ChatGPT in research is provided in Figure 3.

Figure 3. Comprehensive artificial intelligence–enhanced scientific research framework incorporating literature review, topic selection, design, data analysis, and result interpretation.

Although ChatGPT enhances the efficiency of daily work in hospital pharmacy and provides assistance in scientific research, it still faces some technical hurdles and challenges [28,44-46]. ChatGPT’s responses rely on the context provided in the input. However, it may sometimes misunderstand or misinterpret vague queries or complex medical scenarios, resulting in potentially inaccurate or irrelevant responses. Repeated questions to ChatGPT do not ensure consistent answers [24]. Its knowledge is rooted in pretraining data, which means that it lacks the ability to update medical guidelines, latest research results, or constantly evolving clinical practices in real time. Therefore, its answers may not be the most up-to-date information [31]. In addition, biases present in its training data may influence its responses, introducing the risk of biased or incorrect content [47,48]. The performance of ChatGPT-4 and Google Bard in providing accurate preventive medicine and primary care recommendations were evaluated, and a considerable portion of responses from both AI models contained inaccuracies or missing details. The findings underscore the necessity for AI tools to be regularly updated, especially in fast-paced medical fields, and to be used as supplementary resources rather than sole authorities on medical information [49].

Incorporating ChatGPT into hospital settings requires a careful approach to patient privacy and ethical considerations [50]. When interacting with ChatGPT, sensitive information should be deidentified to protect patient privacy. In daily work and scientific research, one should be clear about the advantages and disadvantages of using ChatGPT and obtain informed consent from patients before using ChatGPT. ChatGPT, while capable of addressing professional inquiries and providing recommendations, serves as an auxiliary decision support tool rather than a substitute for the professional knowledge of clinical pharmacists [51]. Pharmacists or researchers should critically evaluate and verify the information provided by ChatGPT before making a final decision, and they should be responsible for the final decision (Figure 4).

Figure 4. Key challenges and issues in artificial intelligence applications highlighting inaccurate responses, outdated information, patient privacy, and ethical concerns.

While the potential of ChatGPT in enhancing hospital pharmacy operations is significant, the practicalities of its integration into existing workflows require careful consideration. The necessary infrastructure includes robust IT systems capable of handling the computational demands of AI, secure data storage solutions to safeguard patient privacy, and a reliable internet connection to ensure continuous access to ChatGPT’s services. Staff training is equally vital, encompassing not only the technical aspects of using the AI tool but also the interpretation of its outputs within a clinical context. Change management strategies must be used to facilitate a smooth transition, addressing potential resistance and fostering a culture of continuous learning and adaptation. Piloting ChatGPT in select areas of the pharmacy, soliciting feedback from frontline staff, and iterating on the implementation plan based on real-world experiences can significantly mitigate challenges and optimize outcomes. Ongoing evaluation and refinement of the integration process are imperative to ensure that the benefits of ChatGPT are fully realized and sustained over time.

To facilitate the development and scientific rational use of AI, it is imperative for governments and industry associations to establish pertinent innovation and regulatory frameworks [37,50]. Innovation policies include formulating technical standards for AI, supporting the research and development of AI, increasing investment in AI technology, strengthening talent cultivation for AI, promoting popularization and promotion of AI, etc. Regulatory policies include strengthening protection of intellectual property rights related to AI, ensuring that AI is only used for reasonable and legal activities, ensuring that relevant policies are conducive to innovation and development of AI, protection of privacy by AI, ethical issues related to AI, etc. The United States has already formulated relevant policies in this regard.

To optimize ChatGPT’s role in hospital pharmacy, enhancing its model performance and reliability is important [26]. On the basis of the original data model, it is crucial to strengthen its training on professional medical datasets. This will enhance its understanding of medical terminology, drug information, and clinical background knowledge. Refining its ability to deliver precise responses to medical inquiries is paramount. By bolstering ChatGPT's interpretive skills in grasping nuanced contexts, it can generate more accurate and contextually fitting answers. Advancing its contextual understanding will not only minimize the incidence of incorrect responses but also elevate its efficacy in intricate medical situations. Medical professionals should participate in training and calibration of ChatGPT and regularly evaluate and verify its performance in medical applications. Through rigorous testing, comparison with gold standards for calibration, and incorporation of feedback from medical professionals, its reliability in the medical field can be enhanced.

AI-assisted diagnosis is based on the intelligent analysis of big data. It is necessary to solve the problem of fragmentation of medical health data to achieve a leap from data to knowledge to intelligence. Efforts must be made to bridge the gaps among disparate data sources, creating a comprehensive medical knowledge center that facilitates a connection between individuals and health care providers. To ensure the widespread adoption of AI in health care, developing interfaces that seamlessly integrate AI technologies with existing hospital information systems is essential. One study introduces PMC-LLaMA, an open-source large language model tailored for medical applications. By integrating a vast database of biomedical literature and textbooks, and fine-tuning with domain-specific instructions, PMC-LLaMA has reportedly outperformed models like ChatGPT in medical question–answering benchmarks. The research provides an open-source framework that could drive future developments in medical AI, offering a foundational model that can be further trained and adapted for various medical tasks [52]. This integration will enable AI to play role in enhancing hospitals’ information infrastructure (Figure 5).

Figure 5. Strategic recommendations for the future development of artificial intelligence.

Integrating ChatGPT into the practice of hospital pharmacy requires a detailed strategy that addresses technology, training, data security, and ethical compliance across several key areas. Initially, a needs assessment determines the scope of assistance that ChatGPT can provide, such as drug information retrieval and patient counseling. Subsequently, IT infrastructure is strengthened to ensure that servers, data storage, and network security can support the integration of ChatGPT, with the development of data interfaces for seamless integration with hospital systems like electronic health records. Concurrently, pharmacy personnel are trained in the use of ChatGPT, emphasizing best practices and potential risks. In terms of privacy and compliance, it is imperative that the use of ChatGPT adheres to data protection regulations such as HIPAA (Health Insurance Portability and Accountability Act) and undergoes review by an ethics committee to prevent ethical issues. Moreover, strict data security protocols and oversight mechanisms are implemented to protect patient information and monitor ChatGPT’s performance. Intuitive user interfaces have been designed to facilitate interaction between medical staff and ChatGPT, and testing in real environments has been conducted, with feedback collected for iterative improvements. Regular assessments of ChatGPT’s performance, including accuracy and user satisfaction, are conducted, and necessary improvements are made based on the evaluation results. Medical personnel are encouraged to engage in research on the application of ChatGPT in pharmacy and to publish their findings to share knowledge. Patients are clearly informed about the supportive role of ChatGPT, its benefits, and the data security measures in place, maintaining full transparency. Additionally, collaboration across various disciplines such as pharmacy, IT, data science, and health care management is fostered to ensure the effective integration of ChatGPT. Finally, clear policies and guidelines for AI use are established to ensure that all relevant personnel understand and comply with these regulations. Through these comprehensive strategies, hospital pharmacy departments can improve work efficiency while ensuring patient safety and data protection.


In summary, with its advanced language generation and understanding capabilities, ChatGPT has great value and broad application prospects in the field of hospital pharmacy. Its potential to streamline daily tasks and spur advancements in scientific research is noteworthy. However, there are still some challenges with ChatGPT’s predictive performance, privacy protection, and ethics. In the future, through policy formulation, model optimization, information integration, and other measures are required to further promote the development and application of AI in hospital pharmacy. ChatGPT is expected to contribute to the transformation of hospital pharmacy in the future, benefiting patients, pharmacists, medical practitioners, and the broader health care ecosystem.

Acknowledgments

This study was funded by Research and Application of Clinical Characteristic Diagnosis and Treatment Technology in Beijing (grant Z221100007422032).

Authors' Contributions

All authors contributed to the writing and reviewing of this viewpoint paper.

Conflicts of Interest

None declared.

  1. Bishop J, Kong D, Schulz T, Thursky K, Buising K. Meeting the challenge for effective antimicrobial stewardship programs in regional, rural and remote hospitals - what can we learn from the published literature? Rural Remote Health. May 2018;18(2):4442-4442. [FREE Full text] [CrossRef] [Medline]
  2. Kennedy MJ. Personalized medicines - are pharmacists ready for the challenge? Integr Pharm Res Pract. Sep 2018;7:113-123. [FREE Full text] [CrossRef] [Medline]
  3. Sakeena MHF, Bennett AA, McLachlan AJ. Enhancing pharmacists' role in developing countries to overcome the challenge of antimicrobial resistance: a narrative review. Antimicrob Resist Infect Control. May 02, 2018;7:63. [FREE Full text] [CrossRef] [Medline]
  4. Zhang T, Lambert H, Zhao L, Liu R, Shen X, Wang D, et al. Antibiotic stewardship in retail pharmacies and the access-excess challenge in China: a policy review. Antibiotics (Basel). Jan 21, 2022;11(2):141. [FREE Full text] [CrossRef] [Medline]
  5. Nguyen J, Pepping CA. The application of ChatGPT in healthcare progress notes: a commentary from a clinical and research perspective. Clin Transl Med. Jul 02, 2023;13(7):e1324. [FREE Full text] [CrossRef] [Medline]
  6. Gilardi F, Alizadeh M, Kubli M. ChatGPT outperforms crowd workers for text-annotation tasks. Proc Natl Acad Sci U S A. Jul 25, 2023;120(30):e2305016120. [FREE Full text] [CrossRef] [Medline]
  7. Kusunose K, Kashima S, Sata M. Evaluation of the accuracy of ChatGPT in answering clinical questions on the Japanese Society of Hypertension guidelines. Circ J. 2023;87(7):1030-1033. [CrossRef]
  8. Liu J, Wang C, Liu S. Utility of ChatGPT in clinical practice. J Med Internet Res. Jun 28, 2023;25:e48568. [FREE Full text] [CrossRef] [Medline]
  9. Egli A. ChatGPT, GPT-4, and other large language models: the next revolution for clinical microbiology? Clin Infect Dis. Nov 11, 2023;77(9):1322-1328. [FREE Full text] [CrossRef] [Medline]
  10. Thirunavukarasu AJ, Ting DSJ, Elangovan K, Gutierrez L, Tan TF, Ting DSW. Large language models in medicine. Nat Med. Aug 17, 2023;29(8):1930-1940. [CrossRef] [Medline]
  11. Mesko B. The ChatGPT (generative artificial intelligence) revolution has made artificial intelligence approachable for medical professionals. J Med Internet Res. Jun 22, 2023;25:e48392. [FREE Full text] [CrossRef] [Medline]
  12. Friederichs H, Friederichs WJ, März M. ChatGPT in medical school: how successful is AI in progress testing? Med Educ Online. Dec 12, 2023;28(1):2220920. [FREE Full text] [CrossRef] [Medline]
  13. Cross J, Robinson R, Devaraju S, Vaughans A, Hood R, Kayalackakom T, et al. Transforming medical education: assessing the integration of ChatGPT into faculty workflows at a Caribbean medical school. Cureus. Jul 2023;15(7):e41399. [FREE Full text] [CrossRef] [Medline]
  14. Jin Q, Leaman R, Lu Z. Retrieve, summarize, and verify: how will ChatGPT affect information seeking from the medical literature? J Am Soc Nephrol. Aug 01, 2023;34(8):1302-1304. [CrossRef] [Medline]
  15. Wang H, Ding YJ, Luo Y. Future of ChatGPT in pharmacovigilance. Drug Saf. Aug 12, 2023;46(8):711-713. [FREE Full text] [CrossRef] [Medline]
  16. Huang X, Estau D, Liu X, Yu Y, Qin J, Li Z. Evaluating the performance of ChatGPT in clinical pharmacy: a comparative study of ChatGPT and clinical pharmacists. Br J Clin Pharmacol. Jan 13, 2024;90(1):232-238. [CrossRef] [Medline]
  17. van Nuland M, Erdogan A, Aςar C, Contrucci R, Hilbrants S, Maanach L, et al. Performance of ChatGPT on factual knowledge questions regarding clinical pharmacy. J Clin Pharmacol. Sep 16, 2024;64(9):1095-1100. [CrossRef] [Medline]
  18. Murugan M, Yuan B, Venner E, Ballantyne C, Robinson K, Coons J, et al. Empowering personalized pharmacogenomics with generative AI solutions. J Am Med Inform Assoc. May 20, 2024;31(6):1356-1366. [CrossRef] [Medline]
  19. Rao A, Kim J, Lie W, Pang M, Fuh L, Dreyer KJ, et al. Proactive polypharmacy management using large language models: opportunities to enhance geriatric care. J Med Syst. Apr 18, 2024;48(1):41. [CrossRef] [Medline]
  20. Juhi A, Pipil N, Santra S, Mondal S, Behera JK, Mondal H. The capability of ChatGPT in predicting and explaining common drug-drug interactions. Cureus. Mar 2023;15(3):e36272. [FREE Full text] [CrossRef] [Medline]
  21. Roosan D, Padua P, Khan R, Khan H, Verzosa C, Wu Y. Effectiveness of ChatGPT in clinical pharmacy and the role of artificial intelligence in medication therapy management. J Am Pharm Assoc (2003). Mar 2024;64(2):422-428.e8. [FREE Full text] [CrossRef] [Medline]
  22. Al-Ashwal FY, Zawiah M, Gharaibeh L, Abu-Farha R, Bitar AN. Evaluating the sensitivity, specificity, and accuracy of ChatGPT-3.5, ChatGPT-4, Bing AI, and Bard against conventional drug-drug interactions clinical tools. Drug Healthc Patient Saf. 2023;15:137-147. [FREE Full text] [CrossRef] [Medline]
  23. Luo Y, Hu N. Can ChatGPT be a new educational tool in medicine? Med Clin (Barc). Oct 27, 2023;161(8):363-364. [CrossRef] [Medline]
  24. He N, Yan Y, Wu Z, Cheng Y, Liu F, Li X, et al. Chat GPT-4 significantly surpasses GPT-3.5 in drug information queries. J Telemed Telecare. Jun 22, 2023:1357633X231181922. [CrossRef] [Medline]
  25. Ayers JW, Zhu Z, Poliak A, Leas EC, Dredze M, Hogarth M, et al. Evaluating artificial intelligence responses to public health questions. JAMA Netw Open. Jun 01, 2023;6(6):e2317517. [FREE Full text] [CrossRef] [Medline]
  26. Zhu Z, Ying Y, Zhu J, Wu H. ChatGPT's potential role in non-English-speaking outpatient clinic settings. Digit Health. Jun 26, 2023;9:20552076231184091. [FREE Full text] [CrossRef] [Medline]
  27. Hsu H, Hsu K, Hou S, Wu C, Hsieh Y, Cheng Y. Examining real-world medication consultations and drug-herb interactions: ChatGPT performance evaluation. JMIR Med Educ. Aug 21, 2023;9:e48433. [FREE Full text] [CrossRef] [Medline]
  28. Meyer JG, Urbanowicz RJ, Martin PCN, O'Connor K, Li R, Peng P, et al. ChatGPT and large language models in academia: opportunities and challenges. BioData Min. Jul 13, 2023;16(1):20. [FREE Full text] [CrossRef] [Medline]
  29. Abu Hammour K, Alhamad H, Al-Ashwal FY, Halboup A, Abu Farha R, Abu Hammour K. ChatGPT in pharmacy practice: a cross-sectional exploration of Jordanian pharmacists' perception, practice, and concerns. J Pharm Policy Pract. Oct 03, 2023;16(1):115. [FREE Full text] [CrossRef] [Medline]
  30. Ruksakulpiwat S, Phianhasin L, Benjasirisan C, Ding K, Ajibade A, Kumar A, et al. Assessing the efficacy of ChatGPT versus human researchers in identifying relevant studies on mHealth interventions for improving medication adherence in patients with ischemic stroke when conducting systematic reviews: comparative analysis. JMIR Mhealth Uhealth. May 06, 2024;12:e51526. [FREE Full text] [CrossRef] [Medline]
  31. Sanmarchi F, Bucci A, Nuzzolese AG, Carullo G, Toscano F, Nante N, et al. A step-by-step researcher's guide to the use of an AI-based transformer in epidemiology: an exploratory analysis of ChatGPT using the STROBE checklist for observational studies. Z Gesundh Wiss. May 26, 2023:1-36. [FREE Full text] [CrossRef] [Medline]
  32. Cloesmeijer ME, Janssen A, Koopman SF, Cnossen MH, Mathôt RAA, SYMPHONY consortium. ChatGPT in pharmacometrics? Potential opportunities and limitations. Br J Clin Pharmacol. Jan 06, 2024;90(1):360-365. [CrossRef] [Medline]
  33. Huang Y, Wu R, He J, Xiang Y. Evaluating ChatGPT-4.0's data analytic proficiency in epidemiological studies: a comparative analysis with SAS, SPSS, and R. J Glob Health. Mar 29, 2024;14:04070. [FREE Full text] [CrossRef] [Medline]
  34. Noy S, Zhang W. Experimental evidence on the productivity effects of generative artificial intelligence. Science. Jul 14, 2023;381(6654):187-192. [CrossRef] [Medline]
  35. Lenharo M. ChatGPT gives an extra productivity boost to weaker writers. Nature. Jul 13, 2023. [CrossRef] [Medline]
  36. Darzidehkalani E. ChatGPT in medical publications. Radiology. Jun 01, 2023;307(5):e231188. [CrossRef] [Medline]
  37. Garcia MB. Using AI tools in writing peer review reports: should academic journals embrace the use of ChatGPT? Ann Biomed Eng. Feb 27, 2024;52(2):139-140. [CrossRef] [Medline]
  38. Munoz-Zuluaga C, Zhao Z, Wang F, Greenblatt M, Yang H. Assessing the accuracy and clinical utility of ChatGPT in laboratory medicine. Clin Chem. Aug 02, 2023;69(8):939-940. [CrossRef] [Medline]
  39. Graham F. Daily briefing: the pros and cons of writing a paper with ChatGPT. Nature. Jul 07, 2023. [CrossRef] [Medline]
  40. Baker N, Thompson B, Fox D. ChatGPT can write a paper in an hour - but there are downsides. Nature. Jul 12, 2023. [CrossRef] [Medline]
  41. Ring J. Artificial intelligence-ChatGPT and scientific publishing. J Eur Acad Dermatol Venereol. Jul 12, 2023;37(7):1253-1254. [CrossRef] [Medline]
  42. Shafiee A. Matters arising: authors of research papers must cautiously use ChatGPT for scientific writing. Int J Surg. Sep 01, 2023;109(9):2853-2854. [FREE Full text] [CrossRef] [Medline]
  43. He S, Yang F, Zuo J, Lin Z. ChatGPT for scientific paper writing-promises and perils. Innovation (Camb). Nov 13, 2023;4(6):100524. [FREE Full text] [CrossRef] [Medline]
  44. Dashti M, Londono J, Ghasemi S, Moghaddasi N. How much can we rely on artificial intelligence chatbots such as the ChatGPT software program to assist with scientific writing? J Prosthet Dent. Jul 10, 2023. [CrossRef] [Medline]
  45. Heng JJY, Teo DB, Tan LF. The impact of Chat Generative Pre-trained Transformer (ChatGPT) on medical education. Postgrad Med J. Sep 21, 2023;99(1176):1125-1127. [CrossRef] [Medline]
  46. Qureshi R, Shaughnessy D, Gill KAR, Robinson KA, Li T, Agai E. Are ChatGPT and large language models "the answer" to bringing us closer to systematic review automation? Syst Rev. Apr 29, 2023;12(1):72. [FREE Full text] [CrossRef] [Medline]
  47. Morath B, Chiriac U, Jaszkowski E, Deiß C, Nürnberg H, Hörth K, et al. Performance and risks of ChatGPT used in drug information: an exploratory real-world analysis. Eur J Hosp Pharm. Jun 01, 2023:ejhpharm-2023-003750. [CrossRef] [Medline]
  48. Kao Y, Chuang W, Yang J. Use of ChatGPT on Taiwan's examination for medical doctors. Ann Biomed Eng. Mar 11, 2024;52(3):455-457. [CrossRef] [Medline]
  49. Kassab J, Hadi El Hajjar A, Wardrop RM, Brateanu A. Accuracy of online artificial intelligence models in primary care settings. Am J Prev Med. Jun 2024;66(6):1054-1059. [CrossRef] [Medline]
  50. Minssen T, Vayena E, Cohen IG. The challenges for regulating medical use of ChatGPT and other large language models. JAMA. Jul 25, 2023;330(4):315-316. [CrossRef] [Medline]
  51. Li S. Exploring the clinical capabilities and limitations of ChatGPT: a cautionary tale for medical applications. Int J Surg. Sep 01, 2023;109(9):2865-2867. [FREE Full text] [CrossRef] [Medline]
  52. Wu C, Lin W, Zhang X, Zhang Y, Xie W, Wang Y. PMC-LLaMA: toward building open-source language models for medicine. J Am Med Inform Assoc. Sep 01, 2024;31(9):1833-1843. [CrossRef] [Medline]


AI: artificial intelligence
GPT: generative pretrained transformer
HIPAA: Health Insurance Portability and Accountability Act
NLP: natural language processing
STROBE: Strengthening the Reporting of Observational Studies in Epidemiology


Edited by G Eysenbach, T de Azevedo Cardoso; submitted 06.08.23; peer-reviewed by Z Wang, X Li, Z Wang, T Ma; comments to author 07.03.24; revised version received 09.04.24; accepted 06.09.24; published 04.10.24.

Copyright

©Xingang Li, Heng Guo, Dandan Li, Yingming Zheng. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 04.10.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.