This paper is in the following e-collection/theme issue:

Chatbots and Conversational Agents (740) Generative Language Models Including ChatGPT (708) Information Seeking, Information Needs (561) Artificial Intelligence (2129) Natural Language Processing (917)

Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/51229, first published .
Comparisons of Quality, Correctness, and Similarity Between ChatGPT-Generated and Human-Written Abstracts for Basic Research: Cross-Sectional Study

Comparisons of Quality, Correctness, and Similarity Between ChatGPT-Generated and Human-Written Abstracts for Basic Research: Cross-Sectional Study

Comparisons of Quality, Correctness, and Similarity Between ChatGPT-Generated and Human-Written Abstracts for Basic Research: Cross-Sectional Study

Authors of this article:

Shu-Li Cheng1 Author Orcid Image ;   Shih-Jen Tsai2, 3 Author Orcid Image ;   Ya-Mei Bai2, 3 Author Orcid Image ;   Chih-Hung Ko4, 5, 6 Author Orcid Image ;   Chih-Wei Hsu7 Author Orcid Image ;   Fu-Chi Yang8 Author Orcid Image ;   Chia-Kuang Tsai8 Author Orcid Image ;   Yu-Kang Tu9, 10 Author Orcid Image ;   Szu-Nian Yang11, 12, 13 Author Orcid Image ;   Ping-Tao Tseng14, 15, 16 Author Orcid Image ;   Tien-Wei Hsu17, 18 Author Orcid Image ;   Chih-Sung Liang19, 20 Author Orcid Image ;   Kuan-Pin Su21, 22, 23 Author Orcid Image
Article Authors Cited by (32) Tweetations (3) Metrics

Journals

  1. Cheng J. Applications of Large Language Models in Pathology. Bioengineering 2024;11(4):342 View
  2. Zhu L, Mou W, Hong C, Yang T, Lai Y, Qi C, Lin A, Zhang J, Luo P. The Evaluation of Generative AI Should Include Repetition to Assess Stability. JMIR mHealth and uHealth 2024;12:e57978 View
  3. Li K, Fernandez A, Schwartz R, Rios N, Carlisle M, Amend G, Patel H, Breyer B. Comparing GPT-4 and Human Researchers in Health Care Data Analysis: Qualitative Description Study. Journal of Medical Internet Research 2024;26:e56500 View
  4. Zhui L, Yhap N, Liping L, Zhengjie W, Zhonghao X, Xiaoshu Y, Hong C, Xuexiu L, Wei R. Impact of Large Language Models on Medical Education and Teaching Adaptations. JMIR Medical Informatics 2024;12:e55933 View
  5. Kim S. Research ethics and issues regarding the use of ChatGPT-like artificial intelligence platforms by authors and reviewers: a narrative review. Science Editing 2024;11(2):96 View
  6. Chou W, Chow J. Enhancing English abstract quality for non-English speaking authors using ChatGPT: A comparative study of Taiwan, Japan, China, and South Korea with slope graphs. Medicine 2024;103(40):e39796 View
  7. Alencar‐Palha C, Ocampo T, Silva T, Neves F, Oliveira M. Performance of a Generative Pre‐Trained Transformer in Generating Scientific Abstracts in Dentistry: A Comparative Observational Study. European Journal of Dental Education 2025;29(1):149 View
  8. Ding Z, Wei R, Xia J, Mu Y, Wang J, Lin Y. Exploring the potential of large language model–based chatbots in challenges of ribosome profiling data analysis: a review. Briefings in Bioinformatics 2024;26(1) View
  9. Omar M, Nassar S, Hijazi K, Glicksberg B, Nadkarni G, Klang E. Generating credible referenced medical research: A comparative study of openAI's GPT-4 and Google's gemini. Computers in Biology and Medicine 2025;185:109545 View
  10. Wang Z, Zhou C. Reassessing AI in Medicine: Exploring the Capabilities of AI in Academic Abstract Synthesis. Journal of Medical Internet Research 2024;26:e55920 View
  11. Li F, Yang Y. Impact of Artificial Intelligence–Generated Content Labels On Perceived Accuracy, Message Credibility, and Sharing Intentions for Misinformation: Web-Based, Randomized, Controlled Experiment. JMIR Formative Research 2024;8:e60024 View
  12. Hsu T, Liang C. Authors’ Reply: Reassessing AI in Medicine: Exploring the Capabilities of AI in Academic Abstract Synthesis. Journal of Medical Internet Research 2024;26:e65123 View
  13. Arzideh K, Baldini G, Winnekens P, Friedrich C, Nensa F, Idrissi-Yaghir A, Hosch R. A Transformer-Based Pipeline for German Clinical Document De-Identification. Applied Clinical Informatics 2025;16(01):031 View
  14. Kim J, Vajravelu B. Assessing the Current Limitations of Large Language Models in Advancing Health Care Education. JMIR Formative Research 2025;9:e51319 View
  15. Akgun M, Savasci M, Gunerbuyuk C, Gunara S, Oktenoglu T, Ozer A, Ates O. Battle of the authors: Comparing neurosurgery articles written by humans and AI. Journal of Clinical Neuroscience 2025;135:111152 View
  16. Donner S. What kind of documents can AI language model outputs be? The concept of artificially blended testimony. Journal of Documentation 2025;81(3):788 View
  17. Jongkind R, Elings E, Joukes E, Broens T, Leopold H, Wiesman F, Meinema J. Is your curriculum GenAI-proof? A method for GenAI impact assessment and a case study. MedEdPublish 2025;15:11 View
  18. Chen X, Xiang J, Lu S, Liu Y, He M, Shi D. Evaluating large language models and agents in healthcare: key challenges in clinical applications. Intelligent Medicine 2025;5(2):151 View
  19. Celikten T, Onan A. Exploring Text Similarity in Human and AI-Generated Scientific Abstracts: A Comprehensive Analysis. IEEE Access 2025;13:74313 View
  20. Culda L, Nerişanu R, Cristescu M, Mara D, Bâra A, Oprea S. Comparative linguistic analysis framework of human-written vs. machine-generated text. Connection Science 2025;37(1) View
  21. Rudko I, Bashirpour Bonab A. ChatGPT is incredible (at being average). Ethics and Information Technology 2025;27(3) View
  22. Sciarra F, Caivano G, Cacioppo A, Messina P, Cumbo E, Di Vita E, Scardina G. Dentistry in the Era of Artificial Intelligence: Medical Behavior and Clinical Responsibility. Prosthesis 2025;7(4):95 View
  23. Han M, Liu Y. Evaluating generative artificial intelligence products using fuzzy social network multi-attribute decision-making model: User perspective. Applied Soft Computing 2025;183:113715 View
  24. Gong Y, Xu C, Luo S, Lin J. Modeling teacher education students’ adoption of large language models through an extended technology acceptance framework. Scientific Reports 2025;15(1) View
  25. Arif B, Aladdin A. A Comparative Analysis of ChatGPT and Traditional Machine Learning Algorithms on Real-World Data. Kurdistan Journal of Applied Research 2025;10(2):93 View
  26. Hui L, Khosa F. Artificial Intelligence in Action: Racial and Gender Disparities in Academic Radiology. Cureus 2025 View
  27. Álvarez-Martínez F, Esteban L, Frungillo L, Butassi E, Zambon A, Herranz-López M, Aranda M, Pollastro F, Tixier A, Garcia-Perez J, Arráez-Román D, Ross A, Mena P, Edrada-Ebel R, Lyng J, Micol V, Borrás-Rocher F, Barrajón-Catalán E. There are significant differences among artificial intelligence large language models when answering scientific questions. Frontiers in Artificial Intelligence 2025;8 View
  28. El-Dakhs D, Afzaal M, Siyanova-Chanturia A. A Genre-Based Comparison of Chat-GPT-Generated Abstracts Versus Human-Authored Abstracts: Focus on Applied Linguistics Research Articles. Corpus Pragmatics 2026;10(1) View
  29. Di Vita E, Caivano G, Sciarra F, Lo Bianco S, Messina P, Cumbo E, Caradonna L, Nigliaccio S, Fontana D, Scardina A, Scardina G. Artificial Intelligence in Medicine and Healthcare: A Complexity-Based Framework for Model–Context–Relation Alignment. Applied Sciences 2025;15(22):12005 View
  30. Popescu-Apreutesei L, Iosupescu M, Necula S, Păvăloaia V. Upholding Academic Integrity amidst Advanced Language Models: Evaluating BiLSTM Networks with GloVe Embeddings for Detecting AI-Generated Scientific Abstracts. Computers, Materials & Continua 2025;84(2):2605 View

Books/Policy Documents

  1. Gómez-García A, Basualto C, Gray N. Demographic Transitions, Health, and Well-Being. View

Conference Proceedings

  1. Preiß N, Westner M. Proceedings of the 20th Conference on Computer Science and Intelligence Systems (FedCSIS). From Agents to Copilots: A Systematic Review of Digital Assistant Technology Adoption in Proprietary Productivity Software View