This paper is in the following e-collection/theme issue:

Generative Language Models Including ChatGPT (492) Artificial Intelligence (1723) Clinical Information and Decision Making (1647) Chatbots and Conversational Agents (627) Decision Support for Health Professionals (1337)

Published on in Vol 25 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/48659, first published .
Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study

Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study

Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study

Authors of this article:

Arya Rao1, 2, 3 Author Orcid Image ;   Michael Pang1, 2, 3 Author Orcid Image ;   John Kim1, 2, 3 Author Orcid Image ;   Meghana Kamineni1, 2, 3 Author Orcid Image ;   Winston Lie1, 2, 3 Author Orcid Image ;   Anoop K Prasad1, 2, 3 Author Orcid Image ;   Adam Landman2, 4 Author Orcid Image ;   Keith Dreyer2, 5 Author Orcid Image ;   Marc D Succi1, 2, 3, 6 Author Orcid Image
Article Authors Cited by (152) Tweetations (29) Metrics
All Time | Last Month | Last Six Months | Last Year
cagsei cagsei @cagsei

ChatGPT klinik karar vermede 'etkileyici' bir doğruluk göstermiş. ChatGPT'nin tüm tıbbi uzmanlık alanlarında ve klinik bakım aşamalarında yaklaşık yüzde 72 doğruluğa sahip olduğu ve nihai tanı koymada ise yüzde 77 doğruluğa sahip olduğu tespit edilmiş https://t.co/nYfGfHXIdr

4:21 PM · Aug 22, 2023

1
0
JMIR Publications JMIR Publications @jmirpub

New in JMIR: Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and #Usability #UX #Study https://t.co/AHPDOvHKCs https://t.co/T7nSSf3QWN

4:25 PM · Aug 22, 2023

0
1
Journal of Medical Internet Research Journal of Medical Internet Research @JMIR_

RT @jmirpub: New in JMIR: Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and #Usability #UX #Study h…

4:25 PM · Aug 22, 2023

0
1
Tom Bellis Tom Bellis @tommybellis

Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study https://t.co/tDc3lOdrfh https://t.co/Gn4rQ873UY

4:37 PM · Aug 22, 2023

0
0
Olivier Miossec Olivier Miossec @omiossec_med

#ChatGPT Displays 72% Accuracy in Clinical Decision Making https://t.co/3ItjOC8G0j

4:01 AM · Aug 23, 2023

0
0
NHFT Library Service NHFT Library Service @NHFTNHSLibrary

Assessing the Utility of #ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study https://t.co/woI3uHVw4W #Openaccess #research in @jmirpub #AI #artificalintelligence #clinialdecisionmaking #diagnostics #DigitalHealth

8:55 AM · Aug 23, 2023

2
2
Chidambara .ML. Chidambara .ML. @chidambara09

RT @NHFTNHSLibrary: Assessing the Utility of #ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study https://t.co…

10:46 AM · Aug 23, 2023

2
2
Jacqueline Sepúlveda Jacqueline Sepúlveda @JackieUdeC

Un estudio demostró que #ChatGPT tiene una precisión del 72% en la toma de decisiones clínicas y un 77% en el diagnóstico final. Por ahora hay que analizar con cautela estos hallazgos, ya que podrían impactar los procesos formativos. #SaludDigital https://t.co/13UTrsKQQ8

12:00 PM · Aug 23, 2023

0
0
JMIR Publications JMIR Publications @jmirpub

RT @NHFTNHSLibrary: Assessing the Utility of #ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study https://t.co…

1:37 PM · Aug 23, 2023

2
2
Sandro Graca Sandro Graca @SandroGraca

The Doct...the ChatGPT will see you now ???????? https://t.co/pMI5V71zyl ChatGPT achieves impressive accuracy in clinical decision-making, w/ increasing strength as it gains more clinical information. ???? greatest accuracy in tasks of final diagnosis as compared to initial diagnosis

11:15 PM · Aug 24, 2023

0
0
Giuseppe Biondi-Zoccai Giuseppe Biondi-Zoccai @gbiondizoccai

'ChatGPT achieves impressive accuracy in clinical decision-making, with increasing strength as it gains more clinical information. ChatGPT demonstrates the greatest accuracy in tasks of final diagnosis as compared to initial diagnosis' https://t.co/AY9kstBAEj @OpenAI #ChatGPT https://t.co/yGFLCWSYnZ

10:07 AM · Aug 25, 2023

0
0
河野 健一　生成AI ✕ 医療に注目！ 手術支援AI CEO 脳外科医 河野 健一　生成AI ✕ 医療に注目！ 手術支援AI CEO 脳外科医 @CeoImed

｢臨床ワークフロー全体のGPTの有用性｣ ･ 患者との関わりから、鑑別診断、検査、診断、管理を通じて、GPTの意思決定サポートを評価 ･ 最初の鑑別診断で最低の精度60%で、最終診断で最高精度77% 現時点ではある程度情報が集まってからGPT使用するのが臨床上は良さそう https://t.co/WXX9BlNiGT https://t.co/cxDa4OqJzC

12:01 AM · Aug 26, 2023

4
0
おぐま おぐま @o6lvl4

RT @CeoImed: ｢臨床ワークフロー全体のGPTの有用性｣ ･ 患者との関わりから、鑑別診断、検査、診断、管理を通じて、GPTの意思決定サポートを評価 ･ 最初の鑑別診断で最低の精度60%で、最終診断で最高精度77% 現時点ではある程度情報が集まってからGPT使…

8:58 AM · Aug 26, 2023

9
1
Florencia Tevy Florencia Tevy @florenciatevy

RT @JackieUdeC: Un estudio demostró que #ChatGPT tiene una precisión del 72% en la toma de decisiones clínicas y un 77% en el diagnóstico f…

8:22 PM · Aug 28, 2023

1
2
????Victoria Aranguiz???? ???????????? ????Victoria Aranguiz???? ???????????? @Azulvictoria

RT @JackieUdeC: Un estudio demostró que #ChatGPT tiene una precisión del 72% en la toma de decisiones clínicas y un 77% en el diagnóstico f…

10:20 PM · Aug 28, 2023

1
2
Brian Ahier Brian Ahier @ahier

ChatGPT plays doctor with 72% success https://t.co/3bXBC8ejLz https://t.co/UGtNm7ICLW

1:32 PM · Aug 29, 2023

3
2
Angélique Caste Angélique Caste @Angeliquecaste

RT @ahier: ChatGPT plays doctor with 72% success https://t.co/3bXBC8ejLz https://t.co/UGtNm7ICLW

1:33 PM · Aug 29, 2023

3
2
Luka.eth ????️ Luka.eth ????️ @LukaWeb3

RT @ahier: ChatGPT plays doctor with 72% success https://t.co/3bXBC8ejLz https://t.co/UGtNm7ICLW

1:35 PM · Aug 29, 2023

3
2
Hillary Johnson: journalist Hillary Johnson: journalist @oslersweb

In future, might AI dx ME faster + more accurately because MD bigotry and ignorance is removed from process? That's assuming dx continues to be symptom-based (no lab-based markers). More reliable dx would also provide more accurate prevalence numbers. https://t.co/jSh4VmYcAs

3:20 PM · Aug 29, 2023

7
0
Andrew Hundt ????????x4 ahundt@mastodon.social Andrew Hundt ????????x4 ahundt@mastodon.social @athundt

@jmirpub @RetractionWatch The design of this study looks seriously problematic: https://t.co/4W5jjM521h

4:28 AM · Aug 30, 2023

0
0
Chris Bennett, MD Chris Bennett, MD @cleebennett

“ChatGPT achieves impressive accuracy in clinical decision-making, with increasing strength as it gains more clinical information at its disposal…” https://t.co/uxEcEAgcvB

2:51 PM · Aug 30, 2023

0
0
nisten nisten @nisten

@Scobleizer Where the are their actual prompts..methodology.. or any code.. or testing setup... how the fuck is anyone supposed to reproduce this...unless they cherrypick allow you to do it?! https://t.co/grKIrbBnR4

4:00 PM · Aug 30, 2023

0
0
Brian Ahier Brian Ahier @ahier

RT @ahier: ChatGPT plays doctor with 72% success https://t.co/3bXBC8ejLz https://t.co/UGtNm7ICLW

6:28 PM · Sep 01, 2023

3
3
AI Aorta AI Aorta @ai_aorta19268

Rao A, Pang M, Kim J, Kamineni M, Lie W, Prasad AK, Landman A, Dreyer K, Succi MD Assessing the Utility of ChatGPT Throughout the Entire Clinical Workflow: Development and Usability Study JMIR 2023 doi: 10.2196/48659 PMID: 37606976 https://t.co/b3p6atLdd6

3:08 AM · Sep 02, 2023

0
0
中島 啓 kei nakashima 中島 啓 kei nakashima @keinakashima1

Chat GPTは医学的な臨床判断において，71.7%の正確性を示した． Journal of Medical Internet Research https://t.co/pqcqSATjGg

9:24 PM · Sep 03, 2023

9
0
Daily Dose of Data Daily Dose of Data @data_debunks

According to a comprehensive study assessing ChatGPT's clinical decision-making aka. Doctor playing capabilities, ChatGPT managed to achieve an overall accuracy of 71.7%. A link to the study: https://t.co/y9S78OPKt4

7:25 PM · Sep 08, 2023

0
0
MedPro Group MedPro Group @MedProProtector

Study examines #ChatGPT’s capacity for ongoing clinical decision support: https://t.co/EHeq0WF3Je #AI https://t.co/fwJJ8fJ0EI

6:35 PM · Sep 15, 2023

0
0
????????????????????????{*-*}???????????? ???????? ????????????????????????{*-*}???????????? ???????? @sargon_sus

@DahiliyeDoktoru el-cevap ; EVET,ALABİLİR(!) en azından pratisyen hekimler, dermatologlar, iç hastalıkları(dahiliye) elenir :) ayırıcı tanı koymada zayıf olsa da %77'lik doğruluk oranı fena değil :) https://t.co/AUmEltTEwh

3:18 PM · Sep 23, 2023

1
0
Dexter Dexter @Dexter_90_

@Bloncka_hlasi @kajki_ Zkoušela jste chatGPT? Dost často se plete, ale někdy se trefí, tak to může stát za pokus. https://t.co/X1fbmkBFTJ

10:09 AM · Oct 18, 2023

1
0
????????????????????????{*-*}???????????? ???????? ????????????????????????{*-*}???????????? ???????? @sargon_sus

@tupludahiliyeci @drfaithdz sevgili doktorum, nasıl ki tüplü televizyon ve tüplü ocak devri bittiyse çok yakın bir gelecekte de tüplü dahiliye uzmanları bitecek :) sizinle birlikte pratisyen hekimler, dermatologlar da elenecek :) ayırıcı tanıda %77'lik doğruluk oranı fena değil :) https://t.co/AUmEltTEwh

8:46 AM · Nov 22, 2023

0
0
????????????????????????{*-*}???????????? ???????? ????????????????????????{*-*}???????????? ???????? @sargon_sus

@Aegean_E ayırıcı tanıda %77'lik doğruluk oranı sağlayan ve anında vaka analizi yapabilen bir sistem :) https://t.co/AUmEltTEwh

3:11 PM · Nov 23, 2023

2
0
????????????????????????{*-*}???????????? ???????? ????????????????????????{*-*}???????????? ???????? @sargon_sus

@DrGozen sevgili @DrGozen ; Cerrahlar ve Operatörler harici bütün branşlar yapay zekaya elenecekler ! CoPilot (Bing Chat AI) ve Babylon Health çoktan eledi sizleri :) ayırıcı tanıda %77'lik doğruluk oranı azımsanacak değil :) https://t.co/AUmEltTEwh

9:56 AM · Dec 08, 2023

4
2
Komik Olmayan Erkek Komik Olmayan Erkek @erkekkomikdegil

RT @sargon_sus: @DrGozen sevgili @DrGozen ; Cerrahlar ve Operatörler harici bütün branşlar yapay zekaya elenecekler ! CoPilot (Bing Chat A…

10:13 AM · Dec 08, 2023

4
2