Published on in Vol 27 (2025)

This is a member publication of JISC

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/72186, first published .
Differences in Expert Perspectives on AI Training in Medical Education: Secondary Analysis of a Multinational Delphi Study

Differences in Expert Perspectives on AI Training in Medical Education: Secondary Analysis of a Multinational Delphi Study

Differences in Expert Perspectives on AI Training in Medical Education: Secondary Analysis of a Multinational Delphi Study

1School of Life Course and Population Sciences, King's College London, London, United Kingdom

2School of Public Health, Imperial College London, White City Campus, 90 Wood Lane, London, United Kingdom

3Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore

4WHO Collaborating Centre for Digital Health and Health Education, Nanyang Technological University, Singapore, Singapore

5School of Medicine, Faculty of Health and Medical Sciences, Taylor's University, Subang Jaya, Malaysia

6Department of Global Health and Population, Harvard TH Chan School of Public Health, Harvard University, Cambridge, MA, United States

7Department of Global Health and Social Medicine, Harvard Medical School, Harvard University, Cambridge, MA, United States

Corresponding Author:

Qi Chwen Ong, MBBS


In this secondary analysis of a multinational Delphi study, experts from low- and middle-income countries were less likely than those from high-income countries to consider artificial intelligence (AI) learning outcomes mandatory in preregistration medical education, potentially reflecting underlying global inequalities in medical AI education and highlighting the need for adaptable AI competency frameworks.

J Med Internet Res 2025;27:e72186

doi:10.2196/72186

Keywords



Artificial intelligence’s (AI) rapid advances in health care have intensified calls for incorporating AI training into medical education [1]. However, few existing AI-related medical curricula are tailored to specific national contexts and lack global applicability [2,3]. Perspectives on the relevance and prioritization of AI training may vary between high-income countries (HICs) and low- and middle-income countries (LMICs), as do the development, evaluation, and implementation of health care AI technologies [4,5]. Understanding differences in AI training priorities is crucial for designing medical curricula addressing global and national health care needs. We examined differences in perspectives on the prioritization of AI learning outcomes (LOs) in preregistration medical education between experts from HICs and LMICs.


Overview

We conducted a secondary analysis using deidentified data from a multinational 2-round modified Delphi study on digital health competencies in medical education (DECODE) [6]. This study involved 211 experts from 79 countries and territories recruited through purposive and snowball sampling based on expertise in digital health, health informatics, clinical medicine, or medical education. Only participants who completed both rounds of the Delphi survey were included in this analysis. The detailed Delphi methodology and description of AI LOs were reported elsewhere [6].

Participants rated 19 proposed LOs under the competency domain “Artificial Intelligence in Healthcare” from the DECODE framework (Multimedia Appendix 1) as mandatory, elective, or supplementary. The outcome was the binary conversion of ratings on prioritization (mandatory vs discretionary [elective/supplementary]) of AI LOs. The main exposure variable was participants’ self-reported country of primary affiliation, classified as either HIC or LMIC based on the World Bank’s income classification [7]. Differences in participant characteristics were assessed using Fisher exact tests. To account for participant-level clustering in repeated measures data and varying correlations between AI LOs (ie, conceptual, technical, and ethical aspects), we used generalized estimating equations with an unstructured correlation matrix to examine the association between participants’ ratings of AI LOs and their country income group. Models were adjusted for participants’ clinical background, research role, and leadership position. Variables such as clinical role, hospital workplace, teaching role, and university workplace were excluded due to multicollinearity. All analyses were performed using R version 4.3.1 (R Project for Statistical Computing), with a 2-sided P<.05 considered statistically significant.

Ethical Considerations

The original Delphi study and this secondary analysis were approved by the Nanyang Technological University Institutional Review Board (IRB-2021‐838). Additional informed consent was not required for this secondary analysis due to the use of deidentified data.


Of the 149 experts who participated in both rounds of the original Delphi study, 130 (87.2%) completed the AI LO section (n=59, 45.4% from HICs and n=71, 54.6% from LMICs). Significant differences between HIC and LMIC participants were observed in teaching roles (P=.01), clinical setting (hospital or private practice; P=.03), or institutional leadership positions (P<.001; Table 1). In the adjusted model, experts from LMICs were significantly less likely to rate AI LOs as mandatory in medical education (odds ratio 0.58, 95% CI 0.37‐0.91; P=.02) compared to their HIC counterparts (Table 2).

Table 1. Characteristics of Delphi experts by country income groups.
CharacteristicsExperts (n=130), n (%)P value
HICsa (n=59)LMICsb (n=71)
Primary professional discipline>.99
Clinical medicine41 (69)50 (70)
Nonclinical medicine18 (31)21 (30)
Teaching role.01
Yes43 (73)64 (90)
No16 (27)7 (10)
Clinical role.50
Yes32 (54)33 (46)
No27 (46)38 (54)
Research role.40
Yes40 (68)53 (75)
No19 (32)18 (25)
Institutional leadership positionc<.001
Yes11 (19)34 (48)
No48 (81)37 (52)
Worked in university.50
Yes56 (95)65 (92)
No3 (5)6 (8)
Worked in hospital/private practice.03
Yes35 (59)28 (39)
No24 (41)43 (61)

aHIC: high-income country.

bLMIC: low- and middle-income countries.

cDefined as president (or vice president), chancellor, or rector of a university; dean or vice dean of a medical school or faculty; or chief medical officer or chief medical informatics officer of a health care institution.

Table 2. Inclusion of artificial intelligence learning outcomes in medical education by country income groups.
Learning outcomeUnadjusted ORa (95% CI)P valueAdjusted ORb (95% CI)P value
Mandatory inclusion of artificial intelligence learning outcomes
Low- and middle-income countries0.64 (0.43‐0.95).03c0.58 (0.37‐0.91).02c
Clinical medicine background —d —0.86 (0.56‐1.31).47
Research role — —0.86 (0.58‐1.26).44
Institutional leadership — —1.34 (0.86‐2.09).19

aOR: odds ratio.

bAdjusted for clinical medicine background, research role, and institutional leadership position.

cP<.05.

dNot applicable.


In this secondary analysis of data from 130 experts, those from LMICs appeared less likely to consider AI LOs as mandatory compared to their HIC counterparts, which may have implications for widening inequalities in medical AI expertise between HICs and LMICs. Our findings extend research on regional variation in attitudes toward AI in health care. One cross-sectional study revealed differing views on AI in practice between health profession students from the Global North and Global South [8], while another study reported lower confidence in clinical AI among physicians and medical students from lower middle– and low-income countries compared to those from upper middle– and high-income countries [9]. The congruence of our findings with these studies points to a potential divergence in AI perceptions across income settings, likely reflecting broader structural inequalities such as disparities in digital infrastructure, educational resources, institutional readiness, and exposure to AI technologies, rather than disagreement on the value of AI training.

Several limitations should be noted. Binary classification of countries may mask important intragroup differences. Imbalanced representation of participant roles may have introduced bias, and important demographic variables such as age, gender, and years of experience were not available. Expert migration, institutional policies, and exposure to AI may also have influenced expert responses. Future research should use qualitative methods to elucidate contextual determinants of expert opinions on AI training.

In conclusion, our findings indicate that a one-size-fits-all approach to AI training in medical education may not be appropriate. An adaptable, needs-based framework that considers socioeconomic, infrastructural, and health care disparities could better serve the diverse needs of medical students and health systems worldwide.

Acknowledgments

The authors thank all expert panelists and collaborators involved in the Delphi study. No funding was received for this study.

Data Availability

Requests for data access should be addressed to the corresponding author and will require ethical and legal approval by the relevant institutions.

Authors' Contributions

QCO contributed to the conceptualization, methodology, investigation, data curation, project administration, formal analysis, validation, visualization, writing of the original draft, and review and editing. CSA contributed to the formal analysis, validation, and review and editing. NML contributed to the investigation, review and editing, and supervision. RA contributed to the conceptualization, methodology, investigation, review and editing, and supervision. JC contributed to the conceptualization, methodology, investigation, project administration, review and editing, and supervision. All authors approved the final version of the manuscript.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Ratings of artificial intelligence learning outcomes in 2-round modified Delphi survey.

DOCX File, 23 KB

  1. Paranjape K, Schinkel M, Nannan Panday R, Car J, Nanayakkara P. Introducing artificial intelligence training in medical education. JMIR Med Educ. Dec 3, 2019;5(2):e16048. [CrossRef] [Medline]
  2. Çalışkan SA, Demir K, Karaca O. Artificial intelligence in medical education curriculum: an e-Delphi study for competencies. PLoS One. Jul 21, 2022;17(7):e0271872. [CrossRef] [Medline]
  3. Singla R, Pupic N, Ghaffarizadeh SA, et al. Developing a Canadian artificial intelligence medical curriculum using a Delphi study. NPJ Digit Med. Nov 18, 2024;7(1):323. [CrossRef] [Medline]
  4. Yang R, Nair SV, Ke Y, et al. Disparities in clinical studies of AI enabled applications from a global perspective. NPJ Digit Med. Aug 10, 2024;7(1):209. [CrossRef] [Medline]
  5. Serra-Burriel M, Locher L, Vokinger KN. Development pipeline and geographic representation of trials for artificial intelligence/machine learning–enabled medical devices (2010 to 2023). NEJM AI. Nov 9, 2023:AIp2300038. [CrossRef]
  6. Car J, Ong QC, Erlikh Fox T, et al. The digital health competencies in medical education framework: an international consensus statement based on a Delphi study. JAMA Netw Open. Jan 2, 2025;8(1):e2453131. [CrossRef] [Medline]
  7. World Bank country and lending groups. World Bank Data Help Desk. URL: https:/​/datahelpdesk.​worldbank.org/​knowledgebase/​articles/​906519-world-bank-country-and-lending-groups [Accessed 2025-03-18]
  8. Busch F, Hoffmann L, Truhn D, et al. Global cross-sectional student survey on AI in medical, dental, and veterinary education and practice at 192 faculties. BMC Med Educ. Sep 28, 2024;24(1):1066. [CrossRef] [Medline]
  9. Chen M, Zhang B, Cai Z, et al. Acceptance of clinical artificial intelligence among physicians and medical students: a systematic review with cross-sectional survey. Front Med (Lausanne). Aug 31, 2022;9:990604. [CrossRef] [Medline]


AI: artificial intelligence
DECODE: digital health competencies in medical education
HIC: high-income country
LMIC: low- and middle-income countries
LO: learning outcome


Edited by Taiane de Azevedo Cardoso; submitted 05.02.25; peer-reviewed by Rong Yin, Yih-Dih Cheng; final revised version received 11.04.25; accepted 21.04.25; published 09.05.25.

Copyright

© Qi Chwen Ong, Chin-Siang Ang, Nai Ming Lai, Rifat Atun, Josip Car. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 9.5.2025.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research (ISSN 1438-8871), is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.