Search Articles

View query in Help articles search

Search Results (1 to 4 of 4 Results)

Download search results: CSV END BibTex RIS


Designing a Multimodal and Culturally Relevant Alzheimer Disease and Related Dementia Generative Artificial Intelligence Tool for Black American Informal Caregivers: Cognitive Walk-Through Usability Study

Designing a Multimodal and Culturally Relevant Alzheimer Disease and Related Dementia Generative Artificial Intelligence Tool for Black American Informal Caregivers: Cognitive Walk-Through Usability Study

We observed how Black American caregivers expressed the need for multimodality of interaction to equitably access what generative AI tools have to offer. Indeed, they expressed the importance of being able to “talk with the tool” and hear back (eg, read content out loud) in the fashion of a conversational voice assistant.

Cristina Bosco, Ege Otenen, John Osorio Torres, Vivian Nguyen, Darshil Chheda, Xinran Peng, Nenette M Jessup, Anna K Himes, Bianca Cureton, Yvonne Lu, Carl V Hill, Hugh C Hendrie, Priscilla A Barnes, Patrick C Shih

JMIR Aging 2025;8:e60566

Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook

Multimodal Large Language Models in Health Care: Applications, Challenges, and Future Outlook

Finally, multimodality characterizes systems designed to generate outputs in >1 modality, such as systems capable of producing both textual and image-based content [40]. Several previous works have developed basic M-LLMs by aligning the well-trained encoders from different modalities with the textual feature space of LLMs. This approach enables LLMs to process inputs other than text, as seen in various examples [41-44].

Rawan AlSaad, Alaa Abd-alrazaq, Sabri Boughorbel, Arfan Ahmed, Max-Antoine Renault, Rafat Damseh, Javaid Sheikh

J Med Internet Res 2024;26:e59505

The Impact of Multimodal Large Language Models on Health Care’s Future

The Impact of Multimodal Large Language Models on Health Care’s Future

As medicine is a multimodal discipline, the potential future versions of LLMs that can handle multimodality—meaning that they could interpret and generate not only text but also images, videos, sound, and even comprehensive documents—can be conceptualized as a significant evolution in the field of AI. Such advancements would enable more holistic patient assessments, drawing from diverse data sources for accurate diagnoses and treatment recommendations.

Bertalan Meskó

J Med Internet Res 2023;25:e52865

A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation

A Multimodality Machine Learning Approach to Differentiate Severe and Nonsevere COVID-19: Model Development and Validation

To use such diverse multimodality information as alternative evidence to facilitate accurate classifications, we propose a data mining and machine learning (ML) framework as an alternative to commonly used hypothesis-driven parametric models. The goal of this study is to provide reliable data-driven support for clinicians, even those who do not have comprehensive experience in diagnosing the emerging disease COVID-19.

Yuanfang Chen, Liu Ouyang, Forrest S Bao, Qian Li, Lei Han, Hengdong Zhang, Baoli Zhu, Yaorong Ge, Patrick Robinson, Ming Xu, Jie Liu, Shi Chen

J Med Internet Res 2021;23(4):e23948