AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (7.9 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Review Article | Open Access

Visual-language foundation models and artificial intelligence agents in healthcare: Bridging from technological innovation to clinical impact

School of Computer Science, Shanghai Jiao Tong University, Shanghai 200240, China
Beijing Visual Science and Translational Eye Research Institute (BERI), Eye Center of Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua Medicine, Tsinghua University, Beijing 100084, China
Institute for Hospital Management, Tsinghua University, Beijing 100084, China
School of Healthcare Management, Beijing Tsinghua Changgung Hospital, Institute for Hospital Management, and School of Basic Medical Sciences, Tsinghua University, Beijing 100084, China
Bloomberg School of Public Health, Johns Hopkins University, Baltimore 21218, MD, USA
Vanke School of Public Health, Tsinghua University, Beijing 100084, China
State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Disease, Guangzhou 510060, China
Beijing Key Laboratory of Intelligent Diagnostic Technology and Devices for Major Blinding Eye Diseases, Tsinghua Medicine, Tsinghua University, Beijing 100084, China
Singapore Eye Research Institute, Singapore National Eye Center, Singapore 169856, Singapore
School of Computing, Gachon University, Seongnam 13120, Republic of Korea
MoE Key Lab of Artificial Intelligence, AI Institute,Shanghai Jiao Tong University, Shanghai 200240, China
Show Author Information

Abstract

Recent advances in foundation models (FMs) have enabled artificial intelligence systems to acquire generalizable capabilities, with language and visual models demonstrating adaptability across diverse healthcare applications and multimodal vision-language FMs (VLFMs) supporting complex tasks such as report generation and question answering. Building on these developments, autonomous agents, particularly vision-language agents (VLAs), represent the next frontier, extending AI from perception and recognition to cognition, decision-making, and action. By integrating multimodal understanding with planning, interaction, and tool use, VLAs introduce autonomous intelligence capable of managing multi-step clinical workflows, adapting over time, and collaborating with clinicians. This survey provides a comprehensive perspective on VLAs in healthcare. We examine their current progress, analyze the major challenges hindering their integration, and highlight promising directions for future development. Unlike prior surveys that primarily focus on diverse FMs, our work prioritizes emerging VLFMs and incorporates agentic concepts, emphasizing their transformative potential beyond narrow research prototypes. Specifically, we (ⅰ) evaluate VLAs in terms of VLFM architectures and adaptation strategies and agentic design, (ⅱ) assess their potential impact across diverse clinical workflows, and (ⅲ) discuss pathways towards next-generation clinical decision support, considering technical and clinical challenges.

Graphical Abstract

References

【1】
【1】
 
 
Computational Visual Media
Pages 1225-1262

{{item.num}}

Comments on this article

Go to comment

< Back to all reports

Review Status: {{reviewData.commendedNum}} Commended , {{reviewData.revisionRequiredNum}} Revision Required , {{reviewData.notCommendedNum}} Not Commended Under Peer Review

Review Comment

Close
Close
Cite this article:
Al-Jebrni AH, Jiang Z, Qin Y, et al. Visual-language foundation models and artificial intelligence agents in healthcare: Bridging from technological innovation to clinical impact. Computational Visual Media, 2026, 12(5): 1225-1262. https://doi.org/10.26599/CVM.2026.9450530

13

Views

4

Downloads

0

Crossref

0

Web of Science

0

Scopus

0

CSCD

Received: 29 August 2025
Accepted: 09 January 2026
Published: 14 October 2026
© The Author(s) 2026.

This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.

The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

To submit a manuscript, please go to https://jcvm.org.