multimodal perception

XMedFusion: A Knowledge-Guided Multimodal Perception and Reasoning Framework for Autonomous Medical Systems

Researchers introduce XMedFusion, a knowledge-guided multimodal perception and reasoning framework for autonomous medical systems. The framework decomposes visual information into coordinated agents, achieving significant improvements in radiology report generation metrics on a public chest radiograph dataset.