arXiv:2507.01055eess.IVcs.AI2025-07综述被引 6

用提示工程提升医疗影像模型性能,无需重训也能适应新任务。

Prompt Mechanisms in Medical Imaging: A Comprehensive Survey

  • 通过文本、视觉和可学习嵌入等提示方式,灵活引导模型
  • 提升分类、分割等任务的准确率与数据效率,减少人工特征依赖
  • 适合关注医疗AI可解释性与临床落地的研究者

深度学习在医疗影像中具有变革潜力,但临床应用常受限于数据稀缺、分布偏移和任务泛化能力不足。提示方法作为一种关键策略,通过提供灵活的领域特定引导,显著提升模型性能与适应性,且无需大量重训练。本综述系统分析了医疗影像中提示工程的发展现状,剖析了文本指令、视觉提示和可学习嵌入等多种提示模态,并探讨其在图像生成、分割与分类等核心任务中的集成应用。研究发现,这些机制通过提高准确性、鲁棒性和数据效率,降低对人工特征工程的依赖,同时增强模型可解释性,使指导逻辑更透明。尽管进展显著,仍面临提示设计优化、数据异质性及临床部署可扩展性等挑战。未来方向包括多模态提示增强与稳健临床集成,凸显提示驱动AI在加速医学诊断与个性化治疗规划中的关键作用。

原文摘要 · Abstract (English)

Deep learning offers transformative potential in medical imaging, yet its clinical adoption is frequently hampered by challenges such as data scarcity, distribution shifts, and the need for robust task generalization. Prompt-based methodologies have emerged as a pivotal strategy to guide deep learning models, providing flexible, domain-specific adaptations that significantly enhance model performance and adaptability without extensive retraining. This systematic review critically examines the burgeoning landscape of prompt engineering in medical imaging. We dissect diverse prompt modalities, including textual instructions, visual prompts, and learnable embeddings, and analyze their integration for core tasks such as image generation, segmentation, and classification. Our synthesis reveals how these mechanisms improve task-specific outcomes by enhancing accuracy, robustness, and data efficiency and reducing reliance on manual feature engineering while fostering greater model interpretability by making the model's guidance explicit. Despite substantial advancements, we identify persistent challenges, particularly in prompt design optimization, data heterogeneity, and ensuring scalability for clinical deployment. Finally, this review outlines promising future trajectories, including advanced multimodal prompting and robust clinical integration, underscoring the critical role of prompt-driven AI in accelerating the revolution of diagnostics and personalized treatment planning in medicine.

医疗影像提示工程深度学习可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。