用多模态大模型+专家混合架构,提升医疗健康推荐精准度
Enhancing Healthcare Recommendation Systems with a Multimodal LLMs-based MOE Architecture
- 融合大模型与专家混合架构,整合文本与图像多源信息
- 在精确率、召回率等指标上超越单一模型基线,提升个性化推荐效果
- 适合医疗健康领域研究者,尤其关注冷启动与图像质量影响的场景
随着多模态数据日益丰富,多个领域亟需能有效融合异构数据的先进架构以解决具体问题。本研究提出一种结合专家混合(MOE)框架与大语言模型的混合推荐模型,用于提升医疗健康领域的推荐性能。基于患者描述构建了一个小型健康食品推荐数据集,并在精度(Precision)、召回率(Recall)、NDCG 和 MAP@5 等关键指标上评估模型表现。实验结果表明,该混合模型在准确性和个性化推荐效果上均优于仅使用 MOE 或大语言模型的基线模型。然而,图像数据对个性化推荐性能的提升有限,尤其在解决冷启动问题时作用较小;同时,图像重分类问题也影响推荐结果,特别是在低质量图像或物品外观变化情况下导致性能下降。研究为构建高效、可扩展的推荐系统提供了重要启示,推动个性化推荐技术在医疗等真实场景中的应用。
原文摘要 · Abstract (English)
With the increasing availability of multimodal data, many fields urgently require advanced architectures capable of effectively integrating these diverse data sources to address specific problems. This study proposes a hybrid recommendation model that combines the Mixture of Experts (MOE) framework with large language models to enhance the performance of recommendation systems in the healthcare domain. We built a small dataset for recommending healthy food based on patient descriptions and evaluated the model's performance on several key metrics, including Precision, Recall, NDCG, and MAP@5. The experimental results show that the hybrid model outperforms the baseline models, which use MOE or large language models individually, in terms of both accuracy and personalized recommendation effectiveness. The paper finds image data provided relatively limited improvement in the performance of the personalized recommendation system, particularly in addressing the cold start problem. Then, the issue of reclassification of images also affected the recommendation results, especially when dealing with low-quality images or changes in the appearance of items, leading to suboptimal performance. The findings provide valuable insights into the development of powerful, scalable, and high-performance recommendation systems, advancing the application of personalized recommendation technologies in real-world domains such as healthcare.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。