用视觉语言模型帮建筑师快速找设计案例。
ArchSeek: Retrieving Architectural Case Studies Using Vision-Language Models
- 结合图文查询与跨模态嵌入，支持细粒度搜索。
- 可基于交互行为推荐个性化设计案例。
- 适合需要灵感启发的建筑师或设计师。
在建筑设计中，高效检索相关案例对设计师至关重要，因其常依赖先例来指导或激发创意。然而传统文本搜索工具难以捕捉建筑知识固有的视觉性和复杂性，导致探索过程耗时且不精准。本文提出 ArchSeek，一个专为建筑设计专业人士打造的案例检索系统，具备推荐功能。该系统利用视觉语言模型的视觉理解能力与跨模态嵌入，支持文本与图像双模态查询，并实现基于交互行为的设计案例推荐。它为建筑师提供更高效、个性化的灵感发现方式，未来可推广至其他视觉驱动的设计领域。源代码已开源：https://github.com/danruili/ArchSeek。
原文摘要 · Abstract (English)
Efficiently searching for relevant case studies is critical in architectural design, as designers rely on precedent examples to guide or inspire their ongoing projects. However, traditional text-based search tools struggle to capture the inherently visual and complex nature of architectural knowledge, often leading to time-consuming and imprecise exploration. This paper introduces ArchSeek, an innovative case study search system with recommendation capability, tailored for architecture design professionals. Powered by the visual understanding capabilities from vision-language models and cross-modal embeddings, it enables text and image queries with fine-grained control, and interaction-based design case recommendations. It offers architects a more efficient, personalized way to discover design inspirations, with potential applications across other visually driven design fields. The source code is available at https://github.com/danruili/ArchSeek.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。