用引导式搜索让大模型突破思维定式,生成更创新的科学构想。
Magellan: Guided MCTS for Latent Space Exploration and Novelty Generation
- 引入分层引导机制,用语义向量定向探索潜在概念空间。
- 在科学创意生成任务中,新颖性和可信度均显著优于现有方法。
- 适合需要高质量创意输出的研究者与AI协作场景。
大型语言模型(LLMs)常因受限于训练数据中的高概率概念而难以生成真正创新的想法。尽管基于搜索的方法如思维树(ToT)试图缓解此问题,但其探索过程依赖不一致的自我评估启发式,缺乏系统性引导。为此,本文提出 extbf{Magellan},将创造性生成重构为对LLM潜在概念空间的有原则、受引导的探索。核心采用蒙特卡洛树搜索(MCTS),由分层引导系统驱动:长期方向由通过正交投影构建的“语义罗盘”向量控制,确保探索趋向相关新颖性;局部决策则由景观感知的价值函数替代错误的自我评估,显式平衡内在连贯性、外在新颖性与叙事进展。大量实验表明,Magellan在生成科学想法方面显著优于强基线(包括ReAct和ToT),展现出更高的可信度与创新水平。结果表明,对于创造性发现,有原则的引导搜索比无约束的自主探索更有效,为大模型成为创新伙伴开辟了新路径。
原文摘要 · Abstract (English)
Large Language Models (LLMs) often struggle with generating truly innovative ideas, typically defaulting to high-probability, familiar concepts within their training data's "gravity wells." While advanced search-based methods like Tree of Thoughts (ToT) attempt to mitigate this, they are fundamentally limited by their reliance on unprincipled, inconsistent self-evaluation heuristics to guide exploration. To address this gap, we introduce \textbf{Magellan}, a novel framework that reframes creative generation as a principled, guided exploration of an LLM's latent conceptual space. At its core, Magellan employs Monte Carlo Tree Search (MCTS) governed by a hierarchical guidance system. For long-range direction, a "semantic compass" vector, formulated via orthogonal projection, steers the search towards relevant novelty. For local, step-by-step decisions, a landscape-aware value function replaces flawed self-evaluation with an explicit reward structure that balances intrinsic coherence, extrinsic novelty, and narrative progress. Extensive experiments demonstrate that Magellan significantly outperforms strong baselines, including ReAct and ToT, in generating scientific ideas with superior plausibility and innovation. Our work shows that for creative discovery, a principled, guided search is more effective than unconstrained agency, paving the way for LLMs to become more capable partners in innovation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。