arXiv:2606.14386cs.LGcs.AI2026-06

提出几何理论,解释为何大模型搜索常无效,何时才值得跳转方向。

Discovery under Hypothesis Redundancy: A Geometric Theory of Discovery Bottlenecks

  • 用三个几何条件判断非局部探索是否有效:谱压缩、正交逃离、信号对齐。
  • 实验证明:只有弱表示但含目标信号的方向能获提升,满秩时收益归零。
  • 适合做因子发现或强化搜索策略设计的研究者,可避免盲目试错。

科学发现会因新假设不再提供独立信息而饱和,即使假设空间名义上仍很大。本文研究结合结构化局部搜索与大模型生成的非局部提议的混合发现系统,提出搜索压缩假说:非局部探索仅在三种几何条件同时满足时才有帮助——谱压缩、从已探索空间正交逃逸、残差信号与目标对齐。我们形式化这些条件,推导出混合优势的必要条件,并在受控合成环境、A股因子发现大规模实验及符号回归基准上验证机制;公开的表格型操作检验用于验证预算分配推论。信号植入和定向对比随机实验表明:仅新颖性不足,随机正交跳跃虽扩大覆盖范围,但无预测对齐则无法提升产出。在压缩扫描、真实因子档案及LLM-SRBench任务中,混合收益集中于弱表示但承载目标的方向,当假设空间接近满秩时消失。该框架将大模型引导的发现从泛化新颖性搜索转变为决定是否应进行有目的的非局部探索的诊断工具。

原文摘要 · Abstract (English)

Scientific discovery saturates when new hypotheses cease to provide independent information, even if the nominal hypothesis space remains large. We study hybrid discovery systems that combine structured local search with LLM-generated non-local proposals and pose the Search Compression Hypothesis: non-local exploration helps only when three geometric conditions co-occur: spectral compression, orthogonal escape from the explored span, and residual signal alignment with the target. We formalize these conditions, derive necessary conditions for hybrid advantage, and test the mechanism in controlled synthetic environments, large-scale A-share factor discovery, and symbolic-regression benchmarks; a public tabular operational sanity check tests the associated budget-allocation implication. Signal-planting and directed-versus-random experiments show that novelty alone is insufficient: random orthogonal jumps expand coverage but do not improve yield without predictive alignment. Across compression sweeps, real factor archives, and LLM-SRBench tasks, hybrid gains concentrate in weakly represented but target-bearing directions and vanish as the hypothesis space approaches full rank. The framework turns LLM-guided discovery from generic novelty search into a diagnostic procedure for deciding when directed non-local exploration is warranted.

科学发现大模型搜索几何理论因子挖掘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。