让神经网络学会可验证的逻辑,解决模型偏见与不可解释问题。
Knowledge, Rules and Their Embeddings: Two Paths towards Neuro-Symbolic JEPA
- 用能量约束和双编码器将规则注入自监督学习,生成有几何意义的逻辑表示
- 通过连续可微逻辑实现梯度引导的规则发现,支持生成与推理
- 在拓扑模拟和临床数据上验证,兼具可靠性与可解释性,适合高风险场景
现代自监督预测架构擅长捕捉高维数据中的复杂统计相关性,但缺乏内化可验证人类逻辑的机制,易受虚假相关性和捷径学习影响。传统基于规则的推理系统虽具严谨可解释性,却受限于离散边界和指数级组合爆炸。为弥合这一鸿沟,我们提出双向神经符号框架——规则引导的联合嵌入预测架构(RiJEPA)。一方面,通过能量约束(EBC)和多模态双编码器架构,将结构化归纳偏置注入JEPA训练,重塑表示流形,以几何合理的逻辑盆地替代任意统计相关性。另一方面,将刚性离散规则松弛为连续可微逻辑,利用规则能量景观中的梯度引导朗之万扩散,实现无需组合搜索的新规则生成。该方法支持无条件联合生成、条件前向与溯因推理及边际预测转换。在合成拓扑模拟与高风险临床案例上的实证评估证实其有效性。本框架为鲁棒、生成式且可解释的神经符号表征学习奠定了坚实基础。
原文摘要 · Abstract (English)
Modern self-supervised predictive architectures excel at capturing complex statistical correlations from high-dimensional data but lack mechanisms to internalize verifiable human logic, leaving them susceptible to spurious correlations and shortcut learning. Conversely, traditional rule-based inference systems offer rigorous, interpretable logic but suffer from discrete boundaries and NP-hard combinatorial explosion. To bridge this divide, we propose a bidirectional neuro-symbolic framework centered around Rule-informed Joint-Embedding Predictive Architectures (RiJEPA). In the first direction, we inject structured inductive biases into JEPA training via Energy-Based Constraints (EBC) and a multi-modal dual-encoder architecture. This fundamentally reshapes the representation manifold, replacing arbitrary statistical correlations with geometrically sound logical basins. In the second direction, we demonstrate that by relaxing rigid, discrete symbolic rules into a continuous, differentiable logic, we can bypass traditional combinatorial search for new rule generation. By leveraging gradient-guided Langevin diffusion within the rule energy landscape, we introduce novel paradigms for continuous rule discovery, which enable unconditional joint generation, conditional forward and abductive inference, and marginal predictive translation. Empirical evaluations on both synthetic topological simulations and a high-stakes clinical use case confirm the efficacy of our approach. Ultimately, this framework establishes a powerful foundation for robust, generative, and interpretable neuro-symbolic representation learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。