用代数结构约束生成,防止跨领域知识干扰。
DALM: A Domain-Algebraic Language Model via Three-Phase Structured Generation
- 分三阶段逐步消除领域、关系、概念的不确定性
- 在封闭词表下完全阻断跨领域污染,开放词表可审计控制
- 支持单查询输出多视角答案空间,适合需要精准领域的应用
大语言模型将异构知识压缩至单一参数空间,导致生成时不同领域信息相互干扰。本文提出DALM,一种基于领域代数结构的语言模型,以结构化去噪替代无约束的词元生成。DALM采用三阶段生成路径:先解决领域不确定性,再处理关系不确定性,最后消除概念不确定性,每阶段均受显式代数约束。该框架仅需三个要素:可计算交、并与蕴含的领域格;控制跨领域继承的关系类型函数;将知识局部化到领域子集的纤维划分。在此基础上,构建三阶段编码器-解码器架构,使生成局限于特定领域纤维,在封闭词汇模式下彻底防止跨领域污染,开放词汇模式下污染可审计控制,且单次查询可生成领域索引的多视角答案空间。通过结合CDC知识表示系统,在标注领域的真实晶体库上完成训练与评估。DALM将语言生成重构为代数约束下的结构化去噪,而非对扁平词元空间的无约束解码。
原文摘要 · Abstract (English)
Large language models compress heterogeneous knowledge into a single parameter space, allowing facts from different domains to interfere during generation. We propose DALM, a Domain-Algebraic Language Model that replaces unconstrained token generation with structured denoising over a domain lattice. DALM follows a three-phase generation path: it first resolves domain uncertainty, then relation uncertainty, and finally concept uncertainty, so each stage operates under explicit algebraic constraints. The framework requires only three ingredients: a lattice of domains with computable meet, join, and implication; a typing function over relations that controls inheritance across domains; and a fiber partition that localizes knowledge to domain-specific subsets. Given these ingredients, DALM yields a three-phase encoder-decoder architecture in which generation is confined to a domain fiber, cross-domain contamination is structurally prevented in closed-vocabulary mode and auditably bounded in open-vocabulary mode, and a single query can produce a domain-indexed multi-perspective answer space. We instantiate the framework with the CDC knowledge representation system and outline training and evaluation on validated domain-annotated crystal libraries. DALM reframes language generation as algebraically constrained structured denoising rather than unconstrained decoding over a flat token space.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。