让符号因子发现更可靠,通过智能筛选和强化教学提升策略效果。
AlphaG-OPD: Reliability-Gated Sibling Counterfactuals for On-Policy Distillation in Symbolic Alpha Factor Discovery
- 将最终评分转化为中间步骤的动作指导,实现结构化在线蒸馏。
- 在多个市场中表现稳定,跨随机种子的收益显著优于基线方法。
- 适合量化交易研究者与需要高可信度因子生成的金融工程团队。
符号因子发现能评估完整表达式的优劣,但无法为生成过程中的结构决策提供直接标签。生成流网络(GFlowNets)保留了完整表达式上多样且与奖励成比例的分布,但其轨迹级目标未能比较中间状态下的未选兄弟动作。本文提出 AlphaG-OPD,一种结构化的在线蒸馏框架,将终端因子评估转化为局部动作指导。该设计分离三个决策:组件 I 在当前前向策略访问的部分抽象语法树(AST)状态中暴露语法有效的兄弟表达式以确定教学位置;组件 II 判定教学内容是否可靠:在四个共享后缀下评估三个支持的兄弟表达式,仅当匹配比较显示充分胜者一致性和正的经验下置信界(LCB)时才接受 KL 有界的目标;组件 III 决定教学强度与持续时间:通过有界重放、基于得分的过期机制和前向梯度平衡整合被接受的目标,无需额外因子评估。终端奖励、轨迹平衡、反向策略、语法和因子池规则保持不变。等效物理得分的四臂消融实验验证了配对教学、可靠性门控和整合机制的有效性。在中证300、中证500、中证1000及美国标普500指数上,该方法在多随机种子下均表现出强劲的跨市场性能。
原文摘要 · Abstract (English)
Symbolic alpha factor discovery can score a completed expression, but it provides no direct label for the structural decisions that produced it. Generative flow networks (GFlowNets) preserve a diverse, reward-proportional distribution over complete expressions, yet their trajectory-level objective does not compare unchosen sibling actions at an intermediate state. We introduce AlphaG-OPD, a structural on-policy distillation framework that turns terminal factor evaluations into local action guidance. Its design separates three decisions. Component I determines where to teach by exposing grammar-valid siblings at partial abstract-syntax-tree (AST) states visited by the current forward policy. Component II determines what is reliable enough to teach: it evaluates three supported siblings under four shared suffixes and admits a KL-bounded target only when their matched comparisons exhibit sufficient winner agreement and a positive empirical lower confidence bound (LCB). Component III determines how strongly and for how long to teach by consolidating accepted targets through bounded replay, score-indexed expiry, and forward-gradient balancing, without additional factor evaluations. Terminal reward, Trajectory Balance, the backward policy, grammar, and factor-pool rules remain unchanged. An equal-physical-score four-arm ablation tests paired teaching, reliability gating, and consolidation. Across China's CSI300, CSI500, and CSI1000 and the U.S. S&P 500, the complete method delivers strong cross-market performance over multiple random seeds.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。