arXiv:2508.20944cs.CL2025-08EMNLP被引 2

通过结构对齐提升示例选择,让大模型更准确完成语义解析任务。

STARE at the Structure: Steering ICL Exemplar Selection with Structural Alignment

  • 用结构感知监督微调检索器,选示例时兼顾语义与结构匹配
  • 在隐藏表示中增强语法信息,提升模型对结构的敏感度
  • 方法轻量通用,适合各类大模型和结构化预测任务

上下文学习(ICL)已成为无需任务微调即可使大语言模型执行多种任务的强大范式。然而,ICL的效果高度依赖于示例选择质量。尤其在语义解析等结构化预测任务中,现有选择策略常忽视结构对齐,导致性能不佳且泛化能力差。为此,我们提出一种两阶段示例选择策略,在效率、泛化性和性能间取得良好平衡。首先,使用结构感知监督微调基于BERT的检索器,使其选出既语义相关又结构对齐的示例;其次,引入一个即插即用模块,增强隐藏表示中的句法信息。该模块与模型无关、开销小,可无缝集成至现有流程。在涵盖三种语义解析任务的四个基准上,使用多个近期大模型作为推理模型进行实验,结果表明本方法持续优于现有基线。

原文摘要 · Abstract (English)

In-Context Learning (ICL) has become a powerful paradigm that enables LLMs to perform a wide range of tasks without task-specific fine-tuning. However, the effectiveness of ICL heavily depends on the quality of exemplar selection. In particular, for structured prediction tasks such as semantic parsing, existing ICL selection strategies often overlook structural alignment, leading to suboptimal performance and poor generalization. To address this issue, we propose a novel two-stage exemplar selection strategy that achieves a strong balance between efficiency, generalizability, and performance. First, we fine-tune a BERT-based retriever using structure-aware supervision, guiding it to select exemplars that are both semantically relevant and structurally aligned. Then, we enhance the retriever with a plug-in module, which amplifies syntactically meaningful information in the hidden representations. This plug-in is model-agnostic, requires minimal overhead, and can be seamlessly integrated into existing pipelines. Experiments on four benchmarks spanning three semantic parsing tasks demonstrate that our method consistently outperforms existing baselines with multiple recent LLMs as inference-time models.

上下文学习示例选择语义解析结构对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。