在受限环境下,大模型三元组生成质量依赖信息增益与智能过滤。
Noise or Nuance: An Investigation Into Useful Information and Filtering For LLM Driven AKBC
- 利用额外信息提升三元组生成质量
- 大模型能有效筛选低质量三元组
- 响应解析的灵活性与一致性需依场景权衡
RAG和微调是提升大模型输出质量的常用策略。但在资源受限场景(如2025年LM-KBC挑战赛)下,这些方法受到限制。本文研究三元组补全任务的三个关键环节:生成、质量保障与大模型响应解析。研究发现,在此受限设置下:额外信息可提升生成质量;大模型能有效过滤低质量三元组;响应解析中灵活性与一致性的权衡关系取决于具体场景。
原文摘要 · Abstract (English)
RAG and fine-tuning are prevalent strategies for improving the quality of LLM outputs. However, in constrained situations, such as that of the 2025 LM-KBC challenge, such techniques are restricted. In this work we investigate three facets of the triple completion task: generation, quality assurance, and LLM response parsing. Our work finds that in this constrained setting: additional information improves generation quality, LLMs can be effective at filtering poor quality triples, and the tradeoff between flexibility and consistency with LLM response parsing is setting dependent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。