LLM在匹配市场推理中表现不佳,难以处理大规模偏好排序问题。
Matching Markets Meet LLMs: Algorithmic Reasoning with Ranked Preferences
- 用分级任务评估LLM处理偏好排序的算法能力
- 大市场中模型常无法识别冲突对或迭代执行算法
- 小市场可用LoRA提升性能,但大市场无效
大型语言模型(LLMs)在程序合成、科学假说生成等推理任务中取得进展,但在组合领域中处理排序偏好与结构化算法方面仍研究不足。本文研究匹配市场这一核心框架,其应用于资源分配、网约车等场景,需协调个体排序偏好以实现稳定结果。我们评估了多个先进模型在一系列基于偏好的推理任务上的表现,包括稳定匹配生成、不稳定性检测、不稳定性修复及细粒度偏好查询。结果显示,即使顶尖模型在处理大规模市场时仍难以解决不稳定性,常无法识别阻塞对或进行迭代算法执行。进一步发现,参数高效微调(LoRA)在小市场中显著提升性能,但在大规模实例上效果有限,表明需要更复杂的策略来增强LLM在长上下文输入下的推理能力。
原文摘要 · Abstract (English)
The rise of Large Language Models (LLMs) has driven progress in reasoning tasks -- from program synthesis to scientific hypothesis generation -- yet their ability to handle ranked preferences and structured algorithms in combinatorial domains remains underexplored. We study matching markets, a core framework behind applications like resource allocation and ride-sharing, which require reconciling individual ranked preferences to ensure stable outcomes. We evaluate several state-of-the-art models on a hierarchy of preference-based reasoning tasks -- ranging from stable-matching generation to instability detection, instability resolution, and fine-grained preference queries -- to systematically expose their logical and algorithmic limitations in handling ranked inputs. Surprisingly, even top-performing models with advanced reasoning struggle to resolve instability in large markets, often failing to identify blocking pairs or execute algorithms iteratively. We further show that parameter-efficient fine-tuning (LoRA) significantly improves performance in small markets, but fails to bring about a similar improvement on large instances, suggesting the need for more sophisticated strategies to improve LLMs' reasoning with larger-context inputs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。