arXiv:2605.31272cs.LG2026-05中稿 · ICML

首次为表格数据的上下文学习提供可操作的算法回溯方案。

Algorithmic Recourse of In-Context Learning for Tabular Data

  • 基于零阶优化构建自适应子空间回溯框架,支持黑盒模型。
  • 在真实数据集上用更少查询达到与现有方法相当的回溯质量。
  • 理论证明回溯解随上下文增大收敛到经典解,适用于多分类任务。

随着预测模型在信贷审批等高风险场景中的广泛应用,亟需事后回溯方法帮助受影响个体。许多此类模型处理表格数据,特征对应现实属性。近年来,上下文学习(ICL)使大语言模型能在推理时通过条件化标注样本实现表格预测,无需显式训练。然而,针对表格决策中ICL的算法回溯仍基本未被探索。本文首次系统研究了表格数据在ICL下的算法回溯问题。我们进行了理论分析,证明回溯解依然有界且定义良好,并揭示其随上下文规模增大而收敛至经典解。实践中,我们提出一种新型零阶回溯框架——自适应子空间回溯(ASR-ICL),能高效生成可操作且稀疏的回溯建议,适用于黑盒ICL模型,自然扩展至多分类任务。多个真实数据集和模型上的实验表明,ASR-ICL以更少查询达成与现有方法相当的回溯质量,且实证验证了预期的收敛行为,支持理论分析。

原文摘要 · Abstract (English)

As predictive models are increasingly deployed in high-stakes settings such as credit approval, there is a growing need for post-hoc methods that provide recourse to affected individuals. Many such models operate on tabular data, where features correspond to real-world attributes. Recently, in-context learning (ICL) has enabled large language models to perform tabular prediction by conditioning on labeled examples at inference time, without explicit training. However, algorithmic recourse for tabular decision-making under ICL remains largely unexplored. In this work, we present the first study of algorithmic recourse for tabular data under ICL. We carry out a theoretical analysis, showing that recourse remains well-defined and bounded, and we characterize how recourse converges toward classical solutions as the context size increases. In practice, we propose a novel zeroth-order recourse framework, Adaptive Subspace Recourse for In-Context Learning (ASR-ICL), that efficiently generates actionable and sparse recourse for black-box ICL models. The proposed framework naturally extends to multi-class tabular tasks. Experiments across multiple real-world datasets and models demonstrate that ASR-ICL achieves recourse quality comparable to existing methods with fewer queries and empirically confirm the predicted convergence behavior, supporting our theoretical analysis.

算法回溯上下文学习表格数据零阶优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。