通过动态分析查询交互,用少量响应就能准确识别大模型来源。
READER: Dynamic LLM Provenance from Query-Varying Interactions

- 用冻结的代理模型提取响应特征,构建可比指纹
- 1条响应达50.4%准确率,100条时达96.2%
- 无需目标模型内部信息,适合实际审计场景
现有黑箱大模型溯源方法通过统一诊断提示实现可比性。但在部署中,审计者面对的是异构、渐进式到达的提示-响应记录。本文提出动态黑箱大模型溯源:在固定候选模型池注册后,利用任意可用证据预算,对查询变化的交互进行溯源。READER通过冻结的代理模型,将与响应词元对齐的隐藏状态投影到长度归一化的主成分(DC)和首阶自相关(first-AC)模式上,捕捉响应全局激活位置与粗略演化轨迹。通过注册训练的线性探测器将每个指纹转化为源证据,贝叶斯累积机制复用该证据单元于多次观测。我们构建了Agent500数据集,包含100个本地与API源对500个异构代理提示的5万条响应。在100分类溯源任务中,仅需1条响应即达50.4%准确率,100条时提升至96.2%,显著优于最强动态基线(33.0%和79.0%)。四种不同代理模型族在100条预算下均超94.8%。受控的响应长度与Math100领域迁移实验揭示零重训练迁移的局限。组件分析显示:主成分主导动态来源身份,首阶自相关主导静态关系证据,二者联合指纹为两类任务提供共享测量空间。READER可在不依赖目标模型内部或专用审计查询的情况下完成文本审计。代码与数据已公开于https://github.com/LeoJeshua/READER。
原文摘要 · Abstract (English)
Existing black-box LLM provenance methods achieve comparability by querying every candidate model with the same diagnostic prompts. In deployment, auditors inherit a different evidence stream: heterogeneous prompt-response traces that arrive incrementally. We formalize dynamic black-box LLM provenance: after enrolling a fixed candidate ecosystem, attribute query-varying interactions at any available evidence budget. READER recovers comparability through a frozen proxy LLM. It projects proxy states aligned with response tokens onto length-normalized DC and first-AC modes, capturing response-wide activation location and coarse trajectory evolution. An enrollment-trained linear probe converts each fingerprint into source evidence, and Bayesian accumulation reuses this evidence unit from one observation to many. We introduce Agent500, containing 50,000 responses from 100 local and API sources to 500 heterogeneous agent prompts. On 100-way attribution, READER reaches $50.4\%$ accuracy from one response and $96.2\%$ from 100, compared with $33.0\%$ and $79.0\%$ for the strongest dynamic baselines. Four distinct proxy families all exceed $94.8\%$ at the latter budget. Controlled response-length and Math100 domain shifts expose the limits of zero-retraining transfer. Component analysis reveals a task-dependent spectral division of labor: DC dominates dynamic source identity, while first AC dominates static relationship evidence. Their joint fingerprint provides a shared measurement space for both tasks. READER audits observed text without target internals or audit-only queries. Code and data are available at https://github.com/LeoJeshua/READER.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。