arXiv:2510.02116cs.LGcs.DB2025-10

通过集成校准实现精准召回控制,减少人工核查成本。

Ensemble Threshold Calibration for Stable Sensitivity Control

  • 采用分箱采样与神经排序器,构建可复现的校准集。
  • 在631万至6734万对数据上实现召回率误差小于1%,方差极低。
  • 适合大规模地理数据匹配任务,部署轻量且兼容TPU。

精确控制召回率在大规模空间配准和实体匹配任务中至关重要,漏掉少量真实匹配会破坏下游分析,而过多人工审核则增加成本。经典置信区间方法如Clopper-Pearson或Wilson虽提供召回下界,但常高出目标数个百分点,且在偏态分数分布下波动大。本文提出端到端框架,在数千万几何对上实现精确召回与亚百分比级方差,同时保持TPU友好。流程始于等距网格边界框过滤与压缩稀疏行(CSR)候选表示,将配对数量减少两个数量级。使用确定性xxHash抽样训练轻量神经排序器,其得分通过一次前向传播推广至所有剩余配对,并用于构建基于分数十等分的可复现校准集。四种互补阈值估计器——Clopper-Pearson、Jeffreys、Wilson及精确分位数——通过反方差加权聚合,并在九个独立子样本间融合,显著降低阈值方差。在两个真实地籍数据集(约631万和6734万对)上评估,该方法始终将召回率控制在小误差范围内,相比其他校准方式减少冗余验证,且可在单个TPU v3核心上完成全流程运行。

原文摘要 · Abstract (English)

Precise recall control is critical in large-scale spatial conflation and entity-matching tasks, where missing even a few true matches can break downstream analytics, while excessive manual review inflates cost. Classical confidence-interval cuts such as Clopper-Pearson or Wilson provide lower bounds on recall, but they routinely overshoot the target by several percentage points and exhibit high run-to-run variance under skewed score distributions. We present an end-to-end framework that achieves exact recall with sub-percent variance over tens of millions of geometry pairs, while remaining TPU-friendly. Our pipeline starts with an equigrid bounding-box filter and compressed sparse row (CSR) candidate representation, reducing pair enumeration by two orders of magnitude. A deterministic xxHash bootstrap sample trains a lightweight neural ranker; its scores are propagated to all remaining pairs via a single forward pass and used to construct a reproducible, score-decile-stratified calibration set. Four complementary threshold estimators - Clopper-Pearson, Jeffreys, Wilson, and an exact quantile - are aggregated via inverse-variance weighting, then fused across nine independent subsamples. This ensemble reduces threshold variance compared to any single method. Evaluated on two real cadastral datasets (approximately 6.31M and 67.34M pairs), our approach consistently hits a recall target within a small error, decreases redundant verifications relative to other calibrations, and runs end-to-end on a single TPU v3 core.

召回控制空间配准模型集成TPU优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。