构建可验证的个人相册重建基准,实现证据支撑的身份还原。
PAL-Bench: Evidence-Grounded Profile Reconstruction from Longitudinal Personal Albums

- 用合成数据生成含证据链的私有相册世界
- 7个系统在身份识别与证据引用上仍有明显差距
- 适合研究多模态融合与证据溯源的学者
纵向个人相册是弱结构的多模态数据集:包含噪声感知记录,关键事实需跨人脸、文本、时间戳、位置和重复事件进行关联。现有视觉、视频、文档和生活日志基准仅测试子问题,未涵盖相册级的带社会身份绑定与证据引用的重构任务。评估该任务困难在于真实相册所需的真值——用户档案、社交图谱、人脸-姓名映射及证据来源——属于私有状态,无法安全公开。本文提出PAL-Bench,在公开记录协议下构建可控的证据接地重建基准。其证据编译器生成隐式私有世界,规划目标级证据路径,渲染相册像素,通过感知流水线重新测量,并导出审计后的公/私视图。代理仅接收感知推导的公共记录;目标、标识符映射与证据路径保持隐藏。PAL-Bench包含50个合成用户、36,659条公共照片记录、2,799个目标(涉及用户事实、身份与关系)。10名参与者隐私保护审计表明,PAL-Bench的证据结构与真实私有相册一致,但等效释放仍受隐私限制。在七个系统与两种计算匹配诊断下,七项指标协议揭示了合理摘要与忠实社会重构之间的差距:系统能恢复部分用户事实,但在反复出现的身份识别与证据引用上表现不佳。PAL-TRACE作为参考框架,在挖掘用户事实前冻结身份绑定,表现最佳,但复杂身份解析仍未解决。PAL-Bench为感知实体消歧、多模态数据整合、时间证据聚合与溯源感知结构预测提供测试平台。
原文摘要 · Abstract (English)
Longitudinal personal albums are weak-schema multimodal databases: noisy perceptual records whose key facts require joins across faces, text, timestamps, locations, and repeated events. Existing visual, video, document, and lifelog benchmarks test sub-problems, but not album-scale profile reconstruction with social identity binding and evidence citation. Benchmarking this task is difficult because the ground truth needed for evaluation--owner profiles, social graphs, face-name maps, and evidence provenance--is private state that real albums cannot safely release. We introduce PAL-Bench, a controlled benchmark for evidence-grounded reconstruction under a public-record contract. Its Evidence Compiler builds latent private worlds, programs target-level evidence paths, renders album pixels, re-measures them through perception pipelines, and exports audited public/private views. Agents receive only perception-derived public records; targets, identifier maps, and evidence paths remain hidden. PAL-Bench contains 50 synthetic users, 36,659 public photo records, and 2,799 targets over owner facts, identities, and relations. A privacy-preserving audit with 10 participants confirms that PAL-Bench evidence structures match real private albums, though equivalent releases remain privacy-prohibitive. Across seven systems and two compute-matched diagnostics, a seven-metric protocol reveals a gap between plausible profile summarization and faithful social reconstruction: systems recover some owner facts but struggle with recurring identities and evidence citation. PAL-TRACE, a reference framework that freezes identity bindings before owner-fact mining, performs best but leaves hard identity resolution far from solved. PAL-Bench provides a testbed for perceptual entity resolution, multimodal data integration, temporal evidence aggregation, and provenance-aware structured prediction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。