arXiv:2510.24375cs.LG2025-10

提出评估公交出行数据生成质量的三维度框架,解决隐私与实用性平衡难题。

A Comprehensive Evaluation Framework for Synthetic Trip Data Generation in Public Transport

  • 构建代表-隐私-效用三维评估体系,覆盖记录、群体、整体三层级
  • 12种生成方法对比显示无通用最优模型,隐私与真实性存在明显权衡
  • 条件表格式GAN表现最佳,适合实际公交场景应用

合成数据为解决公共交通中智能卡数据的隐私与可及性问题提供了潜在方案。尽管生成建模进展迅速,但综合评估仍显不足,导致合成数据的真实可靠性、安全性与实用性尚不明确。现有评估多局限于人群层面的代表性或记录层面的隐私保护,缺乏对群体层面差异和任务特定效用的考量。为此,本文提出代表-隐私-效用(RPU)评估框架,系统化地在三个互补维度和三个层级(记录、群体、人口)上评估合成出行数据。该框架整合一致的度量指标,量化相似性、泄露风险与实用价值,实现合成数据质量的透明与均衡评估。我们应用该框架对十二种典型生成方法进行基准测试,涵盖传统统计模型、深度生成网络及隐私增强变体。结果表明,合成数据并不天然保证隐私,且不存在‘万能’模型,隐私与代表性/效用之间的权衡显著。条件表格式生成对抗网络(CTGAN)在各方面表现最均衡,建议用于实际应用。RPU框架为研究者与从业者比较生成技术、选择合适方法提供了系统且可复现的基础。

原文摘要 · Abstract (English)

Synthetic data offers a promising solution to the privacy and accessibility challenges of using smart card data in public transport research. Despite rapid progress in generative modeling, there is limited attention to comprehensive evaluation, leaving unclear how reliable, safe, and useful synthetic data truly are. Existing evaluations remain fragmented, typically limited to population-level representativeness or record-level privacy, without considering group-level variations or task-specific utility. To address this gap, we propose a Representativeness-Privacy-Utility (RPU) framework that systematically evaluates synthetic trip data across three complementary dimensions and three hierarchical levels (record, group, population). The framework integrates a consistent set of metrics to quantify similarity, disclosure risk, and practical usefulness, enabling transparent and balanced assessment of synthetic data quality. We apply the framework to benchmark twelve representative generation methods, spanning conventional statistical models, deep generative networks, and privacy-enhanced variants. Results show that synthetic data do not inherently guarantee privacy and there is no "one-size-fits-all" model, the trade-off between privacy and representativeness/utility is obvious. Conditional Tabular generative adversarial network (CTGAN) provide the most balanced trade-off and is suggested for practical applications. The RPU framework provides a systematic and reproducible basis for researchers and practitioners to compare synthetic data generation techniques and select appropriate methods in public transport applications.

合成数据隐私保护交通数据评估框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。