提出隐私保护的特征贡献评估方法,无需共享数据即可量化各方数据价值。
Privacy-Preserving Feature Valuation in Vertical Federated Learning Using Shapley-CMI and PSI Permutation
- 基于条件互信息与私有集合交集技术,安全计算特征贡献值。
- 在不交换原始数据前提下,实现多参与方间特征价值公平评估。
- 适合需要数据隐私保护的金融、医疗等垂直联邦学习场景。
联邦学习(FL)是一种新兴的机器学习范式,允许多方在不共享原始数据的情况下协同训练模型,保障数据隐私。在垂直联邦学习(VFL)中,各参与方持有相同用户的不同特征,关键挑战在于模型训练前评估各方特征的贡献,尤其在无模型可用的初期阶段。为此,近期提出的Shapley-CMI方法是一种无需模型的信息论特征估值方法,利用条件互信息(CMI)。然而其原始形式缺乏可实施的隐私保护方案,无法安全计算所需特征排列与交集。本文提出一种新型隐私保护的Shapley-CMI在VFL中的实现。系统引入私有集合交集(PSI)服务器,对所有特征排列进行加密处理,并计算离散化加密用户组间的交集大小,无需原始数据交换。各参与方使用这些交集结果计算自身特征的Shapley-CMI值,以评估特征的边际效用。初步实验验证了该系统的正确性与隐私性,证明其在安全高效估算VFL中特征贡献方面的可行性。该方法确保数据保密性,支持多参与方扩展,且无需共享原始数据或训练模型即可实现公平数据估值。
原文摘要 · Abstract (English)
Federated Learning (FL) is an emerging machine learning paradigm that enables multiple parties to collaboratively train models without sharing raw data, ensuring data privacy. In Vertical FL (VFL), where each party holds different features for the same users, a key challenge is to evaluate the feature contribution of each party before any model is trained, particularly in the early stages when no model exists. To address this, the Shapley-CMI method was recently proposed as a model-free, information-theoretic approach to feature valuation using Conditional Mutual Information (CMI). However, its original formulation did not provide a practical implementation capable of computing the required permutations and intersections securely. This paper presents a novel privacy-preserving implementation of Shapley-CMI for VFL. Our system introduces a private set intersection (PSI) server that performs all necessary feature permutations and computes encrypted intersection sizes across discretized and encrypted ID groups, without the need for raw data exchange. Each party then uses these intersection results to compute Shapley-CMI values, computing the marginal utility of their features. Initial experiments confirm the correctness and privacy of the proposed system, demonstrating its viability for secure and efficient feature contribution estimation in VFL. This approach ensures data confidentiality, scales across multiple parties, and enables fair data valuation without requiring the sharing of raw data or training models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。