A Universal Metric of Dataset Similarity for Cross-silo Federated Learning

一种用于跨孤岛联邦学习的通用数据集相似性度量

阅读:1

Abstract

Federated Learning (FL) enables collaborative model training across institutions without sharing raw data, making it valuable for privacy-sensitive domains like healthcare. However, FL performance deteriorates significantly when client datasets are non-IID. While dataset similarity metrics could guide collaboration decisions, existing approaches have critical limitations: unbounded costs that lack interpretability across domains, requirements for direct data access that violate FL's privacy constraints, and poor sample efficiency. We propose a novel metric that extracts model representations after a single federated training round to predict whether collaboration will improve performance. Our approach formulates similarity assessment as an optimal transport problem with a hybrid cost function that captures both feature-level differences and label distribution divergence between clients. We ensure privacy through a careful composition of Secure Multiparty Computation (SMC) and Differential Privacy (DP) mechanisms. Our theoretical analysis establishes a formal connection between the proposed metric and weight divergence in federated training, explaining why early-round activations can predict long-term collaboration outcomes. Empirically, the metric remains tightly correlated with weight divergence throughout training, reinforcing the validity of our single-round probe. Extensive experiments on synthetic benchmarks and real-world medical imaging tasks demonstrate that our metric reliably identifies beneficial collaborations providing practitioners with an actionable tool for participant selection in cross-silo FL.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。