Calendar09 September 2024

Publication: Decentralized Incremental Federated Learning with Echo State Networks Publication: Decentralized Incremental Federated Learning with Echo State Networks

Federated Echo State Networks proved their efficiency in learning low-resource collaborative settings where data is regulated privacy. In this work, EMERGE partners from the University of Pisa broaden the applicability of this machine learning approach to a decentralized setting, where a set of peers is connected through a logical communication topology and cannot rely on a centralized aggregation entity.

In particular, the authors propose Decentralized Incremental Federated Learning (DIncFed), where multiple agents collaborate to learn a readout by leveraging exact consensus strategies. Such strategies include mechanisms for collaboratively aggregating knowledge towards consensus, as well as policies for dynamically updating the communication topology. Experiments prove the efficacy and the efficiency of the proposed learning methodology against a state-of-the-art iterative competitor on multiple benchmarks characterized by different levels of statistical heterogeneity.

Read the paper in the link below.