Topic
federated learning
SDFLoRA: Selective Decoupled Federated LoRA for Privacy-Preserving Fine-Tuning with Heterogeneous Clients
Federated learning for LLMs faces challenges from heterogeneous client ranks and data distributions. SDFLoRA proposes a structure-aware LoRA framework that decouples updates into shared and private components, enabling stable aggregation, personalization, and improved differential privacy. Experiments show it outperforms existing federated LoRA baselines.
CLoVE: New Federated Learning Algorithm Clusters Loss Vectors for Personalization
Researchers propose CLoVE (Clustering of Loss Vector Embeddings), a novel clustered federated learning algorithm that groups clients based on loss patterns. It achieves high cluster recovery in few rounds and state-of-the-art accuracy across supervised and unsupervised tasks.
Beyond Weights and Gradients: New Taxonomy Classifies Federated Learning Messages into Three Categories
A research paper by Guerrero, Vargas, Wang, Doan, and Nagels introduces a formal mathematical definition of a federated message and a taxonomy organizing exchanges into three categories: model structures, statistical summaries, and data-conditioned representations. The authors review 202 publications, noting a shift since 2021 toward diverse messaging paradigms beyond traditional weights and gradients, and evaluate trade-offs in computational demands, communication costs, and privacy risks.
Federated Medical Image Segmentation under Real-World Label Noise: A Benchmark Suite for Noisy Label Learning Method Selection
Federated learning enables collaborative medical image segmentation without centralizing sensitive data, but real-world label noise hampers deployment. A new benchmark suite combines diverse real-world noisy datasets, client-noise scenarios, and targeted evaluation to support systematic assessment of federated noisy label learning methods, addressing the gap left by synthetic noise studies.
When Generator Replay Degrades: Projected Rehearsal Orchestration for Heterogeneous Federated Class-Incremental Learning
A new arXiv preprint introduces PRO and PRO-MAX, frameworks that replace synthetic input replay with projected rehearsal orchestration to address degradation in federated class-incremental learning (FCIL) when clients have heterogeneous label subsets and task stages. The methods improve retention and utility across image, text, and graph benchmarks, showing that replay quantity alone does not resolve quality failures.
Privacy-Preserving Text Sanitization for Distributed Agents via Disentangled Representations
Researchers propose DiSan, a privacy-preserving text sanitization framework that uses disentangled representations to separate task semantics from style identifiers. Experiments show it reduces personally identifiable information exposure by 20 times while maintaining 83% answer faithfulness on a multi-agent RAG benchmark, outperforming token-level masking.
PreLort: Prefix-Nested LoRA Enables Federated Fine-Tuning Across Heterogeneous Hardware Ranks
A new method called PreLort addresses the challenge of aggregating federated LoRA adapters with different ranks due to heterogeneous hardware. By organizing adapter dimensions into a prefix hierarchy and introducing segment-wise aggregation and prefix-nested training, PreLort consistently outperforms existing heterogeneous federated LoRA methods in accuracy and ROUGE-L while achieving lower perplexity.
LLM-Encoded Knowledge Guides Federated Graph Recommendation to Improve Accuracy
Researchers propose a federated graph recommendation framework that leverages LLM-encoded semantic knowledge to guide cross-client structural aggregation, addressing the challenge of non-IID client data. The method consistently outperforms existing federated graph baselines on standard benchmarks.