Federated learning has emerged as a transformative paradigm for collaborative model training across decentralized and privacy-sensitive data sources. By enabling multiple clients to jointly learn a global model without direct data sharing, federated learning addresses critical concerns related to data privacy, regulatory compliance, and communication efficiency. However, as real-world deployments expand across heterogeneous devices, applications, and user populations, fundamental challenges have become increasingly evident. Chief among these challenges is the presence of statistical heterogeneity, commonly referred to as non-identically and independently distributed data, which undermines the effectiveness of traditional federated optimization strategies such as Federated Averaging. This article presents an extensive and theoretically grounded exploration of personalized and cluster-aware federated learning as a response to these limitations. Drawing strictly on established literature, the paper synthesizes advances in soft and hard clustering, personalized optimization objectives, representation learning, curriculum strategies, and meta-learning approaches within federated settings. The methodology emphasizes a conceptual and comparative analysis of algorithmic frameworks rather than empirical experimentation, allowing for a deep examination of underlying assumptions, convergence behaviors, fairness implications, and trade-offs between global generalization and local adaptation. The results are presented as a descriptive synthesis of findings reported across prior studies, highlighting consistent patterns such as improved local performance, robustness to heterogeneity, and enhanced user-level fairness when personalization mechanisms are introduced. The discussion critically examines unresolved issues, including scalability, interpretability, privacy leakage risks, and regulatory considerations, while also outlining promising directions for future research. By unifying diverse strands of federated learning research into a coherent analytical narrative, this article aims to provide a comprehensive reference for researchers and practitioners seeking to design federated systems that are both privacy-preserving and adaptive to real-world data diversity.

Federated learning, personalization, data heterogeneity

Bengio, Y.; Louradour, J.; Collobert, R.; Weston, J. Curriculum learning. In Proceedings of the 26th Annual International Conference on Machine Learning, Montreal, Canada, 2009; pp. 41–48.

Chen, H.-Y.; Chao, W.-L. On bridging generic and personalized federated learning for image classification. arXiv, 2021, arXiv:2107.00778.

Collins, L.; Hassani, H.; Mokhtari, A.; Shakkottai, S. FedAvg with fine tuning: Local updates lead to representation learning. In Proceedings of the 36th Conference on Neural Information Processing Systems, New Orleans, USA, 2022; pp. 10572–10586.

Finn, C.; Abbeel, P.; Levine, S. Model-agnostic meta-learning for fast adaptation of deep networks. In Proceedings of the International Conference on Machine Learning, Sydney, Australia, 2017; pp. 1126–1135.

Ghosh, A.; Chung, J.; Yin, D.; Ramchandran, K. An efficient framework for clustered federated learning. In Proceedings of the 34th Conference on Neural Information Processing Systems, Vancouver, Canada, 2020; pp. 19586–19597.

Hsu, T.-M.H.; Qi, H.; Brown, M. Measuring the effects of non-identical data distribution for federated visual classification. arXiv, 2019, arXiv:1909.06335.

Karimireddy, S.P.; Kale, S.; Mohri, M.; Reddi, S.; Stich, S.; Suresh, A.T. Scaffold: Stochastic controlled averaging for federated learning. In Proceedings of the International Conference on Machine Learning, 2020; pp. 5132–5143.

Li, C.; Li, G.; Varshney, P.K. Federated learning with soft clustering. IEEE Internet of Things Journal, 2021, 9, 7773–7782.

Li, T.; Hu, S.; Beirami, A.; Smith, V. Ditto: Fair and robust federated learning through personalization. In Proceedings of the International Conference on Machine Learning, 2021; pp. 6357–6368.

Li, T.; Sahu, A.K.; Zaheer, M.; Sanjabi, M.; Talwalkar, A.; Smith, V. Federated optimization in heterogeneous networks. Proceedings of Machine Learning and Systems, 2020, 2, 429–450.

Lim, J.H.; Ha, S.; Yoon, S.W. MetaVers: Meta-learned versatile representations for personalized federated learning. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, USA, 2024; pp. 2587–2596.

Lu, Z.; Pan, H.; Dai, Y.; Si, X.; Zhang, Y. Federated learning with non-iid data: A survey. IEEE Internet of Things Journal, 2024, 11, 19188–19209.

Mactaggert, A. The California Privacy Rights and Enforcement Act of 2020. Retrieved October 2024.

McMahan, B.; Moore, E.; Ramage, D.; Hampson, S.; Arcas, B.A. Communication-efficient learning of deep networks from decentralized data. In Proceedings of Artificial Intelligence and Statistics, 2017; pp. 1273–1282.

Nguyen, D.C.; Ding, M.; Pathirana, P.N.; Seneviratne, A.; Li, J.; Poor, H.V. Federated learning for internet of things: A comprehensive survey. IEEE Communications Surveys and Tutorials, 2021, 23, 1622–1658.

Nichol, A. On first-order meta-learning algorithms. arXiv, 2018, arXiv:1803.02999.

Ruan, Y.; Joe-Wong, C. FedSoft: Soft clustered federated learning with proximal local updating. In Proceedings of the AAAI Conference on Artificial Intelligence, 2022; pp. 8124–8131.

Tan, A.Z.; Yu, H.; Cui, L.; Yang, Q. Towards personalized federated learning. IEEE Transactions on Neural Networks and Learning Systems, 2022, 34, 9587–9603.

Vahidian, S.; Kadaveru, S.; Baek, W.; Wang, W.; Kungurtsev, V.; Chen, C.; Shah, M.; Lin, B. When do curricula work in federated learning? In Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France, 2023; pp. 5084–5094.

Yang, Q.; Liu, Y.; Chen, T.; Tong, Y. Federated machine learning: Concept and applications. ACM Transactions on Intelligent Systems and Technology, 2019, 10, 1–19.

Yosinski, J.; Clune, J.; Bengio, Y.; Lipson, H. How transferable are features in deep neural networks? Advances in Neural Information Processing Systems, 2014, 27, 3320–3328.