Abstract
Federated learning (FL) is a distributed machine learning method that enables multiple participants to contribute a well performed global model while their private training data remains in local devices. FL is promising in the edge computing system which has a large corpus of decentralized data and requires data privacy. However, traditional FL algorithms perform poorly with not independently and identically distribution data, especially highly skewed class imbalanced datasets. When solving class imbalance problems in FL, it is necessary to have prior knowledge of data distribution information, which cannot protect data distribution privacy. To fully protect privacy, we build a privacy protection bottom-up hierarchical federated learning (FedPBH) framework, which alleviates the imbalances by 1) Data sampling based on global data distribution, and 2) Bottom-up client participation. The proposed framework relieves global imbalance by data sampling based on the global data distribution which is obtained through privacy protection collaborative data distribution evaluation. For averaging the local imbalance, the proposed method creates bottom-up client participation, and these clients in the same local server asynchronously train their models. Experiments demonstrate that our FedPBH model provides full privacy protection with high classification performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Cheng, X., Shi, F., Liu, Y., Zhou, J., Liu, X., Huang, L.: A CLASS-imbalanced heterogeneous federated learning model for detecting icing on wind turbine blades. IEEE Transactions on Industrial Informatics (2022)
Choudhury, O., Park, Y., Salonidis, T., Gkoulalas-Divanis, A., Sylla, I., et al.: Predicting adverse drug reactions on distributed health data using federated learning. In: AMIA Annual symposium proceedings. vol. 2019, p. 313. American Medical Informatics Association (2019)
Duan, M., Liu, D., Chen, X., Liu, R., Tan, Y., Liang, L.: Self-balancing federated learning with global imbalanced data in mobile systems. IEEE Transactions on Parallel and Distributed Systems 32(1), 59–71 (2020)
Duan, M., Liu, D., Chen, X., Tan, Y., Ren, J., Qiao, L., Liang, L.: Astraea: Self-balancing federated learning for improving classification accuracy of mobile deep learning applications. In: 2019 IEEE 37th international conference on computer design (ICCD). pp. 246–254. IEEE (2019)
Green, M.C., Plumbley, M.D.: Federated learning with highly imbalanced audio data. arXiv preprint arXiv:2105.08550 (2021)
Hauschild, A.C., Lemanczyk, M., Matschinske, J., Frisch, T., Zolotareva, O., Holzinger, A., Baumbach, J., Heider, D.: Federated random forests can improve local performance of predictive models for various healthcare applications. Bioinformatics 38(8), 2278–2286 (2022)
Hua, G., Zhu, L., Wu, J., Shen, C., Zhou, L., Lin, Q.: Blockchain-based federated learning for intelligent control in heavy haul railway. IEEE Access 8, 176830–176839 (2020)
Li, A., Cao, Y., Guo, J., Peng, H., Guo, Q., Yu, H.: Fedcss: Joint client-and-sample selection for hard sample-aware noise-robust federated learning. Proceedings of the ACM on Management of Data 1(3), 1–24 (2023)
Li, A., Zhang, L., Tan, J., Qin, Y., Wang, J., Li, X.Y.: Sample-level data selection for federated learning. In: IEEE INFOCOM 2021-IEEE Conference on Computer Communications. pp. 1–10. IEEE (2021)
Li, Q., Diao, Y., Chen, Q., He, B.: Federated learning on non-iid data silos: An experimental study. In: 2022 IEEE 38th International Conference on Data Engineering (ICDE). pp. 965–978. IEEE (2022)
Li, Q., Wen, Z., Wu, Z., Hu, S., Wang, N., Li, Y., Liu, X., He, B.: A survey on federated learning systems: vision, hype and reality for data privacy and protection. IEEE Transactions on Knowledge and Data Engineering (2021)
Li, T., Sahu, A.K., Talwalkar, A., Smith, V.: Federated learning: Challenges, methods, and future directions. IEEE Signal Processing Magazine 37(3), 50–60 (2020)
Li, X., Huang, K., Yang, W., Wang, S., Zhang, Z.: On the convergence of fedavg on non-iid data. arXiv preprint arXiv:1907.02189 (2019)
Li, X.C., Zhan, D.C.: Fedrs: Federated learning with restricted softmax for label distribution non-iid data. In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. pp. 995–1005 (2021)
López, V., Fernández, A., GarcÃa, S., Palade, V., Herrera, F.: An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics. Information sciences 250, 113–141 (2013)
McMahan, B., Moore, E., Ramage, D., Hampson, S., y Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. In: Artificial intelligence and statistics. pp. 1273–1282. PMLR (2017)
Mrad, I., Samara, L., Abdellatif, A.A., Al-Abbasi, A., Hamila, R., Erbad, A.: Federated learning for uav swarms under class imbalance and power consumption constraints. arXiv preprint arXiv:2108.10748 (2021)
Qi, T., Zhan, Y., Li, P., Guo, J., Xia, Y.: Hwamei: A learning-based synchronization scheme for hierarchical federated learning. In: 2023 IEEE 43rd International Conference on Distributed Computing Systems (ICDCS). pp. 534–544. IEEE (2023)
Shen, Z., Cervino, J., Hassani, H., Ribeiro, A.: An agnostic approach to federated learning with class imbalance. In: International Conference on Learning Representations (2021)
Truex, S., Baracaldo, N., Anwar, A., Steinke, T., Ludwig, H., Zhang, R., Zhou, Y.: A hybrid approach to privacy-preserving federated learning. In: Proceedings of the 12th ACM workshop on artificial intelligence and security. pp. 1–11 (2019)
Wang, J., Liu, Q., Liang, H., Joshi, G., Poor, H.V.: Tackling the objective inconsistency problem in heterogeneous federated optimization. Advances in neural information processing systems 33, 7611–7623 (2020)
Xiao, C., Wang, S.: An experimental study of class imbalance in federated learning. In: 2021 IEEE Symposium Series on Computational Intelligence (SSCI). pp. 1–7. IEEE (2021)
Yin, X., Zhu, Y., Hu, J.: A comprehensive survey of privacy-preserving federated learning: A taxonomy, review, and future directions. ACM Computing Surveys (CSUR) 54(6), 1–36 (2021)
Yu, T., Li, T., Sun, Y., Nanda, S., Smith, V., Sekar, V., Seshan, S.: Learning context-aware policies from multiple smart homes via federated multi-task learning. In: 2020 IEEE/ACM Fifth International Conference on Internet-of-Things Design and Implementation (IoTDI). pp. 104–115. IEEE (2020)
Zhang, D.Y., Kou, Z., Wang, D.: Fedsens: A federated learning approach for smart health sensing with class imbalance in resource constrained edge computing. In: IEEE INFOCOM 2021-IEEE Conference on Computer Communications. pp. 1–10. IEEE (2021)
Zhang, S., Li, Z., Chen, Q., Zheng, W., Leng, J., Guo, M.: Dubhe: Towards data unbiasedness with homomorphic encryption in federated learning client selection. In: 50th International Conference on Parallel Processing. pp. 1–10 (2021)
Acknowledgements
The research work was partially supported by the Key Research and Development Program of Liaoning Province under Grant No.2023JH26/10300022; and the Shenyang Young and Middle-aged Scientific and Technological Innovation Talent Support Plan under Grant No.RC220504.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhang, J., Li, S., Li, J., Xia, X., Teng, Y., Zhang, A. (2024). Privacy Protection Bottom-up Hierarchical Federated Learning with Class Imbalanced Data. In: Onizuka, M., et al. Database Systems for Advanced Applications. DASFAA 2024. Lecture Notes in Computer Science, vol 14853. Springer, Singapore. https://doi.org/10.1007/978-981-97-5562-2_3
Download citation
DOI: https://doi.org/10.1007/978-981-97-5562-2_3
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-5561-5
Online ISBN: 978-981-97-5562-2
eBook Packages: Computer ScienceComputer Science (R0)