Downloads

https://doi.org/10.62836/jitp.2023.158
Zhou, L., Wang, M., & Zhou, N. (2023). Distributed Federated Learning-Based Deep Learning Model for Privacy MRI Brain Tumor Detection. Journal of Information, Technology and Policy, 1–12. https://doi.org/10.62836/jitp.2023.158
Volume 1, Issue 1, 2023
Copyright (c) 2024 Journal of Information, Technology and Policy
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Distributed Federated Learning-Based Deep Learning Model for Privacy MRI Brain Tumor Detection

Distributed training can facilitate the processing of large medical image datasets, and improve the accuracy and efficiency of disease diagnosis while protecting patient privacy, which is crucial for achieving efficient medical image analysis and accelerating medical research progress. This paper presents an innovative approach to medical image classification, leveraging Federated Learning (FL) to address the dual challenges of data privacy and efficient disease diagnosis. Traditional Centralized Machine Learning models, despite their widespread use in medical imaging for tasks such as disease diagnosis, raise significant privacy concerns due to the sensitive nature of patient data. As an alternative, FL emerges as a promising solution by allowing the training of a collective global model across local clients without centralizing the data, thus preserving privacy. Focusing on the application of FL in Magnetic Resonance Imaging (MRI) brain tumor detection, this study demonstrates the effectiveness of the Federated Learning framework coupled with EfficientNet-B0 and the FedAvg algorithm in enhancing both privacy and diagnostic accuracy. Through a meticulous selection of preprocessing methods, algorithms, and hyperparameters, and a comparative analysis of various Convolutional Neural Network (CNN) architectures, the research uncovers optimal strategies for image classification. The experimental results reveal that EfficientNet-B0 outperforms other models like ResNet in handling data heterogeneity and achieving higher accuracy and lower loss, highlighting the potential of FL in overcoming the limitations of traditional models. The study underscores the significance of addressing data heterogeneity and proposes further research directions for broadening the applicability of FL in medical image analysis.

component; distributed learning; federated learning; brain tumor detection

References

  1. Deng X, Oda S, Kawano Y. Graphene-Based Midinfrared Photodetector With Bull’S Eye Plasmonic Antenna. Optical Engineering 2023; 62(9): 097102–097102.
  2. Sugaya T, Deng X. Resonant Frequency Tuning of Terahertz Plasmonic Structures Based on Solid Immersion Method. In 2019 44th International Conference on Infrared, Millimeter, and Terahertz Waves (IRMMW-THz), Paris, France, 1–6 September 2019.
  3. Li S, Zhao Y, Varma R, Salpekar O, Noordhuis P, Li T, Paszke A, Smith J, Vaughan B, Damania P, Chintala, S. Pytorch Distributed: Experiences on Accelerating Data Parallel Training. Proceedings of the VLDB Endowment 2020; 13(12): 3005–3018.
  4. Chen F, Luo Z, Xu Y, Ke D. Complementary Fusion of Multi-Features and Multi-Modalities in Sentiment Analysis. In Proceedings of the AffCon@AAAI 2019, Honolulu, HI, USA, 27 January 2019.
  5. Luo Z, Zeng X, Bao Z, Xu M. Deep Learning-Based Strategy for Macromolecules Classification With Imbalanced Data From Cellular Electron Cryotomography. In Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary, 14–19 July 2019.
  6. Luo Z. Knowledge-Guided Aspect-Based Summarization. In Proceedings of the 2023 International Conference on Communications, Computing and Artificial Intelligence (CCCAI), Shanghai, China, 23–25 June 2023.
  7. Li L, Fan Y, Tse M, Lin KY. A Review of Applications in Federated Learning. Computers & Industrial Engineering 2020; 149: 106854.
  8. Rieke N, Hancox J, Li W, Milletari F, Roth HR, Albarqouni S, Bakas S, Galtier MN, Landman BA, Maier-Hein K, Ourselin S, Sheller M, Summers RM, Trask A, Xu D, Baust M, Cardoso MJ. The Future of Digital Health With Federated Learning. NPJ Digital Medicine 2020; 3(1): 1–7.
  9. Li J, Shaw MJ. Electronic Medical Records, HIPAA, and Patient Privacy. International Journal of Information Security and Privacy (IJISP) 2008; 2(3): 45–54.
  10. Pokhrel SR, Choi J. Federated Learning With Blockchain for Autonomous Vehicles: Analysis and Design Challenges. IEEE Transactions on Communications 2020; 68(8): 4734–4746.
  11. Jie Z, Chen S, Lai J, Arif M, He Z. Personalized Federated Recommendation System With Historical Parameter Clustering. Journal of Ambient Intelligence and Humanized Computing 2023; 14(8): 10555–10565.
  12. McMahan B, Moore E, Ramage D, Hampson S, y Arcas BA. Communication-Efficient Learning of Deep Networks From Decentralized Data. In Proceedings of the 20 th International Conference on Artificial Intelligence and Statistics (AISTATS), Ft. Lauderdale, FL, USA, 20–22 April 2017.
  13. Li T, Sahu AK, Zaheer M, Sanjabi M, Talwalkar A, Smith V. Federated Optimization in Heterogeneous Networks. Proceedings of Machine Learning and Systems 2020; 2: 429–450.
  14. Acar DAE, Zhao Y, Navarro RM, Mattina M, Whatmough PN, Saligrama V. Federated Learning Based on Dynamic Regularization. 2021. arXiv:2111.04263.
  15. Shi Y, Liang J, Zhang W, Tan VY, Bai S. Towards Understanding and Mitigating Dimensional Collapse in Heterogeneous Federated Learning. 2022. arXiv:2210.00226.
  16. Qu Z, Li X, Duan R, Liu Y, Tang B, Lu Z. Generalized Federated Learning Via Sharpness Aware Minimization. 2022. arXiv:2206.02618.
  17. Wang J, Liu Q, Liang H, Joshi G, Poor HV. Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization. Advances in Neural Information Processing Systems 2020; 33: 7611–7623.
  18. Ma X, Zhang J, Guo S, Xu W. Layer-Wised Model Aggregation for Personalized Federated Learning. In Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 18–24 June 2022.
  19. Reddi S, Charles Z, Zaheer M, Garrett Z, Rush K, Konečný J, Kumar S, McMahan HB. Adaptive Federated Optimization. 2020. arXiv:2003.00295.
  20. Alqudah AM, Alquraan H, Qasmieh IA, Alqudah A, Al-Sharu W. Brain Tumor Classification Using Deep Learning Technique--a Comparison Between Cropped, Uncropped, and Segmented Lesion Images With Different Sizes. 2020. arXiv:2001.08844.
  21. Siar H, Teshnehlab M. Diagnosing and Classification Tumors and MS Simultaneous of Magnetic Resonance Images Using Convolution Neural Network. In Proceedings of the 2019 7th Iranian Joint Congress on Fuzzy and Intelligent Systems (CFIS), Bojnord, Iran, 29–31 January 2019.
  22. Kang L, Jiang J, Huang J, Zhang T. Identifying Early Mild Cognitive Impairment By Multi-Modality MRI-Based Deep Learning. Frontiers in Aging Neuroscience 2020; 12: 206.
  23. Qiu Y, Chang CS, Yan JL, Ko L, Chang TS. Semantic Segmentation of Intracranial Hemorrhages in Head CT Scans. In Proceedings of the 2019 IEEE 10th International Conference on Software Engineering and Service Science (ICSESS), Beijing, China, 18–20 October 2019.
  24. Khan MA, Ashraf I, Alhaisoni M, Damaševičius R, Scherer R, Rehman A, Bukhari SAC. Multimodal Brain Tumor Classification Using Deep Learning and Robust Feature Selection: A Machine Learning Application for Radiologists. Diagnostics 2020; 10(8): 565.
  25. Amin J, Sharif M, Gul N, Yasmin M, Shad SA. Brain Tumor Classification Based on DWT Fusion of MRI Sequences Using Convolutional Neural Network. Pattern Recognition Letters 2020; 129: 115–122.
  26. Sharif M, Tanvir U, Munir EU, Khan MA, Yasmin M. Brain Tumor Segmentation and Classification By Improved Binomial Thresholding and Multi-Features Selection. Journal of Ambient Intelligence and Humanized Computing 2018; 15: 1063–1082.
  27. Rehman A, Naz S, Razzak MI, Akram F, Imran M. A Deep Learning-Based Framework for Automatic Brain Tumors Classification Using Transfer Learning. Circuits, Systems, and Signal Processing 2020; 39(2): 757–775.
  28. Ismael MR, Abdel-Qader I. Brain Tumor Classification Via Statistical Features and Back-Propagation Neural Network. In Proceedings of the 2018 IEEE International Conference on Electro/Information Technology (EIT), Rochester, MI, USA, 3–5 May 2018.
  29. Kaggle Brain Tumor Classification (MRI). Available online: https://www.kaggle.com/datasets/sartajbhuvaji/brain-tumor-classification-mri/data (accessed on 1 July 2023).
  30. Luo Z, Xu H, Chen F. Audio Sentiment Analysis by Heterogeneous Signal Features Learned from Utterance-Based Parallel Neural Network. In Proceedings of the AffCon@ AAAI 2019, Honolulu, Hawaii, USA, 27 January–1 February 2019.
  31. Arena P, Basile A, Bucolo M, Fortuna L. Image Processing for Medical Diagnosis Using CNN. Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment 2003; 497(1): 174–178.
  32. Qiu Y, Wang J, Jin Z, Chen H, Zhang M, Guo L. Pose-Guided Matching Based on Deep Learning for Assessing Quality of Action on Rehabilitation Training. Biomedical Signal Processing and Control 2022; 72: 103323.
  33. Tan M, Le Q. Efficientnet: Rethinking Model Scaling for Convolutional Neural Networks. In Proceedings of the ICML 2019: 36th International Conference on Machine Learning, Long Beach, CA, USA, 10–15 June 2019.
  34. Loshchilov I, Hutter F. Decoupled Weight Decay Regularization. 2017. arXiv:1711.05101.
  35. Qiu Y, Yang Y, Lin Z, Chen P, Luo Y, Huang W. Improved Denoising Autoencoder for Maritime Image Denoising and Semantic Segmentation of USV. China Communications 2020; 17(3): 46–57.
  36. Kong C, Li H, Zhang L, Zhu H, Liu T. Link Prediction on Dynamic Heterogeneous Information Networks. In Proceedings of the 10th International Conference, CSoNet 2021, Virtual Event, 15–17 November 2021.
  37. Zhu H, Wang B. Negative Siamese Network for Classifying Semantically Similar Sentences. In Proceedings of the 2021 International Conference on Asian Language Processing (IALP), Singapore, Singapore, 11–13 December 2021.
  38. Kong C, Zhu H, Li H, Liu J, Wang Z, Qian Y. Multi-agent Negotiation in Real-time Bidding. In Proceedings of the 2019 IEEE International Conference on Consumer Electronics - Taiwan (ICCE-TW), Yilan, Taiwan, 20–22 May 2019.
  39. Kong C, Liu J, Li H, Liu Y, Zhu H, Liu T. Drug Abuse Detection Via Broad Learning. In Proceedings of the Web Information Systems and Applications: 16th International Conference, WISA 2019, Qingdao, China, 20–22 September 2019.
  40. Kong C, Li H, Zhu H, Xiu Y, Liu J, Liu T. Anonymized User Linkage Under Differential Privacy. In Proceedings of the Soft Computing in Data Science: 5th International Conference, SCDS 2019, Iizuka, Japan, 28–29 August 2019.
  41. Zhou Y, Osman A, Willms M, Kunz A, Philipp S, Blatt J, Eul S. Semantic Wireframe Detection. Available online: chrome-extension://efaidnbmnnnibpcajpcglclefindmkaj/https://www.ndt.net/article/dgzfp2023/papers/P17.pdf (accessed on 1 July 2023).
  42. Deng X, Li L, Enomoto M, Kawano Y. Continuously Frequency-Tuneable Plasmonic Structures for Terahertz Bio-Sensing and Spectroscopy. Scientific Reports 2019; 9(1): 3498.
  43. Deng X, Simanullang M, Kawano Y. Ge-Core/a-Si-Shell Nanowire-Based Field-Effect Transistor for Sensitive Terahertz Detection. Photonics 2018; 5(2): 13.

Supporting Agencies

  1. Funding: Not applicable.