Journal Home > Volume 15 , Issue 1

Over the recent years, we have been witnessing spectacular achievements of Artificial Intelligence (AI) and Machine Learning (ML), in particular. We have seen highly visible accomplishments encountered in natural language processing and computer vision impacting numerous areas of human endeavours. Being driven inherently by the technologically advanced learning and architectural developments, ML constructs are highly impactful coming with far reaching consequences; just to mention autonomous vehicles, health care imaging, decision-making processes in critical areas, among others. The quality of ML architectures and credibility of generated results are inherently implied by the nature, quality, and amount of available data. The credibility of ML models and confidence quantified their results are also of paramount concern to any critical application. In this study, we advocate that the credibility (confidence) of results produced by ML constructs is inherently expressed in the form of information granules. Several development scenarios are carefully revisited including those involving constructs in statistics (confidence and prediction intervals), probability (Gaussian process models), and granular parameters (fuzzy sets and interval techniques). We augment the commonly encountered and challenging category of applications of ML referred to as federated learning where the aspect of quality of the model and its results calls for a thorough assessment.


menu
Abstract
Full text
Outline
About this article

Advancing Federated Learning with Granular Computing

Show Author's information Witold Pedrycz( )
Department of Electrical & Computer Engineering, University of Alberta, Edmonton, T6G 2R3, Canada

Abstract

Over the recent years, we have been witnessing spectacular achievements of Artificial Intelligence (AI) and Machine Learning (ML), in particular. We have seen highly visible accomplishments encountered in natural language processing and computer vision impacting numerous areas of human endeavours. Being driven inherently by the technologically advanced learning and architectural developments, ML constructs are highly impactful coming with far reaching consequences; just to mention autonomous vehicles, health care imaging, decision-making processes in critical areas, among others. The quality of ML architectures and credibility of generated results are inherently implied by the nature, quality, and amount of available data. The credibility of ML models and confidence quantified their results are also of paramount concern to any critical application. In this study, we advocate that the credibility (confidence) of results produced by ML constructs is inherently expressed in the form of information granules. Several development scenarios are carefully revisited including those involving constructs in statistics (confidence and prediction intervals), probability (Gaussian process models), and granular parameters (fuzzy sets and interval techniques). We augment the commonly encountered and challenging category of applications of ML referred to as federated learning where the aspect of quality of the model and its results calls for a thorough assessment.

Keywords: machine learning, federated learning, credibility, granular computing, justifiable granularity

References(26)

[1]
W. Pedrycz, Granular Computing: Analysis and Design of Intelligent Systems. Boca Raton, FL, USA: CRC Press, 2013.
DOI
[2]

W. Pedrycz, Granular computing for data analytics: A manifesto of human-centric computing, IEEE/CAA J. Autom. Sin., vol. 5, no. 6, pp. 1025–1034, 2018.

[3]

L. A. Zadeh, Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic, Fuzzy Sets Syst., vol. 90, no. 2, pp. 111–127, 1997.

[4]
R. C. Castanyer, S. Martínez-Fernández, and X. Franch, Which design decisions in AI-enabled mobile applications contribute to Greener AI?, arXiv preprint arXiv: 2109.15284, 2021.
[5]

W. Pedrycz, Towards green machine learning: Challenges, opportunities, and developments, J. Smart Environ. Green Comput., vol. 2, pp. 163–174, 2022.

[6]
R. Schwartz, J. Dodge, N. A. Smith, and O. Etzioni, Green AI, arXiv preprint arXiv: 1907.10597, 2019.
[7]
T. Tornede, A. Tornede, J. Hanselle, M. Wever, F. Mohr, and E. Hüllermeier, Towards green automated machine learning: Status quo and future directions, arXiv preprint arXiv: 2111.05850, 2021.
[8]

A. B. Arrieta, N. Díaz-Rodríguez, J. Del Ser, A. Bennetot, S. Tabik, A. Barbado, S. Garcia, S. Gil-Lopez, D. Molina, R. Benjamins, et al., Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI, Inf. Fusion, vol. 58, pp. 82–115, 2020.

[9]
G. Alefeld and J. Herzberger, Introduction to Interval Computations. New York, NY, USA: Academic Press, 1983.
[10]
R. E. Moore, Interval Analysis. Englewood Cliffs, NJ, USA: Prentice-Hall, 1966.
[11]
R. E. Moore, R. B. Kearfott, and M. J. Cloud, Introduction to Interval Analysis. Philadelphia, PA, USA: SIAM, 2009.
DOI
[12]

D. Dubois and H. Prade, An introduction to fuzzy systems, Clin. Chim. Acta, vol. 270, no. 1, pp. 3–29, 1998.

[13]
H. Nguyen and E. Walker, A First Course in Fuzzy Logic. Boca Raton, FL, USA: CRC Press, 2000.
[14]
W. Pedrycz, An Introduction to Computing with Fuzzy Sets: Analysis, Design, and Applications, Cham, Switzerland: Springer, 2021.
DOI
[15]

W. Pedrycz, Shadowed sets: Representing and processing fuzzy sets, IEEE Trans. Syst., Man, Cybern., Part B (Cybern.), vol. 28, no. 1, pp. 103–109, 1998.

[16]

Y. Yao, S. Wang, and X. Deng, Constructing shadowed sets and three-way approximations of fuzzy sets, Inf. Sci., vol. 412−413, pp. 132–153, 2017.

[17]
Z. Pawlak, Rough sets, Int. J. Comput. Inf. Sci. , vol. 11, no. 5, pp. 341–356, 1982.
DOI
[18]
Z. Pawlak, Rough Sets: Theoretical Aspects of Reasoning about Data, Dordrecht, The Netherlands: Springer, 1991.
DOI
[19]

J. M. Mendel, R. I. John, and F. Liu, Interval Type-2 fuzzy logic systems made simple, IEEE Trans. Fuzzy Syst., vol. 14, no. 6, pp. 808–821, 2006.

[20]
C. E. Rasmussen and G. K. I. Williams, Gaussian Processes for Machine Learning, Cambridge, MA, USA: MIT Press, 2006.
DOI
[21]

S. Abdulrahman, H. Tout, H. Ould-Slimane, A. Mourad, C. Talhi, and M. Guizani, A survey on federated learning: The journey from centralized to distributed on-site learning and beyond, IEEE Internet Things J., vol. 8, no. 7, pp. 5476–5497, 2021.

[22]
P. Kairouz, H. B. McMahan, B. Avent, A. Bellet, M. Bennis, A. N. Bhagoji, K. Bonawitz, Z. Charles, G. Cormode, R. Cummings, et al. , Advances and open problems in federated learning, Found. Trends® Mach. Learn., vol. 14, nos. 1–2, pp. 1–210, 2021.
DOI
[23]
Q. Yang, Y. Liu, Y. Cheng, Y. Kang, T. Chen, and H. Yu, Federated Learning, San Rafael, CA, USA: Morgan & Claypool Publishers, 2019.
[24]
Q. Yang, L. Fan, and H. Yu, Federated Learning: Privacy and Incentive, Cham, Switzerland: Springer, 2020.
DOI
[25]

X. Hu, Y. Shen, W. Pedrycz, X. Wang, A. Gacek, and B. Liu, Identification of fuzzy rule-based models with collaborative fuzzy clustering, IEEE Trans. Cybern., vol. 52, no. 7, pp. 6406–6419, 2022.

[26]
P. S. Bullen, Handbook of Means and Their Inequalities, Dordrecht, The Netherlands: Springer, 2003.
DOI
Publication history
Copyright
Rights and permissions

Publication history

Received: 31 January 2023
Revised: 02 February 2023
Accepted: 24 February 2023
Published: 01 March 2023
Issue date: March 2023

Copyright

© The Author(s) 2023. Published by Tsinghua University Press.

Rights and permissions

This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).

Return