Abstract
Generally, clustering techniques may be classified into hierarchical-based and partition-based techniques. Hierarchical-based clustering techniques included single link [1], complete link [2] and [3][4]. The main drawback of hierarchical clustering is that it is static, and points committed to a given cluster in the early stages cannot be moved to a different cluster. Prototype-based partition clustering techniques, on the other hand, are dynamic and the data points can move from one cluster to another under varying conditions. However, partition-based clustering techniques require prior knowledge such as the number of classes, C, in the set of training data. Such information may be unknown and is difficult to estimate in data sets such as traffic flow data [5]. For tasks such as the 2-Spiral problem [6], computing a predefined number of clusters, C, may not be good enough to satisfactorily solve the tasks. Moreover, partition-based clustering techniques suffer from the stability-plasticity dilemma [7] where new information cannot be learned without running the risk of eroding old (previously learned) but valid knowledge. Therefore, in the context of neural fuzzy systems [8] such as POPFNN [9], hierarchical clustering violates the networks’ ability to self-organize and self-adapt with changing environments while current partition-based clustering techniques have some significant shortcomings. These deficiencies serve as the main motivations behind the development of the Discrete Incremental Clustering (DIC) technique. The DIC technique is not limited by the need to have prior knowledge of the number of clusters C and it preserves the dynamism of partition-based clustering techniques. The proposed DIC technique is implemented in a new neural fuzzy network named Gen-SoFNN [10] to demonstrate its performance.
Preview
Unable to display preview. Download preview PDF.
References
Gower, J.C., Ross, G.J.S.: Minimum spanning trees and single linkage cluster analysis. Applied Statistic (1969) 18: 54–64
Johnson, S.C.:Hierarchical clustering schemes. Psychometrika (1967) 323: 241–254
Benkirane, H., Kbir, M.A., Maalmi, K., Benslimane, R.: Hierarchical fuzzy partition for pattern classification with fuzzy if-then rules. Pattern Recog. Letters (2000) 21: 503–509
Cunningham, G.A., Lin, Y.H., Coggeshall, S.V.: Using Fuzzy Partitions to Create Fuzzy Systems from Input-Output Data and Set the Initial Weights in a Fuzzy Neural Network. IEEE Trans. Fuzzy Systs (1997) 5(4): 614–621
Tan, G.K.: Feasibility of predicting congestion states with neural networks. Final Year Project Thesis, School of Civil and Structural Engineering, Nanyang Technological University, Singapore (1997)
Lang, K.J., Witbrock, M.J.: Learning to tell two spirals apart. Proc. 1988 Connectionist Models Summer School (1988) 52-59
Lin, CT., Lee, C.S.G.: Neural Fuzzy Systems —A Neuro-Fuzzy Synergism to Intelligent Systems. Englewood Cliffs, NJ, Prentice Hall (1996)
Nauck, D., Klawonn, F., Kruse, R.: Foundations of Neuro-Fuzzy Systems. Chichester, England; New York, John Wiley (1997)
Quek, C, Zhou, R.W.: POPFNN: A Pseudo Outer-Product Based Fuzzy Neural Network. Neural Networks 9(9): 1569–1581, Elsevier Science Ltd. (1996)
Tung, W.L.: A Generalized Platform for Fuzzy Neural Network. Technical Report, ISL-TR-01/01, School of Computer Engineering, Nanyang Technological University, Singapore (2001)
Jang, J.S.: ANFIS: Adaptive-Network-Based Fuzzy Inference Systems. IEEE Trans. Systems, Man & Cybernetics (1993) 23: 665–685
Lin, C.J., Lin, C.T.: An ART-Based Fuzzy Adaptive Learning Control Network. IEEE Trans. Fuzzy Systs (1997) 5(4): 477–496
Zadeh, L.A.: Calculus of fuzzy restrictions. Fuzzy sets and Their Applications to Cognitive and Decision Processes. Ed. New York: Academic 1–39 (1975)
Tung, W.L., Quek, C: Derivation of GenSoFNN-CRI(S) from CRI-based Fuzzy System. Technical Report, ISL-TR-04/01, School of Computer Engineering, Nanyang Technological University, Singapore (2001)
Carpenter, G.A., Grossberg, S., Rosen, D.B.: Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural Networks (1991) 4: 759–771
Kohonen, T.K.: Self-Organized Formation of Topologically Correct Feature Maps. Bio. Cybern. (1982) 43: 59–69
Carpenter, G.A., Grossberg, S., Markuzon, N., Reynolds, J.H., Rosen, D.B.: Fuzzy ARTMAP: A Neural Network Architecture for Incremental Supervised Learning of Analog Multidimensional Maps. IEEE Trans. Neural Networks (1992) 3(5): 698–713
Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning internal representations by error propagation. In Rumelhart, D.E., McClelland, J.L. et al., eds. Parallel Distributed Processing, vol. 1, chap. 8, Cambridge, MA: MIT Press (1986)
Fahlman, S.E.: Faster-learning variations on back-propagation: An empirical study. Proc. 1988 Connectionist Models Summer School (1989) 38–51
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tung, W.L., Quek, C. (2002). DIC: A Novel Discrete Incremental Clustering Technique for the Derivation of Fuzzy Membership Functions. In: Ishizuka, M., Sattar, A. (eds) PRICAI 2002: Trends in Artificial Intelligence. PRICAI 2002. Lecture Notes in Computer Science(), vol 2417. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45683-X_21
Download citation
DOI: https://doi.org/10.1007/3-540-45683-X_21
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44038-3
Online ISBN: 978-3-540-45683-4
eBook Packages: Springer Book Archive