International Journal of Computational Intelligence Research (IJCIR)

Volume 1, Number 2 (2005)


Support-Vector-Based Fuzzy Neural Networks

Chin-Teng Lin
National Chiao-Tung University,

Department of Computer Science,

Ta Hsueh Road, Hsinchu, Taiwan


Chang-Mao Yeh, Jen-Feng Chung, Sheng-Fu Liang

National Chiao-Tung University, 

Department of Electrical and Control Engineering, 

Ta Hsueh Road, Hsinchu, Taiwan


Her-Chang Pu

National Chiao-Tung University, 

Department of Biological Science and Technology, 

Ta Hsueh Road, Hsinchu, Taiwan


In this paper, novel fuzzy neural networks (FNNs) combining with support vector learning mechanism called support-vector-based fuzzy neural networks (SVFNNs) are proposed for pattern classification and function approximation. The SVFNNs combine the capability of minimizing the empirical risk (training error) and expected risk (testing error) of support vector learning in high dimensional data spaces and the efficient human-like reasoning of FNN in handling uncertainty information. A learning algorithm consisting of three learning phases is developed to construct the SVFNNs and train the parameters. In the first phase, the fuzzy rules and membership functions are automatically determined by the clustering principle. In the second phase, the parameters of FNN are calculated by the SVM and SVR with the proposed adaptive fuzzy kernel function for pattern classification and function approximation, respectively. In the third phase, the relevant fuzzy rules are selected by the proposed fuzzy rule reduction method. To investigate the effectiveness of the proposed SVFNNs, they are applied to the Iris and Vehicle datasets for classification, and one- and two-variable functions for approximation, respectively. Experimental results show that the proposed SVFNNs can achieve good pattern classification and function approximation performance with drastically reduced number of fuzzy kernel functions (fuzzy rules).

Key words
Fuzzy neural network, fuzzy kernel function, support vector machine, support vector regression, pattern classification, function approximation.