Volume 1, Number 1 (2005)

Approximation Capabilities of Hierarchical Neural-Fuzzy Systems for 

Function Approximation on Discrete Spaces

Xiao-Jun Zeng

School of Informatics University of Manchester, U.K.

John Yannis Goulermas
Department of Electrical Engineering and Electronics University of Liverpool, U.K.

John A Keane

School of Informatics University of Manchester, U.K.

Panos Liatsis

Information and Biomedical Engineering Centre School of Engineering and Mathematical Sciences City University, London EC1V 0HB, U.K.

Abstract

This paper investigates function approximation on discrete input spaces by both neural networks and neural-fuzzy systems. Rather than use existing neural networks for function approximation on continuous input spaces, this paper proposes, based on a hierarchical systematic perspective, four simplified approximation schemes: simplified neural networks, extended simplified neural networks, simple hierarchical neural-fuzzy systems and hierarchical neural-fuzzy systems. Each scheme is proven to be a universal approximator (i.e., each can approximate any function on discrete input spaces to any degree of accuracy). The results provide both several new and simpler approximation schemes for function approximation on discrete spaces and show that there exist simpler and more effective methods for function approximation on discrete spaces compared with continuous spaces.

Keywords

Neural Networks, Fuzzy Systems, Neural-Fuzzy Systems, Hierarchical systems.

______________________________________________________________________________________