A Multi-Objective Optimization Approach for Training Artificial Neural Networks

Roselito de Albuquerque TeixeiraAntônio de Pádua BragaRicardo H. C. TakahashiRodney R. Saldanha

This paper presents a new learning scheme for training Multilayer Perceptrons (MLPs) with improved generalization ability. The algorithm employs a training algorithm based on a multi-objective optimization mechanism. This approach allows balancing between the training squared error and the norm of the network weight vector. This balancing is correlated with the trade-off between overfitting and underfitting. The method is applied to classification and regression problems and compared with Weight Decay (WD), Support Vector Machines (SVMs) and standard Backpropagation (BP) results. The proposed method leads to training results that are the best ones, and additionally allows a systematic procedure for training neural networks, with less heuristic parameter adjustments than the other methods.

Caso o link acima esteja inválido, faça uma busca pelo texto completo na Web: Buscar na Web

Biblioteca Digital Brasileira de Computação - Contato:
     Mantida por: