Rule extraction from multi-layer perceptron neural network using decision tree for currency exchange rates forecasting

Neural network can be used in acquiring hidden knowledge in datasets. However, knowledge acquired by neural network was presented in its topology, the weights on the connections and by the activation functions of the hidden and output nodes. These representations are not easily understandable since...

Full description

Saved in:

Bibliographic Details
Main Author:	Soleh, Ardiansyah
Format:	Thesis
Language:	English
Published:	2015
Subjects:	QA75 Electronic computers Computer science
Online Access:	http://umpir.ump.edu.my/id/eprint/12627/19/Rule%20extraction%20from%20multi-layer%20perceptron%20neural%20network%20using%20decision%20tree%20for%20currency%20exchange%20rates%20forecasting.pdf
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-ump-ir.12627
record_format	uketd_dc
spelling	my-ump-ir.126272021-11-09T01:59:22Z Rule extraction from multi-layer perceptron neural network using decision tree for currency exchange rates forecasting 2015-06 Soleh, Ardiansyah QA75 Electronic computers. Computer science Neural network can be used in acquiring hidden knowledge in datasets. However, knowledge acquired by neural network was presented in its topology, the weights on the connections and by the activation functions of the hidden and output nodes. These representations are not easily understandable since neural networks act as a black box. The black box problem can be solved by extracting rule from trained neural network. Thus, the aim of this study was to extract valuable information (rule) from trained multi-layer perceptron (MLP) neural networks using decision tree. The main process in extracting rules from MLP using decision tree for currency exchange rate forecasting can be divided into two stages. In the first stage, the MLP network was built based on the parameter that was defined in the previous chapter. We also perform training and testing process experimentally and then the performance was evaluated in order to obtain the network with the best performance. The MLP network which provides the best prediction performance will be extracted by decision tree in the second stage by mapping input-output of the network directly. The forecasting result have shown that MLP network of EUR/USD produced a significant results compared to MLP network of GBP/USD and USD/JPY in term of MSE, RMSE, MAPE, and DS. It is quite evident that as the number of hidden neurons increases, MSE and MAPE decrease. In addition, the number of iterations for each model continues to increase along with the increasing number of hidden neurons. The results on decision tree induction show that C4.5 algorithm induction produced a significant result in term of accuracy 84.07% - 86.34%, precision and recall 93.17% and 81.97% respectively. This study has shown how rule can be extracted from MLP network by decision tree without making any assumptions about the networks activations function or having initial knowledge about the problem domain. The extracted rule can be used to explain the process of the neural network systems and also can be used in other systems like expert systems. 2015-06 Thesis http://umpir.ump.edu.my/id/eprint/12627/ http://umpir.ump.edu.my/id/eprint/12627/19/Rule%20extraction%20from%20multi-layer%20perceptron%20neural%20network%20using%20decision%20tree%20for%20currency%20exchange%20rates%20forecasting.pdf pdf en public masters Universiti Malaysia Pahang Faculty of Computer System and Software Engineering
institution	Universiti Malaysia Pahang Al-Sultan Abdullah
collection	UMPSA Institutional Repository
language	English
topic	QA75 Electronic computers Computer science
spellingShingle	QA75 Electronic computers Computer science Soleh, Ardiansyah Rule extraction from multi-layer perceptron neural network using decision tree for currency exchange rates forecasting
description	Neural network can be used in acquiring hidden knowledge in datasets. However, knowledge acquired by neural network was presented in its topology, the weights on the connections and by the activation functions of the hidden and output nodes. These representations are not easily understandable since neural networks act as a black box. The black box problem can be solved by extracting rule from trained neural network. Thus, the aim of this study was to extract valuable information (rule) from trained multi-layer perceptron (MLP) neural networks using decision tree. The main process in extracting rules from MLP using decision tree for currency exchange rate forecasting can be divided into two stages. In the first stage, the MLP network was built based on the parameter that was defined in the previous chapter. We also perform training and testing process experimentally and then the performance was evaluated in order to obtain the network with the best performance. The MLP network which provides the best prediction performance will be extracted by decision tree in the second stage by mapping input-output of the network directly. The forecasting result have shown that MLP network of EUR/USD produced a significant results compared to MLP network of GBP/USD and USD/JPY in term of MSE, RMSE, MAPE, and DS. It is quite evident that as the number of hidden neurons increases, MSE and MAPE decrease. In addition, the number of iterations for each model continues to increase along with the increasing number of hidden neurons. The results on decision tree induction show that C4.5 algorithm induction produced a significant result in term of accuracy 84.07% - 86.34%, precision and recall 93.17% and 81.97% respectively. This study has shown how rule can be extracted from MLP network by decision tree without making any assumptions about the networks activations function or having initial knowledge about the problem domain. The extracted rule can be used to explain the process of the neural network systems and also can be used in other systems like expert systems.
format	Thesis
qualification_level	Master's degree
author	Soleh, Ardiansyah
author_facet	Soleh, Ardiansyah
author_sort	Soleh, Ardiansyah
title	Rule extraction from multi-layer perceptron neural network using decision tree for currency exchange rates forecasting
title_short	Rule extraction from multi-layer perceptron neural network using decision tree for currency exchange rates forecasting
title_full	Rule extraction from multi-layer perceptron neural network using decision tree for currency exchange rates forecasting
title_fullStr	Rule extraction from multi-layer perceptron neural network using decision tree for currency exchange rates forecasting
title_full_unstemmed	Rule extraction from multi-layer perceptron neural network using decision tree for currency exchange rates forecasting
title_sort	rule extraction from multi-layer perceptron neural network using decision tree for currency exchange rates forecasting
granting_institution	Universiti Malaysia Pahang
granting_department	Faculty of Computer System and Software Engineering
publishDate	2015
url	http://umpir.ump.edu.my/id/eprint/12627/19/Rule%20extraction%20from%20multi-layer%20perceptron%20neural%20network%20using%20decision%20tree%20for%20currency%20exchange%20rates%20forecasting.pdf
_version_	1783731968935985152

Rule extraction from multi-layer perceptron neural network using decision tree for currency exchange rates forecasting

Similar Items