Extended multiple models selection algorithms based on iterative feasible generalized least squares (IFGLS) and expectation-maximization (EM) algorithm
Automated model selection has been used to bridge the gap between experts and end users since 1960s starting with Stepwise and recently with Autometrics for single equation. This extension of Autometrics for model selection was also developed for multiple equations by integrating it with seemingly u...
Saved in:
Main Author: | |
---|---|
Format: | Thesis |
Language: | eng eng eng |
Published: |
2019
|
Subjects: | |
Online Access: | https://etd.uum.edu.my/8895/1/S94055_01.pdf https://etd.uum.edu.my/8895/2/S94055_02.pdf https://etd.uum.edu.my/8895/3/s94055_references.docx |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
id |
my-uum-etd.8895 |
---|---|
record_format |
uketd_dc |
spelling |
my-uum-etd.88952022-05-09T07:33:34Z Extended multiple models selection algorithms based on iterative feasible generalized least squares (IFGLS) and expectation-maximization (EM) algorithm 2019 Nur Azulia, Kamarudin Ismail, Suzilah Awang Had Salleh Graduate School of Arts & Sciences Awang Had Salleh Graduate School of Arts & Sciences QA Mathematics Automated model selection has been used to bridge the gap between experts and end users since 1960s starting with Stepwise and recently with Autometrics for single equation. This extension of Autometrics for model selection was also developed for multiple equations by integrating it with seemingly unrelated regressions equations (SURE) and estimated using feasible generalized least squares (FGLS), known as SURE-Autometrics algorithm. However, SURE-Autometrics has not been estimated using maximum likelihood estimation (MLE). Therefore, in this study SUREAutometrics is improvised using two MLE methods, which are iterative feasible generalized least squares (IFGLS) and expectation-maximization (EM) algorithm, named as SURE(IFGLS)-Autometrics and SURE(EM)-Autometrics algorithms. Simulation and empirical studies are conducted in validating the performance of the two algorithms. In the simulation study, different sample sizes, strength of correlation among equations, size of general unrestricted model (GUMS), number of equations, significance levels and true specification models are incorporated by evaluating the percentages of finding the true GUMS. While in the empirical study, two empirical data sets which are national growth rates and water quality index (WQI) are assessed using root mean square error and geometric root mean square error where 18 models selection procedures of manual and automated approaches are compared. The simulation results indicated that performance of SURE(IFGLS)-Autometrics and SURE(EM)-Autometrics algorithms improved in conditions of large sample, strong correlation among equations, small GUMS, a smaller number of equations, tight significance level and in an empty model (without predictor variables). The empirical results for both algorithms performed well as compared to other models selection procedures, particularly using WQI data where the sample size is bigger and has good quality data. In conclusion, SURE(IFGLS)-Autometrics and SURE(EM)-Autometrics can be used as models selection algorithms. Additionally, both algorithms are suitable in improving performance of automated models selection procedures. General findings support the idea that automated procedures surpass the manual procedures. 2019 Thesis https://etd.uum.edu.my/8895/ https://etd.uum.edu.my/8895/1/S94055_01.pdf text eng public https://etd.uum.edu.my/8895/2/S94055_02.pdf text eng public https://etd.uum.edu.my/8895/3/s94055_references.docx text eng public other doctoral Universiti Utara Malaysia |
institution |
Universiti Utara Malaysia |
collection |
UUM ETD |
language |
eng eng eng |
advisor |
Ismail, Suzilah |
topic |
QA Mathematics |
spellingShingle |
QA Mathematics Nur Azulia, Kamarudin Extended multiple models selection algorithms based on iterative feasible generalized least squares (IFGLS) and expectation-maximization (EM) algorithm |
description |
Automated model selection has been used to bridge the gap between experts and end users since 1960s starting with Stepwise and recently with Autometrics for single equation. This extension of Autometrics for model selection was also developed for multiple equations by integrating it with seemingly unrelated regressions equations (SURE) and estimated using feasible generalized least squares (FGLS), known as SURE-Autometrics algorithm. However, SURE-Autometrics has not been estimated using maximum likelihood estimation (MLE). Therefore, in this study SUREAutometrics is improvised using two MLE methods, which are iterative feasible generalized least squares (IFGLS) and expectation-maximization (EM) algorithm, named as SURE(IFGLS)-Autometrics and SURE(EM)-Autometrics algorithms. Simulation and empirical studies are conducted in validating the performance of the two algorithms. In the simulation study, different sample sizes, strength of correlation among equations, size of general unrestricted model (GUMS), number of equations, significance levels and true specification models are incorporated by evaluating the percentages of finding the true GUMS. While in the empirical study, two empirical data sets which are national growth rates and water quality index (WQI) are assessed using root mean square error and geometric root mean square error where 18 models selection procedures of manual and automated approaches are compared. The simulation results indicated that performance of SURE(IFGLS)-Autometrics and SURE(EM)-Autometrics algorithms improved in conditions of large sample, strong correlation among equations, small GUMS, a smaller number of equations, tight significance level and in an empty model (without predictor variables). The empirical results for both algorithms performed well as compared to other models selection procedures, particularly using WQI data where the sample size is bigger and has good quality data. In conclusion, SURE(IFGLS)-Autometrics and SURE(EM)-Autometrics can be used as models selection algorithms. Additionally, both algorithms are suitable in improving performance of automated models selection procedures. General findings support the idea that automated procedures surpass the manual procedures. |
format |
Thesis |
qualification_name |
other |
qualification_level |
Doctorate |
author |
Nur Azulia, Kamarudin |
author_facet |
Nur Azulia, Kamarudin |
author_sort |
Nur Azulia, Kamarudin |
title |
Extended multiple models selection algorithms based on iterative feasible generalized least squares (IFGLS) and expectation-maximization (EM) algorithm |
title_short |
Extended multiple models selection algorithms based on iterative feasible generalized least squares (IFGLS) and expectation-maximization (EM) algorithm |
title_full |
Extended multiple models selection algorithms based on iterative feasible generalized least squares (IFGLS) and expectation-maximization (EM) algorithm |
title_fullStr |
Extended multiple models selection algorithms based on iterative feasible generalized least squares (IFGLS) and expectation-maximization (EM) algorithm |
title_full_unstemmed |
Extended multiple models selection algorithms based on iterative feasible generalized least squares (IFGLS) and expectation-maximization (EM) algorithm |
title_sort |
extended multiple models selection algorithms based on iterative feasible generalized least squares (ifgls) and expectation-maximization (em) algorithm |
granting_institution |
Universiti Utara Malaysia |
granting_department |
Awang Had Salleh Graduate School of Arts & Sciences |
publishDate |
2019 |
url |
https://etd.uum.edu.my/8895/1/S94055_01.pdf https://etd.uum.edu.my/8895/2/S94055_02.pdf https://etd.uum.edu.my/8895/3/s94055_references.docx |
_version_ |
1747828484753850368 |