Multicriteria analysis for the evaluation and benchmarking of english language mobile apps for young learners

Multicriteria analysis for the evaluation and benchmarking of english language mobile apps for young learners

This study aimed to construct an evaluation and benchmarking Decision Matrix (DM)based on multi-criteria analysis for English mobile applications (E-apps) for younglearners in terms of Listening, Speaking, Reading, and Writing (LSRW) skills. The DM wasconstructed based on the intersection between ev...

Full description

Saved in:
Bibliographic Details
Main Author: Alglwom, Nu'as Kawther Ibrahim
Format: thesis
Language:eng
Published: 2019
Subjects:
Online Access:https://ir.upsi.edu.my/detailsg.php?det=6635
Tags: Add Tag
eng_apps 1
id oai:ir.upsi.edu.my:6635
record_format uketd_dc
institution Universiti Pendidikan Sultan Idris
collection UPSI Digital Repository
language eng
topic
spellingShingle
Alglwom, Nu'as Kawther Ibrahim
Multicriteria analysis for the evaluation and benchmarking of english language mobile apps for young learners
description This study aimed to construct an evaluation and benchmarking Decision Matrix (DM)based on multi-criteria analysis for English mobile applications (E-apps) for younglearners in terms of Listening, Speaking, Reading, and Writing (LSRW) skills. The DM wasconstructed based on the intersection between evaluation criteria in terms of LSRW and E-apps foryoung learners. The criteria were adopted from a preschool education curriculum knownas the National Preschool Standard Curriculum 2016 standard. The data presented as theDM include six E-apps as alternatives and 17 skills as criteria. Thereafter, the sixE-apps were evaluated by distributing a checklist form amongst three English learning lecturers inearly childhood learning department from local university in Perak. These apps were thenbenchmarked by utilising two experimental MCDM methods, namely, bestworst method (BWM) andTechnique for Order of Preference by Similarity to Ideal Solution (TOPSIS). BWM is used forweighting the evaluation criteria, whereas TOPSIS is used to benchmark the apps andrank them from best to worst. TOPSIS was utilized in two decision-making contexts,namely individual and group contexts. In group decision making, internal and external groupaggregations are applied. For validating the proposed DM, objective and subjective methods wereused. The results showed that (1) the integration of BWM and TOPSIS was effective forsolving benchmarking and ranking problems of E-apps. (2) The ranks of E-apps obtained from internaland external TOPSIS group decision making were the same, with the first index app beingMontessori and the last index app being FunWithFlupe. (3) For objective validation,remarkable differences were observed between the group scores, and they indicated that the internal and external ranking results are identical.(4) For subjective validation,the ranking of experts was exactly similar to the proposed benchmarking DM rankingresults. As conclusion, the proposed DM can be used for evaluation and benchmarkingdifferent E-apps. The implications of this study will benefit(1) English language teachers/designers for understanding how English course contentshould be presented; (2) parents for screening and choosing suitable and reliable English learningapps that will help their children; and (3) kindergarten teachers for choosing anappropriate English app.
format thesis
qualification_name
qualification_level Master's degree
author Alglwom, Nu'as Kawther Ibrahim
author_facet Alglwom, Nu'as Kawther Ibrahim
author_sort Alglwom, Nu'as Kawther Ibrahim
title Multicriteria analysis for the evaluation and benchmarking of english language mobile apps for young learners
title_short Multicriteria analysis for the evaluation and benchmarking of english language mobile apps for young learners
title_full Multicriteria analysis for the evaluation and benchmarking of english language mobile apps for young learners
title_fullStr Multicriteria analysis for the evaluation and benchmarking of english language mobile apps for young learners
title_full_unstemmed Multicriteria analysis for the evaluation and benchmarking of english language mobile apps for young learners
title_sort multicriteria analysis for the evaluation and benchmarking of english language mobile apps for young learners
granting_institution Universiti Pendidikan Sultan Idris
granting_department Fakulti Seni, Komputeran dan Industri Kreatif
publishDate 2019
url https://ir.upsi.edu.my/detailsg.php?det=6635
_version_ 1747833282204008448
spelling oai:ir.upsi.edu.my:66352022-01-28 Multicriteria analysis for the evaluation and benchmarking of english language mobile apps for young learners 2019 Alglwom, Nu'as Kawther Ibrahim This study aimed to construct an evaluation and benchmarking Decision Matrix (DM)based on multi-criteria analysis for English mobile applications (E-apps) for younglearners in terms of Listening, Speaking, Reading, and Writing (LSRW) skills. The DM wasconstructed based on the intersection between evaluation criteria in terms of LSRW and E-apps foryoung learners. The criteria were adopted from a preschool education curriculum knownas the National Preschool Standard Curriculum 2016 standard. The data presented as theDM include six E-apps as alternatives and 17 skills as criteria. Thereafter, the sixE-apps were evaluated by distributing a checklist form amongst three English learning lecturers inearly childhood learning department from local university in Perak. These apps were thenbenchmarked by utilising two experimental MCDM methods, namely, bestworst method (BWM) andTechnique for Order of Preference by Similarity to Ideal Solution (TOPSIS). BWM is used forweighting the evaluation criteria, whereas TOPSIS is used to benchmark the apps andrank them from best to worst. TOPSIS was utilized in two decision-making contexts,namely individual and group contexts. In group decision making, internal and external groupaggregations are applied. For validating the proposed DM, objective and subjective methods wereused. The results showed that (1) the integration of BWM and TOPSIS was effective forsolving benchmarking and ranking problems of E-apps. (2) The ranks of E-apps obtained from internaland external TOPSIS group decision making were the same, with the first index app beingMontessori and the last index app being FunWithFlupe. (3) For objective validation,remarkable differences were observed between the group scores, and they indicated that the internal and external ranking results are identical.(4) For subjective validation,the ranking of experts was exactly similar to the proposed benchmarking DM rankingresults. As conclusion, the proposed DM can be used for evaluation and benchmarkingdifferent E-apps. The implications of this study will benefit(1) English language teachers/designers for understanding how English course contentshould be presented; (2) parents for screening and choosing suitable and reliable English learningapps that will help their children; and (3) kindergarten teachers for choosing anappropriate English app. 2019 thesis https://ir.upsi.edu.my/detailsg.php?det=6635 https://ir.upsi.edu.my/detailsg.php?det=6635 text eng closedAccess Masters Universiti Pendidikan Sultan Idris Fakulti Seni, Komputeran dan Industri Kreatif A. R. Karimi;, N. Mehrdadi;, & S. J. Hashemian; G. R. Nabi Bidhendi; R. TavakkoliMoghaddam. (2011). Selection of wastewater treatment process based on the analyticalhierarchy process and fuzzy analytical hierarchy process methods. Int. J. Environ. Sci. Tech, 8(2),267280.Abdullah, M., Nor, M. M., Damaety, F., & Chee, J. (2017). Teaching Approaches in the Classroomamong Preschool Teachers. International Journal of Academic Research in Business and SocialSciences, 7(3), 748755.Abirami, A. M., & Askarunisa, A. (2017). Sentiment analysis model to emphasize theimpact of online reviews in healthcare industry. Online Information Review, 41(4), 471486.Aceh, B. (2017). the Use of Spelling Bee Game in Teaching, 242251.Ahmad, S., Syed, H., & Tan, S. C. (2018). Engineering Education for a Smart Society, Ahmed, M. A.E. A. S. (2016). The Effect of a Flipping Classroom on Writing Skill inEnglish as a Foreign Language and Students Attitude Towards Flipping. US-China Foreign LanguageVolume 14, Number 2, February 2016 (Serial Number 149)Contents, 14(2), 98114.Al-Otaibi, H. M., Alamer, R. A., & Al-Khalifa, H. S. (2016). The next generation oflanguage labs: Can mobiles help? A case study. Computers in Human Behavior, 59, 342349.https://doi.org/10.1016/j.chb.2016.02.028Albahri, A. S., Zaidan, A. A., Albahri, O. S., Zaidan, B. B., & Alsalem, M. A. (2018). Real-TimeFault-Tolerant mHealth System: Comprehensive Review of Healthcare Services, Opens Issues,Challenges and Methodological Aspects. Journal of Medical Systems, 42(8).https://doi.org/10.1007/s10916-018-0983-9Almahdi, E. M., Zaidan, A. A., Zaidan, B. B., Alsalem, M. A., Albahri, O. S., & Albahri,A. S. (2019). Mobile-Based Patient Monitoring Systems : A Prioritisation FrameworkUsing Multi-Criteria Decision-Making Techniques.Alobaydi, E. K., Alkhayat, R. Y., Arshad, M. R. M., & Ahmed, E. R. (2017). Context- awareubiquitous Arabic vocabularies learning system (U-Arabic): A framework design and implementation. In Control System, Computing and Engineering(ICCSCE), 2017 7th IEEE International Conference on (pp. 2328). IEEE.Alobaydi, E. K., Mustaffa, N., Alkhayat, R. Y., & Arshad, M. R. H. M. (2017). U-Arabic: Design perspective of context-aware ubiquitous Arabic vocabularies learning system.Proceedings - 6th IEEE International Conference on Control System, Computing and Engineering, ICCSCE 2016, (November), 16.https://doi.org/10.1109/ICCSCE.2016.7893535Altalbe, A. A., & Wilkinson, B. (2013). Designing games for learning english as a second language.2013 International Conference on Computer Applications Technology (ICCAT).https://doi.org/10.1109/ICCAT.2013.6521987Angelis, A., & Kanavos, P. (2016). Value-Based Assessment of New MedicalTechnologies: Towards a Robust Methodological Framework for the Application of Multiple CriteriaDecision Analysis in the Context of Health Technology Assessment. PharmacoEconomics,34(5), 435446. https://doi.org/10.1007/s40273- 015-0370-zAruldoss, M. (2013). A Survey on Multi Criteria Decision Making Methods and ItsApplications. American Journal of Information Systems, 1(1), 3143.https://doi.org/10.12691/ajis-1-1-5Ars-Hita, J., Calle-Martnez, C., & Rodrguez-Arancn, P. (2014). A scrutiny of theeducational value of EFL mobile learning applications. Cypriot Journal ofEducational Sciences, 9(3), 137146.Askarifar, K., Motaffef, Z., & Aazaami, S. (2018). An investment developmentframework in Irans seashores using TOPSIS and best-worst multi-criteria decision making methods. Decision Science Letters, 7, 5564.https://doi.org/10.5267/j.dsl.2017.4.004Azar, A. S., & Nasiri, H. (2014). Learners Attitudes toward the Effectiveness of Mobile AssistedLanguage Learning (MALL) in L2 Listening Comprehension. Procedia - Social and Behavioral Sciences, 98, 18361843.https://doi.org/10.1016/j.sbspro.2014.03.613Bagherzadeh, A., & Gholizadeh, A. (2017). Parametric-based neural networks and TOPSISmodeling in land suitability evaluation for alfalfa production using GIS. Modeling EarthSystems and Environment, 3(1), 2. https://doi.org/10.1007/s40808- 016-0263-yBarotov, B. M. (2014). Katedra primrn pedagogiky An Examination of the Helen DoronEarly English Methodology.Barrios, M. A. O., De Felice, F., Negrete, K. P., Romero, B. A., Arenas, A. Y., & Petrillo,A. (2016). An AHP-Topsis Integrated Model for Selecting the Most Appropriate Tomography Equipment. International Journal of Information Technology & Decision Making, 15(04),861885. https://doi.org/10.1142/S021962201640006XBa?aran, S., & Aduradola, O. J. (2018). A Multi-Criteria Decision Making to RankAndroid based Mobile Applications for Mathematics Soft Computing View project cloud computing Viewproject A Multi-Criteria Decision Making to Rank Android based Mobile Applications forMathematics. Article in International Journal of Advanced Computer Science and Applications, 9(7), 99107. https://doi.org/10.14569/IJACSA.2018.090714Bataineh, O., Hjeelah, D. A., & Arabiat, S. (2017). Multi-Criteria Decision Making Using AHP toSelect the Best CAD Software. In International Conference on Intelligent Information Technologiesfor Industry (pp. 106115). Springer.Bojovic, M. (2010). Reading Skills and Reading Comprehension in English for Specific Purposes, (September). Retrieved from http://fl.uni-mb.si/wp-content/uploads/2010/12/BOJOVIC.pdfAKICI dcakici@omu.edu.tr, D. (2016). Parents and English Language Teachers Views about Early Foreign Language Education in Turkey. Participatory Educational Research, 3342. Retrieved fromhttp://10.0.67.123/per.16.spi.1.4%0Ahttp://search.ebscohost.com/login.aspx?direct=true&AuthType=ip&db=eue&AN=111952303&site=eds-live&authtype=ip,uidCavus, N. (2016). Development of an Intellegent Mobile Application for Teaching English Pronunciation. Procedia Computer Science, 102(August), 365369.https://doi.org/10.1016/j.procs.2016.09.413Chachil, K., Rias, R. M., Engkamat, A., & Sarkawi, A. (2015). Interactive multimedia- based mobileapplication for learning iban language. Jurnal Teknologi, 75(3), 41 46.https://doi.org/10.11113/jt.v75.5041Chalermbuntai, R., Kittipol, R., Ranong, M. N., & Tangworakitthaworn, P. (2017). The design anddevelopment of the vocabulary learning system for second language learners using word association. 2017 6th ICT International Student Project Conference (ICT-ISPC), 14.https://doi.org/10.1109/ICT-ISPC.2017.8075295Chen, Y., Smith, T. J., & Carger, C. L. (2017). Mobile-Assisted Narrative WritingPractice for Young English Language Learners From a Funds of Knowledge Approach. LanguageLearning & Technology, 21(212), 2841. Retrieved fromChen, Y., Zhou, D., Wang, Y., & Yu, J. (2017). Application of augmented reality forearly childhood english teaching. Proceedings - 2017 International Symposium on Educational Technology, ISET 2017, 111115.https://doi.org/10.1109/ISET.2017.34Chen, Z., & Yang, W. (2011). A new multiple attribute group decision making method inintuitionistic fuzzy setting. Applied Mathematical Modelling, 35(9), 44244437.https://doi.org/10.1016/j.apm.2011.03.015Chostelidou, D. (2012). Reading Skills Development Among Greek Tertiary Education Students:Principles and Practice of an Experimental Intervention. Procedia - Social and Behavioral Sciences, 46, 13951400.https://doi.org/10.1016/j.sbspro.2012.05.309Christodoulou, S., Karacapilidis, N., & Tzagarakis, M. (2016). Exploiting AlternativeKnowledge Visualizations and Reasoning Mechanisms to Enhance Collaborative Decision Making.In Intelligent Decision Technology Support in Practice (pp. 89 106). Springer.Chrysafiadi, K., & Virvou, M. (2013). PeRSIVA: An empirical evaluation method of a student model ofan intelligent e-learning environment for computer programming. Computers and Education, 68, 322333.https://doi.org/10.1016/j.compedu.2013.05.020Chuang, Y. T. (2017). MEMIS: A Mobile-Supported English-Medium Instruction System. Telematics and Informatics, 34(2), 640656.https://doi.org/10.1016/j.tele.2016.10.007College, N. and F. R. C. for E. L. and C. M. at S. V. (2012). Technology and Interactive Media asTools in Early Childhood Programs Serving Children from Birth through Age 8, (January), 115. Retrieved fromhttp://www.naeyc.org/files/naeyc/PS_technology_WEB.pdfDamkliang, K., Wutthisamai, S., & Jirasinchanarat, P. (2016). Guessing Englishvocabularies: A game application for children on multiple mobile platforms. 2016 8thInternational Conference on Knowledge and Smart Technology, KST 2016, 102 107.https://doi.org/10.1109/KST.2016.7440497Demouy, V., & Kukulska-Hulme, A. (2010). On the spot: Using mobile devices forlistening and speaking practice on a French language programme. Open Learning, 25(3), 217232.https://doi.org/10.1080/02680513.2010.511955Deng, X., Vroman, P., Zeng, X., & Laouisset, B. (2010). Intelligent decision supporttools for multicriteria product design. 2010 IEEE International Conference on Systems, Man and Cybernetics, 12231230.https://doi.org/10.1109/ICSMC.2010.5642407Diner, A., & Ye?ilyurt, S. (2013). Pre-service english teachers beliefs on speaking skill based on motivational orientations. English Language Teaching, 6(7), 8895.https://doi.org/10.5539/elt.v6n7p88Erradi, A., Almerekhi, H., & Nahia, S. (2013). Game-Based Micro-learning Approach for Language Vocabulary Acquisition Using LingoSnacks. 2013 IEEE 13th International Conference on Advanced Learning Technologies, 235237.https://doi.org/10.1109/ICALT.2013.73Erradi, A., Nahia, S., Almerekhi, H., & Al-kailani, L. (2012). LingoSnacks : m-Learning Platformfor Language Learning, 149154.Erradi, A., Nahia, S., Almerekhi, H., & Al-Kailani, L. (2012). ArabicTutor: A multimedia m-Learningplatform for learning Arabic spelling and vocabulary. Proceedings of 2012 InternationalConference on Multimedia Computing and Systems, ICMCS 2012, 833838.https://doi.org/10.1109/ICMCS.2012.6320220Fadhli, M. (2018). GAMIFICATION FOR EARLY CHILDHOOD USINGLINGOKIDSAPPLICATION. JURNAL INDRIA (Jurnal Ilmiah Pendidikan Prasekolah Dan SekolahAwal), 3(1).Fan, Z. P., Liu, Y., & Feng, B. (2010). A method for stochastic multiple criteria decision makingbased on pairwise comparisons of alternatives with random evaluations. European Journal of Operational Research, 207(2), 906915.https://doi.org/10.1016/j.ejor.2010.05.032Feng, F. I. (2011). A study on school leaders ethical orientations in Taiwan. Ethics and Behavior,21(4), 317331. https://doi.org/10.1080/10508422.2011.585599Fomichov, V. A., & Fomichova, O. S. (2017). INFORMACIJSKA DRU?BA - IS 2017 INFORMATIONSOCIETY - IS 2017.Fronza, I., & Gallo, D. (2016). Towards Mobile Assisted Language Learning Based on ComputationalThinking. In Chiu, DKW and Marenzi, I and Nanni, U and Spaniol, M and Temperini, M (Ed.), ADVANCESIN WEB-BASED LEARNING, (ICWL 2016) (Vol. 10013, pp. 141150).https://doi.org/10.1007/978-3-319-47440-3_16Gangaiamaran, R. (2017). Review on Use of Mobile Apps for Language Learning,12(21), 1124211251.Gao, P., Feng, J., & Yang, L. (2008). Fuzzy TOPSIS Algorithm for Multiple CriteriaDecision Making with an Application in Information Systems Project Selection. WirelessCommunications, Networking and Mobile Computing, 2008. WiCOM08. 4th International ConferenceOn, 14.Ghaffari, S., Arab, A., Nafari, J., & Manteghi, M. (2017). Investigation and evaluation of keysuccess factors in technological innovation development based on BWM. Decision ScienceLetters, 6, 295306. https://doi.org/10.5267/j.dsl.2016.12.001Gilakjani, A. P., & Sabouri, N. B. (2016). Learners Listening ComprehensionDifficulties in English Language Learning: A Literature Review. English Language Teaching, 9(6),123. https://doi.org/10.5539/elt.v9n6p123Gomathi, B. S. (2014). Enriching the skills of rural students with effective methods of teachingenglish language using LSRW skills, 4(2), 6569.Gmez Sigsig, D. A. (2015). Programas que se pueden encontrar en la red de Internetpara el aprendizaje interactivo del idioma ingls.Goundar, S. (2011). What is the potential impact of using mobile devices in education. InProceedings of SIG GlobDev Fourth Annual Workshop (Vol. 3, pp. 130).Gul, M., Celik, E., Aydin, N., Taskin Gumus, A., & Guneri, A. F. (2016). A state of the artliterature review of VIKOR and its fuzzy extensions on applications. Applied Soft ComputingJournal, 46, 6089. https://doi.org/10.1016/j.asoc.2016.04.040Guo, H. (2014). Analysing and evaluating current mobile applications for learning English speaking, 91. Retrieved from https://englishagenda.britishcouncil.org/sites/default/files/filefield_paths/analysing_and_evaluating_current_mobile_applications_v2.pdfGuo, S., & Zhao, H. (2017). Fuzzy best-worst multi-criteria decision-making method and its applications. Knowledge-Based Systems, 121, 2331.https://doi.org/10.1016/j.knosys.2017.01.010Gupta, H., & Barua, M. K. (2017). Supplier selection among SMEs on the basis of their greeninnovation ability using BWM and fuzzy TOPSIS. Journal of Cleaner Production, 152,242258. https://doi.org/10.1016/j.jclepro.2017.03.125Gupta, H., & Barua, M. K. (2018). A framework to overcome barriers to green innovation in SMEs using BWM and Fuzzy TOPSIS. Science of the Total Environment, 633,122139. https://doi.org/10.1016/j.scitotenv.2018.03.173Hashim, A. S., Sarlan, A., Sulaiman, S., Hashim, S., & Sarlan, A. (2016). Development of ChineseLanguage Application in Learning as a Second Language for Malaysian Development of ChineseLanguage Application in as a Second Language for Malaysian, 596599.Hashim, N. C., Aini, N., Majid, A., Arshad, H., Soleha, S., & Nizam, M. (2017). Arabic languageEducation- : ARabic, 761766.He, J., Lee, Y., Young, B., & Chiang, F.-K. (2017). A Study on the Effect of JoyfulLearning Application upon Undergraduate English Vocabulary Learning. 2017 InternationalConference of Educational Innovation through Technology (EITT), 288292.https://doi.org/10.1109/EITT.2017.76Heryadi, Y., & Muliamin, K. (n.d.). Gamification of M-Learning Mandarin as SecondLanguage.Hsu, C. F., Chen, C. M., & Cao, D. (2017). Effects of Design Factors of Game-Based EnglishVocabulary Learning APP on Learning Performance, Sustained Attention, Emotional State, and MemoryRetention. Proceedings - 2017 6th IIAI International Congress on Advanced Applied Informatics, IIAI-AAI 2017, 661666. https://doi.org/10.1109/IIAI-AAI.2017.53Hussain, N. H., Siti, T., Tengku, M., Fadzilah, S., & Noor, M. (2018). Speech Input as anAlternative Mode to Perform Multi-touch Gestures. TELKOMNIKA(Telecommunication Computing Electronics and Control), 16(3), 13671375.https://doi.org/10.12928/TELKOMNIKA.v16i3.8417Iphar, M., & Alpay, S. (2018). A mobile application based on multi-criteria decision-making methods for underground mining method selection. International Journal of Mining, Reclamation and Environment, 0930(May), 125.https://doi.org/10.1080/17480930.2018.1467655Ismail, S. N., & Hanafi, Z. (2015). The level of quality management practices inchildcare centers by using a quality improvements and Accreditation System ( QIAS) Model. Australian Journal of Basic and Applied Sciences, 9(18), 108112.https://doi.org/10.1007/s12571-017-0722-yJaini, N. I. (2017). AN EFFICIENT RANKING ANALYSIS IN MULTI-CRITERIA DECISION MAKING.Jaini, N., & Utyuzhnikov, S. (2017). A Fuzzy Trade-Off Ranking Method for Multi-Criteria Decision-Making. Axioms, 7(1), 1. https://doi.org/10.3390/axioms7010001Jeng, Y.-L., Hong, M.-L., & Lu, H.-T. (2017). The Development of the Mobile Situated Learning Application Based on Microlocation Technology. 2017 6th IIAI International Congresson Advanced Applied Informatics (IIAI-AAI), 715718. https://doi.org/10.1109/IIAI-AAI.2017.108Jeong, K. O. (2017). University Students Perception and Motivation of Using DigitalApplications as Effective English Learning Tools. 2017 International Conference on Platform Technology and Service, PlatCon 2017 - Proceedings, 36.https://doi.org/10.1109/PlatCon.2017.7883735Jumaah, F. M., Zadain, A. A., Zaidan, B. B., Hamzah, A. K., & Bahbibi, R. (2018).Decision-making solution based multi-measurement design parameter foroptimization of GPS receiver tracking channels in static and dynamic real-timepositioning multipath environment. Measurement: Journal of the International Measurement Confederation, 118(July 2016), 8395.https://doi.org/10.1016/j.measurement.2018.01.011Jumaah, F. M., Zaidan, A. A., Zaidan, B. B., Bahbibi, R., Qahtan, M. Y., & Sali, A.(2018). Technique for order performance by similarity to ideal solution for solving complexsituations in multi-criteria optimization of the tracking channels of GPS basebandtelecommunication receivers. Telecommunication Systems, 68(3), 425 443.https://doi.org/10.1007/s11235-017-0401-5Kalid, N., Zaidan, A. A., Zaidan, B. B., Salman, O. H., Hashim, M., Albahri, O. S., & Albahri, A.S. (2018). Based on real time remote health monitoring systems: A new approach for prioritizationlarge scales data patients with chronic heart diseases using body sensors andcommunication technology. Journal of Medical Systems, 42(4), 69.Kalz, M., Lenssen, N., Felzen, M., Rossaint, R., Tabuenca, B., Specht, M., & Skorning,M. (2014). Smartphone apps for cardiopulmonary resuscitation training and real incidentsupport: a mixed-methods evaluation study. Journal of Medical Internet Research, 16(3).Kamaruzaman, M. F., & Zainol, I. H. (2012). Behavior response among secondary school studentsdevelopment towards mobile learning application. 2012 IEEE Colloquiumon Humanities, Science and Engineering (CHUSER), (Chuser), 589592.https://doi.org/10.1109/CHUSER.2012.6504381Karabasevic, D., Stanujkic, D., Urosevic, S., Popovic, G., & Maksimovic, M. (2017). An Approach toCriteria Weights Determination by Integrating the DELPHI and the Adapted SWARA Methods.Management: Journal of Sustainable Business and Management Solutions in Emerging Economies, 22(3), 1525.https://doi.org/10.7595/management.fon.2017.0024Kim, Y., & Smith, D. (2015). Pedagogical and technological augmentation of mobilelearning for young children interactive learning environments, 4820(November).https://doi.org/10.1080/10494820.2015.1087411Kocak, H., Caglar, A., & Oztas, G. Z. (2018). Euclidean BestWorst Method and ItsApplication. International Journal of Information Technology & Decision Making, 17, 119.https://doi.org/10.1142/S0219622018500323Kohanestani, Z. M., Ghorbani, R., & Fazel, A. (2013). Original Article Evaluation ofwater quality using TOPSIS method in the Zaringol Stream ( Golestan Province , Iran ).International Journal of Aquatic Biology, 1(5), 202208.Kroeker, A. M., Teddy, A. J., & Macy, M. L. (2015). Car seat inspection among children older than 3years: Using data to drive practice in child passenger safety. Journal of Trauma and Acute Care Surgery, 79(3), S48S54.https://doi.org/10.1097/TA.0000000000000674Kucukali Ozturk, M., Berkalp, O. B., & Nergis, B. (2017). Design of a light weight fabric fromnatural cellulosic fibers with improved moisture related properties. IOP Conference Series: Materials Science and Engineering, 254(18).https://doi.org/10.1088/1757-899X/254/18/182005Kukulska-hulme, A. (2015). The Role of a Mobile App for Listening Comprehen- sion Training inDistance Learning to Sustain Student Motivation, 21(10), 13271338.Lee, E. W., Shon, J. G., & Kim, Y. (2015). Design and implementation of Englishlearning application for early childhood. Indian Journal of Science and Technology, 8(S7), 679685.Lee, L.-K., Chau, C.-H., Chau, C.-H., & Ng, C.-T. (2017). Using Augmented Reality to TeachKindergarten Students English Vocabulary. 2017 International Symposium on Educational Technology(ISET), 5357. https://doi.org/10.1109/ISET.2017.20Leonid, M., Sime, D., Hpc, T., Manager, T. R., Resources, C., Torque, T., Engine, S.G. (2013). Transforming computer lab into a mini hpc cluster, (Ciit), 252255.Lin, C. C. (2014). Learning English reading in a mobile-assisted extensive readingprogram. Computers and Education, 78, 4859. https://doi.org/10.1016/j.compedu.2014.05.004Liu, J., Liu, P., Liu, S.-F., Zhou, X.-Z., & Zhang, T. (2015). A study of decision process in MCDMproblems with large number of criteria. International Transactions in OperationalResearch, 22(2), 237264. https://doi.org/10.1111/itor.12102Ma, J.-W. (2016). A Design and Teaching Practice of Micro Mobile Learning Assisting CollegeEnglish Teaching Mode base on WeChat Public Platform. 2016 2Nd International Conferenceon Modern Education and Social Science (Mess 2016), (August 2012), 250255.Malik, H., Shakshuki, E. M., & Yoo, W. S. (2018). Comparing mobile apps by identifying Hot features. Future Generation Computer Systems.https://doi.org/10.1016/j.future.2018.02.008Marciano, J. N., Bruno, J., Oliveira, C. De, Menezes, B. C. De, Miranda, L. C. De,Esteves, E., & Miranda, C. De. (2015). Katakana Star Samurai : A Mobile Tool to Support Learning ofa basic Japanese Alphabet.Mardani, A., Jusoh, A., & Zavadskas, E. K. (2015). Fuzzy multiple criteria decision-making techniques and applications - Two decades review from 1994 to 2014. Expert Systems with Applications, 42(8), 41264148.https://doi.org/10.1016/j.eswa.2015.01.003Margret, B. (2010). Teaching speaking skills in english language to engineering students usinglanguage lab technology. 2010 International Conference on Technology for Education, T4E2010, 224225. https://doi.org/10.1109/T4E.2010.5550100Marshall, C. (2017). Montessori education: a review of the evidence base. Npj Science of Learning,2(1), 11. https://doi.org/10.1038/s41539-017-0012-7Masudin, I., & Ayni, M. G. F. (2018). Pengambilan Keputusan Multi Kriteria: KajianTeoritis Metode dan Pendekatan Dalam Pemilihan Pemasok. Jurnal Ilmiah Teknik Industri, 17(1), 1.https://doi.org/10.23917/jiti.v17i1.5389Meda, P., Kumar, M., & Parupalli, R. (2014). Mobile Augmented Reality Application for TeluguLanguage Learning, 183186.Migdadi, M. (2009). Knowledge management enablers and outcomes in the mall-and- mediumsized enterprises. Industrial Management and Data Systems, 109(6), 840 858.https://doi.org/10.1108/02635570910968072Milutinovi?, M., Labus, A., Stojiljkovi?, V., Bogdanovi?, Z., & Despotovi?-Zraki?, M. (2013).Designing a mobile language learning system based on lightweight learning objects. Multimedia Tools and Applications, 74(3), 903935.https://doi.org/10.1007/s11042-013-1704-5Mitra, B., Kode, S., & Cheruvu, A. (2015). Mobile Learning: A Pedagogical Framework to FacilitateDistributed Learning through Collaborative Approach for Enhancing English Language Communication Skills. 2015 IEEE Seventh International Conference on Technology for Education (T4E), 9194.https://doi.org/10.1109/T4E.2015.20Mohammed, H. J., Kasim, M. M., Al-Dahneem, E. A., & Hamadi D, A. K. (2016).Evaluating Different Learning Methodologies of Multimedia in Education Using MCDM method,(November). Retrieved from https://sites.google.com/site/sqsiace/Moreno, A. I., & Vermeulen, A. (2015). Using VISP (VIdeos for SPeaking), a Mobile App Based onAudio Description, to Promote English Language Learning among Spanish Students: A CaseStudy. Procedia - Social and Behavioral Sciences, 178(November 2014), 132138.https://doi.org/10.1016/j.sbspro.2015.03.169Motebele, M. M. (2018). Knowledge Based Decision Support System for GSC Industries BenchmarkingPerspective, I(1), 47.Mozhaeva, G., Feshchenko, A., & Kulikov, I. (2014). E-learning in the Evaluation ofStudents and Teachers: LMS or Social Networks? Procedia - Social and Behavioral Sciences, 152,127130. https://doi.org/10.1016/j.sbspro.2014.09.168Muoz Bastas, E. E., Riquelme Seplveda, A. C., & Saldivia Muoz, M. L. (2011).Integration of the Four Skills of the English Language and Its Influence on thePerformance of Second Grade High School Students. Seminario Para Optar Al Ttulo DeProfesor De Educacin Media En Ingls Chillan, 152.N., K., A.A., Z., B.B., Z., O.H., S., M., H., & O.S., A. (2018). Based on RealTimeRemote Health Monitoring Systems: A New Approach for Prioritization Large Scales DataPatients with Chronic Heart Diseases Using Body Sensors and Communication Technology. Journal of Medical Systems, 42(4), 69.https://doi.org/http://dx.doi.org/10.1007/s10916-018-0916-7Najm, I. A., Ismail, M., Lloret, J., Ghafoor, K. Z., Zaidan, B. B., & Rahem, A. A. R. T. (2015).Improvement of SCTP congestion control in the LTE-A network. Journal of Network and Computer Applications, 58, 119129.https://doi.org/10.1016/j.jnca.2015.09.003Nazara, S. (2011). Students Perception on EFL Speaking Skill Development. ReviewLiterature And Arts Of The Americas, 1(1), 2843.Nguyen-Thi, H., Hwang, W. Y., Pham, X. L., & Chen, G. D. (2016). Understanding the participantbehaviors in the online english learning mobile App: A case study among 106,912 learners via googleplay app store. Proceedings - IEEE 16th International Conference on Advanced Learning Technologies, ICALT 2016, 104108. https://doi.org/10.1109/ICALT.2016.137Nilsson, H., Nordstrm, E.-M., & hman, K. (2016). Decision Support for Participatory Forest Planning Using AHP and TOPSIS. Forests, 7(5), 100.https://doi.org/10.3390/f7050100Norman, M., & People, A. I. (2012). M-Jako Iban : A Mobile Application to Introduce Iban Language,11771181.Oakley, G., & Imtinan, U. (2018). Supporting childrens literacy learning in low-andmiddle-income countries through m-learning. In Mobile Technologies in Childrens Language andLiteracy: Innovative Pedagogy in Preschool and Primary Education (pp. 155175). Emerald PublishingLimited.Olson, K. (2010). An examination of questionnaire evaluation by expert reviewers. Field Methods,22(4), 295318. https://doi.org/10.1177/1525822X10379795Ongoro, C. A., & Mwangoka, J. (2014). Using Game-Based approach to enhance languagelearning for preschoolers in Tanzania. Proceedings of the 2nd Pan African International Conferenceon Science, Computing and Telecommunications, PACT 2014, 121126.https://doi.org/10.1109/SCAT.2014.7055145Ortz, M. A., Cmbita, J. P., Hoz, . A. D. la, Felice, F. De, & Petrillo, A. (2016). An integratedapproach of AHP-DEMATEL methods applied for the selection of allied hospitals in outpatientservice. International Journal of Medical Engineering and Informatics, 8(2), 87.https://doi.org/10.1504/IJMEI.2016.075760Paper, C., Christodoulou, S., Karacapilidis, N., & Tzagarakis, M. (2013). Advancingcollaborative decision making through alternative visualizations and reasoning mechanisms,(October 2015). https://doi.org/10.3233/978-1-61499-264-6-38Park, S., Kim, T., & Lee, B. G. (2011). A study on the influential factors for continual usage ofmobile English learning applications. Proceedings - 2011 IEEE Asia- Pacific Services Computing Conference, APSCC 2011, 5661.https://doi.org/10.1109/APSCC.2011.86Pham, X. L., Nguyen, T. H., & Chen, G. D. (2017). Factors that Impact Quiz Score: A Study withParticipants in a Mobile Learning App. Proceedings - IEEE 17th International Conference onAdvanced Learning Technologies, ICALT 2017, 103 105. https://doi.org/10.1109/ICALT.2017.81Pham, X. L., Nguyen, T. H., Hwang, W. Y., & Chen, G. D. (2016). Effects of pushnotifications on learner engagement in a mobile learning app. Proceedings - IEEE 16thInternational Conference on Advanced Learning Technologies, ICALT 2016, 9094.https://doi.org/10.1109/ICALT.2016.50Pilar, R.-A., Jorge, A., & Cristina, C. (2013). The Use of Current Mobile LearningApplications in EFL. Procedia - Social and Behavioral Sciences, 103, 11891196.https://doi.org/10.1016/j.sbspro.2013.10.446Podvezko, V. (2011). The Comparative Analysis of MCDA Methods SAW and COPRAS. Engineering Economics, 22(2), 134146.https://doi.org/10.5755/j01.ee.22.2.310Powers, D. E. (2013). Assessing English-Language Proficiency in All Four Language Domains: Is It Really Necessary ?, (September).Publishing, M. (2014). The Four Basic Language Skills, Whole Language & Intergrated Skill Approach in Mainstream University Classrooms in Turkey. Mediterranean Journal of Social Sciences, 5(9), 672680.https://doi.org/10.5901/mjss.2014.v5n9p672Purgina, M., Mozgovoy, M., & Klyuev, V. (2016). Developing a Mobile System for Natural Language Grammar Acquisition. Proceedings - 2016 IEEE 14th InternationalConference on Dependable, Autonomic and Secure Computing, DASC 2016, 2016 IEEE 14thInternational Conference on Pervasive Intelligence and Computing, PICom 2016, 2016 IEEE2nd International Conference on Big Data, 322325.https://doi.org/10.1109/DASC-PICom-DataCom-CyberSciTec.2016.72Qader, M. A., Zaidan, B. B., Zaidan, A. A., Ali, S. K., Kamaluddin, M. A., & Radzi, W.B. (2017). A methodology for football players selection problem based on multi-measurements criteria analysis. Measurement: Journal of the International MeasurementConfederation, 111, 3850.Radin, J. (2017). Mobile Assisted Language Learning : Advantages and Use among DifferentAge Groups, 16(1).Rawendy, D., Ying, Y., Arifin, Y., & Rosalin, K. (2017). Design and Development Game ChineseLanguage Learning with Gamification and Using Mnemonic Method. Procedia Computer Science,116, 6167.Rezaei, J. (2015). Best-worst multi-criteria decision-making method. Omega (UnitedKingdom), 53(June 2015), 4957. https://doi.org/10.1016/j.omega.2014.11.009Rivera, G. S., Tesoriero, R., & Gallud, J. A. (2018). Model-based approach to develop learning exercises in language-learning applications. IET Software, 12(3).https://doi.org/10.1049/iet-sen.2017.0085Robson, M. (2013). The English Effect: The impact of English, what its worth to the UK and why itmatters to the world. British Council, 124.Roozbahani, A., Zahraie, B., & Tabesh, M. (2012). PROMETHEE with Precedence Order in theCriteria (PPOC) as a New Group Decision Making Aid: An Application in Urban Water SupplyManagement. Water Resources Management, 26(12), 3581 3599.https://doi.org/10.1007/s11269-012-0091-4Saad, R. M., & Ahmad, M. Z. (2016). On understanding decision making process: A shortreview on element in MCDM methods. AIP Conference Proceedings, 1775.https://doi.org/10.1063/1.4965203Sadiq, R. B., Cavus, N., & Ibrahim, D. (2019). Mobile application based on CCIstandards to help children learn English as a foreign language. Interactive Learning Environments,0(0), 116. https://doi.org/10.1080/10494820.2019.1579239Sahri, S., Moussa, R., Long, D. D. E., & Benbernou, S. (2014). DBaaS-expert: Arecommender for the selection of the right cloud database. Lecture Notes in ComputerScience (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes inBioinformatics), 8502 LNAI, 315324. https://doi.org/10.1007/978- 3-319-08326-1_32Salleh, M. I., Habidin, N. F., Masnan, A. H., & Mamat, N. (2017). Estimating Technical Efficiencyand Bootstrapping Malmquist Indices: Analysis of Malaysian Preschool Sector. International Journal of Academic Research in Business and Social Sciences, 7(3), 440457.Sandberg, J., Maris, M., & De Geus, K. (2011). Mobile English learning: An evidence- based studywith fifth graders. Computers and Education, 57(1), 13341347.https://doi.org/10.1016/j.compedu.2011.01.015Scrivner, O., Madewell, J., Buckley, C., & Perez, N. (2016). Augmented reality digital technologies(ARDT) for foreign language teaching and learning. 2016 Future Technologies Conference (FTC), (December), 395398.https://doi.org/10.1109/FTC.2016.7821639Segaran, K., Ali, A. Z. M., & Hoe, T. W. (2014). Usability and User Satisfaction of 3D Talking-headMobile Assisted Language Learning (MALL) App for Non-native Speakers. Procedia - Social and Behavioral Sciences, 131, 410.https://doi.org/10.1016/j.sbspro.2014.04.069Senouci, M. A., Hoceini, S., & Mellouk, A. (2016). Utility function-based TOPSIS for network interface selection in Heterogeneous Wireless Networks. 2016 IEEE International Conference on Communications, ICC 2016, 05.https://doi.org/10.1109/ICC.2016.7511563Shih, R. C., Papa, C., & Cheng, T. F. (2013). Establishment of a mobile-assistedlanguage teaching model for english teachers of technological universities and colleges.Proceedings - 2013 2nd International Conference on Robot, Vision and Signal Processing,RVSP 2013, 144147. https://doi.org/10.1109/RVSP.2013.40Silfiani, Z. A., & Rezeki, Y. S. (2017). Teaching pronunciation in speaking usingprosody pyramid. Jurnal Pendidikan Dam Pembelajaran, 6(10). Retrieved fromhttp://jurnal.untan.ac.id/index.php/jpdpb/article/view/22603/17947Sindkhedkar, S. D. (2012). Objectives of Teaching and Learning English in India. Journal of Arts, III(1), 22314172. Retrieved fromhttp://www.researchersworld.com/vol3/Paper_21.pdfSingla, A., Ahuja, I. S., & Sethi, A. S. (2018). Comparative Analysis of Technology Push StrategiesInfluencing Sustainable Development in Manufacturing Industries Using Topsis and VikorTechnique. International Journal for Quality Research, 12(1), 129146.https://doi.org/10.18421/IJQR12.01-08Son, J.-B. (2016). Selecting and evaluating mobile apps for language learning. TheInternational Handbook of Mobile-Assisted Language Learning, 13721373.Sun, L., Hou, J., Hu, X., & Al-Mekhlafi, K. (2015). A context-based support system of mobileChinese learning for foreigners in China. Procedia Computer Science, 60(1), 13961405.https://doi.org/10.1016/j.procs.2015.08.215Teodorescu, A. (2015). Mobile Learning and its Impact on Business English Learning. Procedia- Social and Behavioral Sciences, 180(November 2014), 15351540.https://doi.org/10.1016/j.sbspro.2015.02.303Tuan, L. T. (2010). Enhancing EFL learners writing skill via journal writing. EnglishLanguage Teaching, 3(3), 8188.Tzeng, G.-H., & Huang, J.-J. (2011). Multiple attribute decision making: methods andapplications. Chapman and Hall/CRC.Voutilainen, A., Saaranen, T., & Sormunen, M. (2017). Conventional vs. e-learning innursing education: A systematic review and meta-analysis. Nurse Education Today, 50, 97103.https://doi.org/10.1016/j.nedt.2016.12.020Walter, F., & Wrester, F. (2009). Early Childhood Development : The Journal of Childhood Development, 23(232), 23. https://doi.org/10.1016/S0140-6736(11)61450-5Wan Ahmad, W. N. K., Rezaei, J., Sadaghiani, S., & Tavasszy, L. A. (2017). Evaluation of theexternal forces affecting the sustainability of oil and gas supply chain using Best Worst Method. Journal of Cleaner Production, 153, 242252.https://doi.org/10.1016/j.jclepro.2017.03.166Wang, P., Zhu, Z., & Wang, Y. (2016). A novel hybrid MCDM model combining the SAW,TOPSIS and GRA methods based on experimental design. Information Sciences, 345, 2745.https://doi.org/10.1016/j.ins.2016.01.076Whaiduzzaman, M., Gani, A., Anuar, N. B., Shiraz, M., Haque, M. N., & Haque, I. T. (2014). Cloudservice selection using multicriteria decision analysis. The Scientific World Journal, 2014.https://doi.org/10.1155/2014/459375Yadegaridehkordi, E., & Alaa, M. (2017). Mobile Learning for English Language Acquisition: Taxonomy , Challenges , and Recommendations, 5.Yalinkaya, F., Muluk, N. B., & ?ahin, S. (2009). Effects of listening ability on speaking, writingand reading skills of children who were suspected of auditory processing difficulty.International Journal of Pediatric Otorhinolaryngology, 73(8), 1137 1142.https://doi.org/10.1016/j.ijporl.2009.04.022Yang, Y. T. C., & Chan, C. Y. (2008). Comprehensive evaluation criteria for Englishlearning websites using expert validity surveys. Computers and Education, 51(1), 403422.https://doi.org/10.1016/j.compedu.2007.05.011Yas, Q. M., Zadain, A. A., Zaidan, B. B., Lakulu, M. B., & Rahmatullah, B. (2017).Towards on Develop a Framework for the Evaluation and Benchmarking of Skin DetectorsBased on Artificial Intelligent Models Using Multi-Criteria Decision- Making Techniques.International Journal of Pattern Recognition and Artificial Intelligence, 31(03), 1759002.https://doi.org/10.1142/S0218001417590029Yas, Q. M., Zaidan, A. A., Zaidan, B. B., Rahmatullah, B., & Abdul Karim, H. (2018). Comprehensiveinsights into evaluation and benchmarking of real-time skin detectors: Review, open issues & challenges, and recommended solutions. Measurement: Journal of theInternational Measurement Confederation, 114, 243 260.https://doi.org/10.1016/j.measurement.2017.09.027Yeganeh, M. T., & Malekzadeh, P. (2015). The Effect of Bilingualism on the Developing of EnglishReading Skill. Procedia - Social and Behavioral Sciences, 192, 803810.https://doi.org/10.1016/j.sbspro.2015.06.099Ying, Y., Rawendy, D., & Arifin, Y. (2017). Game education for learning Chineselanguage with mnemonic method. Proceedings of 2016 International Conference on InformationManagement and Technology, ICIMTech 2016, 2014(November), 171 175.https://doi.org/10.1109/ICIMTech.2016.7930324You, P., Guo, S., Zhao, H., & Zhao, H. (2017). Operation Performance Evaluation ofPower Grid Enterprise Using a Hybrid BWM-TOPSIS Method. Sustainability, 9(12), 2329.https://doi.org/10.3390/su9122329YKSEL, ?., & ELIKER, G. (2015). Early Childhood Learning.Zaidan, A. A., Zaidan, B. B., Al-Haiqi, A., Kiah, M. L. M., Hussain, M., & Abdulnabi,M. (2015). Evaluation and selection of open-source EMR software packages based on integrated AHPand TOPSIS. Journal of Biomedical Informatics, 53, 390404.https://doi.org/10.1016/j.jbi.2014.11.012Zaidan, A. A., Zaidan, B. B., Albahri, O. S., Alsalem, M. A., Albahri, A. S., Yas, Q. M., &Hashim, M. (2018). A review on smartphone skin cancer diagnosis apps in evaluation andbenchmarking: coherent taxonomy, open issues and recommendation pathway solution. Health andTechnology, 116. https://doi.org/10.1007/s12553- 018-0223-9Zaidan, B. B., Zaidan, A. A., Karim, H. A., & Ahmad, N. N. (2017). A new digitalwatermarking evaluation and benchmarking methodology using an external group of evaluators and multi-criteria analysis based on large-scale data. Software - Practice andExperience, 47(10), 13651392. https://doi.org/10.1002/spe.2465Zare, M., Pahl, C., Rahnama, H., Nilashi, M., Mardani, A., Ibrahim, O., & Ahmadi, H. (2016).Multi-criteria decision making approach in E-learning: A systematic review and classification. Applied Soft Computing Journal, 45, 108128.https://doi.org/10.1016/j.asoc.2016.04.020Zavadskas, E. K., Turskis, Z., & Kildien?, S. (2014). State of art surveys of overviews onMCDM/MADM methods. Technological and Economic Development of Economy,20(1), 165179. https://doi.org/10.3846/20294913.2014.892037

Similar Items