Computational model of stepwise quantitative assessment of equations correctness / Nuru'l - 'Izzah Othman

Existing computational solutions for stepwise correctness checking of free-response solution schemes consisting of equations only consider providing qualitative feedbacks. Hence, this research intends to propose a computational model of a typical stepwise correctness checking of a scheme of student-...

Full description

Saved in:

Bibliographic Details
Main Author:	Othman, Nuru'l - 'Izzah
Format:	Thesis
Language:	English
Published:	2015
Subjects:	Combinatorics Combinatorial analysis Analysis
Online Access:	https://ir.uitm.edu.my/id/eprint/16305/1/TP_NURU%27L%20-%20%27IZZAH%20OTHMAN%20CS%2015_5.pdf
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-uitm-ir.16305
record_format	uketd_dc
spelling	my-uitm-ir.163052022-03-10T04:48:49Z Computational model of stepwise quantitative assessment of equations correctness / Nuru'l - 'Izzah Othman 2015 Othman, Nuru'l - 'Izzah Combinatorics. Combinatorial analysis Analysis Existing computational solutions for stepwise correctness checking of free-response solution schemes consisting of equations only consider providing qualitative feedbacks. Hence, this research intends to propose a computational model of a typical stepwise correctness checking of a scheme of student-constructed responses normally (usually) performed by a human examiner with the provision of quantitative feedbacks. The responses are worked solutions on solving linear algebraic equations in one variable. The proposed computational model comprises of computational techniques of key marking processes, and has enabled a marking engine prototype, which has been developed based on the model, to perform stepwise correctness checking and scoring of the response of each step in a working scheme and of the working scheme as well. The assigned numeric score of each step, or analytical score, serves as a quantitative feedback to inform students on the degree of correctness of the response of a particular step. The numeric score of the working scheme, or overall score, indicates the degree of correctness of the whole working scheme. Existing computational solutions that are currently available determine response correctness based on mathematical equivalence of expressions. In this research, the degree of correctness of an equation is based on the structural identicalness of the constituting mathtokens, which is evaluated using a correctness measure formulated in this research. The experimental verification shows that the evaluation of correctness by the correctness measure is comparable to human judgment on correctness. The computational model is formalized mathematically by basic concepts from Multiset Theory, while the process framework is supported by basic techniques and processes problem of this research. The data used are existing worked solutions on solving linear algebraic equations in one variable from a previous pilot study as well as new sets of test of correctness shows that the computational model is able to generate the expected output. Hence, the underlying computational techniques of the model can be regarded as correct. The agreement between the automated and the manual marking methods were analysed in terms of the agreement between the correctness scores. The method agreement analyses were conducted in two phases. The analysis in Phase I involved a total of 561 working schemes which comprised of 2021 responses and in Phase II a total of 350 working schemes comprising of 1385 responses were used. The analyses involved determining the percent agreement, degree of correlation and degree of agreement between the automated and manual scores. The accuracy of the scores was determined by calculating the average absolute errors present in the automated scores, which are calibrated by the average mixed errors. The results show that both the automated analytical scores and the automated overall scores exhibited high percent agreement, high correlation, high degree of agreement and small average absolute and mixed errors. It can be inferred that the automated scores are comparable with manual scores and that the stepwise correctness checking and scoring technique of this research agrees with the human marking technique. Therefore, the computational model of stepwise quantitative assessment is a valid and reliable model to be used in place of a human examiner to check and score responses to similar questions used in this research for both formative and summative assessment settings. 2015 Thesis https://ir.uitm.edu.my/id/eprint/16305/ https://ir.uitm.edu.my/id/eprint/16305/1/TP_NURU%27L%20-%20%27IZZAH%20OTHMAN%20CS%2015_5.pdf text en public phd doctoral Universiti Teknologi MARA Faculty of Computer and Mathematical Sciences
institution	Universiti Teknologi MARA
collection	UiTM Institutional Repository
language	English
topic	Combinatorics Combinatorial analysis Analysis
spellingShingle	Combinatorics Combinatorial analysis Analysis Othman, Nuru'l - 'Izzah Computational model of stepwise quantitative assessment of equations correctness / Nuru'l - 'Izzah Othman
description	Existing computational solutions for stepwise correctness checking of free-response solution schemes consisting of equations only consider providing qualitative feedbacks. Hence, this research intends to propose a computational model of a typical stepwise correctness checking of a scheme of student-constructed responses normally (usually) performed by a human examiner with the provision of quantitative feedbacks. The responses are worked solutions on solving linear algebraic equations in one variable. The proposed computational model comprises of computational techniques of key marking processes, and has enabled a marking engine prototype, which has been developed based on the model, to perform stepwise correctness checking and scoring of the response of each step in a working scheme and of the working scheme as well. The assigned numeric score of each step, or analytical score, serves as a quantitative feedback to inform students on the degree of correctness of the response of a particular step. The numeric score of the working scheme, or overall score, indicates the degree of correctness of the whole working scheme. Existing computational solutions that are currently available determine response correctness based on mathematical equivalence of expressions. In this research, the degree of correctness of an equation is based on the structural identicalness of the constituting mathtokens, which is evaluated using a correctness measure formulated in this research. The experimental verification shows that the evaluation of correctness by the correctness measure is comparable to human judgment on correctness. The computational model is formalized mathematically by basic concepts from Multiset Theory, while the process framework is supported by basic techniques and processes problem of this research. The data used are existing worked solutions on solving linear algebraic equations in one variable from a previous pilot study as well as new sets of test of correctness shows that the computational model is able to generate the expected output. Hence, the underlying computational techniques of the model can be regarded as correct. The agreement between the automated and the manual marking methods were analysed in terms of the agreement between the correctness scores. The method agreement analyses were conducted in two phases. The analysis in Phase I involved a total of 561 working schemes which comprised of 2021 responses and in Phase II a total of 350 working schemes comprising of 1385 responses were used. The analyses involved determining the percent agreement, degree of correlation and degree of agreement between the automated and manual scores. The accuracy of the scores was determined by calculating the average absolute errors present in the automated scores, which are calibrated by the average mixed errors. The results show that both the automated analytical scores and the automated overall scores exhibited high percent agreement, high correlation, high degree of agreement and small average absolute and mixed errors. It can be inferred that the automated scores are comparable with manual scores and that the stepwise correctness checking and scoring technique of this research agrees with the human marking technique. Therefore, the computational model of stepwise quantitative assessment is a valid and reliable model to be used in place of a human examiner to check and score responses to similar questions used in this research for both formative and summative assessment settings.
format	Thesis
qualification_name	Doctor of Philosophy (PhD.)
qualification_level	Doctorate
author	Othman, Nuru'l - 'Izzah
author_facet	Othman, Nuru'l - 'Izzah
author_sort	Othman, Nuru'l - 'Izzah
title	Computational model of stepwise quantitative assessment of equations correctness / Nuru'l - 'Izzah Othman
title_short	Computational model of stepwise quantitative assessment of equations correctness / Nuru'l - 'Izzah Othman
title_full	Computational model of stepwise quantitative assessment of equations correctness / Nuru'l - 'Izzah Othman
title_fullStr	Computational model of stepwise quantitative assessment of equations correctness / Nuru'l - 'Izzah Othman
title_full_unstemmed	Computational model of stepwise quantitative assessment of equations correctness / Nuru'l - 'Izzah Othman
title_sort	computational model of stepwise quantitative assessment of equations correctness / nuru'l - 'izzah othman
granting_institution	Universiti Teknologi MARA
granting_department	Faculty of Computer and Mathematical Sciences
publishDate	2015
url	https://ir.uitm.edu.my/id/eprint/16305/1/TP_NURU%27L%20-%20%27IZZAH%20OTHMAN%20CS%2015_5.pdf
_version_	1783733499918811136

Computational model of stepwise quantitative assessment of equations correctness / Nuru'l - 'Izzah Othman

Similar Items