Consequential validity of student ratings of instruction for administrative purposes and instructional improvement

Student ratings of instruction (SRI) are popular evaluative procedures which are widely practiced in universities around the world including most Malaysian universities. With many universities using student ratings around the world, there are still uncovered issues regarding student ratings that re...

Full description

Saved in:

Bibliographic Details
Main Author:	Safavi, Seyedeh Azadeh
Format:	Thesis
Language:	English
Published:	2012
Subjects:	Educational evaluation Student evaluation of curriculum Universities and colleges - Study and teaching - Evaluation
Online Access:	http://psasir.upm.edu.my/id/eprint/32287/1/FPP%202012%2022R.pdf
Tags:	Add Tag No Tags, Be the first to tag this record!

id	my-upm-ir.32287
record_format	uketd_dc
spelling	my-upm-ir.322872015-01-15T06:47:23Z Consequential validity of student ratings of instruction for administrative purposes and instructional improvement 2012-07 Safavi, Seyedeh Azadeh Student ratings of instruction (SRI) are popular evaluative procedures which are widely practiced in universities around the world including most Malaysian universities. With many universities using student ratings around the world, there are still uncovered issues regarding student ratings that research has not yet explored sufficiently. For instance, student ratings of instruction have been the subject of several validity studies with much of the research focusing on traditional evidence of validity. Only a fewer studies have examined consequential validity of SRI. Validity in its modern concept focuses on the use of instrument for a particular purpose as well as the consequences of instrument use. The evidence on consequences can include evaluation of the effects. Two intended effects of using student ratings are making instructional improvement by faculty members and making administrative decisions by administrators. This study examined consequential validity of student ratings by investigating evidence on the consequences as well as evidence on the utility of student ratings based on the Messick’s validity theory. Additionally, this study uncovered the administrators’ and faculty members’ reactions toward student ratings and obtained their recommendations for the effective use of student ratings. In this study, a descriptive survey design was employed. Two self-developed instruments were used to collect data from a stratified proportionate random sample of 141 administrator and 1089 faculty member populations. The responses were subjected to descriptive statistics, principal component analysis, Pearson’s Product Moment correlation analysis, one way ANOVA, and independent t-test. The study explored the perceived actual and the perceived potential consequences of student ratings on one dimension of administrative practices and two dimensions of instructional practices. Findings showed that the ratings information which focused on faculty members’ efforts in student learning enhancement was considered by both administrators and faculty members as the most useful type of ratings information. These findings addressed the consequential validity of student ratings at UPM, supported/improved validity of the UPM’s student ratings instrument,addressed a gap in the validity of student ratings in its general conception in the literature and in its specific conception at UPM, and provided the university with a reliable evidence for justifying the use of student ratings. This study revealed that administrators and faculty members had positive views toward student ratings. The findings also listed their recommendations regarding issues, such as, supplementing the ratings scale with other measures of teaching quality; providing opportunities for less effective faculty members to receive consultation services; reporting the result of student ratings in a multi-dimensional feedback form; providing an array of items so that different faculties/departments could select items suitable for their needs; and providing written explanations to assist faculty members in interpreting the results. It is expected that the findings of this research will bring valuable insight and understanding to help the university authorities at UPM specifically, and other universities generally, as well as all faculty members to achieve more success in using the student ratings, and consequently, in enhancing the quality of instruction. Educational evaluation Student evaluation of curriculum Universities and colleges - Study and teaching - Evaluation 2012-07 Thesis http://psasir.upm.edu.my/id/eprint/32287/ http://psasir.upm.edu.my/id/eprint/32287/1/FPP%202012%2022R.pdf application/pdf en public phd doctoral Universiti Putra Malaysia Educational evaluation Student evaluation of curriculum Universities and colleges - Study and teaching - Evaluation Faculty of Educational Studies
institution	Universiti Putra Malaysia
collection	PSAS Institutional Repository
language	English
topic	Educational evaluation Student evaluation of curriculum Universities and colleges - Study and teaching - Evaluation
spellingShingle	Educational evaluation Student evaluation of curriculum Universities and colleges - Study and teaching - Evaluation Safavi, Seyedeh Azadeh Consequential validity of student ratings of instruction for administrative purposes and instructional improvement
description	Student ratings of instruction (SRI) are popular evaluative procedures which are widely practiced in universities around the world including most Malaysian universities. With many universities using student ratings around the world, there are still uncovered issues regarding student ratings that research has not yet explored sufficiently. For instance, student ratings of instruction have been the subject of several validity studies with much of the research focusing on traditional evidence of validity. Only a fewer studies have examined consequential validity of SRI. Validity in its modern concept focuses on the use of instrument for a particular purpose as well as the consequences of instrument use. The evidence on consequences can include evaluation of the effects. Two intended effects of using student ratings are making instructional improvement by faculty members and making administrative decisions by administrators. This study examined consequential validity of student ratings by investigating evidence on the consequences as well as evidence on the utility of student ratings based on the Messick’s validity theory. Additionally, this study uncovered the administrators’ and faculty members’ reactions toward student ratings and obtained their recommendations for the effective use of student ratings. In this study, a descriptive survey design was employed. Two self-developed instruments were used to collect data from a stratified proportionate random sample of 141 administrator and 1089 faculty member populations. The responses were subjected to descriptive statistics, principal component analysis, Pearson’s Product Moment correlation analysis, one way ANOVA, and independent t-test. The study explored the perceived actual and the perceived potential consequences of student ratings on one dimension of administrative practices and two dimensions of instructional practices. Findings showed that the ratings information which focused on faculty members’ efforts in student learning enhancement was considered by both administrators and faculty members as the most useful type of ratings information. These findings addressed the consequential validity of student ratings at UPM, supported/improved validity of the UPM’s student ratings instrument,addressed a gap in the validity of student ratings in its general conception in the literature and in its specific conception at UPM, and provided the university with a reliable evidence for justifying the use of student ratings. This study revealed that administrators and faculty members had positive views toward student ratings. The findings also listed their recommendations regarding issues, such as, supplementing the ratings scale with other measures of teaching quality; providing opportunities for less effective faculty members to receive consultation services; reporting the result of student ratings in a multi-dimensional feedback form; providing an array of items so that different faculties/departments could select items suitable for their needs; and providing written explanations to assist faculty members in interpreting the results. It is expected that the findings of this research will bring valuable insight and understanding to help the university authorities at UPM specifically, and other universities generally, as well as all faculty members to achieve more success in using the student ratings, and consequently, in enhancing the quality of instruction.
format	Thesis
qualification_name	Doctor of Philosophy (PhD.)
qualification_level	Doctorate
author	Safavi, Seyedeh Azadeh
author_facet	Safavi, Seyedeh Azadeh
author_sort	Safavi, Seyedeh Azadeh
title	Consequential validity of student ratings of instruction for administrative purposes and instructional improvement
title_short	Consequential validity of student ratings of instruction for administrative purposes and instructional improvement
title_full	Consequential validity of student ratings of instruction for administrative purposes and instructional improvement
title_fullStr	Consequential validity of student ratings of instruction for administrative purposes and instructional improvement
title_full_unstemmed	Consequential validity of student ratings of instruction for administrative purposes and instructional improvement
title_sort	consequential validity of student ratings of instruction for administrative purposes and instructional improvement
granting_institution	Universiti Putra Malaysia
granting_department	Faculty of Educational Studies
publishDate	2012
url	http://psasir.upm.edu.my/id/eprint/32287/1/FPP%202012%2022R.pdf
_version_	1747811661200228352

Consequential validity of student ratings of instruction for administrative purposes and instructional improvement

Similar Items