Development and validation of Writing Assessment Literacy Inventory (WALI) for English language primary school teachers using Rasch model
<p>The purpose of this study is to develop and validate the Writing Assessment Literacy</p><p>Inventory (WALI) for the English primary school teachers focusing on three</p><p>constructs which are practices, belief, and knowledge....
Saved in:
| Main Author: | |
|---|---|
| Format: | thesis |
| Language: | eng |
| Published: |
2021
|
| Subjects: | |
| Online Access: | https://ir.upsi.edu.my/detailsg.php?det=8802 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| id |
oai:ir.upsi.edu.my:8802 |
|---|---|
| record_format |
uketd_dc |
| institution |
Universiti Pendidikan Sultan Idris |
| collection |
UPSI Digital Repository |
| language |
eng |
| topic |
LB Theory and practice of education |
| spellingShingle |
LB Theory and practice of education Nur Atiqah Shaharuddin Development and validation of Writing Assessment Literacy Inventory (WALI) for English language primary school teachers using Rasch model |
| description |
<p>The purpose of this study is to develop and validate the Writing Assessment Literacy</p><p>Inventory (WALI) for the English primary school teachers focusing on three</p><p>constructs which are practices, belief, and knowledge. The items of the instrument</p><p>were mainly adapted based on the original instrument by Crusan et al., (2016) and</p><p>input from literature in order to best suit the Malaysian context. This study used</p><p>quantitative research approach using Rasch model in the data analysis. The draft</p><p>instrument containing 56 items of original WALI was administered to 40 primary</p><p>schools teachers for pilot study in order to measure the validity and reliability of this</p><p>instrument. Based on the results of the pilot study, five items were removed from the</p><p>original instrument. The real study involved 214 primary school English teachers</p><p>from 32 schools in the district of Kinta Utara selected through simple random</p><p>sampling technique. Rasch Measurement analysis was used to obtain important</p><p>information about the validity and reliability of the instrument. The findings from the</p><p>real study showed that WALI has good validity values as demonstrated by PTMEA</p><p>CORR (0.04-0.63), and fit statistics, and the scale is functioning well. Item (0.97) and</p><p>person (0.87) reliability also showed high values. Unidimensionality value showed</p><p>acceptable range (27.6%, 31.3%) based on the analysis. The final version of the</p><p>WALI contained 49 items. The level of writing assessment literacy of teachers is at an</p><p>average level based on logit scores (0.99). From the results, it can be concluded that</p><p>WALI has good validity and reliability values. Therefore, the instrument can be used</p><p>in other primary schools in Malaysia. In addition, WALI will add to collection of</p><p>assessment instrument in writing literacy, and it encourages the use of modern test</p><p>theory in language testing.</p> |
| format |
thesis |
| qualification_name |
|
| qualification_level |
Master's degree |
| author |
Nur Atiqah Shaharuddin |
| author_facet |
Nur Atiqah Shaharuddin |
| author_sort |
Nur Atiqah Shaharuddin |
| title |
Development and validation of Writing Assessment Literacy Inventory (WALI) for English language primary school teachers using Rasch model |
| title_short |
Development and validation of Writing Assessment Literacy Inventory (WALI) for English language primary school teachers using Rasch model |
| title_full |
Development and validation of Writing Assessment Literacy Inventory (WALI) for English language primary school teachers using Rasch model |
| title_fullStr |
Development and validation of Writing Assessment Literacy Inventory (WALI) for English language primary school teachers using Rasch model |
| title_full_unstemmed |
Development and validation of Writing Assessment Literacy Inventory (WALI) for English language primary school teachers using Rasch model |
| title_sort |
development and validation of writing assessment literacy inventory (wali) for english language primary school teachers using rasch model |
| granting_institution |
Universiti Pendidikan Sultan Idris |
| granting_department |
Fakulti Pembangunan Manusia |
| publishDate |
2021 |
| url |
https://ir.upsi.edu.my/detailsg.php?det=8802 |
| _version_ |
1776104567501488128 |
| spelling |
oai:ir.upsi.edu.my:88022023-03-21 Development and validation of Writing Assessment Literacy Inventory (WALI) for English language primary school teachers using Rasch model 2021 Nur Atiqah Shaharuddin LB Theory and practice of education <p>The purpose of this study is to develop and validate the Writing Assessment Literacy</p><p>Inventory (WALI) for the English primary school teachers focusing on three</p><p>constructs which are practices, belief, and knowledge. The items of the instrument</p><p>were mainly adapted based on the original instrument by Crusan et al., (2016) and</p><p>input from literature in order to best suit the Malaysian context. This study used</p><p>quantitative research approach using Rasch model in the data analysis. The draft</p><p>instrument containing 56 items of original WALI was administered to 40 primary</p><p>schools teachers for pilot study in order to measure the validity and reliability of this</p><p>instrument. Based on the results of the pilot study, five items were removed from the</p><p>original instrument. The real study involved 214 primary school English teachers</p><p>from 32 schools in the district of Kinta Utara selected through simple random</p><p>sampling technique. Rasch Measurement analysis was used to obtain important</p><p>information about the validity and reliability of the instrument. The findings from the</p><p>real study showed that WALI has good validity values as demonstrated by PTMEA</p><p>CORR (0.04-0.63), and fit statistics, and the scale is functioning well. Item (0.97) and</p><p>person (0.87) reliability also showed high values. Unidimensionality value showed</p><p>acceptable range (27.6%, 31.3%) based on the analysis. The final version of the</p><p>WALI contained 49 items. The level of writing assessment literacy of teachers is at an</p><p>average level based on logit scores (0.99). From the results, it can be concluded that</p><p>WALI has good validity and reliability values. Therefore, the instrument can be used</p><p>in other primary schools in Malaysia. In addition, WALI will add to collection of</p><p>assessment instrument in writing literacy, and it encourages the use of modern test</p><p>theory in language testing.</p> 2021 thesis https://ir.upsi.edu.my/detailsg.php?det=8802 https://ir.upsi.edu.my/detailsg.php?det=8802 text eng closedAccess Masters Universiti Pendidikan Sultan Idris Fakulti Pembangunan Manusia <p>Adibah Abdul Latif. (2013). Pembangunan Instrumen Penilaian Akhlak Pelajar</p><p>(IMPAK) di Institusi Pengajian Tinggi Awam, PhD dissertation. Universiti</p><p>Teknologi Malaysia. Johor Bharu.</p><p></p><p>Alkharusi, H. (2011). Psychometric properties of the Teacher Assessment Literacy</p><p>Questionnaire for preservice teachers in Oman. In Procedia - Social and</p><p>Behavioral Sciences (Vol. 29, pp. 16141624).</p><p></p><p>American Federation of Teachers, National Council of Measurement in Education,</p><p>National Education Association (1990), Standards for Teacher Competence in</p><p>Educational Assessment of Students, Retrieved from https://buros.org/standardsteacher-</p><p>competence-educational-assessment-students</p><p></p><p>Andrich, D., and Marais, I., (2019). A Course in Rasch Measurement Theory,</p><p>Measuring in the Educational, Social and Health Sciences. Singapore: Springer.</p><p></p><p>Black, P., William, D., (1998). Inside the black box: Raising the standards through</p><p>classroom assessment. Phi Delta Kappa, 1-13</p><p></p><p>Bond, T.G., and Fox, C.M. (2015). Applying the Rasch Model: Fundamental</p><p>Measurement in the Human Sciences (3rd Edition). New York: Routledge.</p><p></p><p>Boone, W., J., Staver, J., R., & Yale, M., S. (2014). Rasch Analysis in the human</p><p>sciences, Dordrecht: Springer.</p><p></p><p>Boone, W., J., (2016). Rasch Analysis for Instrument Development: Why, When,</p><p>And How? CBE Life Sciences Education, 15(4), 1-7.</p><p></p><p>Boone, W., J., & Noltemeyer, A., (2017), Rasch Analysis: A primer for school</p><p>psychology researchers and practitioners. Cogent Education 4:1416898, 1-13.</p><p></p><p>Brookhart, S. M. (2010). How to assess higher-order thinking skills in your</p><p>classroom. Alexandria, VA: ASCD.</p><p></p><p>Brown, S. (2014). Assessment literacy: the foundation for improving student</p><p>learning. Assessment & Evaluation in Higher Education, 39(3),</p><p>395396.</p><p></p><p>Colby-Kelly, C. (2014). Assessment for Learning in Theory and Practice in L2</p><p>Classroom. The Encyclopedia of Applied Linguistics, 1-7.</p><p></p><p>Conrad, J., K., Conrad, M., K., Dennis, L., M., Riley, B., B., & Funk, R. Validation of</p><p>the Crime and Violence Scale (CVS) to the Rasch Measurement Model, GAIN</p><p>Methods Report 1.2, 1-32.</p><p></p><p>Creswell. J., W., (2012). Educational Research, Planning, Conducting, and</p><p>Evaluating Quantitative Research. (4th Edition). Boston: Pearson.</p><p></p><p>Crusan, D., (2010). Assessment in Second Language Writing Classroom. United</p><p>States of America: The University of Michigan Press.</p><p></p><p>Crusan, D., Plakans, L., & Gebril, A. (2016). Writing assessment literacy: Surveying</p><p>second language teachers knowledge, beliefs, and practices. Assessing Writing,</p><p>28, 4356.</p><p></p><p>Davis, L. (2018). Analytic, Holistic, and Primary Trait Marking Scales. The TESOL</p><p>Encyclopedia of English Language Teaching, 16.</p><p></p><p>Deluca, C., Johnson, S. (2017), Developing assessment capable teachers in this age of</p><p>Accountability. Assessment in Education: Principles, Policy, and Practice, Vol.</p><p>24(2), 121-126.</p><p></p><p>DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2016). Approaches to Classroom</p><p>Assessment Inventory: A New Instrument to Support Teacher Assessment</p><p>Literacy. Educational Assessment, 21(4), 248266.</p><p></p><p>DeLuca, C., LaPointe-McEwan, D., & Luhanga, U. (2016). Teacher assessment</p><p>literacy: a review of international standards and measures. Educational</p><p>Assessment, Evaluation and Accountability, 28(3), 251272.</p><p></p><p>DeMars, C. (2010). Item Response Theory: Understanding Statistic Measurement.</p><p>New York: Oxford University Press.</p><p>Education and Performance Unit (PADU). (2018), Malaysia Education Blueprint</p><p>Annual Report, Retrieved from https://www.padu.edu.my/wpcontent/</p><p>uploads/2019/07/AR2018_Report-Card.pdf</p><p></p><p>Education and Performance Unit (PADU). (2017), Malaysia Education Blueprint</p><p>Annual Report, Retrieved from https://www.padu.edu.my/wp-content/</p><p>uploads/2018/07/PADU-AR2017-CARD-ENG_Web.pdf</p><p></p><p>Education and Performance Unit (PADU), (2018), 21st Century Learning Teachers</p><p>Campaign Launch, Retrieved from https://www.padu.edu.my/events/21st-century-</p><p>Learning-teachers-campaign-launch/</p><p></p><p>Fulcher, G. (2012). Assessment literacy for the language classroom. Language</p><p>Assessment Quarterly, 9(2), 113132.</p><p></p><p>Ghazali Darusalam & Sufean Hussein.(2017). Metodologi Penyelidikan dalam</p><p>Pendidikan: Amalan dan Analisis Kajian. Kuala Lumpur: Penerbit Universiti</p><p>Malaya.</p><p></p><p>Giraldo, F. (2018). Language Assessment Literacy: Implications for Language</p><p>Teachers. Profile: Issues in Teachers Professional Development, 20(1), 179</p><p>195.</p><p></p><p>Gotch, C. M., & French, B. F. (2014). A systematic review of assessment literacy</p><p>measures. Educational Measurement: Issues and Practice, 33(2), 1418.</p><p></p><p>Green, K.E. & Frantom, C.G. (2002), Survey Development and Validation with the</p><p>Rasch Model, Presentation Manuscript, Charleston, SC. Retrieved from,</p><p>https://portfolio.du.edu/downloadItem/115525</p><p></p><p>Hailaya, W., Alagumalai, S., & Ben, F. (2014). Examining the utility of Assessment</p><p>Literacy Inventory and its portability to education systems in the Asia Pacific</p><p>region. Australian Journal of Education, 58(3), 297317.</p><p></p><p>Hyland, K. (2003). Second Language Writing. United States of America: Cambridge</p><p>University Press.</p><p></p><p>Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A</p><p>focus on language assessment courses. Language Testing, 25(3), 385402.</p><p></p><p>Inbar-Lourie, O. (2016). Language Assessment Literacy. In Language Testing and</p><p>Assessment (pp. 114). Springer International Publishing.</p><p></p><p>Intisar Ibrahim Ridwan, Rosmah Ali, Mohamad Zulkefli, Nazar Elfadil and Izzeldin</p><p>Ibrahim, (2016). Instrument development and validation using Rasch Model to</p><p>Measure student cognitive skills. International Research Conference on</p><p>Engineering, Science, and Humanities, 9-10 November 2016.</p><p></p><p>Khadijeh, B., & Amir, R. (2015). Importance of Teachers Assessment Literacy.,</p><p>International Journal of English Language Education, 3(1), 139.</p><p></p><p>Lam, R. (2019). Teacher assessment literacy: Surveying knowledge, conceptions and</p><p>practices of classroom-based writing assessment in Hong Kong. System, 81, 78</p><p>89.</p><p></p><p>Lan, C., & Fan, S. (2019). Developing classroom-based language assessment literacy</p><p>for in-service EFL teachers: The gaps. Studies in Educational Evaluation, 61,</p><p>112122.</p><p></p><p>Lee, I. (2017). Classroom writing assessment and feedback in L2 school</p><p>contexts. Singapore: Springer.</p><p></p><p>Lian, L. H., Yew, W. T. (2016). A Framework for Examining Assessment Literacy of</p><p>Preservice Teachers. US-China Education Review A, Vol. 6 (5), 294-300.</p><p></p><p>Lian, L. H., Yew, W. T., & Meng, C. C. (2014). Enhancing Malaysian Teachers</p><p>Assessment Literacy. International Education Studies, 7(10).</p><p></p><p>Linacre. J. M., (2005). A users guide to Winsteps/Ministeps Rasch model programs.</p><p>Chicago, Illanois: MESA Press.</p><p></p><p>Linacre, J., M., (2007). A users guide to WINSTEPS Rasch-model computer</p><p>programs. Chicago, Illinois: MESA Press.</p><p></p><p>Malone, M. E. (2013). The essentials of assessment literacy: Contrasts between testers</p><p>and users. Language Testing, 30(3), 329344.</p><p></p><p>Mellati, M., & Khademi, M. (2018). Exploring teachers assessment literacy: Impact</p><p>on learners writing achievements and implications for teacher</p><p>development. Australian Journal of Teacher Education, 43(6), 118.</p><p></p><p>Mertler, C. A., & Campbell, C. (2005). Measuring Teachers Knowledge &</p><p>Application of Classroom Assessment Concepts: Development of the Assessment</p><p>Literacy Inventory. American Educational Research Association.</p><p></p><p>Ministry of Education (2011). Malaysia Education Blueprint 2013-2025, Retrieved</p><p>From https://www.moe.gov.my/menumedia/media-cetak/penerbitan/dasar/1207-</p><p>malaysia-education-blueprint-2013-2025/file</p><p></p><p>Miller, M., D., Linn, R., L., & Gronlund, N.E. (2013). Measurement and Assessment</p><p>In Teaching, United States of America: Pearson.</p><p></p><p>Mohd Kashfi Mohd Jailani (2011). Manual Pengenalan Pengukuran Rasch dan</p><p>Winsteps, Universiti Kebangsaan Malaysia. Selangor.</p><p></p><p>Mohamad Affi Yusri Mohamad Zaini & Nooraini Othman. (2016). Pengujian</p><p>Kebolehpercayaan Instrumen Sikap Dan Persepsi Terhadap Akademik Dan</p><p>Sahsiah: Pengaplikasian Model Rasch Sains Humanika 8(2), 27-37.</p><p></p><p>Muhamad Shazielan Sharif, Zaliza Hanapi, Irdayanti Mat Nashir, Che Ghani Che</p><p>Kob, and Arman Shah Abdullah. (2019). Construct Validity and Reliability of</p><p>Manufacturing Industry: A Rasch Measurement Model Approaches for Pilot</p><p>Study. International Journal of Academic Research in Business and Social</p><p>Sciences, 9(3), 654665.</p><p></p><p>Mujumdar, A. (2017). Teaching English as A Second Language: Theory and Praxis,</p><p>India: Sage.</p><p></p><p>Norhasnida Che Mad Ghazali (2016). The implementation of School-Based</p><p>Assessment System in Malaysia: A study of teacher perceptions. Geografia</p><p>Online, Malaysia Journal of Society and Space 12(9), 104-117.</p><p></p><p>Normarina Abd Rahman. (2016). Pembinaan dan validasi instrument pengukuran</p><p>efikasi kendiri terhadap pentaksiran alternatif, Masters dissertation. Universiti</p><p>Pendidikan Sultan Idris. Tanjong Malim.</p><p></p><p>Opre, D., (2015). Teachers Conceptions of Assessment. Procedia Social and</p><p>Behavioural Sciences 209, 229-233.</p><p></p><p>Pastore, S. & Andrade, H. L., (2019). Teacher assessment literacy: A threedimensional</p><p>model. Teaching and Teacher Education, Vol. 84, 128-138</p><p></p><p>Perera, C. J, Sumintono, B, Jiang Na, (2018). The Psychometric Validation of the</p><p>Principal Practices Questionnaire Based on Item Response Theory. International</p><p>Online Journal of Educational Leadership, 2(1), 21-38.</p><p></p><p>Popham, W. J. (2009). Assessment literacy for teachers: Faddish or</p><p>fundamental? Theory into Practice, 48(1), 411.</p><p></p><p>Popham, W. J. (2011). Assessment literacy overlooked: A teacher educators</p><p>confession. Teacher Educator, 46(4), 265273.</p><p></p><p>Rasch, G., (1980). Probabilistic Models for Some Intelligence and Attainment Test.</p><p>Chicago: University of Chicago.</p><p></p><p>Rohaya Talib, Mohd Najib Abd Ghafar, Hamimah Abu Naim., (2014), Assessment</p><p>Literacy: A Catalyst to the Success of School-Based Assessment in Malaysian</p><p>Schools.</p><p></p><p>Rohaya Talib, Mohd Zaki Kamsah, Mohd Najib Abd Ghafar, Megat Aman Zahiri</p><p>Megat Zakaria, and Hamimah Abu Naim. (2013), T-Assess: Assessment Literacy</p><p>Test For Malaysian Teachers. International Conference on Assessment for</p><p>Higher Education Across Domains and Skills (pg. 1-9).</p><p></p><p>Rozmi Ismail (2015), Metodologi Penyelidikan Teori dan Praktis. Bangi. Penerbit</p><p>Universiti Kebangsaan Malaysia.</p><p></p><p>Russell, M., K., & Airasian, P., W. (2012). Classroom Assessment: Concepts and</p><p>Application. New York: McGraw Hill.</p><p></p><p>Scarino, A. (2013). Language assessment literacy as self-awareness: Understanding</p><p>the role of interpretation in assessment and in teacher learning. Language</p><p>Testing, 30(3), 309 327.</p><p></p><p>Scarino, A. (2017), Developing assessment literacy of teachers of languages: A</p><p>Conceptual and interpretive challenge. Papers in Language Testing and</p><p>Assessment, Vol. 6(1), 18-39.</p><p></p><p>Sharifah Nurulhuda Tuan Mohd Yasin, Mohd Fauzi Mohd Yunus and Izwah Ismail</p><p>(2018). The use of rasch measurement model for the validity and reliability,</p><p>Journal of Counselling and Educational Technology, 1(2), 22-27.</p><p></p><p>Sinnema, C., Ludlow, L., & Robinson, V. (2016). Educational leadership</p><p>effectiveness: a Rasch analysis. Journal of Educational Administration, 54(3),</p><p>305 - 339.</p><p></p><p>Siti Eshah Mokhsein, Othman Lebar, Jamal@Nordin Yunus, Azali Rahmat, Mohd</p><p>Uzi Dollah, Azliza Muhammad, Nor Azah Mansor, Azma Mahmood & Norain</p><p>Md Noor. (2015). Development and Validation of Assessment Practice Inventory</p><p>for Teacher Educators. International Journal of Assessment and Evaluation in</p><p>Education (5), 25-43</p><p></p><p>Siti Sahirah Saidi & Nyet Moi Siew. (2019). Reliability and Validity Analysis of</p><p>Statistical Reasoning Test Survey Instrument using the Rasch Measurement</p><p>Model. International Electronic Journal of Mathematics Education, 14(3),</p><p>535-546.</p><p></p><p>Sultana, N. (2019). Language Assessment Literacy: An Uncharted Area for the</p><p>English Language Teachers in Bangladesh. Language Testing in Asia 9(1), 1-14.</p><p></p><p>Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch Pada Assessment</p><p>Pendidikan. Cimahi. Trim Komunikata Publishing House.</p><p></p><p>Wei, S., L., Haslinda Ismail. Costa, J., S., Hong, B., T., (2018). Assessment for</p><p>learning research in East Asian countries. Studies in Educational Evaluation</p><p>Vol.59, 270-277.</p><p></p><p>Taherdoost, H. (2016). Sampling Method in Research Methodology; How to Choose</p><p>Sampling Technique. International Journal of Academic Research in Management</p><p>5(2), 18-27.</p><p></p><p>Weigle. S., C., (2014). Considerations for Teaching Second Language Writing, in</p><p>Murcia, M., C., Brinton, D., M., Snow, M., A. (eds). Teaching English as a</p><p>Second or Foreign Language (4th Edition). United States of America: National</p><p>Geographic Learning.</p><p></p><p>Weigle, S., C. (2002). Assessing Writing. United Kingdom: Cambridge University</p><p>Press.</p><p></p><p>Wiliam, D. (2016). Foreword: Assessment Literacy. London Review of</p><p>Education, 13(3), 34.</p><p></p><p>Wright, B., D. (1991). Diagnosing misfit. Rasch Measurement Trans 5(2), 56.</p><p></p><p>Wu, M., & Adams, R. (2007). Applying the Rasch Model to psycho-social</p><p>measurement: A Practical Approach. Melbourne, Australia:Education</p><p>Measurement Solutions.</p><p></p><p>Xu, Y., & Brown, G. T. L. (2016). Teacher assessment literacy in practice: A</p><p>reconceptualization. Teaching and Teacher Education, 58, 149162.</p><p></p><p>Yamtim, V., & Wongwanich, S. (2014). A Study of Classroom Assessment Literacy</p><p>of Primary School Teachers. Procedia - Social and Behavioral Sciences, 116,</p><p>29983004.</p><p></p><p>Zhang, L. & Soh. K.C., (2018), Teacher Assessment Literacy Scale:</p><p>Design and Validation. Teaching Chinese Language in Singapore, 179-191</p><p></p> |