A STUDY ON INTRA-RATER RELIABILITY OF STUDENTS’ SELF-ASSESSMENT OF THEIR ENGLISH WRITING
DOI:
https://doi.org/10.21274/ls.2014.6.2.141-150Keywords:
self-assessment, intra-rater reliability, rater training, writingAbstract
The study is an attempt to estimate the intra-rater reliability of students’ self-assessment of their writing performances and to find out whether rater training improves the reliability. The rater training used is adapted from the model developed by Herman, Aschbacher and Winters(1992). This quantitative study which employed equivalent time-samples design has two variables; they were the reliability coefficient of students’ self-assessment and the rater training. The data were collected by asking 25 students conducting self-assessment on their four writing tasks and analyzed using Spearman coefficient correlation. It was found that the rs were 0.798, 0.772, 0.699 and 0.637; it showed that the consistency within students in assessing their own writing was moderately high. However, the rs of the intra-rater reliability of the self-assessment after the treatments is not higher than that of other experience being available in the absence of the treatment. It is concluded that rater training has not been able to improve the intra-rater reliability.Downloads
References
Ary, D., Jacobs, L.C., & Razavieh, A. 2010. Introduction to Research in Education. Wadsworth: Cengage Learning
Brown, H. D. 2001. Teaching by Principles: An Interactive Approach to Language Pedagogy. White Plains, NY: Addison Wesley Longman.
Brown, H.D. 2004. Language Assessment: Principles and Classroom Practices. White Plain, New York: Pearson Education
Cohen, A.D. 1994. Assesing Language Ability in the Classroom (2nd Edition). Wadsworth: Heinle & Heinle Publishers
Djiwandono, M. S. 2008. Tes Bahasa. Jakarta: Indeks
Hughes, A. 1989. Testing for Language Teachers. Cambridge: Cambridge University Press
Macias, Ana H. 2002. Alternative Assessment: Responses to Commonly Asked Questions. In Richards, Jack C. & Renandya, Willy A. 2002.
Methodology in Language Teaching: An Anthology of Current Practice. Cambridge: Cambridge University Press, page 339
Munoz, A & Alfarez, M. 2007. Students’ Objectivity and Perception of Self Assessment in an EFL Classroom. The Journal of ASIA TEFL Vol. 4 No. 2, pp. 1-25. Summer 2007
O’Malley, J. M. & Pierce, V. P.1996. Authentic Assessment for English Language Learners. Addison-Wesley Publishing Company
Richards, J. C. 2002. 30 Years of TEFL/TESL: A personal Reflection. The 50th TEFLIN International Conference, Surabaya. 29,30, 31 October 2002. page 32
Rini, N. 2011. Improving the Intrarater Reliability of Self-Assessment of English Speaking Performance. English Education Journal. Vol. 1 No.1.
Tuckman, B.W. 1999. Conducting Educational Research (5th Edition) Orlando: Harcourt Brace & Company.
Weigle, S. C. 2002. Assessing Writing. Cambridge: Cambridge University Press
Downloads
Published
How to Cite
Issue
Section
License
Copyright
Authors who publish with this journal agree to the following terms:
a. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
b. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
c. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
