Keywords
Lower-order thinking skill
assessment
English national examination
How to Cite
Abstract
The using of HOTS questions to stimulate the learners’ thinking skills is essential to meet the challenge of 21st century. However, we know little about to what extent and what particular aspects of HOTS implemented in Indonesia English National Examination. Therefore, in order to fulfil the gap, the present study attempts to identify the use of HOTS-based questions and what particular skills appearing under HOTS category in English National Examination. We examine one package of each English National Examination from 2013 until 2018. We analyse 210 multiple-choice items in which each examination contain 35 items of reading comprehension. The items are analyzed quantitatively through content analysis based on the aspects of HOTS in Revised Bloom’s Taxonomy. The researchers find that there is insufficient amount of HOTS questions in English National Examination. 157 items classified into the LOTS and only 53 (25.23%) items are classified into HOTS. The second finding is that the level of HOTS included in English National Examination 2013-2018 is only the level of Analyze. The Differentiating and Organizing are the subskills of the aspect of Analyze that are mostly included in all examinations. There is strong evidence for encouraging the test developers to provide adequate portions of HOTS-based items in English National Examination.
References
Ahmad, U. L. (2016). Senior High School English National Examination and Thinking Skills. Beyond Words, 4(2), 168–190.
Ahmed, A., Aziz-un-Nisa, & Zarif, T. (2013). Table of Specificatin Development and Usage: An Overview. Interdisciplinary JOurnal of Contemporary Research in Business, 4(12), 354–361.
Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., … Wittrock, M. C. (2001). A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives (Abridged E). New York: Longman.
Brookhart, S. M. (2010). How to Assess Higher-Order Thinking Skills in Your Classroom. Alexandria, VA: ASCD. https://doi.org/10.1177/002205741808801819
Fanani, M. Z. (2018). Strategi Pengembangan Soal Higher-Order Thinking Skills (HOTS) dalam kurikulum 2013. Edudeena: Journal of Islamic Religious Education, 2(1), 57–76.
Ganapathy, M., & Kaur, S. (2014). ESL Students’ Perceptions of the use of Higher Order Thinking Skills in English Language Writing. Advances in Language and Literary Studies, 5(5), 80–87. https://doi.org/10.7575/aiac.alls.v.5n.5p.80
Kemendikbud. Peraturan Menteri Pedidikan dan Kebudayaan Nomor 22 Tahun 2016 tentang Standar Proces Pendidikan Dasar dan Menengah (2016). Indonesia.
Kemendikbud. (2017). Modul Penyusunan Soal Higher Order Thinking Skill (HOTS). Jakarta: Direktorat Pembinaan SMA Ditjen Pendidikan Dasar dan Menengah.
Krathwohl, D. R. (2002). A Revision of Bloom’s Taxonomy: An Overview. Theory into Practice, 41(4), 212–219. Retrieved from https://www.depauw.edu/files/resources/krathwohl.pdf
Lewis, A., & Smith, D. (1993). Defining Higher Order. Theory Into Practice, 32(3), 131–137.
Luang Peng, H., & Leng, N. (2006). Level of Thought Processes of the RCQ’s in the Malaysian University English Test (MUET) Reading Component and Students’ Performance : An Analysis.
Luebke, S., & Lorié, J. (2013). Use of Bloom ’ s Taxonomy in Developing Reading Comprehension Specifications. Journal of Applied Testing Technology, 14, 1–26.
Mainali, B. P. (2012). Higher order thinking in education. Academic Voices, 2(1), 5–10.
Moore, B., & Stanley, T. (2013). Critical Thining and Frmatve Assessments: Increasing the Rigor n Your Classroom. New York: Routledge.
Narayanan, S., Nadu, T., Adithan, M., & Nadu, T. (2015). Analysis Of Question Papers In Engineering Courses With Respect To Hots (Higher Order Thinking Skills). American Journal of Engneering Education, 6(1), 1–10.
Saukah, A., & Cahyono, A. E. (2015). Ujian Nasional di Indonesia dan Implikasinya terhadap Pembelajaran Bahasa Inggris. Jurnal Penelitian Dan Evaluasi Pendidikan, 19(2), 243–255.
Schulz, H., & FitzPatrick, B. (2016). Teachers ’ Understandings of Critical and Higher Order Thinking and What This Means for Their Teaching and Assessments. Alberta Journal of Educational Research, 62(1), 61–86.
Scully, D. (2017). Constructing Multiple-Choice Items to Measure Higher-Order Thinking, 22(4), 1–13.
Tan, S. Y., & Siti Hajar, H. (2015). Effective Teaching of Higher-Order Thinking (Hot) in Education. The Online Journal of Distance Education and E-Learning (TOJDEL), 3(2), 41–47.
Valdev Singh, R. K., & Shaari, A. H. (2019). The analysis of Higher-Order Thinking skills in English reading comprehension tests in Malaysia. Malaysian Journal of Society and Space, 15(01), 12–26. https://doi.org/10.17576/geo-2019-1501-02
Widana, I. W. (2017). Higher Order Thinking Skills Assessment (HOTS). JISAE: Journal of Indonesian Student Assessment and Evaluation, 3(1), 32–44
Before going to review process, all manuscripts will be checked that they are free from plagiarism practice using "Turnitin" software. If there is an indication of plagiarism, the manuscript will instantly be rejected.