Abstract
The urgency of mathematical literacy measurement tools for number elements is crucial for designing appropriate learning, but the available instruments are not yet standardized. This study aims to develop a mathematical literacy test instrument for number elements for 10th grade students, analyzed using the PCM item response theory model. The research used the Research and Development (R&D) method with test development procedures: overall plan, content definition, test specifications, item development, test design and assembly, test production, test administration, scoring test responses, cut scores, and test score reports. All items were content-valid with Aiken value >0.80. The eight items were construct-valid with SLF ≥0.45 and construct-reliable with CR of 0.75. The items difficulty is in the good category with b value in the interval -2<b<2. There were 2 items with ideal ICC plots and six items with non-ideal ICC plots. The information function shows that the test instrument provides the best and most accurate information for respondents with abilities slightly above average. Item fit analysis shows that there are seven fit items and one unfit item. Person fit analysis shows that 82 of the 195 respondents were detected as not fitting or deviating from the response pattern.
References
Amelia, R. N. (2021). Identifikasi item fit dan person fit dalam pengukuran hasil belajar kimia. Jurnal Ilmiah WUNY, 3(1), 13–26. https://doi.org/10.21831/jwuny.v3i1.40703
Auliya, L. (2021). Pengembangan instrumen tes literasi matematis berbasis budaya betawi untuk siswa SMP/MTs [UIN Syarif Hidayatullah Jakarta]. https://repository.uinjkt.ac.id/dspace/handle/123456789/59007
Azizah, N. L., Arliani, E., Purbaningrum, M., & Ramadhan, S. (2024). Literasi matematika materi sistem persamaan dan pertidaksamaan linier: pengembangan butir soal. AKSIOMA: Jurnal Program Studi Pendidikan Matematika, 13(2), 708–719. https://doi.org/10.24127/ajpm.v13i2.8547
Azwar, S. (2019). Reliabilitas dan validitas. Pustaka Pelajar.
Baker, F. B. (2001). The basics of item response theory (2nd ed.). ERIC Clearinghouse on Assessment and Evaluation.
Dewanti, S. S. (2021). Model penilaian kompetensi matematika abad xxi pada mahasiswa program studi S1 pendidikan matematika [Universitas Negeri Yogyakarta]. https://eprints.uny.ac.id/73381/
Dewanti, S. S., Ayriza, Y., & Setiawati, F. A. (2020). The application of item response theory for development of a students’ attitude scale toward mathematics. New Educational Review, 60, 108–123. https://czasopisma.marszalek.com.pl/journals/19/376/6185
Dewanti, S. S., Izzah, J. N., & Kiranasari, S. P. (2024). Utilizing item response theory for the analysis of self-regulated learning scale in mathematics. Jurnal Elemen, 10(3), 614–629. https://doi.org/10.29408/jel.v10i3.26618
Downing, S. M., & Haladyna, T. M. (2006). Handbook of test development. Lawrence Erlbaum Associates, Inc.
Farida, R. N., Qohar, A., & Rahardjo, S. (2021). Analisis kemampuan literasi matematis siswa SMA kelas x dalam menyelesaikan soal tipe pisa konten change and relationship. Jurnal Cendekia: Jurnal Pendidikan Matematika, 5(3), 2802–2815. https://doi.org/10.31004/cendekia.v5i3.972
Fitriana, D. A. (2022). Validitas dan reliabilitas instrumen penilaian matematika dengan problem solving berbasis penskoran politomus. Journal IKLILA: Jurnal Studi Islam dan Sosial, 5(1), 13–25. https://ejournal.iaikhozin.ac.id/ojs/index.php/iklila/article/view/118
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (eighth). Pearson Education, Inc.
Hambleton, R. K., & Swaminathan, H. (1985). Items response theory: Principles and application. Kluwer, Inc.
Hambleton, R. K., Swaminathan, H., & Rogers, D. J. (1991). Fundamentals of item response theory. Sage Publications.
Istiyono, E., Mardapi, D., & Suparno, S. (2014). Pengembangan tes kemampuan berpikir tingkat tinggi fisika (pysTHOTS) peserta didik SMA. Jurnal Penelitian dan Evaluasi Pendidikan, 18(1), 1–12. https://doi.org/10.21831/pep.v18i1.2120
Kurniawan, R., & Djidu, H. (2021). Kemampuan literasi matematis siswa: Sebuah studi literatur. Jurnal Edumatic: Jurnal Pendidikan Matematika, 2(01), 24–30. https://doi.org/10.21137/edumatic.v2i01.468
Mulvia, R., Ramalis, T. R., & Efendi, R. (2021). Mendeteksi keajegan butir tes dengan fungsi informasi. Jurnal Pendidikan Indonesia, 2(1), 72–84. https://doi.org/10.36418/japendi.v2i1.66
Nurjanah, U., & Hakim, D. L. (2019). Number sense siswa pada materi bilangan. Prosiding Seminar Nasional Matematika Dan Pendidikan Matematika Sesiomadika 2019, 2(1), 1174–1182.
OECD. (2023a). PISA 2022 assessment and analytical framework. OECD Publishing.
OECD. (2023b). PISA 2022 results: The state of learning and equity in education. OECD Publishing.
Ogunsakin, I. B., & Shogbesan, Y. O. (2018). Item response theory (IRT): A modern statistical theory for solving measurement problem in 21st century. International Journal of Scientific Research in Education, 11(3B), 627–635. https://www.ijsre.com.ng/assets/vol.%2C-11%283b%29-ogunsakin---shogbesan.pdf
Purnama, D. N. (2023). Perbandingan estimasi kemampuan akuntansi siswa smk pada penskoran dikotomus dan politomus. Jurnal Pendidikan Akuntansi Indonesia, 20(2), 145–154. https://doi.org/10.21831/jpai.v20i2.54143
Purwanto, A. H., & Jailani. (2024). Pengembangan soal matematika model AKM menggunakan konteks budaya yogyakarta untuk mengetahui profil literasi matematika siswa sekolah menengah atas. Algoritma: Jurnal Matematika, Ilmu Pengetahuan Alam, Kebumian Dan Angkasa, 2(6), 182–204. https://doi.org/0.62383/algoritma.v2i6.299
Putra, Y. Y., & Vebrian, R. (2019). Pengembangan soal matematika model PISA konteks kain cual Bangka Belitung. Jurnal Cendekia : Jurnal Pendidikan Matematika, 3(2), 333–340. https://doi.org/10.31004/cendekia.v3i2.114
Reise, S. P. (1990). A comparison of item and person fit methods of assessing model data fit in IRT. Applied Psychological Measurement, 14(2), 127–137. https://doi.org/10.1177/014662169001400202
Retnawati, H. (2014). Teori respons butir dan penerapannya untuk peneliti, praktisi pengukuran dan pengujian, mahasiswa pascasarjana. Nuha Medika.
Retnawati, H. (2016). Analisis kuantitatif instrumen penelitian (panduan peneliti, mahasiswa, dan psikometrian). Parama Publishing.
Retnawati, H. (2017). Validitas, reliabilitas & karakteristik butir (panduan untuk peneliti, mahasiswa, dan psikometrian). Parama Publishing.
Stacey, K. (2015). Selected regular lectures from the 12th international congress on mathematical education. In Selected regular lectures from the 12th international congress on mathematical education (pp. 771–790). Springer. https://doi.org/10.1007/978-3-319-17187-6
Sudaryono. (2012). Dasar-dasar evaluasi pembelajaran. Graha Ilmu.
Sumaryanta. (2021). Teori tes klasik dan teori respon butir: konsep dan contoh penerapannya. CV. Confident.
Takaria, J., Pattimukay, N., & Kaary, K. M. (2022). Analisis kemampuan literasi numerasi siswa dalam menyelesaikan soal cerita ditinjau dari kemampuan awal matematis (KAM). Pedagogika:Jurnal Pedagogik dan Dinamika Pendidikan, 10(2), 318–327. https://doi.org/10.30598/pedagogikavol10issue2page318-327
Wibowo, A. A., Rif’at, M., & Yani, A. (2020). Pengembangan instrumen tes untuk mengukur kemampuan koneksi literasi siswa SMP. JPPK: Jurnal Pendidikan dan Pembelajaran Khatulistiwa, 9(7), 1–12. https://doi.org/10.26418/jppk.v9i7.41316
Widhiarso, W. (2010). Model politomi dalam teori respons butir. Universitas Gadjah Mada.
Wright, B. D., & Stone, M. H. (1999). Measurement essentials. In Measurement (2nd ed.). Wide Range, Inc.
Zubairi, A. M., & Kassim, N. L. A. (2006). Classical and rasch analyses of dichotomously scored reading comprehension test items. Malaysian Journal of ELT Research, 2(1), 1–20. https://meltajournals.com/index.php/majer/article/view/663

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Copyright (c) 2025 Jurnal Tadris Matematika
