Development of mathematics questions in PISA format with number content

Putri Aisyah; Sartika Avrilian; Tara Nurpadillah; Natanael Putera Rasjid Ginting; Ratu Ilma Indra Putri; Elsa Susanti; Ruth Helen Simarmata

doi:10.32332/x4ke7f84

Authors

Putri Aisyah Sriwijaya University
Sartika Avrilian Sriwijaya University
Tara Nurpadillah Sriwijaya University
Natanael Putera Rasjid Ginting Sriwijaya University
Ratu Ilma Indra Putri Sriwijaya University
Elsa Susanti Sriwijaya University
Ruth Helen Simarmata Sriwijaya University

DOI:

https://doi.org/10.32332/x4ke7f84

Keywords:

Mathematical Literacy, Number Content, PISA, Questions Development

Abstract

The low level of mathematical literacy among Indonesian students is reflected in the average results of PISA 2022, indicating the need to develop PISA-style test instruments. Therefore, this study aims to develop PISA-based questions on numbers that are valid and reliable. The method used is a development study consisting of preliminary and formative evaluation stages. The preliminary stage includes analyzing original PISA questions, student needs, curriculum, and determining the material. The formative evaluation stage includes self-evaluation, expert review, one-on-one, and small group discussions. The format of the questions developed is two multiple-choice questions and four contextual descriptions equivalent to PISA. Content validation was tested qualitatively through expert comments, while quantitative analysis was conducted after testing the questions on six junior high school students in Palembang who were selected purposively. Quantitative analysis includes item validity, reliability, difficulty level, and discriminative power. The research results indicate that the questions are valid and reliable based on content appropriateness, ease of understanding, smooth implementation, and time efficiency. These questions can be used as a training tool to improve students' mathematical abilities in accordance with PISA standards. However, this study has limitations due to the limited sample size and only reaching a small group, so it is recommended that further research be conducted with a larger sample size and up to the field test stage.

References

Afriyanti, I., Wardono, & Kartono. (2018). Pengembangan Literasi Matematika Mengacu PISA Melalui Pembelajaran Abad Ke-21 Berbasis Teknologi. PRISMA, Prosiding Seminar Nasional Matematika, 1, 608–617.

Amalia, W., Mulyono, & Napitupulu, E. E. (2020). Development of Pisa-Like Mathematical Problems on The Change and Relationship Content to Measure the Mathematical Solution Ability of Middle School Students Development of Pisa-Like Mathematical Problems on The Change and Relationship Content to Measure t. International Journal of Advanced Science and Technology, 29(6), 4841–4849.

Baka, N. A., Laksana, D. N. L., & Dhiu, K. D. (2019). Konten Dan Konteks Budaya Lokal Ngada Sebagai Bahan Ajar Tematik Di Sekolah Dasar. Journal of Education Technology, 2(2), 46. https://doi.org/10.23887/jet.v2i2.16181

Elyasarikh, A. A., & Masriyah, M. (2024). Bagaimana Literasi Matematis Siswa pada Penyelesaian Soal PISA-Like Berdasarkan Tingkat Kecerdasan Logis Matematis? MATHEdunesa, 13(2), 451–467. https://doi.org/10.26740/mathedunesa.v13n2.p451-467

Farida, & Musyarofah, A. (2021). Validitas dan Reliabilitas dalam Analisis Butir Soal. Al-Mu’Arrib: Journal of Arabic Education, 1(1), 34–44. https://doi.org/10.32923/al-muarrib.v1i1.2100

Herman, T., Hasanah, A., Nugraha, R. C., Harningsih, E., Ghassani, D. A., & Marasabessy, R. (2022). Pembelajaran Berbasis Masalah-High Order Thinking Skill (HOTS) pada Materi Translasi. Jurnal Cendekia : Jurnal Pendidikan Matematika, 6(1), 1131–1150. https://doi.org/10.31004/cendekia.v6i1.1276

Ma’rifah, F., & Kristiana, A. I. (2015). Pengembangan Paket Tes Kemampuan Penalaran Matematika Model PISA Konten Quantity Pada Siswa Kelas VIII SMP ( Development Of Mathematical Reasoning Test Package PISA Model Quantity Contents For Grad 8 th Of Junior High School ). 1–6.

Magdalena, I., Fitroh, A., Fadhilah, D., Habsah, D., & Qodrawati, R. (2023). Mengelolah Data Uji Validitas dan Reliabilitas dalam PenelitianPendidikan: Instrumen Tes dan Non Tes Peserta Didik Kelas IV SDNPondok Kacang Barat 03. Jurnal Pendidikan Sosial Dan Konseling, 1(2), 49–53. https://jurnal.ittc.web.id/index.php/jpdsk/article/view/18

Mahmudah, W. (2018). Analysis of Student Errors in Solving Hots Type Math Problems Based on Newman’s Theory. Jurnal UJMC, 4(1), 49–56.

Mustaqim, M., & Sulisti, H. (2024). Analisis Butir Soal Pas Matematika Peminatan: Daya Pembeda, Tingkat Kesukaran, Dan Kualitas Pengecoh. Al-’Adad : Jurnal Tadris Matematika, 3(1), 44–56. https://doi.org/10.24260/add.v3i1.3011

Novia, T., Wardani, A., Canda, C., Nurdi, N., & Nurmasyitah, N. (2020). Analisis Validitas dan Reliabilitas Butir Soal UTS Fisika Kelas X SMA Swasta Muhammadiyah 4 Langsa. GRAVITASI: Jurnal Pendidikan Fisika Dan Sains, 3(01), 19–22. https://doi.org/10.33059/gravitasi.jpfs.v3i01.2256

Nugraha, A., Meika, I., & Yunitasari, I. (2025). Pengembangan Soal High Order Thinking Skill Matematika SMP. 10(2), 188–194. https://doi.org/10.30653/003.2024102.366

Nurhalimah, S., Hidayati, Y., Rosidi, I., & Hadi, W. P. (2022). Hubungan Antara Validitas Item Dengan Daya Pembeda Dan Tingkat Kesukaran Soal Pilihan Ganda Pas. Natural Science Education Research, 4(3), 249–257. https://doi.org/10.21107/nser.v4i3.8682

OECD. (2019). PISA 2018 insights and interpretations. OECD Publishing.

OECD. (2022). PISA 2022 Results (Volume I and II) - Country Notes: Indonesia. FACTSHEETS - INDONESIA. https://www.oecd.org/en/publications/pisa-2022-results-volume-i-and-ii-country-notes_ed6fbcc5-en/indonesia_c2e1ae0e-en.html

OECD. (2023). PISA 2022 Results (Volume I): The State of Learning and Equity in Education. OECD Publishing. https://doi.org/https://doi.org/10.1787/53f23881-en

Pereira, J., Aulingga, A., Ning, Y., & Vilela, A. (2022). Kesalahan Siswa Smp Dalam Menyelesaikan Soal Pisa Konten Space and Shape Berdasarkan Teori Newman. JPMI (Jurnal Pembelajaran Matematika Inovatif), 5(2), 317. https://doi.org/10.22460/jpmi.v5i2.9910

Putra, Y. Y., Zulkardi, Z., & Hartono, Y. (2016). Pengembangan Soal Matematika Model PISA Konten Bilangan untuk Mengetahui Kemampuan Literasi Matematika Siswa. Jurnal Elemen, 2(1), 14–26. https://doi.org/10.29408/jel.v2i1.175

Putri, S. S. (2021). THE DEVELOPMENT OF FOODIVITY INTERACTIVE AS AN INTERACTIVE MULTIMEDIA TO IMPROVE STUDENTS’ UNDERSTANDING ON FOOD NUTRITION TOPIC. Universitas Pendidikan Indonesia.

Rakhmawati, I. A., & Alifia, N. N. (2018). Kearifan Lokal Dalam Pembelajaran Matematika Sebagai Penguat Karakter Siswa. Jurnal Elektronik Pembelajaran Matematika, 5(2), 186–196. http://jurnal.uns.ac.id/jpm

Saputri, H. A., Zulhijrah, Larasati, N. J., & Shaleh. (2023). Analisis Instrumen Assesmen : Validitas, Reliabilitas, Tingkat Kesukaran, dan Daya Beda Butir Soal. Didaktik : Jurnal Ilmiah PGSD FKIP Universitas Mandiri, 09(05), 2986–2995.

Saputri, N. W., Turidho, A., Zulkardi, Z., Darmawijoyo, D., & Somakim, S. (2020). Desain Soal Pisa Konten Uncertainty and Data Konteks Penyebaran Covid-19. EDU-MAT: Jurnal Pendidikan Matematika, 8(2), 106–118. https://doi.org/10.20527/edumat.v8i2.8564

Zuhri, N. Z., Syihabuddin, S., & Tatang, T. (2024). Analisis Validitas, Reliabilitas, dan Tingkat Kesukaran Soal Bahasa Arab Tingkat SMP Berbasis Artificial Intelligence (AI) melalui Platform QuestionWell. Jurnal Pendidikan Dan Pembelajaran Indonesia (JPPI), 4(2), 693–704. https://doi.org/10.53299/jppi.v4i2.576