Validity and Reliability of the Sustainability Literacy Knowledge Domain among Pre-Service Science Teachers: A Rasch Analysis
DOI:
https://doi.org/10.32332/al-jahiz.v7i1.11550Keywords:
Sustainability literacy, Validity, Reliability, Rasch analysisAbstract
Sustainability literacy is increasingly recognized as a critical competence for pre-service science teachers in addressing global sustainability challenges. The availability of psychometrically robust instruments in the Indonesian higher education context remains limited. This study aims to validate a sustainability literacy instrument within the cognitive domain using a Rasch dichotomous model to evaluate reliability, validity, item-fit statistics, and unidimensionality. The assessment instrument was designed to measure the extent of sustainability literacy among pre-service science teachers. A cross-sectional survey design was employed, involving 144 students from universities in Riau, Indonesia. Participants completed a sustainability literacy instrument comprising 30 multiple-choice items, developed based on the Sulitest framework. Data were analyzed using the Rasch measurement model with the assistance of Winsteps version 3.73 software, focusing on item fit indicators (Outfit MNSQ, ZSTD, and PTMEA Corr.), reliability indices, and principal component analysis of residuals. The results demonstrated that the instrument achieved good internal consistency (α = 0.85), high item reliability (0.94), and stable person reliability (0.84). Two items were identified as misfitting and recommended for revision, while the remaining items met acceptable MNSQ and PTMEA criteria. Furthermore, unidimensionality was confirmed, indicating that the instrument measures a single latent construct of cognitive sustainability literacy. The validated instrument can be used by teacher education institutions to diagnose pre-service teachers’ sustainability knowledge and to inform curriculum improvement. Its distinctive contribution lies in adapting an internationally recognized framework to the Indonesian higher education context through Rasch-based validation.
References
Bond, T. G., Yan, Z., & Heene, M. (2021). Applying the Rasch Model:Fundamental Measurement in The Human Science. In Applying the Rasch Model (Fouth Edit). Routledge. https://doi.org/10.4324/9781410614575
Boone, W. J. (2016). Rasch analysis for instrument development: why, when, and how? CBE—Life Sciences Education, 15(4), rm4.
Brundiers, K., Barth, M., Cebrián, G., Cohen, M., Diaz, L., Doucette-Remington, S., Dripps, W., Habron, G., Harré, N., Jarchow, M., Losch, K., Michel, J., Mochizuki, Y., Rieckmann, M., Parnell, R., Walker, P., & Zint, M. (2021). Key competencies in sustainability in higher education—toward an agreed-upon reference framework. Sustainability Science, 16(1), 13–29. https://doi.org/10.1007/s11625-020-00838-2
Décamps, A., Barbat, G., Carteron, J. C., Hands, V., & Parkes, C. (2017). Sulitest: A collaborative initiative to support and assess sustainability literacy in higher education. International Journal of Management Education, 15(2), 138–152. https://doi.org/10.1016/j.ijme.2017.02.006
Ekaputri, R. Z., Hidayat, T., Surtikanti, H. K., & Surakusumah, W. (2025). Prospective science teachers in the conservation education study. AIP Conference Proceedings, 3206(1), 080033. https://doi.org/10.1063/5.0259754
Fildzah, S. A., Fajrina, S., Ardi, & Selaras, G. H. (2025). Analisis Literasi Keberlanjutan Peserta Didik Fase E SMA Negeri 2 Padang pada Materi Keanekaragaman Hayati. Jurnal Jendela Pendidikan, 5.
García-González, E., Jiménez-Fontana, R., & Azcárate, P. (2020). Education for sustainability and the sustainable development goals: Pre-service teachers’ perceptions and knowledge. Sustainability, 12(18), 7741.
Hariram, N. P., Mekha, K. B., Suganthan, V., & Sudhakar, K. (2023). Sustainalism: An integrated socio-economic-environmental model to address sustainable development and sustainability. Sustainability, 15(13), 10682.
Himmah, R. H., Jatmiko, B., & Prahani, B. K. (2025). Validity and Reliability of ADI-ESD Based Teaching Materials for Scientific Literacy in Junior High School Students. SAR Journal - Science and Research, 9(8), 84–92.
Ilhami, A., Hidayat, T., Riandi, & Sriyati, S. (2025). Psychometric validation of a research skills assessment for pre-service science teachers using the rasch model. THABIEA: Journal of Natural Science Teaching, 8(2), 149–15 http://dx.doi.org/10.21043/thabiea.v8i2.343599.
Markus, K. A., & Borsboom, D. (2024). Frontiers of test validity theory: Measurement, causation, and meaning. Routledge.
Metsämuuronen, J. (2023). Seeking the real item difficulty: bias-corrected item difficulty and some consequences in Rasch and IRT modeling. Behaviormetrika, 50(1), 121–154.
Müller, M. (2020). Item fit statistics for Rasch analysis: can we trust them? Journal of Statistical Distributions and Applications, 7(1), 5.
Nousheen, A., Zia, M. A., & Waseem, M. (2024). Exploring pre-service teachers’ self-efficacy, content knowledge, and pedagogical knowledge concerning education for sustainable development. Environmental Education Research, 30(3), 321–333.
Prasetya, W. A., & Pratama, A. T. (2023). Item quality analysis using the Rasch model to measure critical thinking ability in the material of the human digestive system of Biology subject in high school. Jurnal Penelitian Dan Evaluasi Pendidikan, 27(1), 76–91.
Putri, D. D. N., Rahmawati, Fadilah, M., & Rahmi, F. O. (2025). Analisis Sustainability Literacy (Literasi Keberlanjutan) Peserta Didik Fase E pada Isu Bioteknologi di SMAN 12 Padang. Jurnal Pengabdian Masyarakat Dan Riset Pendidikan, 4(1), 2559–2565. https://doi.org/10.31004/jerkin.v4i1.1832
Saarna, R., & Laius, A. (2025). The sustainability literacy assessment instruments: a systematic literature review. International Journal of Sustainability in Higher Education. https://doi.org/10.1108/IJSHE-01-2025-0048
Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan rasch pada assessment pendidikan (1st ed.). Trim Komunikata Publishing House.
Susbiyanto, S., Hidayat, T., Koosbandiah Surtikanti, H., & Riandi, R. (2025). Measuring changes of students’ problem-solving skills for citizen science projects that integrated in ecology courses: Stacking analysis techniques in Rasch model. https://doi.org/10.20527/bino.v7i1.19574
Vasiliev, D. (2021). Combating global challenges–climate change, biodiversity loss and poverty simultaneously: Unachievable goal or the only way forward? SHS Web of Conferences, 129, 09022.
Yu, H. C. (2020). Objective Measurement: How Rasch Modeling Can Simplify and Enhance Your Assessment. In M. S. Khine (Ed.), Rasch measurement: Application in Quantitative Educational Research (1st ed.). Springer Singapore. https://doi.org/https://doi.org/10.1007/978-981-15-1800-3
Zwickle, A., & Jones, K. (2018). Sustainability Knowledge and Attitudes—Assessing Latent Constructs. In W. Leal Filho, R. W. Marans, & J. Callewaert (Eds.), Handbook of Sustainability and Social Science Research (pp. 435–451). Springer International Publishing. https://doi.org/10.1007/978-3-319-67122-2_25
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Aldeva Ilhami, Topik Hidayat, Riandi, Siti sriyati
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
