Item Analysis of Insya’ Assessment Based on Bloom’s Taxonomy at Islamic Senior High School Darussalam Rajapolah Tasikmalaya

Cecep Sobar Rochmat; Fitri Masturoh; Fairuz Subakir; Zhulfa Halimatus Sadiah

doi:10.32332/an-nabighoh.v27i1.201-222

Authors

Cecep Sobar Rochmat Universitas Darussalam Gontor https://orcid.org/0009-0002-9386-693X
Fitri Masturoh Universitas Darussalam Gontor https://orcid.org/0000-0001-9102-2579
Fairuz Subakir Universitas Darussalam Gontor
Zhulfa Halimatus Sadiah Fatih Sultan Mehmet Vakıf Üniversitesi, Turkey

DOI:

https://doi.org/10.32332/an-nabighoh.v27i1.201-222

Keywords:

Bloom's Taxonomy, Arabic Lesson, HOTS, Item Analysis, Insya’ Assessment

Abstract

Despite the widespread use of Insya’ assessments in educational institutions, comprehensive evaluations of item quality covering validity, reliability, discrimination, difficulty, and cognitive levels based on Revised Bloom’s Taxonomy remain limited. Previous studies rarely integrate statistical analysis with cognitive classification, particularly in high school Arabic education. This study addresses that gap by analyzing ten Insya’ assessment items from Grade 12 students at Islamic Senior High School Darussalam Tasikmalaya. Data consisted of exam questions, student answers, and scores, supported by literature. Collection methods involved interviews, observation, and documentation, with analysis conducted using SPSS version 30. The results showed 80% of items were valid, with a reliability coefficient of 0.743. Discrimination analysis rated 30% very good, 40% good, 10% acceptable, and 20% poor. Difficulty analysis revealed that 10% of the items were difficult, 70% were moderate, and 20% were easy. Cognitive levels indicated 80% assessed Understanding (C2), 10% Applying (C3), and 10% Creating (C6), with only 10% categorized as higher-order thinking skills (HOTS). These findings highlight the need for improved item design that promotes higher-order thinking and aligns more effectively with cognitive learning goals.

Downloads

Download data is not yet available.

Author Biographies

Cecep Sobar Rochmat, Universitas Darussalam Gontor

Cecep Sobar Rochmat is a lecturer at the University of Darussalam Gontor, Indonesia. His academic interests include Islamic Religious Education, Philosophy of Education, Holistic Education, and the Pesantren-based University model. He earned his Bachelor’s degree from the Institute for Islamic Studies Darussalam (ISID) Gontor in 2006, his Master’s degree from STAIN Datokarama Palu in 2013, and his Doctorate from the State Institute for Islamic Studies (IAIN) Palu in 2020. He is actively engaged in teaching and research, focusing on curriculum development in Islamic education and the integration of pesantren (Islamic boarding school) values into higher education. In addition to research, he mentors students and frequently speaks at academic forums related to Islamic education. He can be contacted via email at: cecep.rochmat@unida.gontor.ac.id.
Fitri Masturoh, Universitas Darussalam Gontor

Fitri Masturoh is a postgraduate student in the Arabic Language Education program at the University of Darussalam Gontor, Indonesia. She holds a Bachelor's degree in Islamic Religious Education froms IAILM Suryalaya Tasikmalaya and is currently pursuing her Master’s degree in Arabic Language Education at UNIDA Gontor. Her academic interests include Arabic language teaching and Islamic education. She actively participates in academic conferences and is involved in research focusing on language pedagogy and curriculum development in Islamic educational contexts. she can be contacted via email at: fitrimasturoh@unida.gontor.ac.id.
Fairuz Subakir, Universitas Darussalam Gontor

Fairuz Subakir is a senior lecturer in the Arabic Language Education postgraduate program at the University of Darussalam Gontor, Indonesia. He earned his Bachelor's degree in Da’wah and Islamic Studies from the Islamic University of Madinah, Saudi Arabia, and continued his postgraduate studies in Arabic Language at Punjab University, Pakistan, where he obtained both his Master's and Doctoral degrees. His expertise lies in Arabic language education and Islamic communication. With extensive experience in teaching and research, he plays an active role in academic development within the field of Arabic language studies. He can be contacted via email at: fairuz.subakir@unida.gontor.ac.id.
Zhulfa Halimatus Sadiah, Fatih Sultan Mehmet Vakıf Üniversitesi, Turkey

Zhulfa Halimatus Sadiah is an undergraduate student at Fatih Sultan Mehmet Vakıf University, Turkey, majoring in Islamic Studies. Her academic interests lie in the fields of Islamic education history and Arabic language. She has participated in several academic conferences and research forums focusing on Arabic language learning and the intellectual heritage of Islamic education. She aspires to contribute to the advancement of Arabic pedagogy by integrating historical insights with contemporary educational needs. He can be contacted via email at: zhulfa.sadiah@stu.fsm.edu.tr.

References

Aflisia, Noza, Kasmantoni, and Yunika Febri Yanti. “Writing Errors: A Study of Students Linguistic Errors in Insya Muwajjah Learning.” An Nabighoh 26, no. 1 (2024): 79–96. https://doi.org/10.32332/annabighoh.v26i1.79-96.

Akbarini, Nur Rahmi, and Arun Anggrawal. “Validity and Reliability of Test Questions to Measure the Information Literacy Skills of Prospective Teacher Students.” Jurnal Eduscience 11, no. 1 (May 3, 2024): 163–77. https://doi.org/10.36987/jes.v11i1.5640.

Althory, Abdallah Ali Ali. “Linguistic Features Acquired by a Language of A Speaking Society.” Journal of Arabic Language Sciences and Literature 1, no. 4 (September 30, 2022): 62–77. https://doi.org/10.26389/AJSRP.R150522.

Arikunto, Suharsimi. Dasar-Dasar Evaluasi Pendidikan. Jakarta: PT Bumi Aksara, 2015.

Ashraf, Z. A., and Jaseem K. “Classical and Modern Methods in Item Analysis of Test Tools.” International Journal of Research and Review 7, no. 5 (2020). https://www.ijrrjournal.com/IJRR_Vol.7_Issue.5_May2020/Abstract_IJRR0058.html.

Ayu, Nidya, Suharno, and Kartika Chrysti Suryandari. “Exploration: Creative Thinking Skills in Writing Essays Media-Based Image Series.” International Journal of Elementary Education 7, no. 1 (February 16, 2023): 1–7. https://doi.org/10.23887/ijee.v7i1.54095.

Cecep, Cecep Sobar Rochmat, Amalia Nur Afasa Amalia, Abdul Hafidz Bin Zaid Abdul Hafidz, Moh Alwi Yusron Alwi, and Sania Karimah Liputo Sania. “The Analysis of Experiential Learning Method of Dale’s Cone Experience Model in Improving the Effectiveness of Arabic Language Learning.” Izdihar : Journal of Arabic Language Teaching, Linguistics, and Literature 7, no. 1 (April 30, 2024). https://doi.org/10.22219/jiz.v7i1.30823.

Das, Syaamantak, Shyamal Kumar Das Mandal, and Anupam Basu. “Classification of Action Verbs of Bloom’s Taxonomy Cognitive Domain: An Empirical Study.” Journal of Education 202, no. 4 (October 2022): 554–66. https://doi.org/10.1177/00220574211002199.

ElJishi, Ziad, Faten S. M. Abdel-Hameed, Ahmad Khuddro, and Salman Yusuf Zayed. “Translating Bloom’s Taxonomy Action Verb List into Arabic for Teacher Preparation Programs: Challenges/Problems and Solutions.” International Journal of Education and Literacy Studies 12, no. 1 (January 27, 2024): 295–303. https://doi.org/10.7575/aiac.ijels.v.12n.1p.295.

Elthia, Memy Wardani, and Rosidah Alawiyah. “An Analysis of the Quality Test Items Used in the Final Semester Assessment at MTs Nurul Yaqin Gili Air.” Jurnal Test 2 6, no. 1 (November 18, 2023). https://jonedu.org/index.php/joe/article/view/4572.

Erdiana, Nira, and Sulastri Panjaitan. “How Is HOTS Integrated into the Indonesian High School English Textbook?” Studies in English Language and Education 10, no. 1 (January 31, 2023): 60–77. https://doi.org/10.24815/siele.v10i1.26052.

Hope, David, Karen Adamson, I. C. McManus, Liliana Chis, and Andrew Elder. “Using Differential Item Functioning to Evaluate Potential Bias in a High Stakes Postgraduate Knowledge Based Assessment.” BMC Medical Education 18, no. 1 (December 2018): 64. https://doi.org/10.1186/s12909-018-1143-0.

Hrich, Najoua. “Artificial Intelligence Item Analysis Tool for Educational Assessment: Case of Large-Scale Competitive Exams.” International Journal of Information and Education Technology 14, no. 6 (2024): 822–27. https://doi.org/10.18178/ijiet.2024.14.6.2107.

Imaduddin, Muhammad Faris, Hikmah Maulani, and Ijlal Haziel Taufik. “Test the Validity and Reliability of Arabic Learning Questions.” Arabi : Journal of Arabic Studies 7, no. 2 (December 21, 2022): 198–207. https://doi.org/10.24865/ajas.v7i2.523.

Karim, Sayit Abdul, Suryo Sudiro, and Syarifah Sakinah. “Utilizing Test Items Analysis to Examine the Level of Difficulty and Discriminating Power in a Teacher-Made Test.” EduLite: Journal of English Education, Literature and Culture 6, no. 2 (2021): 256. https://doi.org/10.30659/e.6.2.256-269.

Khalid, Nor Hafizi Mohd, Ibnatul Jalilah Yusof, Adibah Abdul Latif, and Md Daud Md Jani. “Psychometric Properties of Teacher Classroom Assessment Literacy Instrument Using Rasch Model Analysis.” International Journal of Evaluation and Research in Education (IJERE) 12, no. 2 (June 1, 2023): 638. https://doi.org/10.11591/ijere.v12i2.23607.

Kumar, Amit, Dinesh Singh, and M. S. Dhankhar. “Analysis of Bloom Taxonomy-Based Examination Data Using Data Mining.” International Journal of Intelligent Systems and Applications in Engineering 12, no. 4s (2024). https://www.ijisae.org/index.php/IJISAE/article/view/3860.

Kumar, Dharmendra, Raksha Jaipurkar, Atul Shekhar, Gaurav Sikri, and V. Srinivas. “Item Analysis of Multiple Choice Questions: A Quality Assurance Test for an Assessment Tool.” Medical Journal Armed Forces India 77 (February 2021): S85–89. https://doi.org/10.1016/j.mjafi.2020.11.007.

Mahmudi, Ihwan, Fitri Masturoh, and Wiwiek Dwi Febrianti. “Higher Order Thinking Skills (HOTS) Based Assessment: A Proposed Model for Arabic Learning.” Shibghoh: Prosiding Ilmu Kependidikan UNIDA Gontor 1 (2023). https://ejournal.unida.gontor.ac.id/index.php/shibghoh/article/view/10195.

Mahmudi, Ihwan, Afni Nurwardah, Siti Nikmatul Rochma, and Agung Nurcholis. “Item Analysis Of Arabic Language Examination.” Ijaz Arabi Journal of Arabic Learning 6, no. 3 (October 22, 2023). https://doi.org/10.18860/ijazarabi.v6i3.19821.

Mahroof, Ameema, and Muhammad Saeed. “Evaluation of Question Papers by Board of Intermediate and Secondary Education Using Item Analysis and Blooms Taxonomy.” Bulletin of Education and Research 43, no. 3 (2021). https://pu.edu.pk/images/journal/ier/PDF-FILES/5_43_3_21.pdf.

Marar, Sumayyia, Muaawia A. Hamza, Mohsen Ayyash, and Amani Abu-Shaheen. “Development and Validation of an Instrument to Assess the Knowledge and Perceptions of Predatory Journals.” Heliyon 9, no. 11 (November 2023): e22270. https://doi.org/10.1016/j.heliyon.2023.e22270.

Md Ghazali, Nor Hasnida. “A Reliability and Validity of an Instrument to Evaluate the School-Based Assessment System: A Pilot Study.” International Journal of Evaluation and Research in Education (IJERE) 5, no. 2 (June 1, 2016): 148. https://doi.org/10.11591/ijere.v5i2.4533.

Metsämuuronen, Jari. “Generalized Discrimination Index.” International Journal of Educational Methodology 6, no. 2 (May 15, 2020): 237–58. https://doi.org/10.12973/ijem.6.2.237.

Mosier, Charles I. “A Note on Item Analysis and the Criterion of Internal Consistency.” Psychometrika 1, no. 4 (December 1936): 275–82. https://doi.org/10.1007/BF02287879.

Muassomah. “From Global Language Use to Local Meanings: Arabic to Indonesian Absorption.” IAS Journal of Localities 1, no. 1 (May 24, 2023): 16–29. https://doi.org/10.62033/iasjol.v1i1.10.

Rochmat, Cecep Sobar, Syifa Rizki Sholihah, and Shofia Niswah Qonita. “Forming Critical Character With Higher Order Thinking Skill (HOTS) Based Learning Assessment in Islamic Religious Education Subjects.” Educan : Jurnal Pendidikan Islam 6, no. 2 (August 2, 2022): 236. https://doi.org/10.21111/educan.v6i2.8131.

Rochmat, Cecep Sobar, Angelica Silfana Prisca Yoranita Yoranita, Mispullah Prihatini, and Bagus Asri Wibawa. “The Quality of Education from Islamic Perspective Analysis of The Merdeka Belajar Curriculum in Facing The Society 5.0 Era.” Jurnal Tarbiyatuna 14, no. 1 (June 30, 2023): 75–93. https://doi.org/10.31603/tarbiyatuna.v14i1.8633.

Santen, Sally A, Robin R Hemphill, Cindy M Spanier, and Nicholas D Fletcher. “‘Sorry, It’s My First Time!’ Will Patients Consent to Medical Students Learning Procedures?” Medical Education 39, no. 4 (April 2005): 365–69. https://doi.org/10.1111/j.1365-2929.2005.02113.x.

Setiabudi, Agung, Mulyadi Mulyadi, and Hilda Puspita. “An Analysis of Validity and Reliability of a Teacher-Made Test.” Journal of English Education and Teaching 3, no. 4 (December 6, 2019): 522–32. https://doi.org/10.33369/jeet.3.4.522-532.

Suryadinata, Achmad Naufal Irsyadi, Zarkasi, Moh Hasyim Rosyidi, and Yuana Dwi Agustina. “The Challenge of Mastering Arabic Language and Its Relation to the Ability to Read Kitab Kuning among Students in Tapal Kuda Islamic Boarding School.” RETORIKA: Jurnal Ilmu Bahasa 10, no. 3 (2024). https://ejournal.warmadewa.ac.id/index.php/jret/article/view/10488.

Susanto, Susanto, Ayu Desrani, Apri Wardana Ritonga, and Yohan Rubiyantoro. “Improving Students’ Creative Thinking In Learning Arabic Through HOTS Based Project Based Learning Model.” An Nabighoh 24, no. 1 (June 28, 2022): 1. https://doi.org/10.32332/an-nabighoh.v24i1.3924.

Yoo, Hanwook [Henry], and Ronald K. Hambleton. “Digital Module 08: Foundations of Operational Item Analysis Https://Ncme.Elevate.Commpartners.Com.” Educational Measurement: Issues and Practice 38, no. 3 (September 2019): 116–17. https://doi.org/10.1111/emip.12289.

Zakkiyah, Maulia Yasminah, Nurriya Maghfirah Fidyahwati, Ahmad Tarajjil Ma’suq, and Novita Anggraini. “Assessment Design and Analysis of Arabic Reading Skills Instructional Materials.” IJIE International Journal of Islamic Education 3, no. 1 (June 28, 2024): 31–46. https://doi.org/10.35719/ijie.v3i1.2000.

Zulaeha, Zulaeha, and Musdalifah Musdalifah. “Strengthening Students’ Arabic Writing Skills Through Insya’ Muwajjah in Higher Education.” AL-ISHLAH: Jurnal Pendidikan 14, no. 1 (February 1, 2022): 591–602. https://doi.org/10.35445/alishlah.v14i1.1103.