Item Analysis of Mathematical Critical Thinking Skills Using the Rasch Model in Elementary School Students
DOI:
https://doi.org/10.17977/um065.v7.i3.2027.4Keywords:
Critical thinking, Elementary school students, Facione, Mathematics, Rasch modelAbstract
The validity and reliability of educational assessment instruments are fundamental prerequisites for accurate measurement of student competencies. This study evaluates the psychometric quality of a 12-item mathematical critical thinking test grounded in the Facione framework, encompassing Interpretation, Analysis, Inference, and Evaluation, administered to 49 Grade V elementary school students (n = 49) using the Rasch measurement model via Winsteps software. Four psychometric dimensions were assessed simultaneously: (1) construct validity through item fit statistics (Outfit MNSQ, Outfit ZSTD, Pt Measure Corr); (2) internal consistency and reliability (KR-20, Person and Item Reliability, Separation Indices); (3) item discrimination (Pt Measure Corr classification); and (4) item difficulty hierarchy (logit scale measures and Wright Person–Item Map). Results show that 10 of 12 items (83.3%) met Rasch fit criteria, yielding construct-valid measures for all four critical thinking indicators. KR-20 = 0.79 (Good), Person Reliability = 0.79–0.82 (Adequate–Good), and Item Reliability = 0.95 (Excellent). Person Separation (1.96–2.12) confirmed differentiation of ≥2 ability strata; Item Separation (4.37–4.61) confirmed a well-differentiated difficulty hierarchy. All retained items exhibited Moderate difficulty (logit range: −0.66 to +0.23), confirming optimal targeting of the respondent population. Two items failed due to low Point Measure Correlation (0.21–0.22) and were excluded. The final 10-item instrument meets international psychometric standards and is recommended for use in authentic mathematical critical thinking assessment.
References
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012
Alfayez, M. Q. E., Aladwan, S. Q. A., & Shaheen, H. R. A. (2022). The effect of a training program based on mathematical problem-solving strategies on critical thinking among seventh-grade students. Frontiers in Education, 7, 870524. https://doi.org/10.3389/feduc.2022.870524
Bond, T. G., Yan, Z., & Heene, M. (2021). Applying the Rasch model: Fundamental measurement in the human sciences (4th ed.). Routledge. https://doi.org/10.4324/9780429030499
Boone, W. J., & Noltemeyer, A. (2017). Rasch analysis: A primer for school psychology researchers and practitioners. Cogent Education, 4(1), 1416898. https://doi.org/10.1080/2331186X.2017.1416898
Chang, I. (2023). Early numeracy and literacy skills and their influences on fourth-grade mathematics achievement: A moderated mediation model. Large-Scale Assessments in Education, 11(1), 18. https://doi.org/10.1186/s40536-023-00168-6
Dwyer, C. P., Hogan, M. J., & Stewart, I. (2014). An integrated critical thinking framework for the 21st century. Thinking Skills and Creativity, 12, 43–52. https://doi.org/10.1016/j.tsc.2014.02.002
Facione, P. A. (2015). Critical thinking: What it is and why it counts (2015 update). Insight Assessment.
Guler, N., & Uyanik, G. K. (2021). Comparison of classical test theory and item response theory in terms of item parameters. European Journal of Educational Research, 10(1), 395–407. https://doi.org/10.12973/eu-jer.10.1.395
Hambleton, R. K., & Jones, R. W. (1993). Comparison of classical test theory and item response theory and their applications to test development. Educational Measurement: Issues and Practice, 12(3), 38–47. https://doi.org/10.1111/j.1745-3992.1993.tb00543.x
Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi. (2022). Keputusan Kepala BSKAP No. 033/H/KR/2022 tentang capaian pembelajaran pada pendidikan anak usia dini, jenjang pendidikan dasar, dan jenjang pendidikan menengah pada Kurikulum Merdeka. Kemendikbudristek.
Kuder, G. F., & Richardson, M. W. (1937). The theory of the estimation of test reliability. Psychometrika, 2(3), 151–160. https://doi.org/10.1007/BF02288391
Lv, X., Zhou, J., & Ren, X. (2025). The bidirectional relationship between critical thinking and academic achievement is independent of general cognitive ability: A three-year longitudinal study on elementary school children. Learning and Individual Differences, 120, 102666. https://doi.org/10.1016/j.lindif.2025.102666
Mapeala, R., & Siew, N. M. (2015). The development and validation of a test of science critical thinking for fifth graders. SpringerPlus, 4, Article 741. https://doi.org/10.1186/s40064-015-1535-0
OECD. (2023). PISA 2022 results (Volume I): The state of learning and equity in education. OECD Publishing. https://doi.org/10.1787/53f23881-en
Rittle-Johnson, B., Matthews, P. G., Taylor, R. S., & McEldoon, K. L. (2011). Assessing knowledge of mathematical equivalence: A construct-modeling approach. Journal of Educational Psychology, 103(1), 85–104. https://doi.org/10.1037/a0021334
Santos, S., Cadime, I., Viana, F. L., Prieto, G., Chaves-Sousa, S., Spinillo, A. G., & Ribeiro, I. (2016). An application of the Rasch model to reading comprehension measurement. Psicologia: Reflexão e Crítica, 29, Article 38. https://doi.org/10.1186/s41155-016-0044-6
Soeharto, S., & Csapó, B. (2022). Evaluating item difficulty patterns for assessing student problem-solving abilities in science: Insights from Rasch analysis. Frontiers in Education, 7, 1021063. https://doi.org/10.3389/feduc.2022.1021063
Sujatmika, S., Sutarno, Masykuri, M., & Prayitno, B. A. (2025). Applying the Rasch model to measure students' critical thinking skills on the science topic of the human circulatory system. Eurasia Journal of Mathematics, Science and Technology Education, 21(4), em2622. https://doi.org/10.29333/ejmste/16221
Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan Rasch pada asesmen pendidikan. Trim Komunikata.
Tavakol, M., & Dennick, R. (2013). Psychometric evaluation of a knowledge based examination using Rasch analysis: An illustrative guide: AMEE Guide No. 72. Medical Teacher, 35(1), e838–e848. https://doi.org/10.3109/0142159X.2012.737488
Tesio, L., & Scarano, S. (2024). Interpreting results from Rasch analysis 2: Advanced model applications. Disability and Rehabilitation, 46(4), 604–617. https://doi.org/10.1080/09638288.2023.2169772
Wang, Q., & Abdullah, A. H. (2024). Enhancing students' critical thinking through mathematics in higher education: A systemic review. SAGE Open, 14(3), 1–15. https://doi.org/10.1177/21582440241275651
Wyse, A. E., & Mapuranga, R. (2009). Differential item functioning analysis using Rasch item information functions. International Journal of Testing, 9(4), 333–357. https://doi.org/10.1080/15305050903352040
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Yogina Pratiwi, Prihantini, Abubakar
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
