Implementation of The Critical Thinking Skills Measurement Instrument Integrated with the Critical and Creative Thinking in Research-Based Learning Model
DOI:
https://doi.org/10.17977/um065.v7.i2.2027.2Keywords:
CCTRbL, Critical thinking skills, CTSMIAbstract
This study addresses the limited availability of critical thinking assessment instruments that comprehensively measure university students' competencies in higher education. Existing FRISCO-based instruments are constrained by suboptimal internal consistency, a predominant focus on cognitive dimensions, limited assessment of critical thinking dispositions, and potential subjectivity arising from inconsistent interpretation of assessment criteria. To overcome these limitations, the Critical Thinking Skills Measurement Instrument (CTSMI) integrated with the Critical and Creative Thinking Research-based Learning (CCTRbL) model was developed. This study aimed to examine the validity, effectiveness, implementation fidelity, and user acceptability of the integrated CTSMI. A mixed-methods approach combining a pre-experimental design and Collaborative Action Research (CAR) was employed, involving four lecturers and a hundred undergraduate students. Expert validation by specialists in psychology, linguistics, and educational evaluation produced mean scores of 77.0, 77.8, and 72.0, respectively, confirming the instrument's validity. Empirical testing yielded a Cronbach's alpha coefficient of 0.734, while Corrected Item–Total Correlation values demonstrated that all items met the validity criterion (r ≥ 0.30). Implementation of the CTSMI integrated with the CCTRbL model resulted in a mean critical thinking score of 68, indicating a high level of performance. The findings demonstrate that the CTSMI is a valid and reliable instrument for assessing and promoting university students' critical thinking skills. Furthermore, the instrument exhibited strong user acceptability and was implemented effectively, supporting its applicability as a comprehensive assessment tool for higher education learning environments.
References
Agustin, A. (2021). Critical and creative thinking for young learners: Asking questions and giving answers in online learning context. UICELL Conference Proceeding, 5, 33–40. https://journal.uhamka.ac.id/index.php/uicell/article/view/8287
Akmam, A., Anshari, R., Jalinus, N., & Amran, A. (2019). Factors influencing the critical and creative thinking skills of college students in computational physics courses. Journal of Physics: Conference Series, 1317(1), 012172. https://doi.org/10.1088/1742-6596/1317/1/012172 DOI: https://doi.org/10.1088/1742-6596/1317/1/012172
Andanti, M. (2024). Penerapan pembelajaran Agama Buddha berbasis kearifan dan budaya lokal di Sekolah Minggu Buddha (SMB) Adhicitta Suruh, Tengaran, dan Susukan. Scholaria: Jurnal Pendidikan dan Kebudayaan, 14(1), 15–25. https://doi.org/10.24246/j.js.2024.v14.i01.p15-25 DOI: https://doi.org/10.24246/j.js.2024.v14.i01.p15-25
Anders, P. L., Stellrecht, E. M., Davis, E. L., & McCall, W. D. (2019). A systematic review of critical thinking instruments for use in dental education. Journal of Dental Education, 83(4), 381–397. https://doi.org/10.21815/JDE.019.043 DOI: https://doi.org/10.21815/JDE.019.043
Asmara, R., Zubaidah, S., Mahanal, S., & Sari, N. (2023). Levels of inquiry and Reading-Questioning-Answering (LoIRQA) to enhance high school students’ critical and creative thinking. International Journal of Instruction, 16(3), 325–342. https://doi.org/10.29333/iji.2023.16318a DOI: https://doi.org/10.29333/iji.2023.16318a
Binkley, D., Campoe, O. C., Alvares, C., Carneiro, R. L., Cegatta, Í., & Stape, J. L. (2017). The interactions of climate, spacing and genetics on clonal Eucalyptus plantations across Brazil and Uruguay. Forest Ecology and Management, 405, 271–283. https://doi.org/10.1016/j.foreco.2017.09.050 DOI: https://doi.org/10.1016/j.foreco.2017.09.050
Brookfield, S. D., Rudolph, J., & Yeo, E. (2019). The power of critical thinking in learning and teaching: An interview with Professor Stephen D. Brookfield. Journal of Applied Learning and Teaching, 2(2), 76–90. https://doi.org/10.37074/jalt.2019.2.2.11 DOI: https://doi.org/10.37074/jalt.2019.2.2.11
Butler, H. A. (2024). Predicting everyday critical thinking: A review of critical thinking assessments. Journal of Intelligence, 12(2), 16. https://doi.org/10.3390/jintelligence12020016 DOI: https://doi.org/10.3390/jintelligence12020016
Ennis, R. (2011). Critical thinking: Reflection and perspective part II. Inquiry: Critical Thinking Across the Disciplines, 26(2), 5–19. https://doi.org/10.5840/inquiryctnews201126215 DOI: https://doi.org/10.5840/inquiryctnews201126215
Ennis, R. H. (1993). Critical thinking assessment. Theory Into Practice, 32(3), 179–186. https://doi.org/10.1080/00405849309543594 DOI: https://doi.org/10.1080/00405849309543594
Facione, P. A., Facione, N. C., & Gittens, C. A. (2020). What the data tell us about human reasoning. In D. Fasko, Jr. & F. Fair (Eds.), Critical thinking and reasoning: Theory, development, instruction, and assessment (pp. 272–297). Leiden, the Netherlands: Brill Sense. https://doi.org/10.1163/9789004444591_016 DOI: https://doi.org/10.1163/9789004444591_016
Gibson, C. M., Howard, M. L., & Haight, R. C. (2025). Validation of an instrument to assess student pharmacist self-authorship. Currents in Pharmacy Teaching and Learning, 17(2), 102264. https://doi.org/10.1016/j.cptl.2024.102264 DOI: https://doi.org/10.1016/j.cptl.2024.102264
Gokhale, A. A., & Almerico, G. M. (2021). Assessing critical thinking in higher education: A systematic review. Journal of Education and Learning (EduLearn), 10(5), 22–33.
Gultom, D. A. (2024). Implementasi model pembelajaran berbasis konstruktivisme untuk meningkatkan kemampuan komunikasi matematik dan kemandirian siswa. Nucleus, 5(1), 23–28. https://doi.org/10.37010/nuc.v5i1.1509 DOI: https://doi.org/10.37010/nuc.v5i1.1509
Kryshtanovych, M., Kryshtanovych, S., Stepanenko, L., Brodiuk, Y., & Fast, A. (2021). Methodological approach to determining the main factors for the development of creative thinking in students of creative professions. Creativity Studies, 14(2), 391–404. https://doi.org/10.3846/cs.2021.14806 DOI: https://doi.org/10.3846/cs.2021.14806
Ku, K. Y. L. (2009). Assessing students’ critical thinking performance: Urging for measurements using multi-response format. Thinking Skills and Creativity, 4(1), 70–76. https://doi.org/10.1016/j.tsc.2009.02.001 DOI: https://doi.org/10.1016/j.tsc.2009.02.001
Leasa, M., Batlolona, J. R., & Talakua, M. (2021). Elementary students’ creative thinking skills in science in the Maluku Islands, Indonesia. Creativity Studies, 14(1), 74–89. https://doi.org/10.3846/cs.2021.11244 DOI: https://doi.org/10.3846/cs.2021.11244
Marin, L. M., & Halpern, D. F. (2011). Pedagogy for developing critical thinking in adolescents: Explicit instruction produces greatest gains. Thinking Skills and Creativity, 6(1), 1–13. https://doi.org/10.1016/j.tsc.2010.08.002 DOI: https://doi.org/10.1016/j.tsc.2010.08.002
Mawardi, Agustin, A., & Murti, H. A. S. (2026). An innovative method of measuring students’ critical thinking skills in higher education. Journal of Educational and Social Research, 16(2), 431–446. https://doi.org/10.36941/jesr-2026-0304 DOI: https://doi.org/10.36941/jesr-2026-0304
Mawardi, M. (2018). Designing the implementation of model and instructional media. Scholaria: Jurnal Pendidikan dan Kebudayaan, 8(1), 26–40. https://doi.org/10.24246/j.js.2018.v8.i1.p26-40 DOI: https://doi.org/10.24246/j.js.2018.v8.i1.p26-40
Mawardi, M., Wardani, N. S., Hardini, A. T. A., & Kristin, F. (2019). Model desain pembelajaran tematik terpadu kontekstual untuk meningkatkan kebermaknaan belajar siswa SD. Scholaria: Jurnal Pendidikan dan Kebudayaan, 9(1), 48–61. https://doi.org/10.24246/j.js.2019.v9.i1.p48-61 DOI: https://doi.org/10.24246/j.js.2019.v9.i1.p48-61
Mawardi, Satyawati, S. T., & Agustin, A. (2025). Fostering twenty-first-century skills: An analysis of the critical and creative thinking in research-based learning model. The International Journal of Learning in Higher Education, 32(2), 47–65. https://doi.org/10.18848/2327-7955/CGP/v32i02/47-65 DOI: https://doi.org/10.18848/2327-7955/CGP/v32i02/47-65
OECD. (2019). An OECD learning framework 2030. In G. Bast, E. G. Carayannis, & D. F. J. Campbell (Eds.), The future of education and labor (pp. 23–35). Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-030-26068-2_3 DOI: https://doi.org/10.1007/978-3-030-26068-2_3
Park, J. H., Li, Y., & Niu, W. (2023). Revisiting creativity and critical thinking through content analysis. Journal of Creativity, 33(2), 100056. https://doi.org/10.1016/j.yjoc.2023.100056 DOI: https://doi.org/10.1016/j.yjoc.2023.100056
Paul, R., & Elder, L. (2019). The nature and functions of critical & creative thinking (3rd ed.). Lanham, MD: Rowman & Littlefield.
Payan-Carreira, R., Sacau-Fontenla, A., Rebelo, H., Sebastião, L., & Pnevmatikos, D. (2022). Development and validation of a critical thinking assessment-scale short form. Education Sciences, 12(12), 938. https://doi.org/10.3390/educsci12120938 DOI: https://doi.org/10.3390/educsci12120938
Prasanti, A. I., Mawardi, & Winanto, A. (2026). Developing Petualangan Siaga: A TGT-based board game to enhance students’ cooperation skills in civic education. Jurnal Pembelajaran, Bimbingan, dan Pengelolaan Pendidikan, 6(10), 5. https://doi.org/10.17977/um065.v6.i10.2026.5 DOI: https://doi.org/10.17977/um065.v6.i10.2026.5
Putri, A. S., Prasetyo, Z. K., Purwastuti, L. A., Prodjosantoso, A. K., & Putranta, H. (2023). Effectiveness of STEAM-based blended learning on students’ critical and creative thinking skills. International Journal of Evaluation and Research in Education, 12(1), 44–52. https://doi.org/10.11591/ijere.v12i1.22506 DOI: https://doi.org/10.11591/ijere.v12i1.22506
Schmaltz, R. M., Jansen, E., & Wenckowski, N. (2017). Redefining critical thinking: Teaching students to think like scientists. Frontiers in Psychology, 8, 459. https://doi.org/10.3389/fpsyg.2017.00459 DOI: https://doi.org/10.3389/fpsyg.2017.00459
Shaw, A., Liu, O. L., Gu, L., Kardonova, E., Chirikov, I., Li, G., … Loyalka, P. (2020). Thinking critically about critical thinking: Validating the Russian HEIghten® critical thinking assessment. Studies in Higher Education, 45(9), 1933–1948. https://doi.org/10.1080/03075079.2019.1672640 DOI: https://doi.org/10.1080/03075079.2019.1672640
Sondergeld, T. A., & Johnson, C. C. (2019). Development and validation of a 21st century skills assessment: Using an iterative multimethod approach. School Science and Mathematics, 119(6), 312–326. https://doi.org/10.1111/ssm.12355 DOI: https://doi.org/10.1111/ssm.12355
Southworth, J. (2022). Bridging critical thinking and transformative learning: The role of perspective-taking. Theory and Research in Education, 20(1), 44–63. https://doi.org/10.1177/14778785221090853 DOI: https://doi.org/10.1177/14778785221090853
Stephenson, L. (2023). Collective creativity and wellbeing dispositions: Children’s perceptions of learning through drama. Thinking Skills and Creativity, 47, 101188. https://doi.org/10.1016/j.tsc.2022.101188 DOI: https://doi.org/10.1016/j.tsc.2022.101188
Sumarni, W., & Kadarwati, S. (2020). Ethno-STEM project-based learning: Its impact to critical and creative thinking skills. Jurnal Pendidikan IPA Indonesia, 9(1), 11–21. https://doi.org/10.15294/jpii.v9i1.21754 DOI: https://doi.org/10.15294/jpii.v9i1.21754
Yavuz Güler, Ç. (2021). The Turkish adaptation of the Triangular Relationship Inventory: The validity and reliability study. The Family Journal. Advance online publication. https://doi.org/10.1177/10664807211023002 DOI: https://doi.org/10.1177/10664807211023002
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Mawardi, Yohana Setiawan, Suhandi Astuti
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
