A 3x3 LATIN SQUARE COUNTERBALANCED DESIGN FOR COMPARING INSTRUCTIONAL TREATMENTS IN PHYSICS EDUCATION

Authors

  • Febriana Eka Damayanti UIN Syarif Hidayatullah Jakarta
  • Iwan Permana Suwarna UIN Syarif Hidayatullah Jakarta

DOI:

https://doi.org/10.59052/edufisika.v11i2.56090

Keywords:

Critical Thinking, Counterbalanced Design, Latin Square, Physics Learning

Abstract

Conventional quasi-experimental designs in physics education are prone to bias due to differences in characteristics between classes, order-of-instruction effects, and the influence of prior treatments. This study introduces and demonstrates a balanced 3×3 Latin Square design as an alternative methodological framework to enhance internal validity in physics education experiments based on in Indonesia. Using a quasi-experimental rotation at SMAN 4 South Tangerang (N = 102; three 11th-grade classes), each class received three instructional treatments in rotation: (A) Problem-Based Learning (PBL) aided by Zep Quiz, (B) Zep Quiz without PBL, and (C) conventional lectures, on three subtopics of Dynamics of Motion. Students’ critical thinking skills were assessed using an instrument based on Facione’s six indicators. Data were analyzed using prerequisite tests (Shapiro-Wilk, Levene, Mauchly), Repeated-Measures ANOVA, Latin Square ANOVA, and a carryover effect test. Three main findings emerged: (1) a significant period effect (p = 0.028, η² = 0.035) indicated a gradual increase in scores over time; (2) the class factor accounted for the majority of the variance (F = 153.051, p < 0.001, η² = 0.736), far exceeding the effect of the learning method (F = 0.678, p = 0.058, η² = 0.005); and (3) the carryover effect was not significant (F = 0.000, p = 1.000), confirming the effectiveness of rotation in minimizing cross-treatment contamination. These findings establish the 3×3 Latin square design as a practical and bias-controlled framework for research on physics education in whole-class settings.

References

Abrami, P. C., Bernard, R. M., Borokhovski, E., Waddington, D. I., Wade, C. A., & Persson, T. (2015). Strategies for teaching students to think critically: A meta-analysis. Review of Educational Research, 85(2), 275–314. https://doi.org/10.3102/0034654314551063

Afriani, L., Mutmainnah, & Sunarni. (2025). Understanding the design of research and development methods in the field of education. Jurnal Pendidikan dan Pengembangan, 6(1), 1–5.

Anantasia, G., & Rindrayani, S. R. (2025). Metodologi penelitian quasi eksperimen. ADIBA: Journal of Education, 5(2), 183–192.

Arni, K. J. (2025). Systematic review of research trends on critical thinking skills in physics learning. International Journal of Science Education and Science, 2(1), 43–52. [https://doi.org/10.56566/ijses.v2i1.262](https://doi.org/10.56566/ijses.v2i1.262)

Bellhäuser, H., Dignath, C., & Theobald, M. (2023). Daily automated feedback enhances self-regulated learning: A longitudinal randomized field experiment. Frontiers in Psychology, 14, Article 1125873. [https://doi.org/10.3389/fpsyg.2023.1125873](https://doi.org/10.3389/fpsyg.2023.1125873)

Blanca, M. J., Alarcón, R., Arnau, J., Bono, R., & Bendayan, R. (2023). Repeated measures ANOVA and adjusted F-tests when sphericity is violated: Which procedure is best? Frontiers in Psychology, 14, 1192453. https://doi.org/10.3389/fpsyg.2023.1192453

Chen, O., Paas, F., & Sweller, J. (2023). A cognitive load theory approach to defining and measuring task complexity through element interactivity. Educational Psychology Review, 35, Article 63. [https://doi.org/10.1007/s10648-023-09782-w](https://doi.org/10.1007/s10648-023-09782-w)

Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). SAGE Publications.

D’Onofrio, B. M., Sjölander, A., Lahey, B. B., Lichtenstein, P., & Öberg, A. S. (2020). Accounting for confounding in observational studies. Annual Review of Clinical Psychology, 16, 25–48. [https://doi.org/10.1146/annurev-clinpsy-032816-045030](https://doi.org/10.1146/annurev-clinpsy-032816-045030)

Docktor, J. L., & Mestre, J. P. (2014). Synthesis of discipline-based education research in physics. Physical Review Special Topics-Physics Education Research, 10(2), 020119. https://doi.org/10.1103/PhysRevSTPER.10.020119

Facione, P. A. (1990). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction (The Delphi Report) (ERIC Document No. ED315423). American Philosophical Association.

Fadly, M., Simatupang, H. N., Simanjorang, A. S., Purba, J. M., Mihardi, S., & Bunawan, W. (2025). Analisis kemampuan berpikir kritis siswa pada pelajaran fisika tingkat menengah atas. SAKOLA - Journal of Sains Cooperative Learning and Law, 2(1), 434-436.

Field, A. (2018). Discovering statistics using IBM SPSS statistics (5th ed.). SAGE Publications.

Ho, J., & Min, J. (2025). Causal inference in counterbalanced within-subjects designs. arXiv. (https://arxiv.org/abs/2505.03937)

Kirk, R. E. (2013). Experimental design: Procedures for the behavioral sciences (4th ed.). SAGE Publications.

Kulnik, S. T., Carrozzo, A. E., & Crutzen, R. (2025). Persistent carry-over in a two-period randomised crossover design for behavioural interventions without the expectation of return to baseline after intervention cessation. Trials, 26, 561. https://doi.org/10.1186/s13063-025-09358-9

Lim, C.-Y., & In, J. (2021). Considerations for crossover design in clinical study. Korean Journal of Anesthesiology, 74(4), 293–299. https://doi.org/10.4097/kja.21165

Livingston Jr, G. C., & Rayner, J. C. W. (2024). Rank tests for the latin square design. Communications in Statistics - Theory and Methods, 1–14. https://doi.org/10.1080/03610926.2024.2387249

Luthfiyani, F., & Suwarna, I. P. (2026). A counterbalanced quasi-experiment comparing Problem-Based Learning with Zep Quiz, Zep Quiz alone, and traditional lecture on critical thinking in high school mechanics. Jurnal Penelitian Ilmu Pendidikan, 19(1), 23-36. (https://doi.org/10.21831/jpip.v19i1.97460)

Mayer, R. E. (2024). The past, present, and future of the cognitive theory of multimedia learning. Educational Psychology Review, 36, Article 8. [https://doi.org/10.1007/s10648-023-09842-1](https://doi.org/10.1007/s10648-023-09842-1)

Montgomery, D. C. (2017). Design and analysis of experiments (9th ed.). John Wiley & Sons.

Newsom, J. T. (n.d.). Precautions with within-subjects experimental designs [PDF handout]. Portland State University. https://web.pdx.edu/~newsomj/uvclass/ho_counterbalancing.pdf

OECD. (2023). PISA 2022 results (Volume I): The state of learning and equity in education. OECD Publishing. https://doi.org/10.1787/53f23881-en

Parker, K., Nunns, M., Xiao, Z., Ford, T., Stallard, P., Kuyken, W., Axford, N., & Ukoumunne, O. C. (2025). Patterns of intra-cluster correlation coefficients in school-based cluster randomised controlled trials of interventions for improving social-emotional functioning outcomes in pupils: A secondary data analysis of five UK-based studies. BMC Medical Research Methodology, 25, Article 120. (https://doi.org/10.1186/s12874-025-02574-6)

Richardson, J. T. E. (2018). The use of Latin-square designs in educational and psychological research. Educational Research Review, 24, 84–97. https://doi.org/10.1016/j.edurev.2018.03.002

Rusmana, A., Maulidya, R. A., Awalludin, M. R., & Mulyanti, D. (2025). Pengaruh penggunaan model pembelajaran PjBL dengan bantuan media pembelajaran Zep Quis terhadap kemampuan berpikir kritis dan kreatif siswa sekolah dasar kelas tinggi. Journal of Elementary Education, 8(4), 774–780.

Santi, L. M. (2020). Implementasi pembelajaran matematika dengan model problem-based learning di sekolah menengah pertama (kajian meta-analisis) (Skripsi Sarjana, Universitas Pendidikan Indonesia).

Sari, S., Zuhdi, M., & Taufik, M. (2025) Pengaruh model problem-based learning berbantuan media digital terhadap kemampuan berpikir kritis dan hasil belajar fisika. Jurnal Ilmiah Profesi Pendidikan, 10(3), 2234–2238. https://doi.org/10.29303/jipp.v10i3.3798.

Stallasch, S. E., Lüdtke, O., Artelt, C., & Brunner, M. (2021). Multilevel design parameters to plan cluster-randomized intervention studies on student achievement in elementary and secondary school. Journal of Research on Educational Effectiveness, 14(1), 172–206. [https://doi.org/10.1080/19345747.2020.1823539](https://doi.org/10.1080/19345747.2020.1823539)

Sule, A. S., Lantana, B., Nuhu, U. M., Nasir, U., & Amina, A. N. (2025). Latin square design: A methodological innovation in educational research for improved teaching and learning. FUDMA Journal of Sciences, 9(5), 328–334. [https://doi.org/10.33003/fjs-2025-0905-3686](https://doi.org/10.33003/fjs-2025-0905-3686)

Tiruneh, D. T., De Cock, M., Weldeslassie, A. G., Elen, J., & Janssen, R. (2017). Measuring critical thinking in physics: Development and validation of a critical thinking test in electricity and magnetism. International Journal of Science and Mathematics Education, 15(4), 663–682. https://doi.org/10.1007/s10763-016-9723-0

Tiruneh, D. T., Verburgh, A., & Elen, J. (2014). Effectiveness of critical thinking instruction in higher education: A systematic review of intervention studies. Higher Education Studies, 4(1), 1–17. https://doi.org/10.5539/hes.v4n1p1

Yehezkiel, G., & Sapta, A. (2025). Efektivitas media pembelajaran digital terhadap minat dan motivasi belajar siswa di SMP (Systematic Literature Review). Jurnal Teknologi Pendidikan dan Pembelajaran (JTPP), 3(2), 386–395. https://jurnal.kopusindo.com/index.php/jtpp/index.

Zhang, L. (2025). Estimating school and teacher effects on students’ academic performance using multilevel models with three or more levels: A literature review. Discover Education, 4, Article 4. [https://doi.org/10.1007/s44217-024-00392-4](https://doi.org/10.1007/s44217-024-00392-4)

Zulfiani, Z., Suwarna, I. P., & Sumantri, M. F. (2020). Science adaptive assessment tool: Kolb's learning style profile and student's higher order thinking skill level. Jurnal Pendidikan IPA Indonesia, 9(2), 194–207. https://doi.org/10.15294/jpii.v9i2.23840

Downloads

Published

2026-08-01

How to Cite

A 3x3 LATIN SQUARE COUNTERBALANCED DESIGN FOR COMPARING INSTRUCTIONAL TREATMENTS IN PHYSICS EDUCATION . (2026). EduFisika: Jurnal Pendidikan Fisika, 11(2), 209-221. https://doi.org/10.59052/edufisika.v11i2.56090