VALIDITY AND RELIABILITY ANALYSIS OF AN ENVIRONMENTALLY INTEGRATED SCIENCE LITERACY TEST USING RASCH MODEL

Authors

  • Desi Adhari Program Studi Tadris Fisika, FTIK, IAIN Palangka Raya
  • Santiani Santiani IAIN Palangka Raya
  • Sri Fatmawati IAIN Palangka Raya

DOI:

https://doi.org/10.59052/edufisika.v10i1.42136

Keywords:

Environment, Rasch Model, Science Literacy

Abstract

This study aims to create an integrated assessment instrument for environmental science literacy focused on thermodynamics for high school students. The research methodology employed is Research and Development (R&D), specifically using the 4-D model. Participants in the study included 34 twelfth-grade students from Public High School 1 Palangka Raya. The validity of the instrument was evaluated using Aiken's index with input from five expert validators, while its quality was analyzed through the Rasch Model. The findings indicate that the instrument demonstrates unidimensionality, with a Raw Variance Explained by Measures value of 43.2%, confirming its effectiveness in assessing the desired aspects of science literacy. Out of the 16 items analyzed, 13 were considered fitting. The instrument also showed exceptionally high reliability, boasting a Cronbach's Alpha value of 0.89, and most items exhibited no gender bias, according to the Differential Item Functioning (DIF) test. This instrument's development is anticipated to assist students in connecting scientific concepts to real-world scenarios, enhance their science literacy skills, and raise awareness of the importance of environmental conservation, particularly regarding peatland preservation in Palangka Raya.

Downloads

Download data is not yet available.

References

Adhari, D., Santiani, Yuliani, H., & Nasir, M. (2024). Alat Ukur Literasi Sains Pada Pembelajaran IPA Integrasi Lahan Gambut. Sistematika Literatur Review. Kappa Journal, 8(2), 278–285. https://doi.org/10.29408/kpj.v8i2.26075

Aiken, L. R. (1985). Three Coefficients for Analyzing the Reliability and Validity of Ratings. Educational and Psychological Measurement, 131–142.

Arikunto, S. (2010). Prosedur Penelitian: Suatu Pendekatan Praktik. Rineka Cipta.

Arikunto, S. (2019). Prosedur Penelitian: Suatu Pendekatan praktik. Rineka Cipta.

Bond, T. G., & Fox, C. M. (2015). Applying the Rasch Model: Fundamental Measurement in the Human Sciences (3rd ed.). Routledge.

Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch Analysis in the Human Science. Springer.

Bybee, R. W. (2013). The Case for STEM Education: Challenges and Opportunities. NSTA Press.

Danielis, M., Dato, M., Zanotti, R., Biasin, E., & Veronese, M. (2025). Development and validation of the infant nursing assessment scale: Results from exploratory factor analysis and Rasch modeling. Journal of Pediatric Nursing, 81, 55–62. https://doi.org/10.1016/j.pedn.2025.01.018

De Hemptinne, J. C., Kontogeorgis, G. M., Dohrn, R., Economou, I. G., Ten Kate, A., Kuitunen, S., Fele Žilnik, L., De Angelis, M. G., & Vesovic, V. (2022). A View on the Future of Applied Thermodynamics. Industrial and Engineering Chemistry Research, 61(39), 14664–14680. https://doi.org/10.1021/acs.iecr.2c01906

Ding, C. (2022). Examining the context of better science literacy outcomes among U.S. schools using visual analytics: A machine learning approach. International Journal of Educational Research Open, 3. https://doi.org/10.1016/j.ijedro.2022.100191

Fagerlund, J., Palsa, L., & Mertala, P. (2025). Exploration of domains of educational purpose in K-12 data literacy education research. In Educational Research Review (Vol. 46). Elsevier Ltd. https://doi.org/10.1016/j.edurev.2024.100663

Fuadi, H., Robbia, A. Z., Jamaluddin, J., & Jufri, A. W. (2020). Analisis Faktor Penyebab Rendahnya Kemampuan Literasi Sains Peserta Didik. Jurnal Ilmiah Profesi Pendidikan, 5(2), 108–116. https://doi.org/10.29303/jipp.v5i2.122

Holzberger, D., Reinhold, S., Lüdtke, O., & Seidel, T. (2020). A meta-analysis on the relationship between school characteristics and student outcomes in science and maths–evidence from large-scale studies. In Studies in Science Education (Vol. 56, Issue 1, pp. 1–34). Routledge. https://doi.org/10.1080/03057267.2020.1735758

Kain, C., Koschmieder, C., Matischek-Jauk, M., & Bergner, S. (2024). Mapping the landscape: A scoping review of 21st century skills literature in secondary education. In Teaching and Teacher Education (Vol. 151). Elsevier Ltd. https://doi.org/10.1016/j.tate.2024.104739

Kemendikbud. (2019). Hasil PISA Indonesia 2018: Akses makin meluas, saatnya tingkatkan kualitas. Https://Www.Kemdikbud.Go.Id/Main/Blog/2019/12/Hasil-Pisa-Indonesia-2018-Akses-Makin-Meluas-Saatnya-Tingkatkan-Kualitas.

Krisanda, Y. I., & Harjito. (2021). Penggunaan Rasch Model Untuk Analisis Instrumen Tes Literasi Sains Materi Hidrolisis Garam. CiE, 10(2). http://journal.unnes.ac.id/sju/index.php/chemined

Mardapi, D. (2017). Pengukuran, Penilaian, dan Evaluasi Pendidikan. Parama Publishing.

Nisrina, N., Jufri, A. W., & Gunawan, G. (2020). Pengembangan LKPD Berbasis Blended Learning untuk Meningkatkan Literasi Sains Peserta Didik. Jurnal Pijar Mipa, 15(3), 192–199. https://doi.org/10.29303/jpm.v15i3.1880

Nurlatifah, S., Supriatna, M., Yudha, E. S., & Julius, A. (2023). Pengembangan Instrumen Kecakapan Kerja Mahasiswa (Rasch Model Analisis). GUIDENA: Jurnal Ilmu Pendidikan, Psikologi, Bimbingan Dan Konseling, 13(4), 792. https://doi.org/10.24127/gdn.v13i4.8604

OECD. (2019). PISA 2018 Assessment and Analytical Framework. OECD. https://doi.org/10.1787/b25efab8-en

OECD. (2023). PISA 2022 Results (Volume I). OECD. https://doi.org/10.1787/53f23881-en

OECD. (2024). Science performance (PISA). Https://Www.Oecd.Org/En/Data/Indicators/Science-Performance-Pisa.Html.

Rahmati, U., Wahdi Ginting, F., Novita, N., Sakdiah, H., Cot Tengku Nie, J., Muara Batu, K., & Aceh Utara, K. (2024). Pengembangan Instrumen Tes Fisika Berbasis Literasi Sains Pada Materi Gerak Melingkar. In GRAVITASI Jurnal Pendidikan Fisika dan Sains (Vol. 7, Issue 01).

Ramli, M., Susanti, B. H., & Yohana, M. P. (2022). Indonesian Students’ Scientific Literacy in Islamic Junior High School. International Journal of STEM Education for Sustainability, 2(1), 53–65. https://doi.org/10.53889/ijses.v2i1.33

Rosana, D., Widodo, E., Setianingsih, W., Setyawarno, D., Hestiana, & Setiadi, Y. (2020). Pengembangan Instrumen Penilaian Model PISA Untuk Mengukur Kemampuan Literasi Sains Peserta Didik SMP. JPSI.

Roshid, M. M., & Haider, M. Z. (2024). Teaching 21st-century skills in rural secondary schools: From theory to practice. Heliyon, 10(9). https://doi.org/10.1016/j.heliyon.2024.e30769

Saraiva, E., Silva, S., Castro, J., Araújo, D., Almeida, C., & Azevedo, M. M. (2025). Students’ summer internships in a research centre: The impact on scientific literacy and the choice of a career in the STEM fields. Heliyon, 11(4). https://doi.org/10.1016/j.heliyon.2025.e42472

Setiawan, A. R. (2019). Menyusun instrumen penilaian untuk pembelajaran topik lingkungan berorientasi literasi saintifik. Prosiding Seminar Nasional Fisika, 7–14.

Sheptian, R., Ocy, D. R., Triana, D. D., Dwi, L., & Wahyuni, U. (2024). JISAE (Journal of Indonesian Student Assessment and Evaluation) Developing a Validated Essay-Based Assessment Instrument to Measure Science Literacy in Energy Topics. 10(2). https://doi.org/10.21009/JISAE

Soeharto, S., Martono, M., Hairida, H., Akhmetova, A., Arifiyanti, F., Benő, C., & Charalambos, C. (2024). The metacognitive awareness of reading strategy among pre-service primary teachers and the possibility of rating improvement using Rasch analysis. Studies in Educational Evaluation, 80. https://doi.org/10.1016/j.stueduc.2023.101319

Sugiyono. (2012). Metode Penelitian Pendekatan Kuantitatif, Dan R&D. Alfabeta.

Sugiyono. (2014). Metode Penelitian Pendidikan Pendekatan Kuantitatif, Kualitatif, dan R&D. Alfabeta.

Sumintono, B., & Widhiarso, W. (2014). Aplikasi Model Rasch: untuk Penelitian Ilmu-Ilmu Sosial (B. Trim, Ed.). Trim Komunikata.

Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch pada Asesmen Pendidikan. Trim Komunikata.

Supriadi, Sani, A., & Putra Setiawan, I. (2020). Integrasi Nilai Karakter dalam Pembelajaran Keterampilan Menulis Siswa. Journal of Management, 3(3), 84–93. https://doi.org/10.2568/yum.v3i3.778

Sutrisna, N. (2021). Analisis Kemampuan Literasi Sains Peserta Didik Sma Di Kota Sungai Penuh. 1(12), 2683.

Thiagarajan, S., & Semmel, S. (1974). Cercular Model of R&D. Leadership Training.

Tudor, G. (2023). The Interdisciplinary Approach of Physics and Its Role in Environmental Protection. EGU General Assembly 2023, 24–28.

Wahyuni, A. (2022). Detection of Gender Biased Using Dif (Differential Item Functioning) Analysis on Item Test of School Examination Yogyakarta. In Jurnal Evaluasi Pendidikan (Vol. 13, Issue 1).

Wilsa, A. W., Rusilowati, A., Susilaningsih, E., Jaja, J., & Nurpadillah, V. (2023). Validity, reliability, and item characteristics of cell material science literacy assessment instruments. Jurnal Penelitian Dan Evaluasi Pendidikan, 27(2), 177–188. https://doi.org/10.21831/pep.v27i2.61577

Yusmar, F., & Fadilah, R. E. (2023). Analisis Rendahnya Literasi Sains Peserta Didik Indonesia: Hasil PISA Dan Faktor Penyebab. LENSA (Lentera Sains): Jurnal Pendidikan IPA, 13(1), 11–19. https://doi.org/10.24929/lensa.v13i1.283

Downloads

Published

2025-03-30

How to Cite

Adhari, D., Santiani, S., & Fatmawati, S. (2025). VALIDITY AND RELIABILITY ANALYSIS OF AN ENVIRONMENTALLY INTEGRATED SCIENCE LITERACY TEST USING RASCH MODEL. EduFisika: Jurnal Pendidikan Fisika, 10(1), 38–53. https://doi.org/10.59052/edufisika.v10i1.42136

Issue

Vol. 10 No. 1 (2025): EduFisika: Jurnal Pendidikan Fisika Volume 10 Nomor 1 April 2025

Section

Articles

License

Copyright (c) 2025 Desi Adhari, Santiani Santiani, Sri Fatmawati

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.