Validity and reliability of cognitive tests study and development of elementary curriculum using Rasch model

Muhammad Erfan(1*), Mohammad Archi Maulyda(2), Ida Ermiana(3), Vivi Rachmatul Hidayati(4), Arif Widodo(5),

(1) Universitas Mataram
(2) Universitas Mataram
(3) Universitas Mataram
(4) Universitas Mataram
(5) Universitas Mataram
(*) Corresponding Author

Abstract


The instrument for measuring knowledge in the subject of Elementary School Curriculum Study and Development has been created to measure students' understanding of teacher candidates in applying concepts, implications and curriculum development at the elementary school level. In order to make reliable and feasible instrument for measuring students knowledge in the subject of Elementary School Curriculum Study and Development, this study aims to produce empirical evidence about the validity and reliability of test instruments using the Rasch model analysis. The study was conducted by testing 20 items on 142 elementary school teacher candidate at one of the State Universities in the City of Mataram, West Nusa Tenggara. The validity and reliability of the instrument were measured by the Rasch analysis model using the Winstep program. The one-dimensional testing of 20 items has a variance measured at 42.7% which exceeds the minimum points of 40.0% desired by the Rasch model. The reliability index of the respondents was 0.65 and the item reliability index was 0.98. All items show a positive value for Point Measure Correlation (PMC) in terms of item polarity which means there is no conflict between the item and the construct being measured. Outfit Mean Square value also shows that all items that almost all items have an MNSQ Outfit value smaller than 1.5 which means the measurement value can be said to be productive except for item 13 (3.77) and item 16 (3.77). Both of these items need to be re-examined because they have problems in measuring their validity. The results of this study have proven that the knowledge measurement test instrument in the Elementary School Curriculum Study and Development course has validity and reliability values that meet and are empirically feasible to be used in measuring Basic School Curriculum Study and Development knowledge for prospective teacher students.

Keywords


validity; reliability; curriculum; analysis; Rasch model

Full Text:

Fulltext PDF

References


Andrich, D. (1988). Rasch models for measurement. Sage Publication Inc.

Anjos, D. B. M. dos, Rodrigues, R. C. M., Padilha, K. M., Pedrosa, R. B. dos S., & Gallani, M. C. B. J. (2016). Reliability and construct validity of the instrument to measure the impact of valve heart disease on the patient’s daily life. Revista Latino-Americana de Enfermagem, 24(6), 12–25. https://doi.org/10.1590/1518-8345.0624.2730

Ariffin, S. R., Omar, B., Isa, A., & Sharif, S. (2010). Validity and reliability multiple intelligent item using rasch measurement model. Procedia - Social and Behavioral Sciences, 9, 729–733. https://doi.org/10.1016/j.sbspro.2010.12.225

Arifin, Z. (2017). Kriteria instrumen dalam suatu penelitian. Jurnal Theorems (the Original Research of Mathematics), 2(1), 28–36. https://doi.org/10.31949/th.v2i1.571

Azwar, S. (2015). Reliabilitas dan validitas. Pustaka Pelajar.

Bond, T. G., & Fox, C. M. (2007). Applying the Rasch model: Fundamental measurement in the human sciences. Psychology Press.

Erfan, M., Maulyda, M. A., Hidayati, V. R., Astria, F. P., & Ratu, T. (2020). Analisis kualitas soal kemampuan membedakan rangkaian seri dan paralel melalui teori tes klasik dan model rasch. Indonesian Journal Of Educational Research and Review, 3(1), 11. https://doi.org/10.23887/ijerr.v3i1.24080

Fahruna, Y., & Fahmi, M. (2017). Validitas dan reliabilitas konstruk pengukuran perpustakaan ideal berbasis pemakai dengan pendekatan LIBQUAL. Jurnal Ekonomi Bisnis Dan Kewirausahaan, 6(2), 161. https://doi.org/10.26418/jebik.v6i2.22989

Fitriani, C., AR, M., & Usman, N. (2017). Kompetensi profesional guru dalam pengelolaan pembelajaran di MTs Muhammadiyah Banda Aceh. Jurnal Administrasi Pendidikan : Program Pascasarjana Unsyiah, 5(2), 88–95. http://e-repository.unsyiah.ac.id/JAP/article/view/8246

Gronlund, N. E., Linn, R. L., & Miller, M. D. (2009). Measurement and evaluation in teaching (10th ed.). Macmillan Publishing Co., Inc.

Hapsari, S. I., Sugiyarto, K. H., & Kosaka, N. (2018). An evaluation of application of information technology and communication of learning science with the theme of solar system. Psychology, Evaluation, and Technology in Educational Research, 1(1), 41. https://doi.org/10.33292/petier.v1i1.18

Hasibuan, H. (2016). Studi kompetensi guru Pendidikan Agama Islam dalam pelaksanaan evaluasi pembelajaran. Forum Paedagogik, 08(02), 14–38. https://doi.org/10.24952/paedagogik.v8i2.571

Hayati, S., & Lailatussaadah, L. (2016). Validitas dan reliabilitas instrumen pengetahuan pembelajaran aktif, kreatif dan menyenangkan (pakem) menggunakan model rasch. Jurnal Ilmiah Didaktika, 16(2), 169. https://doi.org/10.22373/jid.v16i2.593

Jailani, M. K. M. (2011). Manual pengenalan pengukuran rasch & winsteps. Fakulti Pendidikan Universiti Kebangsaan Malaysia.

Kadir, A. (2015). Menyusun dan menganalisis tes hasil belajar. AL-TA’DIB : Jurnal Kajian Ilmu Kependidikan, 8(2), 70–81. https://doi.org/10.31332/atdb.v8i2.411

Khaeruman, K., & Saefullah, E. (2017). Analisis lokasi usaha terhadap penjualan pedagang buah-buahan di sepanjang jalan ciptayasa serang. Sains Manajemen, 3(2), 15–37. https://doi.org/10.30656/sm.v3i2.255

Kintner, E. K., & Sikorskii, A. (2008). Reliability and construct validity of the Participation in Life Activities Scale for children and adolescents with asthma: an instrument evaluation study. Health and Quality of Life Outcomes, 6(1), 43. https://doi.org/10.1186/1477-7525-6-43

Magdalena, I., Crismaningrum, O. D., Chairunnisa, N., & Jannah, N. (2020). Evaluasi pembelajaran dalam keterampilan berbicarapada mata pelajaran bahasa Indonesia siswa kelas IV SDN Balaraja i. Jurnal Halaqah, 2(3), 349–356. https://doi.org/10.5281/zenodo.3940559

Misbach, I. H., & Sumintono, B. (2014). Pengembangan dan validasi instrumen “persepsi siswa tehadap karakter moral guru” di Indonesia dengan model rasch. PROCEEDING Seminar Nasional Psikometri, 148–162.

Nurfaizin, N. (2019). Uji validitas konstruk self control terhadap prokrastinasi akademik dengan metode confirmatory factor analysis (CFA). Jurnal Pengukuran Psikologi Dan Pendidikan Indonesia (JP3I), 7(1), 41–48. https://doi.org/10.15408/jp3i.v7i1.12107

Nuswowati, M., Binadja, A., Soeprodjo, S., & Ifada, K. E. N. (2010). Pengaruh validitas dan reliabilitas butir soal ulangan akhir semester bidang studi kimia terhadap pencapaian kompetensi. Jurnal Inovasi Pendidikan Kimia, 4(1), 566–573. https://journal.unnes.ac.id/nju/index.php/JIPK/article/view/1314

Pallant, J. (2010). SPSS survival manual a step by step guide to data analysis using the SPSS Program. McGraw-Hill Education.

Prijowuntato, S. W. (2020). Evaluasi pembelajaran. Sanata Dharma University Press.

Rosseni, D., Ahmad, M., M.Faisal, K., Sidek, N. M., Karim, A. A., Johar, N. A., Jusoff, K., Zakarian, M. S., Mastor, K. A., & Ariffin, S. R. (2009). Kesahan dan kebolehpercayaan soal selidik gaya e-pembelajaran (eLSE) versi 8.1 menggunakan model pengukuran rasch. Journal of Quality Measurement and Analysis, 5(1), 15–27. http://journalarticle.ukm.my/1930/

Searing, L. M. (2008). Family functioning scale validation: A Rasch analysis. University of Illinois.

Setyosari, H. P. (2013). Metode penelitian pendidikan & pengembangan. Prenadamedia Group.

Sulistyawati, S., & Guntur, G. (2019). Sports education learning program evaluation in senior high school. Psychology, Evaluation, and Technology in Educational Research, 2(1), 22. https://doi.org/10.33292/petier.v2i1.31

Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan Rasch pada assessment pendidikan. Trim Komunikata.

Wahyudi, W. (2010). Assesment Pembelajaran Berbasis Portofolio di Sekolah. Jurnal Visi Ilmu Pendidikan, 2(1), 288–296. https://doi.org/10.26418/jvip.v2i1.370

Wahyuningsih, E. T. (2015). Analisis butir soal tes objektif buatan guru ulangan semester ganjil mata pelajaran ekonomi kelas X di SMA Negeri 1 Mlati tahun ajaran 2013/2014. Universitas Negeri Yogyakarta.

Widyaningsih, S. W., & Yusuf, I. (2018). Analisis soal modul laboratorium fisika sekolah I menggunakan racsh model. Gravity : Jurnal Ilmiah Penelitian Dan Pembelajaran Fisika, 4(1). https://doi.org/10.30870/gravity.v4i1.3116

Yusup, F. (2018). Uji validitas dan reliabilitas instrumen penelitian kuantitatif. Jurnal Tarbiyah : Jurnal Ilmiah Kependidikan, 7(1). https://doi.org/10.18592/tarbiyah.v7i1.2100




DOI: http://dx.doi.org/10.33292/petier.v3i1.51

Article Metrics

Abstract view : 1090 times
Fulltext PDF - 98 times

Refbacks

  • There are currently no refbacks.


Copyright (c) 2020 Psychology, Evaluation, and Technology in Educational Research

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Our Journal indexed by:

Psychology, Evaluation, and Technology in Educational Research
ISSN: 2622-5506

Creative Commons License
Psychology, Evaluation, and Technology in Educational Research is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. Based on a work at http://petier.org/index.php/PETIER.

 

PETiER Stats