Skip to main content
Online ISSN: 2622-5506
Articles

E-learning and higher order thinking: Impact of STEM-based approach

Abdul Rahman (1), Yayat Suharyat (2), Tomi Apra Santosa (3), Efendi Abdullah (4), Pahmi Rizal (5)
(1) Universitas Sebelas Maret, Indonesia (2) Universitas Islam 45 Bekasi, Indonesia (3) Akademi Teknik Adikarya, Indonesia (4) Universiti Teknikal Malaysia Melaka, Malaysia (5) Universiti Brunei Darussalam, Brunei Darussalam
DOI: https://doi.org/10.33292/petier.v6i1.173

Keywords

E-learning STEM Higher Order Thinking Skill SLR Meta-analysis HOTS

Abstract

Please Many studies have described meta-analysis on the overall effect of e-learning influence in learning. However, there has been no meta-analysis of the overall effect of STEM-based e-learning on Higher Order Thinking Skills (HOTS).  The purpose of this study investigates the effect of STEM-based e-learning on students' critical thinking skills in Indonesia. This type of research is a Systematic Literature Review (SL) and meta-analysis. Data sources came from 12 national and international journals published in 2018-2023. The process of searching for data sources through Google Scholar, ScienceDirect, Wiley, Eric, and Springer. Data analysis used the Hedge formula to calculate effect size with the help of the JSAP application. The findings show that the effect size value (ES = 0.84) is very high. This explains that STEM-based e-learning provides a very high positive impact and is effective in improving students' Higher Order Thinking Skills (HOTS). Furthermore, HOTS characteristics do not cause heterogeneity in the results of STEM-based e-learning research on students' Higher Order Thinking Skills. The findings suggest that educators should choose STEM-based e-learning as one of the learning models to improve students' Higher Order Thinking skills in Indonesia

References

  1. Akatsuka, Y. (2019). Awareness of critical thinking attitudes and English language skills: The effects of questions involving higher-order thinking. Journal of Pan-Pacific Association of Applied Linguistics, 23(1), 59–84. https://doi.org/10.25256/PAAL.23.2.4
  2. Aköz, O., Çeliker, H. D., & Genç, H. (2022). A course content designed in accordance with the 5E teaching model within the scope of STEM learning approach in environmental education course: My smart greenhouse. European Journal of Education Studies, 9(4), 274–295. https://doi.org/10.46827/ejes.v9i4.4263
  3. Aljaser, A. M. (2019). The effectiveness of e-learning environment in developing academic achievement and the attitude to learn English among primary students. Turkish Online Journal of Distance Education, 20(2), 176–194. https://doi.org/10.17718/tojde.557862
  4. Alsowat, H. (2016). An EFL flipped classroom teaching model: effects on English language higher-order thinking skills, student engagement and satisfaction. Journal of Education and Practice, 7(9), 108–121. https://www.learntechlib.org/p/195067/
  5. Aurora, A., & Effendi, H. (2019). Pengaruh Penggunaan Media Pembelajaran E-learning terhadap Motivasi Belajar Mahasiswa di Universitas Negeri Padang. JTEV (JURNAL TEKNIK ELEKTRO DAN VOKASIONAL, 05(02), 11–16.
  6. Azid, N., Ali, R. M., El Khuluqo, I., Purwanto, S. E., & Susanti, E. N. (2022). Higher order thinking skills, school-based assessment and students’ mathematics achievement: Understanding teachers’ thoughts. International Journal of Evaluation and Research in Education (IJERE), 11(1), 290. https://doi.org/10.11591/ijere.v11i1.22030
  7. Baji, F., Azadeh, F., Sabaghinejad, Z., & Zalpour, A. (2022). Determinants of e-learning acceptance amongst Iranian postgraduate students. Journal of Global Education and Research, 6(2), 181–191. https://doi.org/10.5038/2577-509X.6.2.1089
  8. Bakarman, A., & Almezeini, N. (2021). Factors influencing students ’ acceptance of e-learning platforms in primary and secondary schools in Saudi Arabia. International Conference E-Learning, 20, 23–33.
  9. Berestova, A., Burdina, G., Lobuteva, L., & Lobuteva, A. (2022). Academic motivation of university students and the factors that influence it in an e-learning environment. Electronic Journal of E-Learning, 20(2), pp201-210. https://doi.org/10.34190/ejel.20.2.2272
  10. Bismala, L., Manurung, Y. H., & Siregar, G. (2022). The impact of e-learning quality and students ’ self -efficacy toward the satisfaction in the using of e-learning. Malaysian Online Journal of Educational Technology, 10(2), 141–150.
  11. Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis (2nd ed.). Wiley.
  12. Çalişir, E. Ç. (2022). Reflections of metaverse-based education on e-learning. EJERCongress 2022 Conference Proceedings Internet, 103–115.
  13. Caratiquit, L. J., & Caratiquit, K. (2022). Influence of technical support on technology acceptance model to examine the project PAIR e-learning system in distance learning modality. Participatory Educational Research, 9(5), 467–485. https://doi.org/10.17275/per.22.124.9.5
  14. Choirunissa, L. (2016). Pengaruh pembelajaran e-learning terhadap hasil belajar mata kuliah statistics Mahasiswa Tadris Bahasa Inggris Fakultas Tarbiyah IAIN Walisongo. Phenomenon : Jurnal Pendidikan MIPA, 2(1), 7. https://doi.org/10.21580/phen.2012.2.1.416
  15. Dabiriyan-tehrani, H., & Yamini, S. (2021). Systematic review and meta-analysis of Altruistic and Game-playing love. Studies in Psychology, 42(1), 1–46. https://doi.org/10.1080/02109395.2020.1857596
  16. Dewi, K. A. I. D., Suarsana, I. M., & Juniantari, M. (2020). Pengaruh e-learning berbasis rumah belajar terhadap kemampuan berpikir kritis matematika siswa. Wahana Matematika Dan Sains: Jurnal Matematika, Sains, Dan Pembelajarannya, 14(1), 65–77.
  17. El-Aasar, S. A., & Farghali, G. (2022). Predictive study of the factors and challenges affecting the usability of e-learning platforms in the light of COVID-19. International Journal of Education in Mathematics, Science and Technology, 10(3), 568–589. https://doi.org/10.46328/ijemst.2428
  18. Eroğlu, S., & Bektaş, O. (2021). High school students’ views on the 5E-based STEM learning strategies. Acta Didactica Napocensia, 14(2), 203–215. https://doi.org/10.24193/adn.14.2.15
  19. Fadlelmula, F. K., Sellami, A., & Le, K. (2022). STEM learning during the COVID-19 pandemic in Qatar: Secondary school students’ and teachers’ perspectives. EURASIA Journal of Mathematics, Science and Technology Education, 18(6), 1–13. https://doi.org/10.29333/ejmste/12102
  20. Ferdyan, R., Vauzia, V., Zulyusri, Z., Santosa, T. A., & Razak, A. (2021). Model pendidikan lingkungan hidup: Kegiatan pembelajaran pada siswa sebagai bagian dari lingkungan di era new normal. Natural Science: Jurnal Penelitian Bidang IPA Dan Pendidikan IPA, 7(1), 51–61. https://doi.org/10.15548/nsc.v7i1.2453
  21. Ferry, D., Santosa, T., & Kamil, D. (2020). Pengetahuan mahasiswa Institut Agama Islam Negeri Kerinci tentang teori asal usul manusia. BIOEDUCA : Journal of Biology Education, 1(1), 11. https://doi.org/10.21580/bioeduca.v1i1.4945
  22. Fitri, H., Wahyuni, A., & Mustafa, M. (2018). Pengaruh model problrm based learning (PBL) terhadap kemampuan penyelesaian soal-soal higher order thinking skills (HOTS) pada materi gelombang bunyi di SMA Negeri 1 Darul Imarah. Jurnal Ilmiah Mahasiswa (JIM) Pendidikan Fisika, 3(1), 19–23. https://jim.usk.ac.id/pendidikan-fisika/article/view/18613
  23. Friedensen, R., Lauterbach, A., Kimball, E., & Mwangi, C. G. (2018). Students with high-incidence disabilities in STEM: Barriers encountered in postsecondary learning environments. Journal of Postsecondary Education and Disability, 34(1), 77–90.
  24. Gustria, A., & Fauzi, A. (2020). Efektifitas e-modul pembelajaran fisika berbasis stem education terintegrasi materi perubahan iklim terhadap kompetensi peserta didik. Jurnal Pendidikan Fisika, 9(2), 105–111. https://doi.org/10.22611/jpf.v9i2.15803
  25. Hamad, A. L., Abouelnaga, H. M., Metwally, A. B. mohamed, Shan, H. S., & Moawad, N. F. (2022). The importance of e-learning to the students and teachers. Journal of Language and Linguistic Studies, 18(2), 952–968. https://www.jlls.org/index.php/jlls/article/view/4598
  26. Hasibuan, M. P., Sari, R. P., Syahputra, R. A., & Nahadi, N. (2022). Application of Integrated Project-based and STEM-based e-learning tools to improve students’ creative thinking and self-regulation skills. Jurnal Penelitian Pendidikan IPA, 8(1), 51–56. https://doi.org/10.29303/jppipa.v8i1.1050
  27. Hidayah, R. N., Wiyono, K., & Ismet, I. (2022). Effectiveness of using e-learning at STEM-based sound-wave materials to improve collaboration skills of high school students. Berkala Ilmiah Pendidikan Fisika, 10(3), 331. https://doi.org/10.20527/bipf.v10i3.13850
  28. Hodiyanto, H. (2018). Pengaruh model problem based learning terhadap higher order thingking skills (HOTS) matematis siswa. Buana Matematika: Jurnal Ilmiah Matematika Dan Pendidikan Matematika, 8(2), 101–108. https://doi.org/10.36456/buanamatematika.v8i2:.1750
  29. How, R. P. T. K., Zulnaidi, H., & Rahim, S. S. A. (2021). HOTS in quadratic equations: Teaching style preferences and challenges faced by Malaysian teachers. European Journal of Science and Mathematics Education, 10(1), 15–33. https://doi.org/10.30935/scimath/11382
  30. Ibrahim, D. S., & Suardiman, S. P. (2014). Pengaruh penggunaan e-learning terhadap motivasi dan prestasi belajar matematika siswa SD Negeri Tahunan Yogyakarta. Jurnal Prima Edukasia, 2(1), 66. https://doi.org/10.21831/jpe.v2i1.2645
  31. Ichsan, I., Sofianora, A., Desy, D., Suharyat, Y., Santosa, T. A., & Supriyadi, A. (2023). Pengaruh profesionalitas guru matematika dalam meningkatkan kompetensi siswa era revolusi industri 5.0 di Indonesia: Sebuah meta-analisis. Jurnal Math-UMB.EDU, 10(2), 49–58. https://doi.org/10.36085/mathumbedu.v10i2.4868
  32. Ichsan, I., Suharyat, Y., Santosa, T. A., & Satria, E. (2023). Effectiveness of STEM-based learning in teaching 21 st century skills in generation Z student in science learning: A meta-analysis. Jurnal Penelitian Pendidikan IPA, 9(1), 150–166. https://doi.org/10.29303/jppipa.v9i1.2517
  33. Kahar, M. S., Syahputra, R., Arsyad, R. Bin, Nursetiawan, N., & Mujiarto, M. (2021). Design of student worksheets oriented to higher order thinking skills (HOTS) in physics learning. Eurasian Journal of Educational Research, 21(96), 14–29. https://doi.org/10.14689/ejer.2021.96.2
  34. Kareem, A. (2022). Higher-order thinking skills and scientific attitudes components as predictors of scientific creativity among preservice biology teachers. International Journal of Progressive Education, 18(4), 21–30. https://doi.org/10.29329/ijpe.2022.459.2
  35. Karim, M., Antoni, S., Oktarina, K., & Santosa, T. A. (2023). The effect of teacher professionalism in islamic religious education in the era of society 5.0 in Indonesia: A meta-analysis. Jurnal Pendidikan Dan Konseling, 5(2), 1349–1358. https://doi.org/10.31004/jpdk.v5i2.13129
  36. Kim, N. J., Belland, B. R., & Walker, A. E. (2018). Effectiveness of computer-based scaffolding in the context of problem-based learning for STEM education: Bayesian meta-analysis. Educational Psychology Review, 30(2), 397–429. https://doi.org/10.1007/s10648-017-9419-1
  37. Krasodomska, J., Godawska, J., & Krasodomska, J. (2021). E-learning in accounting education : the influence of students ’ characteristics on their engagement and performance characteristics on their engagement and performance. Accounting Education, 4(2), 22–40. https://doi.org/10.1080/09639284.2020.1867874
  38. Kusuma, L., Sukarmin, S., & Supriyanto, A. (2020). The perceptions of teacher and student in senior high school to the needs of STEM-based e-learning in physics learning process. Proceedings of the 4th International Conference on Learning Innovation and Quality Education, 1–7. https://doi.org/10.1145/3452144.3453757
  39. Kusumantara, K. S. (2017). Pengaruh e-learning schoology terhadap hasil belajar simulasi digital dengan model pembelajaran Savi. Jurnal Pendidikan Teknologi Dan Kejuruan, 14(2), 126–135. https://doi.org/10.23887/jptk-undiksha.v14i2.10387
  40. Lee, R., Looi, K. H., Faulkner, M., & Neale, L. (2021). The moderating influence of environment factors in an extended community of inquiry model of e-learning. Asia Pacific Journal of Education, 41(1), 1–15. https://doi.org/10.1080/02188791.2020.1758032
  41. Makhmudah, S., Suyitno, H., & Rusilowati, A. (2021). Mathematics critical thinking ability reviewing from gender and independent learning students in STEM problem-based learning assisted by web e learning school. Unnes Journal of Mathematics Education Research, 10(2), 211–219. https://journal.unnes.ac.id/sju/index.php/ujmer/article/view/49310
  42. Martínez-Torres, M. R., Marín, S. L. T., García, F. B., Vázquez, S. G., Oliva, M. A., & Torres, T. (2008). A technological acceptance of e-learning tools used in practical and laboratory teaching, according to the European higher education area. Behaviour & Information Technology, 27(6), 495–505. https://doi.org/10.1080/01449290600958965
  43. Milner-Bolotin, M., & Marotto, C. C. F. (2018). Parental engagement in children’s STEM education. Part I: Meta-analysis of the literature. Lumat: International Journal of Math, Science and Technology Education, 6(1), 1–10. https://doi.org/10.31129/LUMAT.6.1.292
  44. Mufida, S. N., Sigit, D. V., & Ristanto, R. H. (2020). Integrated project-based e-learning with science, technology, engineering, arts, and mathematics (PjBeL-STEAM): its effect on science process skills. Biosfer, 13(2), 183–200. https://doi.org/10.21009/biosferjpb.v13n2.183-200
  45. Mujib, M., Mardiyah, M., & Suherman, S. (2020). STEM : Pengaruhnya terhadap literasi matematis dan kecerdasan multiple intelligences. Indonesian Journal of Science and Mathematics Education, 3(1), 66–73. https://doi.org/10.24042/ijsme.v3i1.5448
  46. Murthy, C. S. H. N., & Mathur, G. (2008). Designing e-learning programs for rural social transformation and poverty reduction. Turkish Online Journal of Distance Education, 9(1), 169–179. https://dergipark.org.tr/en/pub/tojde/issue/16915/176484
  47. Musna, R. R., Juandi, D., & Jupri, A. (2021). A meta-analysis study of the effect of problem-based learning model on students’ mathematical problem solving skills. Journal of Physics: Conference Series, 1882(1), 012090. https://doi.org/10.1088/1742-6596/1882/1/012090
  48. Noor, M. E., Hardyanto, W., & Wibawanto, H. (2017). Penggunaan E-learning dalam pembelajaran berbasis proyek di SMA Negeri 1 Jepara. Innovative Journal of Curriculum and Educational Technology, 6(1), 17–26. https://doi.org/10.15294/IJCET.V6I1.15572
  49. Noviyani, A., Maison, M., & Syaiful, S. (2022). The influence of PJBL-Stem and PBL-based on the learning motivation of the students on the mathematical creative thinking skills. Psychology, Evaluation, and Technology in Educational Research, 4(1), 25–35. https://doi.org/10.33292/petier.v4i1.115
  50. Nudin, F. A., Rufi’i, R., & Walujo, D. A. (2021). Pengaruh e-learning, pembelajaran langsung, dan faktor gaya kognitif terhadap hasil belajar prakarya kewirausahaan. Edcomtech: Jurnal Kajian Teknologi Pendidikan, 6(2), 222–235. https://doi.org/10.17977/um039v6i12021p222
  51. Nurochman, R., & Diniya, D. (2022). Pengaruh penerapan model pembelajaran problem based learning (PBL) dengan pendekatan blended learning terhadap higher order thinking skill (HOTS) siswa SMP/MTs pada materi sistem gerak manusia. Journal of Natural Science Learning, 1(1), 61–67. https://jom.uin-suska.ac.id/index.php/JNSL/article/view/14
  52. Nuryatin, A., Mukhibad, H., & Tusyanah, T. (2022). Effectiveness of online learning at universities: Do sociocultural differences matter? European Journal of Educational Research, 11(4), 2153–2166. https://doi.org/10.12973/eu-jer.11.4.2153
  53. Oktarina, K., Suhaimi, S., Santosa, T. A., Razak, A., Irdawati, I., Ahda, Y., Lufri, L., & Putri, D. H. (2021). Meta-analysis: The effectiveness of using blended learning on multiple intelligences and student character education during the Covid-19 period. IJECA (International Journal of Education and Curriculum Application), 4(3), 184–192. https://doi.org/10.31764/ijeca.v4i3.5505
  54. Putranta, H., Supahar, S., Dwandaru, W. S. B., Warsono, W., & Abdulfattah, A. (2021). The effect of smartphone usage intensity on high school students’ higher order thinking skills in physics learning. Journal of Turkish Science Education, 18(3), 421–438. https://www.tused.org/index.php/tused/article/view/836
  55. Rahman, A., Santosa, T. A., Suharyat, Y., Aprilisia, S., & Suhaimi, S. (2023). The effectiveness of AI-based blended learning on student scientific literacy. LITERACY : International Scientific Journals Of Social, Education and Humaniora, 2(1), 141–150. https://doi.org/10.56910/literacy.v2i1.542
  56. Razak, A., Santosa, T. A., Lufri, L., & Zulyusri, Z. (2021). Meta-analisis: Pengaruh soal HOTS (higher order thinking skill) terhadap kemampuan literasi sains dan lesson study siswa pada materi ekologi dan lingkungan pada masa pandemi Covid-19. Bioedusiana: Jurnal Pendidikan Biologi, 6(1), 79–87. https://doi.org/10.37058/bioed.v6i1.2930
  57. Rintayati, P., Lukitasari, H., & Syawaludin, A. (2021). Development of two-tier multiple choice test to assess indonesian elementary students’ higher-order thinking skills. International Journal of Instruction, 14(1), 555–566. https://doi.org/10.29333/iji.2021.14133a
  58. Riyanti, R. (2020). Efektivitas penggunaan perangkat pembelajaran project based learning (PjBL) terintegrasi STEM berbasis e-learning untuk meningkatkan kemampuan berpikir kreatif. DWIJA CENDEKIA: Jurnal Riset Pedagogik, 4(2), 206. https://doi.org/10.20961/jdc.v4i2.45276
  59. Saepuzaman, D., Retnawati, H., Istiyono, E., & Haryanto, H. (2021). Can innovative learning affect students’ HOTS achievements? A meta-analysis study. Pegem Journal of Education and Instruction, 11(4), 290–305. https://doi.org/10.47750/pegegog.11.04.28
  60. Saleem, M., Kamarudin, S., Shoaib, H. M., & Nasar, A. (2023). Influence of augmented reality app on intention towards e-learning amidst COVID-19 pandemic. Interactive Learning Environments, 31(5), 3083–3097. https://doi.org/10.1080/10494820.2021.1919147
  61. Santosa, T. A., Razak, A., Lufri, L., Zulyusri, Z., Fradila, E., & Arsih, F. (2021). Meta-analisis: Pengaruh bahan ajar berbasis pendekatan STEM pada pembelajaran ekologi. Journal of Digital Learning and Education, 1(01), 1–9. https://doi.org/10.52562/jdle.v1i01.24
  62. Santosa, T. A., Sepriyani, E. M., & Razak, A. (2021). Analisis e-learning dalam pembelajaran evolusi mahasiswa pendidikan biologi selama pandemi Covid-19. Jurnal Edumaspul, 5(1), 66–70. https://ummaspul.e-journal.id/maspuljr/article/view/1027
  63. Saraç, H. (2018). The effect of science, technology, engineering and mathematics-STEM educational practices on students’ learning outcomes: A meta-analysis study. Turkish Online Journal of Educational Technology - TOJET, 17(2), 125–142. http://www.tojet.net/volumes/v17i2.pdf#page=135
  64. Sari, I. P., Rahmah, P. J., & Arifah, M. N. (2021). Pengaruh e-learning terhadap HOTS (higher order thinking skills) mahasiswa Universitas Islam Indonesia. At-Thullab : Jurnal Mahasiswa Studi Islam, 2(2), 455–468. https://doi.org/10.20885/tullab.vol2.iss2.art6
  65. Saryanto, S., Sumiharsono, R., Ramadhan, S., & Suprapto, E. (2020). The analysis of instrument quality to measure the students higher order thinking skill in physics learning. Turkish Journal of Science Education, 17(4), 520–527. https://doi.org/10.36681/tused.2020.42
  66. Shanti, M. R. S., Istiyono, E., & Munadi, S. (2022). The effectiveness of learning to improve students’ higher-order thinking skills. Cypriot Journal of Educational Sciences, 17(5), 1576–1587. https://doi.org/10.18844/cjes.v17i5.7220
  67. Sigit, D. V., Ristanto, R. H., & Mufida, S. N. (2022). Integration of project-based e-learning with STEAM: An innovative solution to learn ecological concept. International Journal of Instruction, 15(3), 23–40. https://doi.org/10.29333/iji.2022.1532a
  68. Suharyat, Y., Ichsan, I., Satria, E., Santosa, T. A., & Amalia, K. N. (2022). Meta-analisis Penerapan model pembelajaran problem based learning untuk meningkatkan ketrampilan abad-21 siswa dalam pembelajaran IPA Universitas Pahlawan Tuanku Tambusai. Jurnal Pendidikan Dan Konseling, 4(5), 5081–5088. https://doi.org/10.31004/jpdk.v4i5.7455
  69. Suherman, Prananda, M. R., Proboningrum, D. I., Pratama, E. R., Laksono, P., & Amiruddin. (2020). Improving higher order thinking skills (HOTS) with project based learning (PjBL) model assisted by Geogebra. Journal of Physics: Conference Series, 1467(1), 012027. https://doi.org/10.1088/1742-6596/1467/1/012027
  70. Suparman, S., Yohannes, Y., & Arifin, N. (2021). Enhancing mathematical problem-solving skills of indonesian junior high school students through problem-based learning : A systematic review and meta-analysis. Al-Jabar: Jurnal Pendidikan Matematika, 12(1), 1–16. https://ejournal.radenintan.ac.id/index.php/al-jabar/article/view/8036
  71. Supriyadi, A., Desy, D., Suharyat, Y., Santosa, T. A., & Sofianora, A. (2023). The effectiveness of STEM-integrated blended learning on Indonesia student scientific literacy: A meta-analysis. International Journal of Education and Literature, 2(1), 41–48. https://doi.org/10.55606/ijel.v2i1.53
  72. Sury, K., Wiyono, K., & Siahaan, S. M. (2022). Effectiveness of using e-learning at STEM-based physics learning to improve communication skills of high school students. Jurnal Ilmiah Pendidikan Fisika, 6(3), 539. https://doi.org/10.20527/jipf.v6i3.5781
  73. Syafryadin, S., Wardhana, D. E. C., Noermanzah, N., Agus, R., & Awaluddin, A. (2022). Students’ perspective and problems in implementing higher order thinking skill (HOTS) in speaking for presentation class. Journal of Language and Linguistic Studies, 18(1), 477–487. https://doi.org/10.52462/jlls.196
  74. Takiddin, T., Jalal, F., & Neolaka, A. (2020). Improving higher order thinking skills through project-based learning in primary schools. TARBIYA: Journal of Education in Muslim Society, 7(1), 16–28. https://doi.org/10.15408/tjems.v7i1.14052
  75. Tsaparlis, G. (2020). Higher and lower-order thinking skills: The case of chemistry revisited. Journal of Baltic Science Education, 19(3), 467–483. https://doi.org/10.33225/jbse/20.19.467
  76. Tyas, M. A., Nurkamto, J., & Marmanto, S. (2020). Cultivating students’ higher-order thinking skills in efl classes: The role of the teacher and the textbook. International Online Journal of Education and Teaching (IOJET), 7(1), 267–276. https://iojet.org/index.php/IOJET/article/view/773
  77. Wardani, N. E., Kurwidaria, F., & Supriyadi, F. (2020). Higher order thinking skills dalam pembelajaran Bahasa dan Sastra Indonesia di sekolah menengah pertama Kota Madiun. Lingua Didaktika: Jurnal Bahasa Dan Pembelajaran Bahasa, 14(1), 29. https://doi.org/10.24036/ld.v14i1.108330
  78. Widyaningsih, S. W., Yusuf, I., Prasetyo, Z. K., & Istiyono, E. (2021). The development of the HOTS test of physics based on modern test theory: Question modeling through e-learning of Moodle LMS. International Journal of Instruction, 14(4), 51–68. https://doi.org/10.29333/iji.2021.1444a
  79. Wijayanto, T., Supriadi, B., & Nuraini, L. (2020). Pengaruh model pembelajaran project based learning dengan pendekatan STEM terhadap hasil belajar siswa SMA. Jurnal Pembelajaran Fisika, 9(3), 113. https://doi.org/10.19184/jpf.v9i3.18561
  80. Wiyono, K., Sury, K., Hidayah, R. N., Nazhifah, N., Ismet, I., & Sudirman, S. (2022). STEM-based e-learning: implementation and effect on communication and collaboration skills on wave topic. Jurnal Penelitian & Pengembangan Pendidikan Fisika, 8(2), 259–270. https://doi.org/10.21009/1.08208
  81. Yaniawati, R. P. (2013). Pengaruh e-learning untuk meningkatkan daya matematik mahasiswa. Jurnal Cakrawala Pendidikan, 31(3), 381–393. https://doi.org/10.21831/cp.v0i3.1137
  82. Yusoff, W. M. W., & Seman, S. C. (2018). Teachers’ Knowledge of higher order thinking and questioning skills: A case study at a primary school in Terengganu, Malaysia. International Journal of Academic Research in Progressive Education and Development, 7(2). https://doi.org/10.6007/IJARPED/v7-i2/4120
  83. Zeng, Z., Yao, J., Gu, H., & Przybylski, R. (2018). A meta-analysis on the effects of STEM education on students’ abilities. Science Insights Education Frontiers, 1(1), 3–16. https://doi.org/10.15354/sief.18.re005
  84. Zulkifli, Z., Supriyadi, A., Satria, E., & Santosa, T. A. (2022). Meta-analysis: The effectiveness of the integrated STEM technology pedagogical content knowledge learning model on the 21st century skills of high school students in the science department. International Journal of Education and Literature, 1(2), 68–76. https://doi.org/10.55606/ijel.v1i2.32
  85. Zulyusri, Z., Desy, D., Santosa, T. A., & Yulianti, S. (2022). Meta-analysis: The effect of the technological pedagogical content knowledge (TPACK) model through online learning on biology learning outcomes, learning effectiveness, and 21st century competencies of post-COVID-19 students and teachers. International Journal of Progressive Sciences and Technologies, 34(2), 285. https://doi.org/10.52155/ijpsat.v34.2.4631
  86. Zulyusri, Z., Elfira, I., Lufri, L., & Santosa, T. A. (2023). Literature study: utilization of the PjBL model in science education to improve creativity and critical thinking skills. Jurnal Penelitian Pendidikan IPA, 9(1), 133–143. https://doi.org/10.29303/jppipa.v9i1.2555
  87. Zulyusri, Z., Santosa, T. A., Festiyed, F., Yerimadesi, Y., Yohandri, Y., Razak, A., & Sofianora, A. (2023). Effectiveness of STEM learning based on design thinking in improving critical thinking skills in science learning: A meta-analysis. Jurnal Penelitian Pendidikan IPA, 9(6), 112–119. https://doi.org/10.29303/jppipa.v9i6.3709