Development of instruments for DIVAYANA evaluation model

Dewa Gede Hendra Divayana(1*), P Wayan Arta Suyasa(2), Ni Ketut Widiartini(3),

(1) Universitas Pendidikan Ganesha
(2) Universitas Pendidikan Ganesha
(3) Universitas Pendidikan Ganesha
(*) Corresponding Author


The purpose of this research showed a valid DIVAYANA evaluation model instruments were used to evaluate the implementation of e-learning. This research approach was the development of evaluation instruments. The evaluation instruments developed were in the form of interview guides and questionnaires. The interview guidelines that resulted were related to several DIVAYANA evaluation components, included: the Description component, Input component, Verification component, and Yack component. Questionnaires were generated on several DIVAYANA evaluation components, included: the Verification component, Action component, and Yack component. The subjects involved in the content validity test of the interview guidelines were two experts, including an informatics education expert and an educational evaluation expert. The content validity tests of questionnaires were conducted by six experts, including three education evaluation experts and three informatics education experts. The content validity calculation process of the interview guidelines used the Gregory formula, while the content validity of the questionnaires used Lawshe’s CVR formula. The content validity average of interview guidelines on the Description, Input, Verification, and Yack components was 0.882 so it was included in the very good category. The content validity average of questionnaires on the Verification, Action, and Yack components was 0.774 so it was in a good category. The implication of this research is the realization of valid measuring instruments that can be used in evaluating the implementation of e-learning.


Instruments; Interview Guidelines; Questionnaires; Content Validity; DIVAYANA Model.

Full Text:

Fulltext PDF


Aldapit, E., & Suharjana, S. (2019). CIPP evaluation model for the coaching program of running athletes. Psychology, Evaluation, and Technology in Educational Research, 1(2).

Ardi, Z., Syahril, S., & Anwar, M. (2020). Evaluation of digital simulation learning based e-learning in SMK Negeri 2 Padang. International Journal of Educational Dynamics, 2(1), 188–198.

Arifin, Z., Kartono, K., & Supriyadi, S. (2018). Development of authentic assessment instrument for performance in learning mathematics in linear program. Journal of Research and Educational Research Evaluation, 7(2), 154–162.

Barteit, S., Guzek, D., Jahn, A., Bärnighausen, T., Jorge, M. M., & Neuhann, F. (2020). Evaluation of e-learning for medical education in low- and middle-income countries: A systematic review. Computers & Education, 145, 103726.

Divayana, D. G. H. (2020). Utilization of DIVAYANA formula in evaluating of suitable platforms for online learning in the social distancing. International Journal of Interactive Mobile Technologies (IJIM), 14(20), 50.

Erfan, M., Maulyda, M. A., Ermiana, I., Hidayati, V. R., & Widodo, A. (2020). Validity and reliability of cognitive tests study and development of elementary curriculum using Rasch model. Psychology, Evaluation, and Technology in Educational Research, 3(1).

Fitriyanto, J. N., Widjanarko, D., & Khumaedi, M. K. (2019). Validity and reliability test of assessment instrument of the suitability of electric power steering media. Journal of Vocational and Career Education, 4(1).

Ghazali, N. H. M. (2016). A reliability and validity of an instrument to evaluate the school-based assessment system: A pilot study. International Journal of Evaluation and Research in Education (IJERE), 5(2), 148–157.

Ghazali, N., Nordin, M. S., Hashim, S., & Hussein, S. (2018). Measuring content validity: Studentsr self-efficacy and meaningful learning in massive open online course (MOOC) scale. Proceedings of the International Conference on Education in Muslim Society (ICEMS 2017).

Guspatni, G., & Kurniawati, Y. (2018). Validity and reliability testing of an e-learning questionnaire for chemistry instruction. IOP Conference Series: Materials Science and Engineering, 335, 012102.

Hapsari, S. I., Sugiyarto, K. H., & Kosaka, N. (2018). An evaluation of application of information technology and communication of learning science with the theme of solar system. Psychology, Evaluation, and Technology in Educational Research, 1(1), 41.

Hung, J.-L., & Yang, D. (2015). The validation of an instrument for evaluating the effectiveness of professional development program on teaching online. Journal of Educational Technology Development and Exchange, 8(1).

Ismanto, I. (2016). Aspect of language on a qualitative analysis of student’s evaluation instrument. QIJIS (Qudus International Journal of Islamic Studies), 4(2), 218.

Kadir, J. S., Zaim, M., & Refnaldi, R. (2019). Developing instruments for evaluating validity, practicality, and effectiveness of the authentic assessment for speaking skill at junior high school. Proceedings of the Sixth of International Conference on English Language and Teaching (ICOELT 2018).

Mahendra, I. W. E., Jayantika, I. G. N. A. T., Sumandya, I. W., Suarni, N. M., Ariawati, N. W., Sugiharni, G. A. D., & Divayana, D. G. H. (2020). Design of digital test using wondershare in supporting the blended learning with kelase platform. Universal Journal of Educational Research, 8(3), 953–959.

Mahmoudian, A., Torabi Chafjiri, R., Alipour, A., Shamsalinia, A., & Ghaffari, F. (2018). The design and evaluation of psychometric properties for a questionnaire on elderly abuse by family caregivers among older adults on hemodialysis. Clinical Interventions in Aging, Volume 13, 555–563.

Ngadiarti, I., Jauhari, A., El Jannah, S., Sulistyo, J., & Dwirahmadi, F. (2020). Quality validation of learning outcomes test instrument of core courses in Polytechnics Health Jakarta II, Indonesia. Annals of Tropical Medicine and Public Health, 23(08).

Nuruhidin, A., Putra, F., Pamungkas, O. I., Ardiyanto, H., & Saputro, D. P. (2018). An evaluation of powerlifting and weightlifting development program. Psychology, Evaluation, and Technology in Educational Research, 1(1), 1–8.

Panyajamorn, T., Suanmali, S., Kohda, Y., Chongphaisal, P., & Supnithi, T. (2018). Effectiveness of elearning design and affecting variables in Thai public schools. Malaysian Journal of Learning and Instruction, 15(1), 1–34.

Quintas, C., Silva, I. F., & Teixeira, A. (2017). Assessing an e-learning and b-learning model — A study of perceived satisfaction. International Journal of Information and Education Technology, 7(4), 265–268.

Rachman, T., & Napitupulu, D. B. (2017). Rasch model for validation a user acceptance instrument for evaluating e-learning system. CommIT (Communication and Information Technology) Journal, 11(1), 9.

Ramadani, M., Supahar, S., & Rosana, D. (2017). Validity of evaluation instrument on the implementation of performance assessment to measure science process skills. Jurnal Inovasi Pendidikan IPA, 3(2), 180.

Retnawati, H. (2016). Proving content validity of self-regulated learning scale (The comparison of Aiken index and expanded Gregory index). 2(2).

Santoso, B., Marchira, C. R., & Sumarni, P. (2017). Development and validity and reliability tests of professionalism assessment instrument in psychiatry residents. Jurnal Pendidikan Kedokteran Indonesia: The Indonesian Journal of Medical Education, 6(1), 60.

Setiawan, R., & Munajah, R. (2020). Evaluation of the application of online learning in Indonesian Universities. TEM Journal, 9(3), 1194–1199.

Shrotryia, V. K., & Dhanda, U. (2019). Content validity of assessment instrument for employee engagement. SAGE Open, 9(1), 215824401882175.

Singh, U. G., & De Villiers, M. R. (2017). An evaluation framework and instrument for evaluating e-assessment tools. The International Review of Research in Open and Distributed Learning, 18(6).

Sugiharni, G. A. D., Setiasih, N. W., Mahendra, I., Ardana, I., & Divayana, D. G. H. (2018). Development of alkin model instruments as evaluation tools of blended learning implementation in discrete mathematics course on STIKOM Bali. Journal of Theoretical and Applied Information Technology, 96(17), 5803–5818.

Suryaman, H., Kusnan, K., & Mubarok, H. (2020). Profile of online learning in building engineering education study program during the Covid-19 pandemic. IJORER : International Journal of Recent Educational Research, 1(2), 63–77.

Sutrisna, I. P. E., Ratminingsih, N. M., & Artini, L. P. (2018). Mall-based English instruction. JPI (Jurnal Pendidikan Indonesia), 7(1), 30–40.

Taherdoost, H. (2016). Validity and reliability of the research instrument; how to test the validation of a questionnaire/survey in a research. SSRN Electronic Journal.

Torkian, S., Shahesmaeili, A., Malekmohammadi, N., & Khosravi, V. (2020). Content validity and test-retest reliability of a questionnaire to measure virtual social network addiction among students. International Journal of High Risk Behaviors and Addiction, 9(1).

Vakili, M. M., & Jahangiri, N. (2018). Content validity and reliability of the measurement tools in educational, behavioral, and health sciences research. Journal of Medical Education Development, 10(28), 106–118.

Widiharti, W., Tola, B., & Supriyat, Y. (2019). Evaluation of principal partnership programs in the directorate of education management - The application of Kirkpartick and countenance stake evaluation model. Universal Journal of Educational Research, 7(9A), 71–77.

Yudiana, Y., Hidayat, Y., Hambali, B., & Slamat, S. (2017). Content validity estimation of assessment instrument based on volleyball information system of volleyball learning: field research. IOP Conference Series: Materials Science and Engineering, 180, 012230.

Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A.-R. (2015). Design and implementation content validity study: development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4(2), 165–178.


Article Metrics

Abstract view : 171 times
Fulltext PDF - 23 times


  • There are currently no refbacks.

Copyright (c) 2021 Psychology, Evaluation, and Technology in Educational Research

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Our Journal indexed by:

Psychology, Evaluation, and Technology in Educational Research
ISSN: 2622-5506

Creative Commons License
Psychology, Evaluation, and Technology in Educational Research is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. Based on a work at


PETiER Stats