(NON)COMPUTER-ORIENTED TESTING IN HIGHER EDUCATION: VIEWS OF THE PARTICIPANTS OF THE EDUCATIONAL PROCESS ON (IN)CONVENIENCE USING

Authors

DOI:

https://doi.org/10.28925/2414-0325.2024.1612

Keywords:

testing, testing convenience, computer-based testing, oral-based testing, paper-based testing, online survey

Abstract

The article focuses the problems of using computer-based testing learning outcomes under modern conditions of accelerated development of distance and blended learning. The aim of the study is to identify and compare the views of the participants of the educational process  in higher education (students, PhD students, university teachers) on convenience using during computer-based testing as compared to paper-based testing and oral-based testing. The author included 3206 respondents in the anonymous online survey in 2020-2023, including 2897 students (Bachelor and Master students), 140 PhD students, and 169 university teachers; used IBM SPSS Statistics 23 for statistical analyses. There are research results: the convenience of testing improves in the direction (the mean values of convenience and the corresponding percentages of respondents): computer-based testing – students (М=3,68; 58,3%) → university teachers (M=3,81; 65,7%) → PhD students (M=4,31; 84,3%); paper-based testing – students (M=3,21; 42,2%) → PhD students (M=3,28; 44,3%) → university teachers (M=3,46; 54,6%); oral-based testing – students (M=2,49; 19,9%) → PhD students (M=2,84; 31,4%) → university teachers (M=3,69; 60,8%). Oral-based testing is the least convenient for students and PhD students. Paper-based testing is the least convenient for university teachers. Respondents have maximum convenience during computer-based testing for all studied groups. The t-test shows a statistically significant difference (p≤0,05) of the convenience testing in the majority of compared independent groups (students, PhD students, university teachers). The author obtained the results in dynamics over four years: convenience increases in the direction oral-based testing → paper-based testing → computer-based testing for all groups according to various characteristics (educational level, gender, specialty, form of education, year of the survey). The study shows that in most cases there are no statistically significant differences (p≤0,05) of the convenience testing in the following cases: between all independent students groups for all testing forms according to the feature «form of education»; according to the feature «academic performance level» for computer-based testing. We believe that the obtained results regarding the (in)convenience testing of participants in the educational process should be taken into account in the practice of higher education institutions.

Downloads

Download data is not yet available.

References

Al-Fraihat, D., Joy, M., Masa’deh, R. & Sinclair, J. (2020). Evaluating E-learning systems success: An empirical study. Computers in human behavior, 102, 67-86. DOI: https://doi.org/10.1016/j.chb.2019.08.004. (https://www.webofscience.com/wos/woscc/full-record/WOS:000497248000007).

Fojtik, R. (2015). Comparison of full-time and distance learning. Procedia Social and Behavioral Sciences. 4Th world conference on educational technology researcheres (WCETR-2014; Nov 28-29, 2014). Univ. Barcelona, Barcelona, Spain. Edited by: F. Ozdamli, (182), 402-407. DOI: https://doi.org/10.1016/j.sbspro.2015.04.804. https://www.webofscience.com/wos/woscc/full-record/WOS:000380397600059.

Flynn, S., Collins, J. & Malone, L. (2022). Pandemic pedagogies: the impact of ERT on part-time learners in Ireland. International Journal of Lifelong Education, 41(2), 168-182. DOI: https://doi.org/10.1080/02601370.2021.2022792. https://www.webofscience.com/wos/woscc/full-record/WOS:000740091100001.

Kukhar, L. & Sergiyenko, V. (2010). Test design. Сourse of lectures: textbook. Lucz`k: 2010 (in Ukrainian).

Boliubash, N. (2017). Pedagogical testing in the LMS Moodle system. Information Technologies and Learning Tools, 60(4), 116-127. https://www.webofscience.com/wos/woscc/full-record/WOS:000419751700010 (in Ukrainian).

Bulakh, I. & Mruga, M. (2006). Create a quality test: textbook. Kyiv: Majster-klas, 2006 (in Ukrainian).

Tella, A. & Bashorun, M. (2012). Attitude of Undergraduate Students Towards Computer-Based Test (CBT): A Case Study of the University of Ilorin, Nigeria. International Journal of Information and Communication Technology Education, 8(2), 33-45. DOI: https://doi.org/10.4018/jicte.2012040103. https://api.semanticscholar.org/CorpusID:11456124.

Lu, Z., Zheng, C. & Li, Z. (2018). Effects of embedded summary writing on EFL learners’ anxiety and oral production in a computer-based testing environment. J. Comput. Educ., 5(2), 221-241. DOI: https://doi.org/10.1007/s40692-018-0105-1. https://www.webofscience.com/wos/woscc/full-record/WOS:000433561300005.

Ebrahimi, M., Toroujeni, S. & Shahbazi, V. (2019). Score Equivalence, Gender Difference, and Testing Mode Preference in a Comparative Study between Computer-Based Testing and Paper-Based Testing. International journal of emerging technologies in learning, 14(7), 128-143. DOI: https://doi.org/10.3991/ijet.v14i07.10175. https://www.webofscience.com/wos/woscc/full-record/WOS:000464200700009.

Haggstrom, M. (1994). Using a Videocamera and Task-Based Activities to Make Classroom Oral Testing a More Realistic Communicative Experience. Foreing language annals, 27(2), 161-175. DOI: https://doi.org/10.1111/j.1944-9720.1994.tb01199.x. https://www.webofscience.com/wos/woscc/full-record/WOS:A1994PA05400004.

Girón-García, C. & Llopis-Moreno, C. (2015). Designing Oral-based Rubrics for Oral Language Testing with Undergraduate Spanish Students in ESP Contexts. Journal of language teaching teaching and learning, 5(2), 86-107. https://www.webofscience.com/wos/woscc/full-record/WOS:000379412500006.

Rogers, C. (2006). Faculty perceptions about e-cheating during online testing. Journal of Computing Sciences in Colleges, 22(2), 206-212. https://digitalcommons.georgiasouthern.edu/info-sys-facpubs/144/.

Shakhina, I. & Ilyina, A. (2016). Оrganization of quality control knowledge students with electronic test. Physical and Mathematical Education: scientific journal, 4(10), 152-157. http://nbuv.gov.ua/UJRN/fmo_2016_4_34 (in Ukrainian).

Reiss, D. & Sheriff, W. (1970). A computer-automated procedure for testing some experience of family membership. Behavioral science, 15(5), 431-443. DOI: https://doi.org/10.1002/bs.3830150505. https://www.webofscience.com/wos/woscc/full-record/WOS:A1970H302900004.

Bilousova, L. & Kolhatin, O. (2015). Problems of efficient use of automated testing systems. Ukrainian Journal of Educational Studies and Information Technology, 1(1), 8-16. https://uesit.org.ua/index.php/itse/article/view/193 (in Ukrainian).

Erstad, B. & Favre, J. (1999). Written testing of students in the experiential setting. American journal of pharmaceutical education, 63(40), 426-429. https://www.webofscience.com/wos/woscc/full-record/WOS:000085377000011.

Tryus, Yu., Herasymenko, I. & Franchuk, V. (2012). Electronic learning system based on MOODLE: Methodical manual. Red. Yu. V. Tryusa. Cherkasy: ChDTU (in Ukrainian).

Morze, N., Buinytska, O. & Varchenko-Trotsenko, L. (2016). Creating a modern e-course in MOODLE system: A textbook. Kam'janecj Podiljsjkyj: PP Bujnycjkyj O.A. (in Ukrainian).

Angriani, P., & Nurcahyo, H. (2019). The influence of moodle-based e-learningon self-directed learning of senior high school students. International Conference on Biology and Applied Science (ICOBAS; 13-14.05.2019; Malang, Indonesia). AIP Conference Proceedings, 2120, N 060007. DOI: https://doi.org/10.1063/1.5115707. https://www.webofscience.com/wos/woscc/full-record/WOS:000507519000106.

Acar, A. & Kayaoglu, M. (2020). Moodle as a Potential Tool for Language Education under the Shadow of COVID-19. Eurasian Journal of Educational Research, (90), 67-82. DOI: https://doi.org/10.14689/ejer.2020.90.4. https://www.webofscience.com/wos/woscc/summary/de269169-3e7b-4aab-a934-37e02e29c06b-781cb887/relevance/1.

Starosta, V. (2021). Moodle before, during and after the Covid-19 pandemic: using by bachelor and master students. Electronic Scientific Professional Journal «Open educational e-enviroment of modern university», (10), 216-230. DOI: https://doi.org/10.28925/2414-0325.2021.1018. https://openedu.kubg.edu.ua/journal/index.php/openedu/article/view/368 (in Ukrainian).

Calhoun, J. (1974). Oral vs written testing in self-paced individualized instruction. Education, 94(3), 242-248. https://www.webofscience.com/wos/woscc/full-record/WOS:A1974T018700005.

Lim, E., Yim, M. & Huh, S. (2017). Smart device-based testing for medical students in Korea: satisfaction, convenience, and advantages. Journal of Educational Evaluation for Health Professions, (14), Article N7. DOI: https://doi.org/10.3352/jeehp.2017.14.7. https://www.webofscience.com/wos/woscc/full-record/WOS:000402927900001.

Butler, A. (2018). Multiple-Choice Testing in Education: Are the Best Practices for Assessment Also Good for Learning? Journal of Applied Research in Memory and Cognition, 7(3), 323-331. https://www.webofscience.com/wos/woscc/full-record/WOS:000444108200002.

Moroz, V., Sadkovyi, V., Babayev, V. & Moroz, S. (2018). Online survey of students in the system for quality assurance in higher education. Information Technologies and Learning Tools, 68(6), 235-250. DOI https://doi.org/10.33407/itlt.v68i6.2415. https://www.webofscience.com/wos/woscc/full-record/WOS:000454452100018 (in Ukrainian).

Starosta, V. (2021). Postgraduate students’ attitude towards computer-based testing of learning results. Information Technologies and Learning Tools, 82(2), 215-230. DOI: https://doi.org/10.33407/itlt.v82i2.3304. https://www.webofscience.com/wos/woscc/full-record/WOS:000646477700015 (in Ukrainian).

Starosta, V. (2023). Student-centered distance learning in complicated conditions (pandemic Covid-19, marital state in Ukraine. Electronic Scientific Professional Journal «Open educational e-enviroment of modern university», (14), 63-77. DOI: https://doi.org/10.28925/2414-0325.2023.146. https://openedu.kubg.edu.ua/journal/index.php/openedu/article/view/457 (in Ukrainian).

Dictionary of the Ukrainian language: 11 Vol. (1970-1980). URSR. Instytut movoznavstva; za red. I.K. Bilodida. Kyiv: Naukova dumka. http://ukrlit.org/slovnyk (in Ukrainian).

Buhaichuk, K. (2016). Blended learning: theoretical analysis and strategy of implementation in educational process of higher educational institutions. Infotmation technologies and learning tools, 54(4), 1-18. https://www.webofscience.com/wos/woscc/full-record/WOS:000390559500001 (in Ukrainian).

Andujar, A. & Cruz-Martínez, M. (2020). Cognitive test anxiety in high-stakes oral examinations: Face-to-face or computer-based? Language learning in higher education, 10(2), Special Issue SI, 445-467. DOI: https://doi.org/10.1515/cercles-2020-2029. https://www.webofscience.com/wos/woscc/full-record/WOS:000734286700012.

Downloads


Abstract views: 81

Published

2024-04-29

How to Cite

Starosta, V. (2024). (NON)COMPUTER-ORIENTED TESTING IN HIGHER EDUCATION: VIEWS OF THE PARTICIPANTS OF THE EDUCATIONAL PROCESS ON (IN)CONVENIENCE USING. Electronic Scientific Professional Journal “OPEN EDUCATIONAL E-ENVIRONMENT OF MODERN UNIVERSITY”, (16), 173–193. https://doi.org/10.28925/2414-0325.2024.1612

Issue

Section

Статті