A MODEL OF USING INFORMATION AND DIGITAL TECHNOLOGIES TO EVALUATE THE EFFECTIVENESS OF PEDAGOGICAL RESEARCH
DOI:
https://doi.org/10.28925/2414-0325.2023.145Keywords:
інформаційно-цифрові технології; результативність педагогічних досліджень; оцінювання результативності педагогічних досліджень; модель; критерії оцінювання результативності педагогічних дослідженьAbstract
The paper clarifies the definitions of "information and digital technologies", "effectiveness of pedagogical research", and "evaluation of the effectiveness of pedagogical research using information and digital technologies". A model of using information and digital technologies to evaluate the effectiveness of pedagogical research has been developed, which contains four blocks: purpose, content, organizational and activity, and evaluation and result. The selected components are characterized. In particular, the purpose of the model is to develop the content and technologies for using information and digital technologies to evaluate the effectiveness of pedagogical research; the purpose group, and regulatory documents on which the developed model is based. The following digital tools and platforms are highlighted in the content block: scientometric databases, electronic scientific and educational libraries, altmetric tools, etc. In the organizational and activity block, the following topics are proposed as possible topics for seminars/webinars: evaluating the effectiveness of pedagogical research using statistical modules of scientific digital libraries, Google cloud services, international and domestic scientometric databases, scientific social networks, altmetric and bibliometric systems, and creating an e-portfolio. The evaluation and result block considers project-competition, scientific-publication, scientometric, altmetric, expert and representative scientific criteria and indicators for evaluating the effectiveness of pedagogical research of scholars, research and teaching staff, research institutions, and HEIs. The weight of each criterion can be adjusted by introducing coefficients of significance. The result of the developed model is the improvement of the competence of researchers and academic staff using information and digital technologies to evaluate the effectiveness of pedagogical research.
Downloads
References
Hariton E., Locascio J. J. Randomised controlled trials – the gold standard for effectiveness research. BJOG. 2018. № 125. pp. 1716-1716. doi:10.1111/1471-0528.15199.
Masson A., De Marchi G., Merin B. et al. Google dataset search and DOI for data in the ESA space science archives. Advances in Space Research. 2021. № 67(8). рр. 2504-2516. doi:10.1016/j.asr.2021.01.035.3. Tagarev T.,
Sharkov G., Lazarov А. Cyber Protection of Critical Infrastructures, Novel Big Data and Artificial Intelligence Solutions. Information & Security: An International Journal. 2020. № 47(1). рр. 7-10. doi:10.11610/isij.4711.
Zhang Y., Zhang C., Mayr P. et al. An editorial of “AI + informetrics”: multi-disciplinary interactions in the era of big data. Scientometrics. 2022. № 127. рр. 6503-6507. doi:10.1007/s11192-022-04561-w.
Bykov V. Yu., Spirin О. М., Ivanova S. М. et al. Scientometric Indicators for Evaluating the Effectiveness of Pedagogical Research of Scientific Institutions and Educational Institutions. Information Technologies and Learning Tools. 2021. № 86(6). pp. 289-312. doi:10.33407/itlt.v86i6.4656.
Bykov V.Yu., Spirin О. М., Biloshchytskyi А. О. et al. Open Digital Systems for Assessment of Pedagogical Research Results. Information Technologies and Learning Tools. 2020. № 75(1). pp. 294-315. doi:10.33407/itlt.v75i1.3589.
Martín-Martín А., Orduna-Malea Е., Thelwall М. et al. Google Scholar, Web of Science, and Scopus: A systematic comparison of citations in 252 subject categories. Journal of Informetrics. 2018. № 12(4). рр. 1160-1177. doi:10.1016/j.joi.2018.09.002.
Strübing J., Hirschauer S., Ayaß R. et al. Gütekriterien qualitativer Sozialforschung. Ein Diskussionsanstoß. Zeitschrift für Soziologie. 2018. № 47(2). pp. 83-100. doi:10.1515/zfsoz-2018-1006.
Fang Z., Costas R., Tian W. et al. An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics. Scientometrics. 2020. № 124. рр. 2519-2549. doi:10.1007/s11192-020-03564-9.
Karmakar М., Banshal S. K., Singh V. K. A large-scale comparison of coverage and mentions captured by the two altmetric aggregators: Altmetric.com and PlumX. Scientometrics. 2021. № 126(5). рр. 4465-4489. doi:10.1007/s11192-021-03941-y.
Thelwall M., Kousha K. ResearchGate: Disseminating, Communicating, and Measuring Scholarship? Journal of the Association for Information Science and Technology. 2015. №66. рр. 876-889. doi:10.1002/asi.23236.
Maz-Machado A., Jiménez-Fanjul N. Collaboration and Citation Analysis Within Social Sciences: A Comparative Analysis Between Two Fields. Scientometrics. Eds. Jibu M., Osabe Y. Rijeka, IntechOpen. 2018. doi:10.5772/intechopen.76732.
Moreno R., Pérez-Gil F. J., Pardo J. J. et al. Science for everyone (ScifE): A proposed framework for science as a service using interactive web technologies. Computers & Geosciences. 2019. № 131. рр. 70-79. doi:10.1016/j.cageo.2019.06.001.
Toelch U., Ostwald D. Digital open science – Teaching digital tools for reproducible and transparent research. PLOS Biology. 2018. № 16(7). рр. e2006022. doi:10.1371/journal.pbio.2006022.
Costas R., Zahedi Z., Wouters P. Do “Altmetrics“ Correlate With Citations? Journal of the Association for Information Science and Technology. 2015. № 66. рр. 2003-2019. doi:10.1002/asi.23309.
Waltman L., Costas R. F1000 Recommendations as a Potential New Data Source for Research Evaluation: A Comparison With Citations. Journal of the Association for Information Science and Technology. 2014. № 65. рр. 433-445. doi:10.1002/asi.23040.
Bykov V. Yu., Vernygora S. М., Hurzhii А. М. et al. The Design and Use of the Open Cloud Based Learning and Reserch Environment of a University. Information Technologies and Learning Tools. 2019. №74(6). pp. 1-19. doi:10.33407/itlt.v74i6.3499.
Spirin О. М., Ivanova S. М., Іatsyshyn А.V. et al. The Model for the Application of Open Electronic Scientific and Educational Systems to the Development of Researchers’ Information and Research Competence. Information Technologies and Learning Tools. 2020. № 77(3). pp. 302-323. doi10.33407/itlt.v77i3.3985.
Agreement on Reforming Research Assessment – Science Europe. [Online]. URL: https://www.scienceeurope.org/our-resources/agreement-reforming-research-assessment/. (дата звернення: 12.01.2023).
Squazzoni F., Brezis E., Marušić A. Scientometrics of peer review. Scientometrics. 2017. № 113. рр. 501-502. doi:10.1007/s11192-017-2518-4.
Цифрова адженда України – 2020. [Електронний ресурс]. URL: https://ucci.org.ua/uploads/files/58e78ee3c3922.pdf (дата звернення: 12.01.2023).
Концепція цифрової трансформації освіти і науки на період до 2026 року [Електронний ресурс]. URL: https://mon.gov.ua/ua/news/koncepciya-cifrovoyi-transformaciyi-osviti-i-nauki-mon-zaproshuye-do-gromadskogo-obgovorennya. (дата звернення: 12.02.2023).
Розпорядження КМУ від 23 лютого 2022 року №286-р «Про схвалення Стратегії розвитку вищої освіти в Україні на 2022-2032 роки». [Електронний ресурс]. URL: https://mon.gov.ua/ua/news/opublikovano-strategiyu-rozvitku-vishoyi-osviti-v-ukrayini-na-2022-2032-roki. (дата звернення: 21.02.2023).
Developing Institutional OA Publishing Models to Advance Scholarly Communication [Online]. URL: https://cordis.europa.eu/project/id/101058007. (date of access: 21.02.2023).
GitHub – scholarly-python-package/scholarly. [Online]. URL: https://github.com/scholarly-python-package/scholarly. (дата звернення: 12.01.2023).
Hlavcheva Y. M., Kanishcheva O. V., Borysova N. V. A Survey of Informetric Methods and Technologies. Cybernetics and Systems Analysis. 2019. № 55. рр. 503-513. doi:10.1007/s10559-019-00158-z.
Home | DORA. [Online]. URL: https://sfdora.org/. (дата звернення: 12.01.2023).
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Spirin O., Vakaliuk T., Oleksiuk V., Ivanova S., Mintii I. Kilchenko A.
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
1.jpg)
