Potentials of integrating generative artificial intelligence technologies into formative assessment processes in higher education

The use of generative artificial intelligence technologies in education has the potential to revolutionize learning and educational assessment by personalizing the learning experience, providing immediate feedback, and improving the overall learning experience.

The relevance of the research is due to the spread of artificial intelligence technologies and the lack of practices for formative assessment of educational achievements in higher education.

The problem statement: existing domestic e-learning systems have limited functionality, which makes them difficult to use in the process of formative testing.

The goal of the research is to study the possibility and effectiveness of using generative artificial intelligence technologies in formative assessment in higher education.

The objectives of the research are to consider the theoretical foundations of using generative artificial intelligence tools in assessing knowledge, skills and abilities, and to analyze our own experience of using large language models in formative testing at a university.

The methodological basis of the research is analysis of Internet resources and literary sources, methods of mathematical statistics, and synthesis.

The research results: the possibilities of using and the effectiveness of generative artificial intelligence technologies in formative testing of university students have been studied, our own experience of using large language models in formative testing have been analyzed, the main limitations of introducing these technologies into the educational process have been identified, recommendations have been given for organizing formative testing using large language models.

Key conclusions: Large language models can be integrated into the learning process to assess formative and summative tests, which will significantly reduce the workload of teachers, provide more objective results and, ultimately, increase the effectiveness of the learning process.

1. Annenkova A.V. Artificial intelligence: some features of implementation in the education system in the context of digitalization of society and the economy [Electronic resource] // International scientific research journal. 2023. No. 9 (135). URL: https://research-journal.org/archive/9-135-2023-september/10.23670/IRJ.2023.135.33 (access date: 05/03/2024). — DOI: 10.23670/IRJ.2023.135.33

2. Gusyatnikov V.N. Using artificial intelligence methods to assess competencies during testing [Electronic resource] / V.N. Gusyatnikov [and others] // Informatics and education. 2023. No. 38(6). pp. 75-85. https://doi.org/10.32517/0234-0453-2023-38-6-75-85 (access date: 05/03/2024)

3. Kibzun A.I., Naumov A.V., Mkhitaryan G.A. Features and technologies for developing a system for distance learning in mathematical disciplines class.Net [Electronic resource] // Modern information technologies and IT education. 2015. No. 11. URL: https://cyberleninka.ru/article/n/osobennosti-i-tehnologii-razrabotki-sistemy-distantsionnogo-obucheniya-matematicheskim-distsiplinam-class-net (date of access: 05/03/2024).

4. Kropotova N.A., Legkova I.A. Application of formative assessment in the educational process of higher education // NovaInfo.Ru. No. 74, 2017. URL: https://novainfo.ru/article/14271 (access date: 05/03/2024)

5. Kulikova N.Yu., Maslova O.A., Ponomareva Yu.S. Model of using artificial intelligence systems to assess the quality of developing competencies of university students [Electronic resource] // World of Science. Pedagogy and psychology. 2021. Vol. 9, Issue 5. URL: https://mir-nauki.com/PDF/33PDMN521.pdf (access date: 05/03/2024)

6. Nikitin I.V., Belolutskaya A.K. Conceptualization of formative assessment in higher education: results of thematic analysis // Higher education in Russia. 2021. Vol. 30, Issue 11.

7. Paskova A.A. Practical aspects of using ChatGPT in higher education // Bulletin of Maikop State Technological University. 2023. Vol. 15, Issue 3. P. 67-74.

8. Petrov A.A., Druzhinina O.V., Masina O.N. Modeling knowledge assessment systems within the framework of a hybrid intellectual learning environment [Electronic resource] // Modern information technologies and IT education. 2021. No. 1. URL: https://cyberleninka.ru/article/n/modelirovanie-sistem-otsenivaniya-znaniy-v-ramkah-gibridnoy-intellektualnoy-obuchayuschey-sredy (date of access: 05/03/2024).

9. Sverdlova N.A., Orlova E.S. Analysis of the capabilities of artificial intelligence in relation to schooling [Electronic resource] // International scientific research journal. 2024. No. 1 (139). URL: https://research-journal.org/archive/1-139-2024-january/10.23670/IRJ.2024.139.161 (access date: 03/05/2024). — DOI: 10.23670/IRJ.2024.139.161

10. Tardif A. Unlocking the capabilities of large language models (LLM) [Electronic resource] // Unite.AI. 2023. April 22 URL: https://www.unite.ai/ru/%D0%B1%D0%BE%D0%BB%D1%8C%D1%88%D0%B8%D0%B5-%D1%8F%D0%B7%D1%8B%D0%BA%D0%BE%D0%B2%D1%8B%D0%B5-%D0%BC%D0%BE%D0%B4%D0%B5%D0%BB%D0%B8/ (date of access: 05/03/2024)

11. Numbers of the month: successes and failures of schoolchildren, employment of teachers and course students [Electronic resource] // ScillboxMedia. 2022. 1 Aug. URL: https://skillbox.ru/media/education/tsifry-mesyatsa-uspekhi-i-provaly-shkolnikov-zanyatost-pedagogov-i-studenty-kursov/?utm_source=media&utm_medium=link&utm_campaign=all_all_media_links_links_articles_all_all_skillbox (access date: 05.03. 2024)

12. Shmigirilova I.B., Rvanova A.S., Grigorenko O.V. Assessment in education: current trends, problems and contradictions (review of scientific publications) // Education and Science. 2021. Vol. 23, Issue 6. P. 43-83.

13. Formative and Summative Assessments // Yale. URL: https://poorvucenter.yale.edu/Formative-Summative-Assessments (access date: 05/03/2024)

14. Jamal A. The Role Of Artificial Intelligence (AI) In Teacher Education: Opportunities & Challenges [Electronic resource] // IJRAR March. 2023. Vol. 10, Iss. 1. P 139-146. URL: https://www.researchgate.net/publication/369384184_The_Role_of_Artificial_Intelligence_AI_in_Teacher_Education_Opportunities_Challenges (access date: 05/03/2024)

15. Impact of artificial intelligence on assessment methods in primary and secondary education: Systematic literature review [Electronic resuors] / M. Martínez-Comesaña [et al.] // Revista de Psicodidáctica (English ed.). 2023.Vol. 28, Iss. 2. P. 93-103. URL: https://doi.org/10.1016/j.psicoe.2023.06.002. (date of access: 03/05/2024)

16. Luckin R., Cukurova M. Designing educational technologies in the age of AI: A learning sciences-driven approach // BJET. 2019. Vol. 50. P. 2824-2838

17. Shonubi O. AI In The Classroom: Pros, Cons And The Role Of EdTech Companies [Electronic resuors] // Forbes. 2023. Feb 21. URL: https://www.forbes.com/sites/theyec/2023/02/21/ai-in-the-classroom-pros-cons-and-the-role-of-edtech-companies/sh=591f5509feb4https://www.forbes.com/sites/theyec/2023/02/21/ai-in-the-classroom-pros-cons-and-the-role-of-edtech-companies/?sh=591f5509feb4https://www.forbes.com/sites/theyec/2023/02/21/ai-in-the-classroom-pros-cons-and-the-role-of-edtech-companies/?sh=591f5509feb4 (access date: 05.03.2024)