The Impact of LLM-Based Chatbots on Secondary Computing Education

Keywords:
Large Language Model, Artificial Intelligence in education, AI Chatbots, Computing education, Tutoring systems

Abstract:
This study aims to show the difference in teaching and learning approaches in secondary education. The purpose is to compare the output of a Computing project of three different groups of students with different resources for the same task. The main resource for the first group was the Computing book and teacher presentations, for the second group the main resource were the search engines Google and Bing, and the third group’s main resource was the Large Language Model. By comparing the outcomes and performance of the three groups, the effectiveness of using different resources in a controlled classroom environment is assessed, showing the difference in overall performance of each group - project completion times vary widely, as do the definitions of key terms and answers to specific questions. The study also shows that resources such as books can be very useful as the limited experience of students means that the standards are very clear. Using a search engine expands the reach of information to students but also leads to too many choices. The problem that arises here is that of data accuracy, for example: whether the data obtained by LLM is accurate and sufficient for defining key terms and completing tasks.

CITATION:

IEEE format

Copy to clipboard

M. Vukojičić, I. Korica, M. Veinović, “The Impact of LLM-Based Chatbots on Secondary Computing Education,” in Sinteza 2024 - International Scientific Conference on Information Technology, Computer Science, and Data Science, Belgrade, Singidunum University, Serbia, 2024, pp. 31-37. doi:10.15308/Sinteza-2024-31-37

APA format

Copy to clipboard

Vukojičić, M., Korica, I., Veinović, M. (2024). The Impact of LLM-Based Chatbots on Secondary Computing Education. Paper presented at Sinteza 2024 - International Scientific Conference on Information Technology, Computer Science, and Data Science. doi:10.15308/Sinteza-2024-31-37

BibTeX format
Download

RefWorks Tagged format
Download