A Generative Artificial Intelligence empowered chatbot : system usability and student teachers’ experience

Nikou, Stavros and Guliya, Arjun and Van Verma, Suraj and Chang, Maiga; Sifaleras, Angelo and Lin, Fuhua, eds. (2024) A Generative Artificial Intelligence empowered chatbot : system usability and student teachers’ experience. In: Intelligent Tutoring Systems. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) . Springer, GRC, pp. 330-340. ISBN 9783031630286 (https://doi.org/10.1007/978-3-031-63028-6_27)

[thumbnail of Nikou-etal-ITS-2024-A-Generative-Artificial-Intelligence-empowered-chatbot]
Preview
 Text. Filename: Nikou-etal-ITS-2024-A-Generative-Artificial-Intelligence-empowered-chatbot.pdf
Accepted Author Manuscript
License: Creative Commons Attribution 4.0 logo
Download (981kB)| Preview

Abstract

Generative Artificial Intelligence empowered conversational agents (chatbots) seem to be increasingly used in various settings including education. While student teachers are key stakeholders in supporting and improving educa- tion, not many studies exist in student teachers’ views on the educational use of chatbots. The current study performs a usability evaluation and explores student teachers’ views on the academic use of the VIP-Bot, an advanced academic Discord chatbot, which leverages the OpenAI’s gpt-3.5-turbo-instruct model. Student teachers, within the context of the formative task of writing a literature review, interacted with the chatbot and self-reported their experiences through an online survey. The usability evaluation returned a relatively high SUS score (76.36) for the chatbot. Moreover, student teachers view on the chatbot acceptance, effectiveness and motivation were positive. The chatbot can be helpful in developing ideas and initiating further engagement with the literature. Academic misconduct concerns have been expressed if the chatbot is not used properly. The study, as a usability evaluation, is an essential step in further chat- bot development and, as an investigation of student teachers’ views, it is an essential step on the chatbot employment in teaching and learning.

ORCID iDs

Nikou, Stavros ORCID logoORCID: https://orcid.org/0000-0001-9941-2125, Guliya, Arjun, Van Verma, Suraj and Chang, Maiga; Sifaleras, Angelo and Lin, Fuhua

Persistent Identifier

https://doi.org/10.17868/strath.00088631
CORE (COnnecting REpositories)