COLOSS B-RAP expert evaluation of beekeeping advice from ChatGPT, part 2

Tools

Fabricius Kristiansen, Lotta and Morawetz, Linde and Chlebo, Robert and Gray, Alison and Mazur, Ewa and Dahle, Bjørn and Diéguez-Antón, Ana and Schaunitzer, Georg and Gratzer, Kristina and Oberreiter, Hannes and Schorkopf, Dirk Louis P. and Fischer, Johann and Brodschneider, Robert (2024) COLOSS B-RAP expert evaluation of beekeeping advice from ChatGPT, part 2. Bee World. pp. 1-3. ISSN 2376-7618 (https://doi.org/10.1080/0005772x.2024.2418224)

[thumbnail of COLOSS B-RAP Expert Evaluation of Beekeeping Advice from ChatGPT Part 2]
Preview
 Text. Filename: COLOSS_B-RAP_Expert_Evaluation_of_Beekeeping_Advice_from_ChatGPT_Part_2.pdf
Final Published Version
License: Creative Commons Attribution 4.0 logo
Download (1MB)| Preview

Abstract

The artificial intelligence (AI) chatbot or advanced language model (LLM) ChatGPT is capable of understanding and generating human-like text. This article is a sequel to our first article on this topic, in which we imagined an AI tool that would serve as a beekeeping advisory tool in the future after having been trained with information stemming from high quality public domain resources on beekeeping and bee diseases (Morawetz et al., Citation2024). In that article, we presented the first part of the COLOSS B-RAP AI challenge, in which we asked ChatGPT-3.5 for advice regarding the serious honey bee disease American Foulbrood, which is a notifiable disease in many countries. We concluded that the tested AI chatbot version is a good teacher for basic or general beekeeping knowledge. It summarizes common knowledge about bee diseases at a level of detail that can be found in general beekeeping textbooks or in a beginners’ course in beekeeping. As a summarization tool, it was, for example, used to write the recently published book on bee diseases by Walker (Citation2024) to provide a comprehensive and structured overview of the topic. Nonetheless, it was concluded by the expert panel that advice from ChatGPT should be avoided for critical situations needing immediate action by the beekeeper, such as notifiable or severe diseases (Morawetz et al., Citation2024). Worryingly, part of the advice given was identified as misleading, wrong, or of limited usefulness in the given context and may easily lead to the spread of notifiable diseases and to severe consequences for the beekeeper and the beekeeping neighbors.

ORCID iDs

Fabricius Kristiansen, Lotta, Morawetz, Linde, Chlebo, Robert, Gray, Alison ORCID logoORCID: https://orcid.org/0000-0002-6273-0637, Mazur, Ewa, Dahle, Bjørn, Diéguez-Antón, Ana, Schaunitzer, Georg, Gratzer, Kristina, Oberreiter, Hannes, Schorkopf, Dirk Louis P., Fischer, Johann and Brodschneider, Robert;
CORE (COnnecting REpositories)