ChatAgri: Exploring potentials of ChatGPT on cross-linguistic agricultural text classification

Biao Zhao, Weiqiang Jin, Javier Del Ser, Guang Yang*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

24 Citations (Scopus)

Abstract

In the era of sustainable smart agriculture, a vast amount of agricultural news text is posted online, accumulating significant agricultural knowledge. To efficiently access this knowledge, effective text classification techniques are urgently needed. Deep learning approaches, such as fine-tuning strategies on pre-trained language models (PLMs), have shown remarkable performance gains. Nonetheless, these methods face several complex challenges, including limited agricultural training data, poor domain transferability (especially across languages), and complex and expensive deployment of large models. Inspired by the success of recent ChatGPT models (e.g., GPT-3.5, GPT-4), this work explores the potential of applying ChatGPT in the field of agricultural informatization. Various crucial factors, such as prompt construction, answer parsing, and different ChatGPT variants, are thoroughly investigated to maximize its capabilities. A preliminary comparative study is conducted, comparing ChatGPT with PLMs-based fine-tuning methods and PLMs-based prompt-tuning methods. Empirical results demonstrate that ChatGPT effectively addresses the mentioned research challenges and bottlenecks, making it an ideal solution for agricultural text classification. Moreover, ChatGPT achieves comparable performance to existing PLM-based fine-tuning methods, even without fine-tuning on agricultural data samples. We hope this preliminary study could inspire the emergence of a general-purpose AI paradigm for agricultural text processing.

Original languageEnglish
Article number126708
JournalNeurocomputing
Volume557
DOIs
Publication statusPublished - 7 Nov 2023

Keywords

  • Agricultural text classification
  • ChatGPT
  • Generative Pre-trained Transformer (GPT)
  • GPT-4
  • Very large pre-trained language model

Fingerprint

Dive into the research topics of 'ChatAgri: Exploring potentials of ChatGPT on cross-linguistic agricultural text classification'. Together they form a unique fingerprint.

Cite this