intent-classification-analysis

A comparative analysis of encoder only and decoder only models in intent classication.

Reference

• A Comparative Analysis of Encoder Only and Decoder Only Models in Intent Classification and Sentiment Analysis: Navigating the Trade-Offs in Model Size and Performance

  Abstract
  Intent classification and sentiment analysis stand as pivotal tasks in natural language processing, with applications ranging from virtual assistants to customer service.
  The advent of transformerbased models has significantly enhanced the performance of various NLP tasks, with encoder-only architectures gaining prominence for their effectiveness.
  More recently, there has been a surge in the development of larger and more powerful decoder-only models, traditionally employed for text generation tasks.
  This paper aims to answer the question of whether the colossal scale of newer decoder-only language models is essential for real-world applications by comparing their performance to the well established encoder-only models, in the domains of intent classification and sentiment analysis.
  
  Our results shows that for such natural language understanding tasks, encoder-only models in general provide better performance than decoder-only models, at a fraction of the computational demands.
  

Dataset

• AI Hub/용도별 목적대화 데이터/shopping
  1. Training
     • Label: TL_1.shopping.zip: data/training/label
     • Raw: TS_1.shopping.zip: data/training/raw
  2. Validation
     • Label: VL_1.shopping.zip: data/validation/label
     • Raw: VS_1.shopping.zip: data/validation/raw