Skip to content

Lewis-panda/Multi-LLM-Evaluation

Repository files navigation

LLM Model Performance Analysis

image image image image image

Overview

This project aims to analyze and compare the rewriting capabilities of various large language models (LLMs) across 24 different text categories. By doing so, we aim to identify which models perform best in specific domains.

Structure

  • Category Texts: 24 categories, each with 50 texts.
  • Models: Six LLMs are employed to rewrite the texts.
  • Evaluation: A custom evaluation system, called "Judge" (GPT-4o), scores the rewritten texts based on defined metrics.

Sample Result

The results will include detailed scores for each model across different categories, allowing for an in-depth comparison of their performance. image image image

Conclusion

This analysis provides insights into which LLMs are best suited for different types of content, helping guide future applications and research in the field of natural language processing.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors