lighteval
by huggingface
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
AI summary
LLM evaluator
An all-in-one toolkit for evaluating Large Language Models (LLMs) across multiple backends.
- stars
- 879
- forks
- 105
- watching
- 29
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
Model Evaluator
An evaluation framework for machine learning models and datasets, providing standardized metrics and tools for comparing model performance.
Model evaluator
A tool to automate the evaluation of large language models in Google Colab using various benchmarks and custom parameters.
LLM evaluator
An evaluation suite and dynamic data release platform for large language models
Model evaluation toolkit
Tools and evaluation framework for accelerating the development of large multimodal models by providing an efficient way to assess their performance
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
Evaluation pipeline
A framework for evaluating language models on NLP tasks
LLM evaluation resource
A repository of papers and resources for evaluating large language models.
Model evaluation framework
An evaluation toolkit and platform for assessing large models in various domains
Evaluation tool
An open-source framework that enables language model evaluation using Prometheus and GPT4
Evaluation framework
An evaluation toolkit for large vision-language models
Emotion analyzer
An open-source implementation of a deep learning model that analyzes sentiment and emotion in text using emojis
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
Transformer model
Implementing OpenAI's transformer language model in PyTorch with pre-trained weights and fine-tuning capabilities
LLM evaluator collection
A collaborative catalogue of LLM evaluation frameworks and papers
LLM evaluator
An evaluation framework for large language models with Elo rating system and A/B testing capabilities
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions lighteval.
