llm-autoeval
by mlabonne
Automatically evaluate your LLMs in Google Colab
AI summary
Model evaluator
A tool to automate the evaluation of large language models in Google Colab using various benchmarks and custom parameters.
- stars
- 566
- forks
- 93
- watching
- 7
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
Model evaluation toolkit
Tools and evaluation framework for accelerating the development of large multimodal models by providing an efficient way to assess their performance
LLM evaluator
An all-in-one toolkit for evaluating Large Language Models (LLMs) across multiple backends.
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
LLM evaluation resource
A repository of papers and resources for evaluating large language models.
Model evaluator
Evaluates and compares the performance of multimodal large language models on various tasks
Model evaluator
An evaluation framework for large language models trained with instruction tuning methods
Legal model evaluator
Evaluates the legal knowledge of large language models using a custom benchmarking framework.
Model evaluator
A tool for evaluating and visualizing machine learning model performance
LLM evaluator
An evaluation framework for large language models with Elo rating system and A/B testing capabilities
Model Evaluator
An evaluation framework for machine learning models and datasets, providing standardized metrics and tools for comparing model performance.
QA evaluation tool
Automated evaluation of language models for question answering tasks
QA evaluator
An evaluation tool for question-answering systems using large language models and natural language processing techniques
LLM
A multilingual large language model developed by XVERSE Technology Inc.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions llm-autoeval.
