lmms-eval
Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.
AI summary
Model evaluation toolkit
Tools and evaluation framework for accelerating the development of large multimodal models by providing an efficient way to assess their performance
- stars
- 2.2K
- forks
- 168
- watching
- 3
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Model evaluator
Evaluates and compares the performance of multimodal large language models on various tasks
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
LLM evaluation resource
A repository of papers and resources for evaluating large language models.
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Model evaluator
A tool to automate the evaluation of large language models in Google Colab using various benchmarks and custom parameters.
Multimodal model evaluator
Evaluating and improving large multimodal models through in-context learning
Evaluation framework
An evaluation toolkit for large vision-language models
Model evaluator
An evaluation framework for large language models trained with instruction tuning methods
Evaluation tool
An open-source framework that enables language model evaluation using Prometheus and GPT4
Model evaluator
A community-developed tool for evaluating climate models and providing diagnostic metrics.
LLM evaluator
An evaluation framework for large language models with Elo rating system and A/B testing capabilities
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
LLM evaluator
An all-in-one toolkit for evaluating Large Language Models (LLMs) across multiple backends.
Long context transfer
An open-source project that enables the transfer of language understanding to vision capabilities through long context processing.
Model evaluator
A framework for efficiently evaluating and benchmarking large models
Featured in 1 awesome list
Each link jumps to the spot where the list mentions lmms-eval.
