instruct-eval
by declare-lab
This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
AI summary
Model evaluator
An evaluation framework for large language models trained with instruction tuning methods
- stars
- 535
- forks
- 43
- watching
- 13
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Evaluator
An automatic evaluation tool for large language models
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
Model Evaluator
An evaluation framework for machine learning models and datasets, providing standardized metrics and tools for comparing model performance.
Model evaluation toolkit
Tools and evaluation framework for accelerating the development of large multimodal models by providing an efficient way to assess their performance
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
Model evaluator
A tool for evaluating and visualizing machine learning model performance
Model evaluator
Evaluates and compares the performance of multimodal large language models on various tasks
Model evaluator
A tool to automate the evaluation of large language models in Google Colab using various benchmarks and custom parameters.
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
Multimodal model evaluator
Evaluating and improving large multimodal models through in-context learning
LLM evaluator
An evaluation framework for large language models with Elo rating system and A/B testing capabilities
Model evaluator
A framework for efficiently evaluating and benchmarking large models
Model Tester
A tool for testing and evaluating large language models with a focus on AI safety and model assessment.
LLM evaluation resource
A repository of papers and resources for evaluating large language models.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions instruct-eval.
