auto-evaluator
by rlancemartin
Evaluation tool for LLM QA chains
AI summary
QA evaluator
An evaluation tool for question-answering systems using large language models and natural language processing techniques
- stars
- 1.1K
- forks
- 95
- watching
- 8
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
QA evaluation tool
Automated evaluation of language models for question answering tasks
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Model evaluator
A tool to automate the evaluation of large language models in Google Colab using various benchmarks and custom parameters.
Prompt evaluator
An API for evaluating the quality of text prompts used in Large Language Models (LLMs) based on perplexity estimation
Evaluator
An automatic evaluation tool for large language models
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
RAG evaluator
An evaluation tool for Retrieval-augmented Generation methods
Model evaluator
An evaluation framework for large language models trained with instruction tuning methods
Web task evaluator
A tool to evaluate AI agents on web tasks by dynamically constructing and executing test suites against predefined example websites.
Model evaluation toolkit
Tools and evaluation framework for accelerating the development of large multimodal models by providing an efficient way to assess their performance
obss/jury187
NLP evaluator
A comprehensive toolkit for evaluating NLP experiments offering automated metrics and efficient computation.
RAG model evaluator
A tool for automatically evaluating RAG models by generating synthetic data and fine-tuning classifiers
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
Paragraph QA tools
Tools and codebase for training neural question answering models on multiple paragraphs of text data
Reward model evaluator
A comprehensive benchmarking framework for evaluating the performance and safety of reward models in reinforcement learning.
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions auto-evaluator.
