continuous-eval
by relari-ai
Data-Driven Evaluation for LLM-Powered Applications
AI summary
LLM evaluation framework
Provides a comprehensive framework for evaluating Large Language Model (LLM) applications and pipelines with customizable metrics
- stars
- 455
- forks
- 31
- watching
- 4
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
LLM evaluation resource
A repository of papers and resources for evaluating large language models.
LLM evaluator collection
A collaborative catalogue of LLM evaluation frameworks and papers
LLM evaluator
An evaluation framework for large language models with Elo rating system and A/B testing capabilities
LLM framework
A framework for managing and testing large language models to evaluate their performance and optimize user experiences.
Evaluation pipeline
A framework for evaluating language models on NLP tasks
LLM evaluator
An evaluation suite and dynamic data release platform for large language models
LLM framework
A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs.
LLM toolkit
An open-source toolkit for building and evaluating large language models
LLM benchmarking tool
A tool for evaluating the performance of large language model APIs
LLM benchmarker
A benchmarking framework for large language models
Evaluation tool
An open-source framework that enables language model evaluation using Prometheus and GPT4
LLM API
An API that provides a unified interface to multiple large language models for chat fine-tuning
LLM trainer
A flexible RL training framework designed for large language models
Model evaluator
A framework for efficiently evaluating and benchmarking large models
Model evaluator
A tool to automate the evaluation of large language models in Google Colab using various benchmarks and custom parameters.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions continuous-eval.
