ragas
Supercharge Your LLM Application Evaluations 🚀
AI summary
LLM evaluation toolkit
A toolkit for evaluating and optimizing Large Language Model applications with objective metrics, test data generation, and seamless integrations.
- stars
- 7.6K
- forks
- 771
- watching
- 38
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
LLM evaluator
A framework for evaluating large language models
LLM toolkit
An integrated development platform for large language models (LLMs) that provides observability, analytics, and management tools.
Evaluation framework
Provides a unified framework to test generative language models on various evaluation tasks.
Model monitor
An observability framework for evaluating and monitoring the performance of machine learning models and data pipelines
openai/evals15.2K
Benchmarking framework
A framework for evaluating large language models and systems, providing a registry of benchmarks.
Prompt testing env
An environment for battle-testing prompts to Large Language Models (LLMs) to evaluate response quality and performance.
LLM tester
A tool for testing and evaluating large language models (LLMs) to ensure they are reliable and secure
LLM app builder
A framework for building enterprise LLM-based applications using small, specialized models
AI app templates
Provides pre-built AI application templates to integrate Large Language Models (LLMs) with various data sources for scalable RAG and enterprise search.
shishirpatil/gorilla11.6K
API toolkit
Enables large language models to interact with external APIs using natural language queries
LLM toolkit
An open-source toolkit for pretraining and fine-tuning large language models
LLM evaluation framework
Provides a comprehensive framework for evaluating Large Language Model (LLM) applications and pipelines with customizable metrics
LLM framework
A framework for training and serving large language models using JAX/Flax
mlabonne/llm-course40.1K
LLM tutorial
A comprehensive course and resource package on building and deploying Large Language Models (LLMs)
AI auditor
Automates the detection of performance, bias, and security issues in AI applications
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions ragas.
