deepeval
by confident-ai
The LLM Evaluation Framework
AI summary
LLM evaluator
A framework for evaluating large language models
- stars
- 4K
- forks
- 324
- watching
- 23
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
LLM evaluation toolkit
A toolkit for evaluating and optimizing Large Language Model applications with objective metrics, test data generation, and seamless integrations.
Model monitor
An observability framework for evaluating and monitoring the performance of machine learning models and data pipelines
Evaluation framework
Provides a unified framework to test generative language models on various evaluation tasks.
AI toolkit
Provides pre-packaged building blocks for generative AI applications with standardized APIs and service-oriented design.
Prompt testing env
An environment for battle-testing prompts to Large Language Models (LLMs) to evaluate response quality and performance.
deepset-ai/haystack18.1K
LLM orchestrator
An AI orchestration framework to build customizable LLM applications with advanced retrieval methods.
ludwig-ai/ludwig11.2K
Deep Learning Framework
A low-code framework for building custom deep learning models and neural networks
LLM evaluation framework
Provides a comprehensive framework for evaluating Large Language Model (LLM) applications and pipelines with customizable metrics
AI auditor
Automates the detection of performance, bias, and security issues in AI applications
openai/evals15.2K
Benchmarking framework
A framework for evaluating large language models and systems, providing a registry of benchmarks.
modeltc/lightllm2.7K
LLM server
A Python-based framework for serving large language models with low latency and high scalability.
mlabonne/llm-course40.1K
LLM tutorial
A comprehensive course and resource package on building and deploying Large Language Models (LLMs)
AI Data Storage
A Database for AI that stores and manages various data types used in deep learning applications.
LLM evaluator
An evaluation suite and dynamic data release platform for large language models
ggerganov/llama.cpp69.2K
LLM inference software
Enables LLM inference with minimal setup and high performance on various hardware platforms
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions deepeval.
