evidently
by evidentlyai
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
AI summary
Model monitor
An observability framework for evaluating and monitoring the performance of machine learning models and data pipelines
- stars
- 5.5K
- forks
- 607
- watching
- 48
- awesome lists
- 8
Similar projects
Found by comparing what the projects do, not just their names.
LLM evaluator
A framework for evaluating large language models
LLM evaluation toolkit
A toolkit for evaluating and optimizing Large Language Model applications with objective metrics, test data generation, and seamless integrations.
AI auditor
Automates the detection of performance, bias, and security issues in AI applications
openai/evals15.2K
Benchmarking framework
A framework for evaluating large language models and systems, providing a registry of benchmarks.
Evaluation framework
Provides a unified framework to test generative language models on various evaluation tasks.
LLM handler
A Python library that simplifies working with structured outputs from large language models
LLM evaluation framework
Provides a comprehensive framework for evaluating Large Language Model (LLM) applications and pipelines with customizable metrics
Prompt testing env
An environment for battle-testing prompts to Large Language Models (LLMs) to evaluate response quality and performance.
pair-code/lit3.5K
ML Model Analyzer
An interactive tool for analyzing and understanding machine learning models
Data Quality Tool
Automates data quality checks and model training with AI-driven methods to improve machine learning performance
Model Interpreter
A comprehensive resource for explaining the decisions and behavior of machine learning models.
AI model explainer
An open-source package for explaining machine learning models and promoting transparency in AI decision-making
Model interpreter
Provides tools and techniques for interpreting machine learning models
LLM toolkit
An open-source toolkit for building and evaluating large language models
LLM evaluator
An evaluation suite and dynamic data release platform for large language models
Featured in 8 awesome lists
Each link jumps to the spot where the list mentions evidently.
