tonic_validate
by TonicAI
Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.
AI summary
Quality checker
A framework for evaluating and monitoring the quality of large language model outputs in Retrieval Augmented Generation applications.
- stars
- 271
- forks
- 27
- watching
- 14
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Test quality checker
A tool for verifying test quality by introducing small changes to code and checking if tests pass.
Validator
A tool to visually validate web pages using natural language prompts instead of traditional selectors.
Package validator
Tools to validate the size and contents of software packages during continuous integration
Verifier
An implementation of a DeepPoly-based verifier for robustness analysis in deep neural networks
LLM evaluator
An evaluation suite and dynamic data release platform for large language models
Prompt evaluator
An API for evaluating the quality of text prompts used in Large Language Models (LLMs) based on perplexity estimation
RAG evaluator
An evaluation tool for Retrieval-augmented Generation methods
Vocabulary validator
A tool for identifying quality issues in SKOS vocabularies, integrating with online services and development workflows.
Code quality checker
An extension for flake8 that integrates PyLint to check Python code quality and detect potential errors.
LLM benchmarker
A benchmarking framework for large language models
Validator
A Python data validation library providing simple and flexible ways to validate complex data structures.
Code quality checker
A comprehensive configuration for JavaScript projects with enhanced error checking and code quality control.
RAG application builder
A Python package that enables the creation and management of Retrieval Augmented Generation applications with filtering capabilities.
Code checker
A tool to check Python code quality in Jupyter notebooks.
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Featured in 1 awesome list
Each link jumps to the spot where the list mentions tonic_validate.
