RAGChecker

RAG diagnostic tool

An automated evaluation framework for assessing and diagnosing Retrieval-Augmented Generation systems.

RAGChecker: A Fine-grained Framework For Diagnosing RAG

GitHub

575 stars
7 watching
47 forks
Language: Python
last commit: 2 months ago

Related projects:

Repository Description Stars
stanford-futuredata/ares A tool for automatically evaluating RAG models by generating synthetic data and fine-tuning classifiers 492
amazon-science/refchecker Automates fine-grained hallucination detection in large language model outputs 306
robbyfux/ragpicker A tool used to test antivirus products and analyze malware samples. 94
whyhow-ai/rule-based-retrieval A Python package that enables the creation and management of Retrieval Augmented Generation applications with filtering capabilities. 224
gomate-community/rageval An evaluation tool for Retrieval-augmented Generation methods 139
pinecone-io/canopy An open-source framework for building retrieval-augmented generation applications using a vector database 977
coolhandsquid/tirefire Automates scanning and enumeration of target machines with control over scans 148
no13bus/ohmyrepo Automatically analyzes GitHub repository activity, including stars and followers 123
vida-nyu/ache A web crawler designed to efficiently collect and prioritize relevant content from the web 456
k3170makan/goodork A command-line tool that uses regular expressions to analyze Google search results and extract data from web applications. 133
udayraj123/omrchecker An OMR sheet scanner and analyzer that reads and evaluates human-marked data on documents from images taken by scanner or phone. 784
tonicai/tonic_validate A framework for evaluating and monitoring the quality of large language model outputs in Retrieval Augmented Generation applications. 269
damian89/extended-ssrf-search An SSRF scanner written in Python to identify potential vulnerabilities by scanning predefined settings in URLs and request headers. 275
usscltd/dorks Automates searching for vulnerabilities in databases and websites using predefined query patterns 199
rverton/webanalyze Automates mass website analysis by uncovering technologies used on websites. 979