RAGChecker
RAG evaluator
A framework for evaluating and diagnosing retrieval-augmented generation systems
RAGChecker: A Fine-grained Framework For Diagnosing RAG
630 stars
9 watching
55 forks
Language: Python
last commit: about 2 months ago Related projects:
| Repository | Description | Stars |
|---|---|---|
 stanford-futuredata/ares | A tool for automatically evaluating RAG models by generating synthetic data and fine-tuning classifiers | 499 |
| amazon-science/refchecker | Automates fine-grained hallucination detection in large language model outputs | 325 |
 robbyfux/ragpicker | A tool used to test antivirus products and analyze malware samples. | 94 |
 whyhow-ai/rule-based-retrieval | A Python package that enables the creation and management of Retrieval Augmented Generation applications with filtering capabilities. | 229 |
 gomate-community/rageval | An evaluation tool for Retrieval-augmented Generation methods | 141 |
 pinecone-io/canopy | An open-source framework for building retrieval-augmented generation applications using a vector database | 982 |
 coolhandsquid/tirefire | Automates the scanning and enumeration of machines externally while maintaining control over scans. | 148 |
 no13bus/ohmyrepo | An application that uses GitHub webhooks to track repository stars and followers from users worldwide. | 123 |
 vida-nyu/ache | A web crawler designed to efficiently collect and prioritize relevant content from the web | 459 |
 k3170makan/goodork | A command-line tool that uses regular expressions to analyze Google search results and extract data from web applications. | 134 |
 udayraj123/omrchecker | An OMR sheet scanner and analyzer that reads and evaluates human-marked data on documents from images taken by scanner or phone. | 791 |
 tonicai/tonic_validate | A framework for evaluating and monitoring the quality of large language model outputs in Retrieval Augmented Generation applications. | 271 |
 damian89/extended-ssrf-search | An SSRF scanner written in Python to identify potential vulnerabilities by scanning predefined settings in URLs and request headers. | 276 |
 usscltd/dorks | Automates searching for vulnerabilities in databases and websites using predefined query patterns | 200 |
 rverton/webanalyze | Automates mass website analysis by uncovering technologies used on websites. | 987 |