giskard
by Giskard-AI
🐢 Open-Source Evaluation & Testing for AI & LLM systems
AI summary
AI auditor
Automates the detection of performance, bias, and security issues in AI applications
- stars
- 4.1K
- forks
- 274
- watching
- 33
- awesome lists
- 3
Similar projects
Found by comparing what the projects do, not just their names.
LLM evaluator
A framework for evaluating large language models
Model monitor
An observability framework for evaluating and monitoring the performance of machine learning models and data pipelines
LLM evaluation toolkit
A toolkit for evaluating and optimizing Large Language Model applications with objective metrics, test data generation, and seamless integrations.
deepset-ai/haystack18.1K
LLM orchestrator
An AI orchestration framework to build customizable LLM applications with advanced retrieval methods.
LLM app builder
A framework for building enterprise LLM-based applications using small, specialized models
Bias detector and remover
A comprehensive toolkit for detecting and mitigating bias in machine learning models and datasets.
openai/evals15.2K
Benchmarking framework
A framework for evaluating large language models and systems, providing a registry of benchmarks.
langgenius/dify54.9K
AI application builder
An open-source LLM app development platform that enables users to build and deploy AI-powered applications quickly and efficiently.
ML defense toolkit
A Python library that provides tools and techniques to defend against various attacks on machine learning models and applications.
Model memorization analysis
A Python package for measuring memorization in Large Language Models.
Bias datasets
Compiles bias evaluation datasets and provides access to original data sources for large language models
LLM tester
A tool for testing and evaluating large language models (LLMs) to ensure they are reliable and secure
Research Agent
An autonomous research agent that gathers and summarizes information from various sources to generate comprehensive reports with citations.
Prompt testing env
An environment for battle-testing prompts to Large Language Models (LLMs) to evaluate response quality and performance.
Featured in 3 awesome lists
Each link jumps to the spot where the list mentions giskard.
