promptfoo

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

GitHub
4k stars
20 watching
316 forks
Language: TypeScript
last commit: 5 days ago
Linked from 2 awesome lists

cici-cdcicdevaluationevaluation-frameworkllmllm-evalllm-evaluationllm-evaluation-frameworkllmopspentestingprompt-engineeringprompt-testingpromptsragred-teamingtestingvulnerability-scanners

Screenshot of promptfoo/promptfoo website

promptfoo.dev

Backlinks from these awesome lists: