PromptInject
PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Safety Workshop 2022
AI summary
Prompt analysis tool
A framework for analyzing the robustness of large language models to adversarial prompt attacks
- stars
- 318
- forks
- 32
- watching
- 11
Similar projects
Found by comparing what the projects do, not just their names.
protectai/rebuff1.1K
Prompt shield
Protects AI applications from prompt injection attacks through multiple layers of defense
jthack/pipe376
Prompt Injection Primer
A guide to help developers understand and mitigate the security risks of prompt injection in AI-powered applications and features.
Prompt engineering course
A comprehensive resource for learning prompt engineering techniques for interacting with large language models.
Prompt evaluator
An API for evaluating the quality of text prompts used in Large Language Models (LLMs) based on perplexity estimation
Prompt Optimizer
A tool to reduce the complexity of text prompts to minimize API costs and model computations.
AI attack analysis tool
A framework to help security analysts understand and prepare for adversarial machine learning attacks on AI systems
Model evaluator
A unified framework for evaluating large language models' performance and robustness in various scenarios.
MARL experiment tool
A research-friendly codebase for experimenting with multi-agent reinforcement learning in JAX
Prompt tester
An interactive tool that tests and hardens the security of system prompts used in GenAI applications against various attacks.
Prompt Server
An ExpressJS middleware that allows users to execute LLM prompts stored in a git repository and retrieve results from a chosen model.
Prompt tuning for speech processing
An approach to leveraging pre-trained models for efficient speech processing tasks by using prompt tuning
Prompt Scanner
A security scanner for Large Language Model prompts to detect potential threats and vulnerabilities
demisto/cops151
Incident response standard
Standardized framework for creating and sharing incident response processes in a shared language
Prompt library
A comprehensive collection of customizable prompts for Generative Pre-trained Transformers (GPTs) designed specifically for educational use.
xcambar/purs252
Prompt engine
A Rust implementation of a minimal, fast, and aesthetically pleasing prompt system
