PyRIT

Risk assessment tool

Empowers security professionals to identify risks in generative AI systems by providing a framework for proactive risk assessment and red teaming.

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

GitHub

2k stars
32 watching
377 forks
Language: Python
last commit: almost 2 years ago
Linked from 1 awesome list

ai-red-teamgenerative-aired-team-toolsresponsible-ai

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
ensta-u2is-ai/torch-uncertaintyProvides tools and methods to quantify uncertainty in deep learning models and improve their reliability320
claudiugeorgiu/riskindroidAn Android app risk analysis tool using machine learning and reverse engineering to evaluate permission usage and risks.141
endgameinc/rtaA framework of python scripts designed to test detection capabilities against malicious tradecraft modeled after MITRE ATT&CK tactics.1,054
embodiedgpt/embodiedgpt_pytorchA PyTorch-based toolkit for creating customized multimedia datasets and handling heterogeneous data for training AI models.346
orobix/visual-feature-attribution-using-wasserstein-gans-pytorchA PyTorch implementation of a feature attribution technique using Wasserstein Generative Adversarial Networks for anomaly detection in medical images.93
arm-doe/pyartAn interactive toolkit for working with weather radar data using Python and atmospheric radar algorithms520
apger/sa-rbaA Splunk add-on that provides risk-based alerting capabilities using Python and integrates with Splunk Enterprise Security45
ai-secure/decodingtrustAn assessment tool for evaluating trustworthiness in GPT models across various aspects such as toxicity, bias, robustness, and fairness.267
python-security/pytA tool that analyzes Python web applications for potential security vulnerabilities2,181
tripwire/tardisAn intelligence platform for threat analysis and incident response123
ctallec/pyvarinfA Python package facilitating Bayesian Deep Learning methods with Variational Inference for PyTorch359
project-dc/pygenesesA PyTorch-based framework for training and studying artificial species in bio-inspired environments72
jphall663/gai_risk_managementResources to help organizations manage risks associated with Generative AI systems11
someengineering/fixinventoryTools to identify and remove critical risks in cloud infrastructure accounts by analyzing metadata from APIs of various cloud services1,617
stratosphereips/manatiAn open-source tool utilizing machine learning to assist threat analysts in identifying security problems.112