rlhf_trojan_competition
by ethz-spylab
Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.
AI summary
Backdoor detector
Detecting backdoors in language models to prevent malicious AI usage
- stars
- 109
- forks
- 9
- watching
- 4
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Federated Learning Detector
Develops and evaluates a framework for detecting attacks on federated learning systems
Secret detector
Automates secret detection in GitHub repositories
IPv6 attack detector
Tools to detect and analyze link-local IPv6 attacks
Backdoor defense framework
A framework for defending against backdoor attacks in federated learning systems
Phishing Detector
A framework that detects and responds to phishing attacks by analyzing email contents, attachments, and links.
Federated learning defense system
A backdoor defense system for federated learning, designed to protect against data poisoning attacks by isolating subspace training and aggregating models with robust consensus fusion.
Security scanner
Automates vulnerability detection and remediation across GitHub and GitLab assets to strengthen software security posture.
Malware detector dataset
A large-scale dataset and codebase for training machine learning models to detect malicious software
Fraud detector
Develops and evaluates machine learning models for detecting financial fraud
Behavior alignment tool
Aligns large language models' behavior through fine-grained correctional human feedback to improve trustworthiness and accuracy.
Federated Learning Attack
A framework for attacking federated learning systems with adaptive backdoor attacks
LLM vulnerability detector
A toolkit to detect and protect against vulnerabilities in Large Language Models.
Scanner
Secret scanner built in Rust for performance to detect sensitive information
Federated Learning Framework
This project presents a framework for robust federated learning against backdoor attacks.
Security toolkit
An open-source project that explores the intersection of machine learning and security to develop tools for detecting vulnerabilities in web applications.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions rlhf_trojan_competition.
