jailbreak-evaluation
The jailbreak-evaluation is an easy-to-use Python package for language model jailbreak evaluation.
AI summary
Control evaluation
Evaluates language model attempts to determine their control and trustworthiness
- stars
- 20
- forks
- 3
- watching
- 0
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Evaluation tool
Develops an interpretable evaluation procedure for off-policy evaluation (OPE) methods to quantify their sensitivity to hyper-parameter choices and/or evaluation policy choices.
Model evaluator
Evaluates and compares the performance of multimodal large language models on various tasks
LLM evaluator
An evaluation suite and dynamic data release platform for large language models
Quality checker
A framework for evaluating and monitoring the quality of large language model outputs in Retrieval Augmented Generation applications.
experiment framework
A Python library designed to support the development of timing-critical experiments in cognitive science and neuroscience.
Test runner
Provides a way to run Behavior-Driven Development tests in Django applications
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
Evaluation toolkit
A comprehensive Python toolbox for evaluating salient object detection and camouflaged object detection tasks
Model evaluator
An evaluation framework for large language models trained with instruction tuning methods
Chart eval
An evaluation suite for assessing chart understanding in multimodal large language models.
Test suite
A BDD testing framework for Django applications
Safety fine-tuner
Improves safety and helpfulness of large language models by fine-tuning them using safety-critical tasks
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Model inspector
A framework for evaluating large language models
Bias scanner
Tools and resources for identifying biased language in code and content.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions jailbreak-evaluation.
