mimir
by iamgroot42
Python package for measuring memorization in LLMs.
AI summary
Model memorization analysis
A Python package for measuring memorization in Large Language Models.
- stars
- 126
- forks
- 23
- watching
- 3
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Dataset checker
Detects whether a given text sequence is part of the training data used to train a large language model.
Model evaluator
Evaluates and compares the performance of multimodal large language models on various tasks
Code detector
Automatically detects obfuscated code and other complex code constructs in binaries to aid reverse engineering.
Bias detector
A dataset and benchmarking framework to evaluate the performance of question answering models on detecting and mitigating social biases.
truera/trulens2.2K
Performance tracker for LLMs
A tool to evaluate and track the performance of large language model (LLM) experiments
Security toolkit
An open-source project that explores the intersection of machine learning and security to develop tools for detecting vulnerabilities in web applications.
Privacy Auditor
An auditing tool to assess the privacy risks of machine learning models
Prompt Scanner
A security scanner for Large Language Model prompts to detect potential threats and vulnerabilities
mop/bier39
Metric learner
This project implements a deep metric learning framework using an adversarial auxiliary loss to improve robustness.
Memory analyzer
Tools and scripts for capturing and analyzing Linux memory
jina-ai/thinkgpt1.6K
LLM augmentor
A Python library to augment large language models by enabling them to think and reason more effectively
LLM auditor
An auditing tool to identify weaknesses in large language models before deployment.
Content Extractor
A tool to extract memorized content from large language models like GPT-2 by analyzing their training data
Machine Learning Book Implementation
An implementation of Manning Publications' How Machine Learning Works book in Python using Jupyter Notebook
chanyn/hkrm105
Object Detector
Develops a deep learning model for large-scale object detection that leverages hybrid knowledge and routing mechanisms.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions mimir.
