inspect_ai
Inspect: A framework for large language model evaluations
AI summary
Model inspector
A framework for evaluating large language models
- stars
- 669
- forks
- 135
- watching
- 9
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Model evaluator
An evaluation framework for large language models trained with instruction tuning methods
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
Code auditor
Automates code quality checks for Python programs
Model evaluation framework
An evaluation toolkit and platform for assessing large models in various domains
Exam evaluator
Evaluates foundation models on human-centric tasks with diverse exams and question types
Type inspector
Provides utilities for inspecting and analyzing Python types at runtime
Model Tester
A tool for testing and evaluating large language models with a focus on AI safety and model assessment.
Model evaluator
A framework for efficiently evaluating and benchmarking large models
Legal model evaluator
Evaluates the legal knowledge of large language models using a custom benchmarking framework.
Model testing framework
An evaluation framework using Chinese high school examination questions to assess large language model capabilities
Model Evaluator
An evaluation framework for machine learning models and datasets, providing standardized metrics and tools for comparing model performance.
Model interpreter
Provides tools and techniques for interpreting machine learning models
Language model toolkit
Provides pre-trained language models and tools for fine-tuning and evaluation
Multilingual Model
Develops and publishes large multilingual language models with advanced mixing-of-experts architecture.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions inspect_ai.
