promptbench
by microsoft
A unified evaluation framework for large language models
AI summary
Model evaluator
A unified framework for evaluating large language models' performance and robustness in various scenarios.
- stars
- 2.5K
- forks
- 184
- watching
- 20
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Prompt generator
A utility library for crafting prompts to help Large Language Models generate specific outputs
Prompt Generator
A toolkit for creating and using natural language prompts to enable large language models to generalize to new tasks.
Evaluation framework
Provides a unified framework to test generative language models on various evaluation tasks.
Prompt engineering guide
Guides software developers on how to effectively use and build systems around Large Language Models like GPT-4.
Prompt papers
A curated list of papers on prompt-based tuning for pre-trained language models, providing insights and advancements in the field.
Prompt analysis tool
A framework for analyzing the robustness of large language models to adversarial prompt attacks
google/big-bench2.9K
Language model benchmark
A benchmark designed to probe large language models and extrapolate their future capabilities through a diverse set of tasks.
LLM tester
A tool for testing and evaluating large language models (LLMs) to ensure they are reliable and secure
Prompt tester
A set of tools for testing and evaluating natural language processing models and vector databases.
Tool learning platform
A platform for training, serving, and evaluating large language models to enable tool use capability
Prompt Guide
A comprehensive resource for guiding the development and optimization of prompts to use language models effectively in various applications.
Text parser
A tool that uses large language models to extract structured information from unstructured text
LLM toolkit
A toolkit for fine-tuning and inferring large machine learning models
Prompt testing env
An environment for battle-testing prompts to Large Language Models (LLMs) to evaluate response quality and performance.
CLI toolkit
A Python library for building interactive command line applications with advanced features like syntax highlighting and code completion.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions promptbench.
