BIG-bench
by google
Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models
AI summary
Language model benchmark
A benchmark designed to probe large language models and extrapolate their future capabilities through a diverse set of tasks.
- stars
- 2.9K
- forks
- 593
- watching
- 51
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
Prompt Generator
A toolkit for creating and using natural language prompts to enable large language models to generalize to new tasks.
Prompt engineering guide
Guides software developers on how to effectively use and build systems around Large Language Models like GPT-4.
Language benchmarks
A collection of benchmarking tests for various programming languages
Batch processor
Generates large language model outputs in high-throughput mode on single GPUs
Model evaluator
A unified framework for evaluating large language models' performance and robustness in various scenarios.
openbmb/bmtools2.9K
LM toolkit
Tools and platform for building and extending large language models
Text Generation Toolkit
A toolkit for deploying and serving Large Language Models (LLMs) for high-performance text generation
Code timer
A microbenchmarking library that allows users to measure the execution time of specific code snippets
LLM toolkit
A toolkit for fine-tuning and inferring large machine learning models
Tool learning platform
A platform for training, serving, and evaluating large language models to enable tool use capability
NLP toolkit
An NLP project offering various text classification models and techniques for deep learning exploration
Chinese understanding benchmark
Measures the understanding of massive multitask Chinese datasets using large language models
Mixture-of-Experts Language Model
A high-performance mixture-of-experts language model with strong performance and efficient inference capabilities.
LLM evaluator
A framework for evaluating large language models
Benchmark
An image-context reasoning benchmark designed to challenge large vision-language models and help improve their accuracy
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions BIG-bench.
