betterprompt
Test suite for LLM prompts
AI summary
Prompt evaluator
An API for evaluating the quality of text prompts used in Large Language Models (LLMs) based on perplexity estimation
- stars
- 43
- forks
- 4
- watching
- 3
Similar projects
Found by comparing what the projects do, not just their names.
Prompt Optimizer
A tool to reduce the complexity of text prompts to minimize API costs and model computations.
Multimodal model evaluator
Evaluating and improving large multimodal models through in-context learning
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
Multimodal model evaluator
An open-source benchmark and evaluation tool for assessing multimodal large language models' performance in embodied decision-making tasks
Exam evaluator
Evaluates foundation models on human-centric tasks with diverse exams and question types
QA evaluator
An evaluation tool for question-answering systems using large language models and natural language processing techniques
Evaluation framework
An evaluation toolkit for large vision-language models
Segmentation evaluator
Evaluates segmentation performance in medical imaging using multiple metrics
Chart eval
An evaluation suite for assessing chart understanding in multimodal large language models.
VQA prompter
An implementation of a two-stage framework designed to prompt large language models with answer heuristics for knowledge-based visual question answering tasks.
Model evaluator
Evaluates and compares the performance of multimodal large language models on various tasks
Model Evaluator
A benchmarking framework for evaluating Large Multimodal Models by providing rigorous metrics and an efficient evaluation pipeline.
obss/jury187
NLP evaluator
A comprehensive toolkit for evaluating NLP experiments offering automated metrics and efficient computation.
Language model evaluator
Evaluates German transformer language models with syntactic agreement tests
Model evaluator
An evaluation framework for large language models trained with instruction tuning methods
