jury
by obss
Comprehensive NLP Evaluation System
AI summary
NLP evaluator
A comprehensive toolkit for evaluating NLP experiments offering automated metrics and efficient computation.
- stars
- 187
- forks
- 20
- watching
- 5
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
maluuba/nlg-eval1.4K
Model evaluator
A toolset for evaluating and comparing natural language generation models
Model Evaluator
An evaluation framework for machine learning models and datasets, providing standardized metrics and tools for comparing model performance.
Evaluation pipeline
A framework for evaluating language models on NLP tasks
Evaluator
An expression evaluator library written in Go.
Model Evaluator
Evaluates language models using standardized benchmarks and prompting techniques.
olical/conjure1.8K
Code evaluator
An interactive environment for evaluating code within a running program.
Legal model evaluator
Evaluates the legal knowledge of large language models using a custom benchmarking framework.
Evaluator
An automatic evaluation tool for large language models
Chart eval
An evaluation suite for assessing chart understanding in multimodal large language models.
Word embedding evaluator
An evaluation framework for Polish word embeddings prepared by various research groups using analogy tasks.
LLM evaluator
An all-in-one toolkit for evaluating Large Language Models (LLMs) across multiple backends.
Evaluation toolkit
A comprehensive Python toolbox for evaluating salient object detection and camouflaged object detection tasks
OCR evaluator
A collection of tools and utilities for evaluating the performance and quality of OCR output
hkust-nlp/ceval1.7K
Evaluation suite
An evaluation suite providing multiple-choice questions for foundation models in various disciplines, with tools for assessing model performance.
Prompt evaluator
An API for evaluating the quality of text prompts used in Large Language Models (LLMs) based on perplexity estimation
Featured in 1 awesome list
Each link jumps to the spot where the list mentions jury.
