BenchLMM

Similar projects

Found by comparing what the projects do, not just their names.

• ailab-cvc/seed-bench322

  Multimodal LLM test suite

  A benchmark for evaluating large language models' ability to process multimodal input

• damo-nlp-sg/m3exam93

  LM Benchmark

  A benchmark for evaluating large language models in multiple languages and formats

• qcri/llmebench81

  LLM benchmarker

  A benchmarking framework for large language models

• ucsc-vlaa/vllm-safety-benchmark72

  Vision model safety test

  A benchmark for evaluating the safety and robustness of vision language models against adversarial attacks.

• junyangwang0410/amber98

  MLLM benchmark

  An LLM-free benchmark suite for evaluating MLLMs' hallucination capabilities in various tasks and dimensions

• freedomintelligence/mllm-bench56

  Model evaluator

  Evaluates and compares the performance of multimodal large language models on various tasks

• szilard/benchm-ml1.9K

  ML benchmark

  A benchmark for evaluating machine learning algorithms' performance on large datasets

• multimodal-art-projection/omnibench15

  Multimodal benchmarking

  Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.

• ailab-cvc/seed585

  Multimodal LLM

  An implementation of a multimodal language model with capabilities for comprehension and generation

• bradyfu/video-mme422

  Video analysis benchmark

  Comprehensive benchmark for evaluating multi-modal large language models on video analysis tasks

• felixgithub2017/mmcu87

  Chinese understanding benchmark

  Measures the understanding of massive multitask Chinese datasets using large language models

• i-gallegos/fair-llm-benchmark115

  Bias datasets

  Compiles bias evaluation datasets and provides access to original data sources for large language models

• mlcommons/inference1.3K

  Model benchmarking suite

  Measures the performance of deep learning models in various deployment scenarios.

• tsb0601/mmvp296

  Visual model evaluation

  An evaluation framework for multimodal language models' visual capabilities using image and question benchmarks.

• lxtgh/omg-seg1.3K

  Visual Model

  Develops an end-to-end model for multiple visual perception and reasoning tasks using a single encoder, decoder, and large language model.