Monkey

Similar projects

Found by comparing what the projects do, not just their names.

• kohjingyu/fromage478

  Multimodal model framework

  A framework for grounding language models to images and handling multimodal inputs and outputs

• lyuchenyang/macaw-llm1.6K

  Multimodal LLM

  A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation

• yuliang-liu/multimodalocr484

  OCR Benchmark

  An evaluation benchmark for OCR capabilities in large multmodal models.

• pleisto/yuren-baichuan-7b73

  Multimodal LLM

  A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks

• openbmb/viscpm1.1K

  Multimodal Models

  A family of large multimodal models supporting multimodal conversational capabilities and text-to-image generation in multiple languages

• yfzhang114/slime143

  Multimodal model developer

  Develops large multimodal models for high-resolution understanding and analysis of text, images, and other data types.

• zhourax/vega33

  Multimodal evaluation framework

  Develops a multimodal task and dataset to assess vision-language models' ability to handle interleaved image-text inputs.

• bytedance/lynx-llm231

  Multimodal LLM framework

  A framework for training GPT4-style language models with multimodal inputs using large datasets and pre-trained models

• yuweihao/mm-vet274

  Model evaluator

  Evaluates the capabilities of large multimodal models using a set of diverse tasks and metrics

• runpeidong/dreamllm402

  Multimodal Model Builder

  A framework to build versatile Multimodal Large Language Models with synergistic comprehension and creation capabilities

• phellonchen/x-llm308

  Multimodal LLM Framework

  A framework that enables large language models to process and understand multimodal inputs from various sources such as images and speech.

• ailab-cvc/seed585

  Multimodal LLM

  An implementation of a multimodal language model with capabilities for comprehension and generation

• multimodal-art-projection/omnibench15

  Multimodal benchmarking

  Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.

• mbzuai-oryx/groundinglmm797

  Multimodal conversational model

  An end-to-end trained model capable of generating natural language responses integrated with object segmentation masks for interactive visual conversations

• yuxie11/r2d2157

  Vision-Language Framework

  A framework for large-scale cross-modal benchmarks and vision-language tasks in Chinese