MMC

Chart model trainer

Develops a large-scale dataset and benchmark for training multimodal chart understanding models using large language models.

[NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning

GitHub

84 stars
6 watching
3 forks
Language: Python
last commit: about 2 months ago
arxivbenchmarkchartdatasetgptinstruction-tuningllavaminigpt4mplug-owlmultimodalotterresourcestock

Related projects:

Repository Description Stars
felixgithub2017/mmcu Evaluates the semantic understanding capabilities of large Chinese language models using a multimodal dataset. 87
haozhezhao/mic Develops a multimodal vision-language model to enable machines to understand complex relationships between instructions and images in various tasks. 334
ailab-cvc/seed-bench A benchmark for evaluating large language models' ability to process multimodal input 315
open-mmlab/mmengine Provides a flexible and configurable framework for training deep learning models with PyTorch. 1,179
ailab-cvc/seed An implementation of a multimodal language model with capabilities for comprehension and generation 576
fukuball/fuku-ml An easy-to-use machine learning library with various algorithms for classification and regression tasks. 281
giuseppec/iml Provides methods to interpret and explain the behavior of machine learning models 492
pleisto/yuren-baichuan-7b A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks 72
yuliang-liu/monkey A toolkit for building conversational AI models that can process images and text inputs. 1,825
minimaxir/automl-gs Automates machine learning model creation and optimization for complex datasets 1,853
yuweihao/mm-vet Evaluates the capabilities of large multimodal models using a set of diverse tasks and metrics 267
freedomintelligence/mllm-bench Evaluates and compares the performance of multimodal large language models on various tasks 55
mosecorg/mosec A high-performance ML model serving framework 790
tingxueronghua/chartllama-code A multimodal LLM for understanding and generating charts in various formats. 196
x-plug/mplug-halowl Evaluates and mitigates hallucinations in multimodal large language models 79