mmf

Multimodal framework

A modular framework for building vision and language multimodal research projects using PyTorch.

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

GitHub

6k stars
114 watching
939 forks
Language: Python
last commit: 8 days ago
captioningdeep-learningdialoghateful-memesmulti-taskingmultimodalpretrained-modelspytorchtextvqavqa

Related projects:

Repository Description Stars
jackie840129/fedfr An open-source software framework for jointly optimizing face recognition models in federated learning settings. 15
fff-rs/juice A machine learning framework designed to be extensible and agnostic, with support for multiple backends and linear algebra libraries. 1,111
mlreef/mlreef A platform for collaboration, data management, and reproducibility in machine learning development 1,442
asappresearch/flambe An ML framework for accelerating research and its integration into production workflows 262
ganyuwang/vfl-czofo A unified framework for improving privacy and reducing communication overhead in distributed machine learning models. 11
facebookresearch/detectron2 A platform for object detection and segmentation tasks using machine learning algorithms 30,583
sarababakn/mfcl-neurips23 A framework for mitigating catastrophic forgetting in federated learning for vision tasks using data synthesis from past distributions. 15
facebookresearch/spiritlm This repository provides an end-to-end language model capable of generating coherent text based on both spoken and written inputs. 777
google-parfait/tensorflow-federated An open-source framework for training machine learning models across decentralized data 2,322
somnibyte/mlkit A framework for implementing machine learning algorithms in Swift to make it easier for developers to incorporate ML into their projects. 152
mmorafah/pacfl Implementation of federated learning algorithms for distributed machine learning on private client data 37
mlr-org/mlr Provides an infrastructure for machine learning in R, enabling users to focus on experiments without writing lengthy wrappers and boilerplate code. 1,643
facebookresearch/fairseq A toolkit for training custom sequence-to-sequence models for various NLP tasks 30,575
facebookresearch/slowfast Provides state-of-the-art video understanding codebase with efficient training methods and pre-trained models for various tasks 6,623
adap/flower A framework for building federated AI systems with customization, extensibility, and flexibility in mind. 5,146