multimodal_rerprogramming

Similar projects

Found by comparing what the projects do, not just their names.

• paarthneekhara/rnn_adversarial_reprogramming6

  Neural network reprogramming

  Repurposes pre-trained neural networks for new classification tasks through adversarial reprogramming of their inputs.

• prinsphield/adversarial_reprogramming33

  Network reprogramming

  This project enables reprogramming of pre-trained neural networks to work on new tasks by fine-tuning them on smaller datasets.

• multimodal-art-projection/omnibench15

  Multimodal benchmarking

  Evaluates and benchmarks multimodal language models' ability to process visual, acoustic, and textual inputs simultaneously.

• dodohow1011/speechadvreprogram18

  Speech Recognition

  Developing low-resource speech command recognition systems using adversarial reprogramming and transfer learning

• yunyuntsai/black-box-adversarial-reprogramming37

  Model reprogramming

  An approach to adapt machine learning models using scarce data and limited resources by modifying their internal workings without changing the model's original architecture or training data.

• pku-yuangroup/languagebind751

  Multimodal alignment model

  Extending pretraining models to handle multiple modalities by aligning language and video representations

• huckiyang/voice2series-reprogramming70

  Acoustic model reprogramming

  An approach to reprogramming acoustic models for time series classification using differential mel-spectrograms and adversarial training

• yerevann/warp83

  NLP Task Adaptation

  An approach to transfer learning for NLP tasks using adversarial reprogramming and word-level task-specific embeddings.

• openbmb/viscpm1.1K

  Multimodal Models

  A family of large multimodal models supporting multimodal conversational capabilities and text-to-image generation in multiple languages

• subho406/omninet515

  Multi-modal ML framework

  An implementation of a unified architecture for multi-modal multi-task learning using PyTorch.

• ailab-cvc/seed585

  Multimodal LLM

  An implementation of a multimodal language model with capabilities for comprehension and generation

• xverse-ai/xverse-v-13b78

  Multimodal model

  A large multimodal model for visual question answering, trained on a dataset of 2.1B image-text pairs and 8.2M instruction sequences.

• l0sg/relational-rnn-pytorch245

  Language model

  An implementation of DeepMind's Relational Recurrent Neural Networks (Santoro et al. 2018) in PyTorch for word language modeling

• lyuchenyang/macaw-llm1.6K

  Multimodal LLM

  A multi-modal language model that integrates image, video, audio, and text data to improve language understanding and generation

• pleisto/yuren-baichuan-7b73

  Multimodal LLM

  A multi-modal large language model that integrates natural language and visual capabilities with fine-tuning for various tasks