adapters

Transfer learning library

A unified library for parameter-efficient and modular transfer learning in NLP tasks

A Unified Library for Parameter-Efficient and Modular Transfer Learning

GitHub

3k stars
29 watching
352 forks
Language: Jupyter Notebook
last commit: about 2 months ago
Linked from 1 awesome list

adaptersbertloranatural-language-processingnlpparameter-efficient-learningparameter-efficient-tuningpytorchtransformers

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
huggingface/transformers A collection of pre-trained machine learning models for various natural language and computer vision tasks, enabling developers to fine-tune and deploy these models on their own projects. 136,357
huggingface/pytorch-openai-transformer-lm Implementing OpenAI's transformer language model in PyTorch with pre-trained weights and fine-tuning capabilities 1,511
codertimo/bert-pytorch An implementation of Google's 2018 BERT model in PyTorch, allowing pre-training and fine-tuning for natural language processing tasks 6,251
huggingface/trl A library designed to train transformer language models with reinforcement learning using various optimization techniques and fine-tuning methods. 10,308
qubvel-org/segmentation_models.pytorch A comprehensive library for training and applying deep learning models for image segmentation 9,829
thuml/transfer-learning-library A comprehensive Python library for adapting models to new environments and tasks through various techniques 3,484
deepset-ai/farm An open-source framework for adapting representation models to various tasks and industries 1,743
microsoft/lora A method to adapt large language models by reducing their parameter count using low-rank adaptation matrices 10,959
pytorch/pytorch A Python library providing tensors and dynamic neural networks with strong GPU acceleration 84,978
kimiyoung/transformer-xl Implementations of a neural network architecture for language modeling 3,619
pytorch/examples A collection of curated examples showcasing various PyTorch applications in computer vision, natural language processing, and reinforcement learning. 22,530
lucidrains/reformer-pytorch An implementation of Reformer, an efficient Transformer model for natural language processing tasks. 2,132
catalyst-team/catalyst A PyTorch framework for accelerating deep learning research and development by focusing on reproducibility, rapid experimentation, and codebase reuse. 3,300
ukplab/sentence-transformers Provides dense vector representations for text using transformer networks 15,556
eleutherai/pythia Analyzing knowledge development and evolution in large language models during training 2,309