PaLM-rlhf-pytorch
by lucidrains
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
AI summary
RLHF framework
An implementation of RLHF on top of the PaLM architecture to enable human feedback in reinforcement learning for large language models.
- stars
- 7.7K
- forks
- 671
- watching
- 143
Similar projects
Found by comparing what the projects do, not just their names.
carperai/trlx4.5K
RL Framework
A framework for distributed reinforcement learning of large language models with human feedback
RL frameworks
PyTorch implementations of popular deep reinforcement learning algorithms and environments.
Text-to-Image Generator
Implements Google's Text-to-Image Neural Network in PyTorch using a cascading DDPM architecture with dynamic clipping and noise level conditioning.
Music Generation Model
Implementation of Google's MusicLM model for music generation using attention networks and text-conditioning.
iffix/machin402
RL framework
An open-source reinforcement learning library for PyTorch, providing a simple and clear implementation of various algorithms.
Model alignment
This project demonstrates the effectiveness of reinforcement learning from human feedback (RLHF) in improving small language models like GPT-2.
RL framework
A high-performance implementation of reinforcement learning training pipelines using JAX and PyTorch-like functionality
Reinforcement Learning framework
Replication of Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks in PyTorch for reinforcement learning tasks
thu-ml/tianshou8.1K
RL library
A high-performance reinforcement learning library with modular interfaces and user-friendly APIs for building deep learning agents.
Image generator
An implementation of DALL-E 2's text-to-image synthesis neural network in PyTorch
LLM Benchmarks
A platform providing data, models, and evaluation benchmarks for large language models to promote accessibility and democratization of AI technology
Alignment Recipes
Provides recipes and guidelines for training language models to align with human preferences and AI goals
huggingface/trl10.3K
Transformer model trainer
A library designed to train transformer language models with reinforcement learning using various optimization techniques and fine-tuning methods.
DRL toolkit
A next-generation deep reinforcement learning toolkit with libraries for multiagent, self-supervised, offline, and transfer/reinforcement learning
RLHF framework
A framework for training language models using human feedback and reinforcement learning
