Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.

stars

467

forks

76

watching

23

• #artificial-intelligence
• #attention-mechanism
• #deep-learning
• #human-feedback
• #machine-learning
• #reinforcement-learning
• #transformers