LaMDA-rlhf-pytorch

Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.

Archived

GitHub

467 stars
23 watching
76 forks
Language: Python
last commit: 10 months ago
artificial-intelligenceattention-mechanismdeep-learninghuman-feedbackmachine-learningreinforcement-learningtransformers