LLMs-from-scratch
by rasbt
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
AI summary
GPT model development
Developing and pretraining a GPT-like Large Language Model from scratch
- stars
- 35.4K
- forks
- 4.4K
- watching
- 382
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
LLM guide
A curated list of resources to help developers navigate the landscape of large language models and their applications in NLP
mlabonne/llm-course40.1K
LLM tutorial
A comprehensive course and resource package on building and deploying Large Language Models (LLMs)
Datasets
A curated collection of high-quality datasets for training large language models.
LLM Client
A command-line tool and workflow manager for interacting with large language models like ChatGPT/GPT4.
LLM trainer
A native PyTorch library for training large language models using distributed parallelism and optimization techniques.
Language Model
Trains a large-scale PyTorch language model on the 1-Billion Word dataset
Instruction framework
Large pre-trained language models trained to follow complex instructions using an evolutionary instruction framework
LLM framework
A framework for training and serving large language models using JAX/Flax
openbmb/bmtools2.9K
LM toolkit
Tools and platform for building and extending large language models
nomic-ai/gpt4all71.2K
LLM client
An open-source Python client for running Large Language Models (LLMs) locally on any device.
LLM tutorial
A practical course teaching large language models and their applications through hands-on projects using OpenAI API and Hugging Face library.
thunlp/plmpapers3.3K
Language model research paper collection
Compiles and organizes key papers on pre-trained language models, providing a resource for developers and researchers.
Chatbot framework
An open-source chatbot platform built on Rasa and Langchain with support for LLM indexing and Telegram integration.
eth-sri/lmql3.7K
LLM programming language
A language that enables efficient and constraint-guided programming with large language models
Prompt engineering guide
Guides software developers on how to effectively use and build systems around Large Language Models like GPT-4.
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions LLMs-from-scratch.
