levanter
Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
AI summary
Language model trainer
A framework for training large language models that prioritizes legibility, scalability, and reproducibility
- stars
- 527
- forks
- 85
- watching
- 14
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
zjunlp/knowlm1.3K
Knowledge model framework
A framework for training and utilizing large language models with knowledge augmentation capabilities
Language model trainer
A framework for training and fine-tuning multimodal language models on various data types
Language models
A collection of lightweight state-of-the-art language models designed to support multilinguality, coding, and reasoning tasks on constrained resources.
ConvCRF model
An implementation of a convolutional Conditional Random Field model for semantic segmentation tasks.
3D LLM
Developing a Large Language Model capable of processing 3D representations as inputs
Model framework
A lightweight model framework for validating and serializing data.
Linguistic data framework
A flexible data model and API for representing linguistic data in a language-independent and theory-neutral way.
LLM framework
A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs.
Language Model
A lightweight, multilingual language model with a long context length
NLP framework
A pre-trained language model designed for various NLP tasks, including dialogue generation, code completion, and retrieval.
Multimodal model framework
A framework for grounding language models to images and handling multimodal inputs and outputs
Language model
An implementation of a fast and efficient language model architecture
ML models
Provides pre-trained machine learning models for natural language processing tasks using Clojure and the clj-djl framework.
LLM benchmarking tool
A tool for evaluating the performance of large language model APIs
google/paxml461
ML framework
A framework for configuring and running machine learning experiments on top of Jax.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions levanter.
