LocalAI
AI server
A drop-in replacement API for local AI inference on consumer-grade hardware without requiring a GPU.
The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
27k stars
191 watching
2k forks
Language: Go
last commit: 1 day ago
Linked from 4 awesome lists
aiapiaudio-generationdistributedgemmagpt4allimage-generationkuberneteslibp2pllamallama3llmmambamistralmusicgenrerankrwkvstable-diffusiontext-generationtts
avelino/awesome-go
ethicalml/awesome-production-machine-learning
pluja/awesome-privacy
kelvins/awesome-mlopsRelated projects:
| Repository | Description | Stars |
|---|---|---|
 lim0606/torch-inception-resnet-v2 | A re-trained version of the Inception-ResNet-V2 model using Torch, with notes on training conditions and experimental results. | 52 |
 flagai-open/aquila2 | Provides pre-trained language models and tools for fine-tuning and evaluation | 439 |
 yuyang-huang/keras-inception-resnet-v2 | Represents an implementation of the Inception-ResNet v2 deep learning model in Keras. | 180 |
 davendw49/k2 | A large language model trained on geoscience literature and fine-tuned with knowledge-intensive data for academic copilot tasks | 173 |
 neulab/prompt2model | Generates deployable models from natural language instructions | 1,975 |
 locuslab/e2e-model-learning | Develops an approach to learning probabilistic models in stochastic optimization problems | 201 |
 nomic-ai/gpt4all | An open-source Python client for running Large Language Models (LLMs) locally on any device. | 71,176 |
 microsoft/phi-3cookbook | A resource providing hands-on examples and guides for using Microsoft's Phi-3 models in various software development contexts. | 2,582 |
 stjordanis/gluon2keras | Converts Gluon deep neural network models to Keras equivalents | 0 |
 jshilong/gpt4roi | Training and deploying large language models on computer vision tasks using region-of-interest inputs | 517 |
 localminimum/qanet | An implementation of Google's QANet for machine reading comprehension using TensorFlow. | 983 |
 gmalivenko/pytorch2keras | Converts PyTorch models to Keras models | 859 |
 mit-han-lab/offsite-tuning | An open-source project that enables private and efficient adaptation of large foundation models to downstream tasks without requiring access to the full model weights. | 367 |
 ymcui/pert | Develops a pre-trained language model to learn semantic knowledge from permuted text without mask labels | 356 |
 guidance-ai/guidance | An efficient programming paradigm for controlling large language models | 19,259 |