LocalAI
AI inference platform
Self-hosted AI inference platform for generating text, audio, video, images, and voice clones using various model architectures.
The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
26k stars
192 watching
2k forks
Language: Go
last commit: 4 days ago
Linked from 4 awesome lists
aiapiaudio-generationdistributedgemmagpt4allimage-generationkuberneteslibp2pllamallama3llmmambamistralmusicgenrerankrwkvstable-diffusiontext-generationtts
avelino/awesome-go
ethicalml/awesome-production-machine-learning
pluja/awesome-privacy
kelvins/awesome-mlopsRelated projects:
| Repository | Description | Stars |
|---|---|---|
 lim0606/torch-inception-resnet-v2 | This project re-implements the Inception-ResNet-v2 model from scratch using PyTorch and trains it on ImageNet. | 52 |
 flagai-open/aquila2 | Provides pre-trained language models and tools for fine-tuning and evaluation | 437 |
 yuyang-huang/keras-inception-resnet-v2 | Represents an implementation of the Inception-ResNet v2 deep learning model in Keras. | 180 |
 davendw49/k2 | A large language model trained on geoscience literature and fine-tuned with knowledge-intensive data for academic copilot tasks | 170 |
 neulab/prompt2model | Generates deployable models from natural language instructions | 1,962 |
 locuslab/e2e-model-learning | Develops an approach to learning probabilistic models in stochastic optimization problems | 200 |
 nomic-ai/gpt4all | An open-source Python client for running Large Language Models (LLMs) locally on any device. | 70,694 |
 microsoft/phi-3cookbook | A comprehensive cookbook providing hands-on examples and guides for using Microsoft's Phi-3 models in various applications and environments. | 2,479 |
 stjordanis/gluon2keras | Converts Gluon deep neural network models to Keras equivalents | 0 |
 jshilong/gpt4roi | Training and deploying large language models on computer vision tasks using region-of-interest inputs | 506 |
 localminimum/qanet | An implementation of Google's QANet for machine reading comprehension using TensorFlow. | 983 |
 gmalivenko/pytorch2keras | Converts PyTorch models to Keras models | 857 |
 mit-han-lab/offsite-tuning | An open-source project that enables private and efficient adaptation of large foundation models to downstream tasks without requiring access to the full model weights. | 368 |
 ymcui/pert | Develops a pre-trained language model to learn semantic knowledge from permuted text without mask labels | 354 |
 guidance-ai/guidance | An efficient programming paradigm for controlling large language models | 19,096 |