mlc-llm
by mlc-ai
Universal LLM Deployment Engine with ML Compilation
AI summary
LLM Deployment Engine
A machine learning compiler and deployment engine for large language models
- stars
- 19.4K
- forks
- 1.6K
- watching
- 177
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
ML framework
A cross-platform machine learning framework for .NET that enables developers to build, train, and deploy models without prior expertise in ML.
LLM app builder
A framework for building enterprise LLM-based applications using small, specialized models
modeltc/lightllm2.7K
LLM server
A Python-based framework for serving large language models with low latency and high scalability.
ML explanations
An explanation of key concepts and advancements in the field of Machine Learning
LLM guide
A curated list of resources to help developers navigate the landscape of large language models and their applications in NLP
microsoft/lmops3.7K
LLM booster
A research initiative focused on developing fundamental technology to improve the performance and efficiency of large language models.
Model lifecycle manager
A platform for managing machine learning projects from inception to deployment
openxla/xla2.8K
ML compiler
Compiles machine learning models for high-performance execution on various hardware platforms
LLM toolkit
An integrated development platform for large language models (LLMs) that provides observability, analytics, and management tools.
LLM framework
A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs.
ludwig-ai/ludwig11.2K
Deep Learning Framework
A low-code framework for building custom deep learning models and neural networks
llvm/llvm-project29.6K
Compiler toolkit
A modular toolkit for building highly optimized compilers and run-time environments.
mlpack/mlpack5.2K
ML Library
A C++ machine learning library with bindings to other languages and bindings for multiple programming languages.
aksnzhy/xlearn3.1K
Machine Learning Library
A high-performance machine learning package with linear models and factorization machines.
ML examples
A collection of samples and examples demonstrating the usage of ML.NET for machine learning tasks in .NET applications.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions mlc-llm.
