mlc-llm
LLM Deployment Engine
A machine learning compiler and deployment engine for large language models
Universal LLM Deployment Engine with ML Compilation
19k stars
177 watching
2k forks
Language: Python
last commit: 3 months ago
Linked from 1 awesome list
language-modelllmmachine-learning-compilationtvm
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 dotnet/machinelearning | A cross-platform machine learning framework for .NET that enables developers to build, train, and deploy models without prior expertise in ML. | 9,071 |
 llmware-ai/llmware | A framework for building enterprise LLM-based applications using small, specialized models | 8,303 |
 modeltc/lightllm | A Python-based framework for serving large language models with low latency and high scalability. | 2,691 |
 dair-ai/ml-papers-explained | An explanation of key concepts and advancements in the field of Machine Learning | 7,352 |
 mooler0410/llmspracticalguide | A curated list of resources to help developers navigate the landscape of large language models and their applications in NLP | 9,551 |
 microsoft/lmops | A research initiative focused on developing fundamental technology to improve the performance and efficiency of large language models. | 3,747 |
 mlflow/mlflow | A platform for managing machine learning projects from inception to deployment | 19,021 |
 openxla/xla | Compiles machine learning models for high-performance execution on various hardware platforms | 2,769 |
 langfuse/langfuse | An integrated development platform for large language models (LLMs) that provides observability, analytics, and management tools. | 7,123 |
 ai-hypercomputer/maxtext | A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs. | 1,557 |
 ludwig-ai/ludwig | A low-code framework for building custom deep learning models and neural networks | 11,236 |
 llvm/llvm-project | A modular toolkit for building highly optimized compilers and run-time environments. | 29,633 |
 mlpack/mlpack | A C++ machine learning library with bindings to other languages and bindings for multiple programming languages. | 5,151 |
 aksnzhy/xlearn | A high-performance machine learning package with linear models and factorization machines. | 3,087 |
| dotnet/machinelearning-samples | A collection of samples and examples demonstrating the usage of ML.NET for machine learning tasks in .NET applications. | 4,508 |