mace
by XiaoMi
MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.
AI summary
Mobile AI Compute Engine
A framework for deep learning inference on mobile devices
- stars
- 4.9K
- forks
- 819
- watching
- 229
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
autumnai/leaf5.6K
Machine learning framework
An open machine learning framework for building classical, deep, or hybrid models on various hardware platforms.
ludwig-ai/ludwig11.2K
Deep Learning Framework
A low-code framework for building custom deep learning models and neural networks
LLM inference engine
An efficient Large Language Model inference engine leveraging consumer-grade GPUs on PCs
Model compressor
A framework that automatically compresses and accelerates deep learning models to make them suitable for mobile devices with limited computational resources.
Model deployment tool
A toolset for deploying deep learning models on various devices and platforms
ML framework
A platform providing pre-built machine learning models and APIs for cross-platform deployment on various devices
Inference accelerator
A Python library designed to accelerate model inference with high-throughput and low latency capabilities
alibaba/mnn8.8K
Deep learning framework
A lightweight deep learning framework developed by Alibaba for efficient inference and training of neural networks on-device.
ML framework
A cross-platform machine learning framework for .NET that enables developers to build, train, and deploy models without prior expertise in ML.
utensor/utensor1.7K
ML inference library
A lightweight machine learning inference framework built on Tensorflow optimized for Arm targets.
exo-explore/exo17.4K
AI cluster framework
An experimental software framework to run AI models on diverse devices without requiring expensive GPUs.
Deep Learning Framework
A high-level Java framework for building and deploying deep learning models
Model deployer
A toolkit for easy and high-performance deployment of deep learning models on various hardware platforms
AI inference toolkit
A toolkit for optimizing and deploying artificial intelligence models in various applications
Batch processor
Generates large language model outputs in high-throughput mode on single GPUs
Featured in 1 awesome list
Each link jumps to the spot where the list mentions mace.
