mistral-inference
Model inference repository
A minimal code repository for running and inferring Mistral models
Official inference library for Mistral models
10k stars
125 watching
870 forks
Language: Jupyter Notebook
last commit: almost 2 years agollmllm-inferencemistralai
Related projects:
| Repository | Description | Stars |
|---|---|---|
 declare-lab/instruct-eval | An evaluation framework for large language models trained with instruction tuning methods | 535 |
 rasbt/llms-from-scratch | Developing and pretraining a GPT-like Large Language Model from scratch | 35,405 |
 moodstocks/inception-v3.torch | Reconstructs Inception V3 network from TensorFlow weights and generates Torch model for computer vision tasks | 131 |
 moquette-io/moquette | A lightweight MQTT broker that provides a simple and efficient way to implement message queuing and routing in software applications. | 2,321 |
 ericlbuehler/mistral.rs | A high-performance LLM inference framework written in Rust | 4,677 |
 instructure/canvas-lms | An open-source learning management system with a Ruby implementation | 5,735 |
 neso613/asr_tflite | Provides pre-trained ASR models for efficient inference using TFLite | 11 |
 mabrains/analog_blocks | Designs and simulates analog circuit components in a standardized format | 26 |
 pytorch/torchtitan | A native PyTorch library for training large language models using distributed parallelism and optimization techniques. | 2,765 |
 kwai-kolors/kolors | A Python framework for training and deploying photorealistic text-to-image synthesis models. | 4,006 |
 tudelft3d/prepair | A tool for automatically repairing broken GIS polygons using constrained triangulation. | 115 |
 tloen/alpaca-lora | Tuning a large language model on consumer hardware using low-rank adaptation | 18,710 |
 roboflow/notebooks | This repository contains tutorials and examples on using state-of-the-art computer vision models and techniques | 5,678 |
 tatsu-lab/stanford_alpaca | Develops an instruction-following LLaMA model for research use only, with the goal of fine-tuning and releasing it under specific licenses and restrictions. | 29,663 |
 torsion-audio/nn-inference-template | A comprehensive template for building real-time audio plugins using neural network inference | 97 |