mistral-inference
Model inference repository
A minimal code repository for running and inferring Mistral models
Official inference library for Mistral models
10k stars
125 watching
870 forks
Language: Jupyter Notebook
last commit: 3 months ago llmllm-inferencemistralai
Related projects:
Repository | Description | Stars |
---|---|---|
declare-lab/instruct-eval | An evaluation framework for large language models trained with instruction tuning methods | 535 |
rasbt/llms-from-scratch | Developing and pretraining a GPT-like Large Language Model from scratch | 35,405 |
moodstocks/inception-v3.torch | Reconstructs Inception V3 network from TensorFlow weights and generates Torch model for computer vision tasks | 131 |
moquette-io/moquette | A lightweight MQTT broker that provides a simple and efficient way to implement message queuing and routing in software applications. | 2,321 |
ericlbuehler/mistral.rs | A high-performance LLM inference framework written in Rust | 4,677 |
instructure/canvas-lms | An open-source learning management system with a Ruby implementation | 5,735 |
neso613/asr_tflite | Provides pre-trained ASR models for efficient inference using TFLite | 11 |
mabrains/analog_blocks | Designs and simulates analog circuit components in a standardized format | 26 |
pytorch/torchtitan | A native PyTorch library for training large language models using distributed parallelism and optimization techniques. | 2,765 |
kwai-kolors/kolors | A Python framework for training and deploying photorealistic text-to-image synthesis models. | 4,006 |
tudelft3d/prepair | A tool for automatically repairing broken GIS polygons using constrained triangulation. | 115 |
tloen/alpaca-lora | Tuning a large language model on consumer hardware using low-rank adaptation | 18,710 |
roboflow/notebooks | This repository contains tutorials and examples on using state-of-the-art computer vision models and techniques | 5,678 |
tatsu-lab/stanford_alpaca | Develops an instruction-following LLaMA model for research use only, with the goal of fine-tuning and releasing it under specific licenses and restrictions. | 29,663 |
torsion-audio/nn-inference-template | A comprehensive template for building real-time audio plugins using neural network inference | 97 |