mistral-inference

Model inference repository

A minimal code repository for running and inferring Mistral models

Official inference library for Mistral models

GitHub

10k stars
125 watching
870 forks
Language: Jupyter Notebook
last commit: 3 months ago
llmllm-inferencemistralai

Related projects:

Repository Description Stars
declare-lab/instruct-eval An evaluation framework for large language models trained with instruction tuning methods 535
rasbt/llms-from-scratch Developing and pretraining a GPT-like Large Language Model from scratch 35,405
moodstocks/inception-v3.torch Reconstructs Inception V3 network from TensorFlow weights and generates Torch model for computer vision tasks 131
moquette-io/moquette A lightweight MQTT broker that provides a simple and efficient way to implement message queuing and routing in software applications. 2,321
ericlbuehler/mistral.rs A high-performance LLM inference framework written in Rust 4,677
instructure/canvas-lms An open-source learning management system with a Ruby implementation 5,735
neso613/asr_tflite Provides pre-trained ASR models for efficient inference using TFLite 11
mabrains/analog_blocks Designs and simulates analog circuit components in a standardized format 26
pytorch/torchtitan A native PyTorch library for training large language models using distributed parallelism and optimization techniques. 2,765
kwai-kolors/kolors A Python framework for training and deploying photorealistic text-to-image synthesis models. 4,006
tudelft3d/prepair A tool for automatically repairing broken GIS polygons using constrained triangulation. 115
tloen/alpaca-lora Tuning a large language model on consumer hardware using low-rank adaptation 18,710
roboflow/notebooks This repository contains tutorials and examples on using state-of-the-art computer vision models and techniques 5,678
tatsu-lab/stanford_alpaca Develops an instruction-following LLaMA model for research use only, with the goal of fine-tuning and releasing it under specific licenses and restrictions. 29,663
torsion-audio/nn-inference-template A comprehensive template for building real-time audio plugins using neural network inference 97