bitsandbytes
Accessible large language models via k-bit quantization for PyTorch.
AI summary
Language model helper
A Python library providing lightweight, hardware-accelerated operations for large language models.
- stars
- 6.4K
- forks
- 639
- watching
- 52
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
pmorissette/bt2.3K
Strategy tester
A flexible Python framework for building and testing algorithmic trading strategies
aristocratos/bpytop10.2K
Resource Monitor
A resource monitor tool that displays system usage statistics and allows for filtering, sorting, and customization of system processes.
Resource monitor
A tool to monitor system resources and display detailed information in a customizable format
GPU-based chat model
A re-implementation of Llama for efficient use with quantized weights on modern GPUs.
pytorch/botorch3.1K
Optimization toolkit
A PyTorch-based library for Bayesian optimization, providing a modular interface for composing and optimizing probabilistic models.
Model optimizer
Tools and techniques for optimizing large language models on various frameworks and hardware platforms.
Matrix multiplication library
A library to support efficient mixed-precision matrix multiplications on GPUs for deep learning model deployment
bytedance/byteps3.6K
Distributed DL framework
A high-performance distributed deep learning framework supporting multiple frameworks and networks
Financial modeling library
A comprehensive C++ library for modeling, trading, and risk management in quantitative finance.
Quant backtesting framework
An open-source Python framework for backtesting trading strategies in cryptocurrencies using machine learning and technical analysis techniques.
LLM Quantizer
An open-source software project that enables efficient and accurate low-bit weight quantization for large language models.
GPU tensor library
A Python library providing tensors and dynamic neural networks with strong GPU acceleration
Quantum computing library
A Python library for training quantum computers using programming techniques similar to neural networks
plasma-umass/scalene12.3K
Profiler
A high-performance Python profiler that analyzes CPU, GPU, and memory usage, providing detailed information and AI-powered optimization suggestions.
GPT model development
Developing and pretraining a GPT-like Large Language Model from scratch
Featured in 1 awesome list
Each link jumps to the spot where the list mentions bitsandbytes.
