BitBLAS

Matrix multiplication library

A library to support efficient mixed-precision matrix multiplications on GPUs for deep learning model deployment

BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.

GitHub

445 stars
16 watching
34 forks
Language: Python
last commit: about 1 month ago
Linked from 1 awesome list


Backlinks from these awesome lists:

Related projects:

Repository Description Stars
google/gemmlowp A small C++ library for low-precision matrix multiplication 1,782
clmathlibraries/clblas A software library that enables developers to tap into the performance benefits of heterogeneous computing by providing an OpenCL interface for BLAS functions. 845
biddata/bidmat A high-performance matrix library with CPU and GPU acceleration for data mining applications. 265
akabe/slap A linear algebra library with type-based static size checking for matrix operations. 88
kaneplusplus/bigmemory A C++ library that provides efficient storage and manipulation of large matrices. 126
libmir/mir A numerical library for scientific and machine learning applications. 209
blindglobe/lisp-matrix A numerical algebra package for Common Lisp 71
denosaurs/neo A matrix and linear algebra library accelerated by WebGPU and WASM for JavaScript development. 67
blas-lapack-rs/openblas-src Provides source code for building BLAS and LAPACK libraries via OpenBLAS 78
uncomplicate/neanderthal A Clojure library providing optimized native libraries for fast matrix and linear algebra computations on CPU and GPU. 1,079
versilov/matrex A fast and efficient matrix library for Elixir/Erlang with C implementation using CBLAS. 479
numpi/hm-toolbox A toolbox implementing arithmetic operations for HODLR and HSS matrices in MATLAB. 44
ist-daslab/marlin An optimized FP16xINT4 matrix multiplication kernel for large language models 655
thephoeron/bit-smasher A Common Lisp library providing functions and macros for handling bit vectors, arithmetic, type conversions, and measurements. 53
jalawson/ulinalg A small size matrix handling module with linear algebra operations for MicroPython (Python3) 32