lance
by lancedb
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
AI summary
Data storage format
A modern columnar data format for machine learning and large language models.
- stars
- 4K
- forks
- 234
- watching
- 42
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Vector Database
A serverless vector search and storage database built with Rust, enabling efficient similarity searches across multimodal data.
wesm/feather2.7K
Data Storage
A binary data frame storage system that enables efficient and interoperable data sharing across multiple programming languages.
apache/arrow14.7K
Data interchange toolkit
A toolkit for efficient data interchange and in-memory analytics in various languages
aksnzhy/xlearn3.1K
Machine Learning Library
A high-performance machine learning package with linear models and factorization machines.
Microservice generator
Automates conversion of machine learning code into production-ready microservices with web API and GUI.
Data lake query engine
Enables direct querying of data lakes from Postgres without moving data to a cloud data warehouse
mlpack/mlpack5.2K
ML Library
A C++ machine learning library with bindings to other languages and bindings for multiple programming languages.
Data analyzer
A software package for analyzing and visualizing large scientific data sets
LLM inference framework
A high-performance LLM inference framework written in Rust
ponyorm/pony3.7K
DB query builder
An object-relational mapper that allows Python developers to write database queries using Python code
Vector search engine
A high-performance vector search engine and database for efficient similarity searches in machine learning applications.
vaexio/vaex8.3K
Data explorer
A high-performance Python library for streaming and exploring large tabular datasets.
Database extension
An open-source Postgres extension for machine learning and AI operations directly within the database.
Search database
A high-performance database designed to support the fast and efficient search of various data types in AI applications
Data explorer
A Python package for data analysis and visualization in machine learning
Featured in 1 awesome list
Each link jumps to the spot where the list mentions lance.
