vaex

Data explorer

A high-performance Python library for streaming and exploring large tabular datasets.

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

GitHub

8k stars
145 watching
591 forks
Language: Python
last commit: almost 2 years ago
Linked from 3 awesome lists

bigdatadata-sciencedataframehdf5machine-learningmachinelearningmemory-mapped-filepyarrowpythontabular-datavisualization

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
wesm/featherA binary data frame storage system that enables efficient and interoperable data sharing across multiple programming languages.2,742
pandas-dev/pandasA powerful data analysis toolkit for Python that provides flexible and expressive data structures for efficient data manipulation and analysis.44,052
lux-org/luxA Python library that automates data exploration by recommending visualizations and suggesting next steps based on user interest5,226
blaze/blazeA Python library that translates familiar NumPy/Pandas-like syntax into database query language3,185
nixtla/statsforecastA fast and accurate Python library for forecasting time series data using various statistical and econometric models4,045
mwaskom/seabornA high-level interface for statistical data visualization12,669
lancedb/lanceA modern columnar data format for machine learning and large language models.4,010
explosion/spacyIndustrial-strength NLP library for Python and Cython30,459
finos/perspectiveA component for creating interactive analytics and data visualization applications with support for large datasets and streaming queries.8,669
ibis-project/ibisA portable Python library for working with dataframes across multiple backends.5,390
apache/datafusion-ballista-pythonBindings for using Apache Arrow's query engine in Python to analyze and manipulate large datasets34
mckinsey/vizroA low-code toolkit for building high-quality data visualization apps using Python2,736
vega/altairA declarative statistical visualization library for Python9,441
vispy/vispyA high-performance interactive 2D/3D data visualization library for Python3,334
holoviz/datashaderAutomates the process of creating meaningful representations of large data sets3,336