mars

Data processing library

A unified framework for large-scale data computation that scales various libraries and frameworks.

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.

GitHub

3k stars
93 watching
328 forks
Language: Python
last commit: about 1 year ago
Linked from 2 awesome lists

daskdataframejobliblightgbmmachine-learningnumpypandaspythonpytorchrayscikit-learnstatsmodelstensortensorflowxgboost

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
numpy/numpy A comprehensive library providing efficient numerical computation and data manipulation capabilities for Python-based scientific computing. 28,350
pyo3/rust-numpy Rust bindings for Python's NumPy C-API 1,151
eric-wieser/ros_numpy A toolset for converting between ROS messages and NumPy arrays 308
wkentaro/pytorch-for-numpy-users Provides a PyTorch interface for working with NumPy arrays and tensors. 691
botkop/numsca Numpy for Scala, implementing key features of Numpy in the Scala language 186
pydata/bottleneck Provides high-performance NumPy array functions written in C. 1,077
boostorg/safe_numerics Replaces standard numeric types with exception-throwing versions to prevent undefined behavior due to integer overflow 210
moble/quaternion A NumPy extension that adds quaternion data type support 614
ml31415/numpy-groupies A package of optimized tools for grouping data by index and calculating aggregated values. 197
nomonosound/numpy-minmax A fast function for finding the minimum and maximum value in a NumPy array 11
pydata/numexpr An expression evaluator for arrays in scientific computing and data analysis 2,255
pycqa/flake8-commas Enforces trailing commas in Python code to avoid merge conflicts and improve readability. 131
radix/sumtypes Provides Algebraic Data Types in Python 42
capitalone/datacompy A package to compare and analyze similar data structures from Pandas, Polars, Spark, and Snowpark 487
accelerated-text/numberwords Converts numbers to natural language expressions 197