mars

Data processing library

A unified framework for large-scale data computation that scales various libraries and frameworks.

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.

GitHub

3k stars
93 watching
328 forks
Language: Python
last commit: over 2 years ago
Linked from 2 awesome lists

daskdataframejobliblightgbmmachine-learningnumpypandaspythonpytorchrayscikit-learnstatsmodelstensortensorflowxgboost

Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
numpy/numpyA comprehensive library providing efficient numerical computation and data manipulation capabilities for Python-based scientific computing.28,350
pyo3/rust-numpyRust bindings for Python's NumPy C-API1,151
eric-wieser/ros_numpyA toolset for converting between ROS messages and NumPy arrays308
wkentaro/pytorch-for-numpy-usersProvides a PyTorch interface for working with NumPy arrays and tensors.691
botkop/numscaNumpy for Scala, implementing key features of Numpy in the Scala language186
pydata/bottleneckProvides high-performance NumPy array functions written in C.1,077
boostorg/safe_numericsReplaces standard numeric types with exception-throwing versions to prevent undefined behavior due to integer overflow210
moble/quaternionA NumPy extension that adds quaternion data type support614
ml31415/numpy-groupiesA package of optimized tools for grouping data by index and calculating aggregated values.197
nomonosound/numpy-minmaxA fast function for finding the minimum and maximum value in a NumPy array11
pydata/numexprAn expression evaluator for arrays in scientific computing and data analysis2,255
pycqa/flake8-commasEnforces trailing commas in Python code to avoid merge conflicts and improve readability.131
radix/sumtypesProvides Algebraic Data Types in Python42
capitalone/datacompyA package to compare and analyze similar data structures from Pandas, Polars, Spark, and Snowpark487
accelerated-text/numberwordsConverts numbers to natural language expressions197