mars

Data processing library

A unified framework for large-scale data computation that scales various libraries and frameworks.

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.

GitHub

3k stars
92 watching
326 forks
Language: Python
last commit: 11 months ago
Linked from 2 awesome lists

daskdataframejobliblightgbmmachine-learningnumpypandaspythonpytorchrayscikit-learnstatsmodelstensortensorflowxgboost

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
numpy/numpy Provides support for large, multi-dimensional arrays and matrices, along with functions to manipulate them, as well as tools for integration with C/C++ code. 28,087
pyo3/rust-numpy Provides Rust bindings to Python's NumPy library for numerical computations 1,137
eric-wieser/ros_numpy A toolset for converting between ROS messages and NumPy arrays 306
wkentaro/pytorch-for-numpy-users Provides a PyTorch interface for working with NumPy arrays and tensors. 687
botkop/numsca Numpy for Scala, implementing key features of Numpy in the Scala language 185
pydata/bottleneck Provides high-performance NumPy array functions written in C. 1,073
boostorg/safe_numerics Replaces standard numeric types with exception-throwing versions to prevent undefined behavior due to integer overflow 210
moble/quaternion A NumPy extension that adds quaternion data type support 612
ml31415/numpy-groupies A package of optimized tools for grouping data by index and calculating aggregated values. 196
nomonosound/numpy-minmax A fast function for finding the minimum and maximum value in a NumPy array 11
pydata/numexpr Fast numerical expression evaluator for NumPy and other libraries 2,238
pycqa/flake8-commas Enforces trailing commas in Python code to avoid merge conflicts and improve readability. 131
radix/sumtypes Provides Algebraic Data Types in Python 42
capitalone/datacompy A tool for comparing and analyzing data in various formats, such as Pandas DataFrames and Spark DataFrames. 485
accelerated-text/numberwords Converts numbers to natural language expressions 197