datafusion-python
by apache
Apache DataFusion Python Bindings
AI summary
Data processor
A Python library that provides a data processing and querying framework using the Apache Arrow in-memory query engine.
- stars
- 385
- forks
- 80
- watching
- 34
Similar projects
Found by comparing what the projects do, not just their names.
Data analysis library
Bindings for using Apache Arrow's query engine in Python to analyze and manipulate large datasets
h2oai/datatable1.8K
Data processor
A Python package for manipulating 2-dimensional tabular data structures with an emphasis on speed and big data support.
Data pipeline processor
A library that provides a fluent interface for processing data pipelines in Python without holding large amounts of memory
Query engine
Distributed query engine for Apache DataFusion applications
apache/spark40.2K
Data processor
An analytics engine designed to handle large-scale data processing and analysis
apache/pig682
Data processor
Enables data processing and transformation in large files using a high-level language with compile-time optimizations for efficient execution on distributed computing frameworks.
Data processor
A distributed batch data processing framework that enables scalable and reliable data transformation, filtering, and aggregation.
Query Engine
A query engine that supports various data formats and allows customization of its functionality.
Data processor
A Python library providing a clean and expressive API for data cleaning by chaining multiple operations together in a logical order.
Data processor
A Python framework for real-time data processing on Apache Kafka streams
Data processor
A package for describing, loading, and processing data in a declarative way
apache/druid13.5K
Data processing engine
A high-performance real-time analytics database for fast queries and ingest
nipype/pydra123
Dataflow engine
A lightweight Python dataflow engine for building and executing directed acyclic graphs (DAGs) in a scalable manner.
apache/samza817
Data processor
A distributed stream processing framework for handling high-volume data streams with fault tolerance and durability guarantees
Data importer library
A PHP library that enables durable and asynchronous data imports with memory-efficient processing and robust recovery from network errors.