pysparkling
by svenkreiss
A pure Python implementation of Apache Spark's RDD and DStream interfaces.
AI summary
Dataset processor
A lightweight Python implementation of Spark's RDD and DStream interfaces for improved performance on small datasets
- stars
- 262
- forks
- 45
- watching
- 9
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
apache/spark40.2K
Data processor
An analytics engine designed to handle large-scale data processing and analysis
Spark wrapper
A set of Python libraries and tools to simplify interactions with various data sources using Apache Spark.
Data processor
A library that enables integration between Apache Spark and Apache Cassandra for fast data processing and analysis.
Data analyzer
Enables distributed data analysis using PySpark and Pandas APIs
Spark Data Processor
An introductory Scala app using Apache Spark Streaming to process data from Kafka and write summaries to Cassandra.
Data analysis tool
A Python package for managing and analyzing demand-side grid data, models, and queries using Apache Spark
Web data processor
A data processing library built on top of Apache Spark to handle temporal web data
Spark interface
An R interface to Apache Spark for distributed data analysis and machine learning
Productivity tools
Pyspark helper functions to maximize developer productivity
Deep learning framework
A PyTorch implementation on Apache Spark for distributed deep learning model training and inference.
Spark API wrapper
Provides an interface to the Cisco Spark REST API
Reference book
A comprehensive reference guide to working with PySpark SQL
Data refiner
A Python-based data refinement tool that extends Google Refine with Linked Open Data features
Data processor
A Python library providing a clean and expressive API for data cleaning by chaining multiple operations together in a logical order.
JSON parser
Fast JSON parsing for Python, using SIMD instructions when available
Featured in 1 awesome list
Each link jumps to the spot where the list mentions pysparkling.
