koalas
by databricks
Koalas: pandas API on Apache Spark
AI summary
Data processing library
A Python package that allows users to work with pandas DataFrames on top of Apache Spark
- stars
- 3.3K
- forks
- 358
- watching
- 323
- awesome lists
- 2
Similar projects
Found by comparing what the projects do, not just their names.
Data exploration tool
An interactive web-based editor for exploring and analyzing large datasets using Scala, Apache Spark, and other data science tools
blaze/blaze3.2K
Query library
A Python library that translates familiar NumPy/Pandas-like syntax into database query language
CoreNLP wrapper
Wraps Stanford CoreNLP annotators as Spark DataFrame functions for natural language processing tasks
Spark API
Provides compatibility and extensions between Kotlin and Apache Spark for big data processing
apache/spark40.2K
Data processor
An analytics engine designed to handle large-scale data processing and analysis
Spark tutorials
Examples and tutorials for learning Spark using Java and Scala
Dataset processor
A lightweight Python implementation of Spark's RDD and DStream interfaces for improved performance on small datasets
pandas-dev/pandas44.1K
Data analysis library
A powerful data analysis toolkit for Python that provides flexible and expressive data structures for efficient data manipulation and analysis.
Spark wrapper
Provides a C# API for interacting with Apache Spark
awslabs/deequ3.3K
Data inspector
A library for testing data quality in large datasets
Data processor
A library that enables integration between Apache Spark and Apache Cassandra for fast data processing and analysis.
Data Profiler
An exploratory data analysis tool for Pandas and Spark DataFrames
Spark Analysis
An in-depth analysis of Apache Spark's design and implementation
Big Data Deployment Tools
Provides scripts to deploy multiple big data tools in a managed environment using Eucalyptus and Amazon AWS
NLP toolkit
Provides a set of pre-trained models and libraries for natural language processing tasks on top of Apache Spark
Featured in 2 awesome lists
Each link jumps to the spot where the list mentions koalas.
