PigPen

Map-reduce framework

A map-reduce framework for Clojure that compiles to Apache Pig or Cascading without requiring prior knowledge of those systems.

Map-Reduce for Clojure

GitHub

567 stars
473 watching
54 forks
Language: Clojure
last commit: over 3 years ago
Linked from 3 awesome lists


Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
apache/pigEnables data processing and transformation in large files using a high-level language with compile-time optimizations for efficient execution on distributed computing frameworks.682
alexeyco/pigA pgx wrapper that simplifies executing and scanning query results in PostgreSQL databases16
nathanmarz/cascalogA library for data processing and querying on large datasets without the need for Hadoop expertise1,375
apache/impalaA high-performance query engine designed to handle large-scale data processing and analytics1,164
schollz/cowyoA simple wiki webserver with minimalistic features such as versioning, page locking and encryption.925
bauplanlabs/quack-reduceA playground for running DuckDB as a stateless query engine over a data lake.178
scicloj/tableclothA dataset manipulation library built on top of tech.ml.dataset, providing a simplified API for data processing and analysis.308
sameeragarwal/blinkdbA system designed to process large datasets efficiently by answering queries with approximate results and error bars.660
apache/tinkerpopProvides a framework for graph computing and processing1,985
netcarver/asy_jpcacheA caching plugin for Textpattern that optimizes page loading by storing full pages in memory8
netflix-skunkworks/policyuniverseA Python package for parsing and processing AWS IAM policies and statements.427
rinuboney/claternA Clojure-based machine learning library providing tools for data preprocessing and modeling various algorithms.67
cakephp/queueA Queueing library for CakePHP that allows tasks to be processed asynchronously36
alienrobotwizard/varahaA set of Apache Pig scripts and UDFs for machine learning and natural language processing53
apache/opennlpProvides a toolkit for natural language text processing tasks using machine learning algorithms in Java.1,449