crunch

Data processor

A toolkit for extracting insights from large datasets by parsing and processing semi-structured data

A fast to develop, fast to run, Go based toolkit for ETL and feature extraction on Hadoop.

GitHub

214 stars
18 watching
16 forks
Language: Go
last commit: almost 12 years ago
Linked from 2 awesome lists


Backlinks from these awesome lists:

Related projects:

RepositoryDescriptionStars
pietern/goestoolsA toolset for working with signals and files from GOES satellites375
apache/sparkAn analytics engine designed to handle large-scale data processing and analysis40,170
elastic/logstashA real-time data processing pipeline that transforms and sends data to a storage system14,293
cube2222/jqlA JSON query processor with a custom syntax that simplifies complex queries by breaking them down into step-by-step operations.895
nikolaydubina/go-featureprocessingA Go library for fast and simple feature engineering and machine learning data preprocessing121
jason-kerney/peelandslice.javaA Java implementation of a self-contained, serverless, and zero-configuration data processing framework1
snoyberg/conduitA framework for handling and transforming streaming data in a consistent and efficient way903
obrok/lensA utility for working with nested data structures190
benmack/eo-boxA toolbox for processing earth observation data with Python.14
yaa110/goteratorAn iterator implementation providing map and reduce functionalities for data processing in Go.16
intake/intakeA package for describing, loading, and processing data in a declarative way1,015
davidbyttow/govipsA fast image processing and resizing library for Go.1,321
utdemir/distributed-datasetA Haskell-based framework for processing and distributing large datasets across multiple nodes in parallel.116
sinhashubham95/jsonicA comprehensive set of utilities to handle JSON data in Go.11
deatil/go-arrayA Go package for working with nested data structures like maps and slices20