elasticsearch_elixir_bulk_processor

Bulk processor

Efficiently inserts data into Elasticsearch using configurable bulk payloads and GenStage-based backpressure handling

Elasticsearch Elixir Bulk Processor is a configurable manager for efficiently inserting data into Elasticsearch. This processor uses GenStages (data-exchange steps) for handling backpressure, and various settings to control the bulk payloads being uploaded to Elasticsearch.

GitHub

14 stars
3 watching
2 forks
Language: Elixir
last commit: over 3 years ago
Linked from 1 awesome list

bulkelasticsearchelixirgenstagehacktoberfestprocessor

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
miku/esbulk Utility for efficient bulk loading of data into an Elasticsearch index 281
danielberkompas/elasticsearch-elixir A no-nonsense library for interacting with Elasticsearch from Elixir 421
werbitzky/elastix An Elixir-based client for interacting with Elasticsearch 253
dashbitco/flow A parallel computation library on top of GenStage for Elixir 1,553
doomspork/artifact A tool for uploading and processing files on-the-fly in Elixir applications 44
radar/elastic A library that provides a thin veneer over HTTPotion to interact with Elastic Search in Elixir 65
scripbox/flume A blazing fast job processing system with built-in support for durability, back-pressure, and rate limiting. 78
zatvobor/tirexs A library that provides an Elixir flavored HTTP client and DSL for interacting with Elasticsearch engines. 429
nebo15/gen_task A behavior that helps manage errors and recover from them in GenStage workers 23
keichan34/exfile Provides file upload persistence and processing with flexibility and extendability for Phoenix/Plug applications. 90
igas/custom_base Provides a custom base conversion mechanism in Elixir 22
elastic/elasticsearch-hadoop Integrates Elasticsearch search and analytics with Hadoop data processing 9
heywhy/ex_elasticlunr A full-text search library for Elixir applications 189
elixir-ivcu/ivcu A library to validate, convert, and upload images by replacing flawed concepts with better alternatives. 5
seantanly/elixir-paratize An Elixir library providing parallel processing facilities with customizable worker size and timeout options. 28