elasticsearch_elixir_bulk_processor
Bulk processor
Efficiently inserts data into Elasticsearch using configurable bulk payloads and GenStage-based backpressure handling
Elasticsearch Elixir Bulk Processor is a configurable manager for efficiently inserting data into Elasticsearch. This processor uses GenStages (data-exchange steps) for handling backpressure, and various settings to control the bulk payloads being uploaded to Elasticsearch.
14 stars
3 watching
2 forks
Language: Elixir
last commit: over 5 years agoLinked from 1 awesome list
bulkelasticsearchelixirgenstagehacktoberfestprocessor
h4cc/awesome-elixirRelated projects:
| Repository | Description | Stars |
|---|---|---|
 miku/esbulk | Utility for efficient bulk loading of data into an Elasticsearch index | 281 |
 danielberkompas/elasticsearch-elixir | A no-nonsense library for interacting with Elasticsearch from Elixir | 422 |
 werbitzky/elastix | An Elixir-based client for interacting with Elasticsearch | 253 |
 dashbitco/flow | A parallel computation library on top of GenStage for Elixir | 1,560 |
 doomspork/artifact | A tool for uploading and processing files on-the-fly in Elixir applications | 44 |
 radar/elastic | A library that provides a thin veneer over HTTPotion to interact with Elastic Search in Elixir | 65 |
 scripbox/flume | A blazing fast job processing system with built-in support for durability, back-pressure, and rate limiting. | 78 |
 zatvobor/tirexs | A library that provides an Elixir flavored HTTP client and DSL for interacting with Elasticsearch engines. | 429 |
 nebo15/gen_task | A behavior that helps manage errors and recover from them in GenStage workers | 23 |
 keichan34/exfile | Provides file upload persistence and processing with flexibility and extendability for Phoenix/Plug applications. | 90 |
 igas/custom_base | Provides a custom base conversion mechanism in Elixir | 22 |
 elastic/elasticsearch-hadoop | Integrates Elasticsearch search and analytics with Hadoop data processing | 1,930 |
 heywhy/ex_elasticlunr | A full-text search library for Elixir applications | 190 |
 elixir-ivcu/ivcu | A library to validate, convert, and upload images by replacing flawed concepts with better alternatives. | 5 |
 seantanly/elixir-paratize | An Elixir library providing parallel processing facilities with customizable worker size and timeout options. | 28 |