flume
Job processor
A blazing fast job processing system with built-in support for durability, back-pressure, and rate limiting.
A blazing fast job processing system backed by GenStage & Redis.
78 stars
9 watching
7 forks
Language: Elixir
last commit: 10 months ago
Linked from 1 awesome list
background-jobsbatch-processingconcurrentelixir-langgenstagerate-limitingredisscheduled-jobs
h4cc/awesome-elixirRelated projects:
| Repository | Description | Stars |
|---|---|---|
 sheharyarn/que | A distributed job processing system utilizing an in-memory real-time database | 672 |
 edgurgel/verk | A job processing system with Redis support and flexible configuration for managing multiple queues. | 722 |
 akira/exq | A job processing library compatible with Resque/Sidekiq for the Elixir language, utilizing Redis as a store. | 1,506 |
 nebo15/gen_task | A behavior that helps manage errors and recover from them in GenStage workers | 23 |
 fukamachi/psychiq | Provides background job processing capabilities for Common Lisp applications. | 53 |
 nilenso/goose | A Clojure-based background job processing library with support for multiple message brokers and scheduling options. | 267 |
 koudelka/honeydew | A pluggable job queue and worker pool for Elixir, focused on at-least-once execution. | 723 |
 tsurupin/job_search | An app to search startup jobs scraped from websites using Elixir, Phoenix, and React. | 99 |
 nesquena/backburner | A Ruby-based job queue system built on top of Beanstalkd for reliable and efficient background processing. | 430 |
 mosic/exdisque | An Elixir client for interacting with an in-memory job queue service | 17 |
 hentioe/honeycomb | An Elixir library for managing background tasks with concurrency control and persistent results | 18 |
 shopify/job-iteration | Makes jobs interruptible and resumable by design. | 1,159 |
 sashman/elasticsearch_elixir_bulk_processor | Efficiently inserts data into Elasticsearch using configurable bulk payloads and GenStage-based backpressure handling | 14 |
 doomspork/artifact | A tool for uploading and processing files on-the-fly in Elixir applications | 44 |
 dashbitco/flow | A parallel computation library on top of GenStage for Elixir | 1,560 |