scio
Data processor
A unified Scala API for Apache Beam and Google Cloud Dataflow with features for batch and streaming data processing and integration with various data sources.
A Scala API for Apache Beam and Google Cloud Dataflow.
3k stars
115 watching
514 forks
Language: Scala
last commit: 2 months ago
Linked from 2 awesome lists
batchbeambigquerydatadataflowgoogle-cloudmlscalasciostreaming
lauris/awesome-scalaRelated projects:
| Repository | Description | Stars |
|---|---|---|
 senecajs/seneca | A toolkit for building microservice architectures in Node.js, providing a flexible way to handle business requirements and manage interactions between services. | 3,964 |
 gitbucket/gitbucket | A Git web platform with a Scala backend offering features like repositories, issue tracking, and collaboration tools. | 9,176 |
 slick/slick | A library providing a modern and comprehensive way to interact with relational databases using Scala | 2,654 |
 rowyio/rowy | A web-based platform for managing data in Firestore using a spreadsheet-like interface and automating workflows with cloud functions. | 6,233 |
 eckerdcollege/google-api-scala | An API wrapper for Google's Java libraries that simplifies access to Admin Directory, Drive, and Calendar services | 18 |
 directus/directus | A real-time API and app dashboard for managing SQL database content | 28,422 |
 netflix/suro | A distributed data pipeline service for collecting, aggregating, and dispatching large volumes of application events. | 794 |
 spacecloud-io/space-cloud | An open-source platform for building serverless applications on Kubernetes | 3,948 |
 pipedreamhq/pipedream | An integration platform that enables developers to automate workflows across multiple applications and services using pre-built components and custom code | 9,075 |
 pathwaycom/llm-app | Provides pre-built AI application templates to integrate Large Language Models (LLMs) with various data sources for scalable RAG and enterprise search. | 7,426 |
 matomo-org/matomo | An open analytics platform providing real-time insights and data control | 20,003 |
 exo-explore/exo | An experimental software framework to run AI models on diverse devices without requiring expensive GPUs. | 17,369 |
 lando/lando | A tool for setting up and managing local development environments for various web frameworks and applications. | 4,112 |
 gaia-pipeline/gaia | Builds pipelines in any programming language to automate and orchestrate workflows | 5,204 |
 googlecloudplatform/dataflowtemplates | A collection of pre-implemented data pipelines using Google Cloud Dataflow and Apache Beam | 1,169 |