scio
Data processor
A unified Scala API for Apache Beam and Google Cloud Dataflow with features for batch and streaming data processing and integration with various data sources.
A Scala API for Apache Beam and Google Cloud Dataflow.
3k stars
115 watching
513 forks
Language: Scala
last commit: 6 days ago
Linked from 2 awesome lists
batchbeambigquerydatadataflowgoogle-cloudmlscalasciostreaming
lauris/awesome-scalaRelated projects:
| Repository | Description | Stars |
|---|---|---|
 senecajs/seneca | A toolkit for building microservice architectures in Node.js, providing a flexible way to handle business requirements and manage interactions between services. | 3,960 |
 gitbucket/gitbucket | A Git web platform with a Scala backend offering features like repositories, issue tracking, and collaboration tools. | 9,159 |
 slick/slick | A library providing a modern and comprehensive way to interact with relational databases using Scala | 2,654 |
 rowyio/rowy | A low-code platform for managing Firestore databases and building cloud functions workflows on the web. | 6,171 |
 eckerdcollege/google-api-scala | An API wrapper for Google's Java libraries that simplifies access to Admin Directory, Drive, and Calendar services | 18 |
 directus/directus | A real-time API and app dashboard for managing SQL database content | 28,131 |
 netflix/suro | A distributed data pipeline service for collecting, aggregating, and dispatching large volumes of application events. | 794 |
 spacecloud-io/space-cloud | An open-source platform for building serverless applications on Kubernetes | 3,944 |
 pipedreamhq/pipedream | An integration platform for automating data flows between applications and services. | 8,981 |
 pathwaycom/llm-app | Pre-built templates for integrating large language models into enterprise applications with real-time data APIs and various data sources. | 4,642 |
 matomo-org/matomo | An open analytics platform providing real-time insights and data control | 19,910 |
 exo-explore/exo | Allows developers to run AI models on personal devices with diverse hardware configurations. | 14,829 |
 lando/lando | A tool for setting up and managing local development environments for various web frameworks and applications. | 4,102 |
 gaia-pipeline/gaia | Builds pipelines in any programming language to automate and orchestrate workflows | 5,200 |
 googlecloudplatform/dataflowtemplates | A collection of pre-implemented data pipelines using Google Cloud Dataflow and Apache Beam | 1,154 |