magda

Data aggregator

A federated data catalog system that aggregates and provides access to diverse datasets from various sources

A federated, open-source data catalog for all your big data and small data

GitHub

514 stars
22 watching
93 forks
Language: Prolog
last commit: 4 days ago
Linked from 2 awesome lists

elasticsearchkubernetesnodejsopen-datapostgresqlscala

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
opendcs/opendcs A tool for retrieving and processing hydro/meteorologic data from various sources in real-time. 33
heedy/heedy An aggregator and analysis platform for personal metrics 407
p1sec/mcc_mnc A tool to gather and process public data on mobile network operators, countries, and international dial plans. 69
google-research/open-covid-19-data An aggregation pipeline for public COVID-19 data from various sources into a standardized schema 116
reagro/carob A framework for standardizing and aggregating agricultural research data from experiments and surveys into reusable collections. 20
johnnythetank/aping An AngularJS module to receive and display data from various sources with customizable attributes. 134
msperlin/gettddata A package to simplify data extraction from Brazilian government bond listings 23
chamathpali/fedsim An implementation of a federated learning algorithm that aggregates models based on similarities between them to improve overall performance in a distributed machine learning environment. 22
sakulstra/meteor-aggregate Provides a simple and reliable MongoDB aggregation framework for Meteor applications. 41
netflix/turbine A Java-based system for aggregating and streaming real-time data from various sources 835
ccpgames/aggregated An InfluxDB client that aggregates metrics and events from various sources into a single database 14
rs/jaggr A command-line tool for aggregating and processing JSON data in real-time 469
franzmaliszt/nordenblog A decentralized news sharing application built on top of the Arweave Blockchain 0
omgimanerd/getnews.tech A command-line news aggregator that fetches and displays articles from the News API. 157
mbta/concentrate A tool that aggregates real-time transit data from multiple sources into single output files. 26