datachain

Data Warehouse Library

A Python-based framework for transforming and analyzing unstructured data from various formats like images, audio, videos, text, and PDFs.

ETL, Analytics, Versioning for Unstructured Data

GitHub

2k stars
15 watching
94 forks
Language: Python
last commit: almost 2 years ago
aicvdata-analyticsdata-wranglingembeddingsllmllm-evalmachine-learningmlopsmultimodal

Related projects:

RepositoryDescriptionStars
jaimegildesagredo/boobyA Python library for defining and validating data structures with built-in support for complex data models and relationships.176
dotchain/dotjsA distributed, reactive, and functional data structure library for JavaScript8
databricks/lilacA tool to improve data quality and efficiency for large language models987
datamol-io/datamolA Python library for manipulating molecules476
h2oai/datatableA Python package for manipulating 2-dimensional tabular data structures with an emphasis on speed and big data support.1,821
dataoneorg/d1_pythonA collection of Python libraries and tools for interacting with DataONE repositories17
f483/btctxstoreA library to store and retrieve data in Bitcoin transactions using OP_RETURN nulldata outputs.10
hellokaton/animaA minimal Java library for simple database operations with a focus on ease of use and support for multiple databases and relational mappings.228
accelerationnet/data-tableProvides a data structure to represent tabular data in Common Lisp, enabling easy interaction with databases and report generation.22
ujjwalkarn/datasciencepythonA curated list of tutorials and resources for learning Python for data science, machine learning, and other related topics.5,301
whitaker-io/machineA library for creating data workflows that can be simple or complex, with features like recursion and memoization.159
sabiwara/ajaAn Elixir standard library extension focused on efficient data structures and manipulation213
indy256/codelibraryA comprehensive collection of algorithms and data structures implemented in multiple programming languages1,944
tiledb-inc/tiledb-pyProvides a Python interface to store and manage large datasets in a distributed, columnar storage system.190
scalamolecule/moleculeA library for defining and querying complex domain models using a high-level, declarative data access API19