lilac
by databricks
Curate better data for LLMs
AI summary
Data curator
A tool to improve data quality and efficiency for large language models
- stars
- 987
- forks
- 93
- watching
- 14
Similar projects
Found by comparing what the projects do, not just their names.
Data Warehouse Library
A Python-based framework for transforming and analyzing unstructured data from various formats like images, audio, videos, text, and PDFs.
Data type checkers
A library of decorators to enforce data type constraints on function attributes
Data printer
A tool to prettify Haskell data types with Show instances in an easy-to-read format
Data cleaner
Library that provides dynamic data cleaning and filtering capabilities for PyTorch datasets and samplers
Data provenance tool
Automates the tracking of how data is produced and transformed in scientific experiments.
Data explorer
A Python package for data analysis and visualization in machine learning
Data analysis toolkit
A collection of curated tools and resources for datajournalists to analyze and visualize their data
NLP dataset manager
A tool that simplifies the process of preparing and manipulating natural language processing datasets
Datasheet extractor
Automates extraction of key circuit information from PDF datasheets/documents to build a database of commercial off-the-shelf IP.
Data collector
Provides tools and methods for collecting, managing, and analyzing meteorological data from various sources
Data collector
A crowdsourcing platform for digitizing biodiversity data using online volunteers
Data visualization project
Recreating data visualizations from the book 'Knowledge is Beautiful' in R
Building dataset
A LiDAR-derived point cloud dataset of one million English buildings linked to energy characteristics
Data transformer
A Python library to manipulate and transform indexable data
Data collector
A tool for collecting and organizing data from the CARLA simulation environment.