awesome-production-machine-learning

ML deployment toolkit

A curated collection of tools and libraries for deploying, monitoring, and maintaining machine learning models in production environments.

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

GitHub

18k stars
407 watching
2k forks
last commit: almost 2 years ago
Linked from 7 awesome lists

awesomeawesome-listdata-miningdeep-learningexplainabilityinterpretabilitylarge-scale-machine-learninglarge-scale-mlmachine-learningmachine-learning-operationsml-operationsml-opsmlopsprivacy-preservingprivacy-preserving-machine-learningprivacy-preserving-mlproduction-machine-learningproduction-mlresponsible-ai

Screenshot of EthicalML/awesome-production-machine-learning website

ethicalml.github.io/awesome-production-machine-learning

Awesome Production Machine Learning / 10 Min Video Overview

10 minute videoThis provides an overview of the motivations for machine learning operations as well as a high level overview on some of the tools in this repo. This covers the an updated 2024 version of the state of MLOps

Awesome Production Machine Learning / Want to receive recurrent updates on this repo and other advancements?

Machine Learning EngineerYou can join the newsletter. Join over 10,000 ML professionals and enthusiasts who receive weekly curated articles & tutorials on production Machine Learning
Awesome Artificial Intelligence Regulation1,277almost 2 years agoAlso check out the List, where we aim to map the landscape of "Frameworks", "Codes of Ethics", "Guidelines", "Regulations", etc related to Artificial Intelligence
EthicalML/awesome-artificial-intelligence-guidelines1,277almost 2 years ago

Main Content / Adversarial Robustness

AdvBox1,389over 3 years agoA toolbox to generate adversarial examples that fool neural networks in PaddlePaddle, PyTorch, Caffe2, MxNet, Keras, TensorFlow, and Advbox can benchmark the robustness of machine learning models
Adversarial DNN Playground130over 3 years agothink , but for Adversarial Examples! A visualization tool designed for learning and teaching - the attack library is limited in size, but it has a nice front-end to it with buttons you can press!
AdverTorch1,311about 3 years agolibrary for adversarial attacks / defenses specifically for PyTorch
ART4,945almost 2 years agoART (Adversarial Robustness Toolbox) provides tools that enable developers and researchers to defend and evaluate Machine Learning models and applications against the adversarial threats of Evasion, Poisoning, Extraction, and Inference
Artificial Adversary399over 4 years agoAirBnB's library to generate text that reads the same to a human but passes adversarial classifiers
Counterfit818almost 3 years agoCounterfit is a command-line tool and generic automation layer for assessing the security of machine learning systems
Factool839about 2 years agoFactool is a tool augmented framework for detecting factual errors of texts generated by large language models
Foolbox2,798over 2 years agoFoolbox is a Python toolbox to create adversarial examples that fool neural networks in PyTorch, TensorFlow, and JAX
MIA139almost 4 years agoA library for running membership inference attacks (MIA) against machine learning models
NeMo Guardrails4,263almost 2 years agoNeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems
OpenAttack699about 3 years agoOpenAttack is a Python-based textual adversarial attack toolkit, which handles the whole process of textual adversarial attacking, including preprocessing text, accessing the victim model, generating adversarial examples and evaluation

Main Content / Agentic Workflow

Agents4,210almost 2 years agoAgents allows users to build AI-driven server programs that can see, hear, and speak in realtime
AgentScope5,501almost 2 years agoAgentScope is a multi-agent platform designed to empower developers to build multi-agent applications with large-scale models
AutoGen35,795almost 2 years agoAutoGen is an open-source framework for building AI agent systems
Chidori1,282almost 2 years agoChidori is a reactive runtime that supports building robust AI agents using languages like Node.js, Python, and Rust, with a focus on reactivity and observability in agent workflows
CrewAI22,550almost 2 years agoCrewAI is a cutting-edge framework for orchestrating role-playing, autonomous AI agents
LangGraph7,250almost 2 years agoLangGraph is a library for building stateful, multi-actor applications with LLMs, used to create agent and multi-agent workflows
Modelscope-Agent2,779almost 2 years agoModelscope-Agent is a customizable and scalable agent framework
OpenAGI1,992almost 2 years agoOpenAGI is used as the agent creation package to build agents for AIOS
Swarm16,939almost 2 years agoSwarm is an educational framework exploring ergonomic, lightweight multi-agent orchestration
Swarms1,904almost 2 years agoSwarms is an enterprise grade and production ready multi-agent collaboration framework that enables you to orchestrate many agents to work collaboratively at scale to automate real-world activities

Main Content / AutoML

AutoGluon8,167almost 2 years agoAutomated feature, model, and hyperparameter selection for tabular, image, and text data on top of popular machine learning libraries (Scikit-Learn, LightGBM, CatBoost, PyTorch, MXNet)
Autokeras9,172almost 2 years agoAutoML library for Keras based on
auto-sklearn7,667almost 2 years agoFramework to automate algorithm and hyperparameter tuning for sklearn
Feature Engine1,956almost 2 years agoFeature-engine is a Python library that contains several transformers to engineer features for use in machine learning models
Featuretools7,304almost 2 years agoAn open source framework for automated feature engineering
FLAML3,968almost 2 years agoFLAML is a fast library for automated machine learning & tuning
go-featureprocessing121almost 2 years agoA feature pre-processing framework in Go that matches functionality of sklearn
HEBO3,306almost 2 years agoSet of open-source hyperparameter optimization frameworks, including the winning submission to the tested on hyperparameter tuning tasks
Katib1,521almost 2 years agoA Kubernetes-based system for Hyperparameter Tuning and Neural Architecture Search
keras-tuner2,860almost 2 years agoKeras Tuner is an easy-to-use, distributable hyperparameter optimisation framework that solves the pain points of performing a hyperparameter search. Keras Tuner makes it easy to define a search space and leverage included algorithms to find the best hyperparameter values
Neural Architecture Search with Controller RNN433about 5 years agoBasic implementation of Controller RNN from and
Neural Network Intelligence14,076about 2 years agoNNI (Neural Network Intelligence) is a toolkit to help users run automated machine learning (AutoML) experiments
Optuna11,082almost 2 years agoOptuna is an automatic hyperparameter optimisation software framework, particularly designed for machine learning
OSS Vizier1,494almost 2 years agoOSS Vizier is a Python-based service for black-box optimisation and research, one of the first hyperparameter tuning services designed to work at scale
sklearn-deap771over 2 years agoUse evolutionary algorithms instead of gridsearch in scikit-learn
TPOT9,776about 2 years agoAutomation of sklearn pipeline creation (including feature selection, pre-processor, etc.)
tsfresh8,486almost 2 years agoAutomatic extraction of relevant features from time series
Upgini321almost 2 years agoFree automated data & feature enrichment library for machine learning: automatically searches through thousands of ready-to-use features from public and community shared data sources and enriches your training dataset with only the accuracy improving features

Main Content / Computation Load Distribution

Apache Beam7,911almost 2 years agoApache Beam is a unified programming model for Batch and Streaming
Bagua876about 2 years agoBagua is a performant and flexible distributed training framework for PyTorch, providing a faster alternative to PyTorch DDP and Horovod. It supports advanced distributed training algorithms such as quantization and decentralization
Colossal-AI38,907almost 2 years agoA unified deep learning system for big model era, which helps users to efficiently and quickly deploy large AI model training and inference
Dask12,691almost 2 years agoDistributed parallel processing framework for Pandas and NumPy computations -
DEAP5,891almost 2 years agoA novel evolutionary computation framework for rapid prototyping and testing of ideas. It seeks to make algorithms explicit and data structures transparent. It works in perfect harmony with parallelisation mechanisms such as multiprocessing and SCOOP
DeepSpeed35,863almost 2 years agoA deep learning optimization library (lightweight PyTorch wrapper) that makes distributed training easy, efficient, and effective
DLRover1,302almost 2 years agoDLRover makes the distributed training of large AI models easy, stable, fast and green
einops8,574almost 2 years agoFlexible and powerful tensor operations for readable and reliable code
Fiber1,042over 3 years agoDistributed computing library for modern computer clusters from Uber
Flashlight5,300almost 2 years agoA fast, flexible machine learning library written entirely in C++ from the Facebook AI Research and the creators of Torch, TensorFlow, Eigen and Deep Speech
Hivemind2,078almost 2 years agoDecentralized deep learning in PyTorch
Horovod14,305almost 2 years agoUber's distributed training framework for TensorFlow, Keras, and PyTorch
Liger Kernel3,840almost 2 years agoLiger Kernel is a collection of Triton kernels designed specifically for LLM training
LightGBM16,769almost 2 years agoLightGBM is a gradient boosting framework that uses tree based learning algorithms
PaddlePaddle22,340almost 2 years agoPaddlePaddle is a framework to perform large-scale deep network training, using data sources distributed across hundreds of nodes
PyTorch Lightning28,636almost 2 years agoPyTorch Lightning pretrains, finetunes and deploys AI models on multiple GPUs, TPUs with zero code changes
PyWren848over 2 years agoAnswer the question of the "cloud button" for python function execution. It's a framework that abstracts AWS Lambda to enable data scientists to execute any Python function -
Ray34,412almost 2 years agoRay is a flexible, high-performance distributed execution framework for machine learning ( )
TensorFlowOnSpark3,875about 3 years agoTensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters
Vespa5,881almost 2 years agoVespa is an engine for low-latency computation over large data sets

Main Content / Data Labelling and Synthesis

Argilla4,126almost 2 years agoArgilla helps domain experts and data teams to build better NLP datasets in less time
Baal876about 2 years agoBaal is an active learning library that supports both industrial applications and research usecases
brat rapid annotation tool1,831about 2 years agoWeb-based text annotation tool for Named-Entity-Recogntion task
cleanlab9,820almost 2 years agoPython library for data-centric AI. Can automatically: find mislabeled data, detect outliers, estimate consensus + annotator-quality for multi-annotator datasets, suggest which data is best to (re)label next
COCO Annotator2,125almost 2 years agoWeb-based image segmentation tool for object detection, localization and keypoints
CVAT12,821almost 2 years agoCVAT (Computer Vision Annotation Tool) is OpenCV's web-based annotation tool for both videos and images for computer algorithms
Doccano9,645almost 2 years agoOpen source text annotation tools for humans, providing functionality for sentiment analysis, named entity recognition, and machine translation
Gretel Synthetics602almost 2 years agoGretel Synthetics is a synthetic data generators for structured and unstructured text, featuring differentially private learning
ImageTagger267about 2 years agoImage labelling tool with support for collaboration, supporting bounding box, polygon, line, point labelling, label export, etc
ImgLab989over 2 years agoImage annotation tool for bounding boxes with auto-suggestion and extensibility for plugins
Label Studio19,798almost 2 years agoMulti-domain data labeling and annotation tool with standardized output format
makesense.ai3,195about 2 years agoFree to use online tool for labelling photos. Prepared labels can be downloaded in one of multiple supported formats
MedTagger119almost 4 years agoA collaborative framework for annotating medical datasets using crowdsourcing
modAL2,239over 2 years agomodAL is an active learning framework designed with modularity, flexibility and extensibility in mind
NeMo Curator672almost 2 years agoNeMo Curator is a GPU-accelerated framework for efficient large language model data curation
OpenLabeling932about 4 years agoOpen source tool for labelling images with support for labels, edges, as well as image resizing and zooming in
PixelAnnotationTool1,410almost 4 years agoImage annotation tool with ability to "colour" on the images to select labels for segmentation. Process is semi-automated with the
refinery1,405almost 2 years agoThe data scientist's open-source choice to scale, assess and maintain natural language data
Rubrix4,126almost 2 years agoOpen-source tool for tracking, exploring, and labeling data for AI projects
SDV2,416almost 2 years agoSynthetic Data Vault (SDV) is a Synthetic Data Generation ecosystem of libraries that allows users to easily learn single-table, multi-table and timeseries datasets to later on generate new Synthetic Data that has the same format and statistical properties as the original dataset
Semantic Segmentation Editor1,827about 2 years agoHitachi's Open source tool for labelling camera and LIDAR data
Snorkel5,826over 2 years agoSnorkel is a system for quickly generating training data with weak supervision
Superintendent189about 4 years agosuperintendent provides an ipywidget-based interactive labelling tool for your data
YData Synthetic1,456almost 2 years agoYData Synthetic is a package to generate synthetic tabular and time-series data leveraging the state of the art generative models

Main Content / Data Pipeline

Apache Airflow37,580almost 2 years agoData Pipeline framework built in Python, including scheduler, DAG definition and a UI for visualisation
Apache Nifi4,955almost 2 years agoApache NiFi was made for dataflow. It supports highly configurable directed graphs of data routing, transformation, and system mediation logic
Apache Oozie717about 2 years agoWorkflow scheduler for Hadoop jobs
Argo Workflows15,155almost 2 years agoArgo Workflows is an open source container-native workflow engine for orchestrating parallel jobs on Kubernetes. Argo Workflows is implemented as a Kubernetes CRD (Custom Resource Definition)
Azkaban4,481about 2 years agoAzkaban is a batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy to use web user interface to maintain and track your workflows
BatchFlow202almost 2 years agoBatchFlow helps data scientists conveniently work with random or sequential batches of your data and define data processing and machine learning workflows for large datasets
Bonobo1,589over 3 years agoETL framework for Python 3.5+ with focus on simple atomic operations working concurrently on rows of data
Chronos4,389about 4 years agoMore of a job scheduler for Mesos than ETL pipeline
Couler919almost 2 years agoUnified interface for constructing and managing machine learning workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow
DataTrove2,103almost 2 years agoDataTrove is a library to process, filter and deduplicate text data at a very large scale
D6tflow953about 3 years agoA python library that allows for building complex data science workflows on Python
DALL·E Flow2,837over 3 years agoDALL·E Flow is an interactive workflow for generating high-definition images from text prompt
Dagster12,055almost 2 years agoA data orchestrator for machine learning, analytics, and ETL
DBND260almost 2 years agoDBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes
DBT10,071almost 2 years agoETL tool for running transformations inside data warehouses
Flyte5,850almost 2 years agoLyft’s Cloud Native Machine Learning and Data Processing Platform -
Genie1,723almost 2 years agoJob orchestration engine to interface and trigger the execution of jobs from Hadoop-based systems
Gokart319almost 2 years agoWrapper of the data pipeline Luigi
Hamilton1,900almost 2 years agoHamilton is a micro-orchestration framework for defining dataflows. Runs anywhere python runs (e.g. jupyter, fastAPI, spark, ray, dask). Brings software engineering best practices without you knowing it. Use it to define feature engineering transforms, end-to-end model pipelines, and LLM workflows. It complements macro-orchestration systems (e.g. kedro, luigi, airflow, dbt, etc.) as it replaces the code within those macro tasks. Comes with a self-hostable UI that captures lineage & provenance, execution telemetry & data summaries, and builds a self-populating catalog; usable in development as well as production
Instill VDP2,181almost 2 years agoInstill VDP (Versatile Data Pipeline) aims to streamline the data processing pipelines from inception to completion
Instructor8,551almost 2 years agoInstructor makes it easy to get structured data like JSON from LLMs like GPT-3.5, GPT-4, GPT-4-Vision, and open-source models
Kedro10,050almost 2 years agoKedro is a workflow development tool that helps you build data pipelines that are robust, scalable, deployable, reproducible and versioned
Luigi17,950almost 2 years agoLuigi is a Python module that helps you build complex pipelines of batch jobs, handling dependency resolution, workflow management, visualisation, etc
Metaflow8,341almost 2 years agoA framework for data scientists to easily build and manage real-life data science projects
Neuraxle610over 3 years agoA framework for building neat pipelines, providing the right abstractions to chain your data transformation and prediction steps with data streaming, as well as doing hyperparameter searches (AutoML)
Pachyderm6,191almost 2 years agoOpen source distributed processing framework build on Kubernetes focused mainly on dynamic building of production machine learning pipelines -
PipelineX226almost 3 years agoBased on Kedro and MLflow. Full comparison is found
Ploomber3,530about 2 years agoThe fastest way to build data pipelines. Develop iteratively, deploy anywhere
Prefect Core17,771almost 2 years agoWorkflow management system that makes it easy to take your data pipelines and add semantics like retries, logging, dynamic mapping, caching, failure notifications, and more
Snakemake2,327almost 2 years agoWorkflow management system for reproducible and scalable data analyses
Sycamore401almost 2 years agoSycamore is an open source, AI-powered document processing engine for ETL, RAG, LLM-based applications, and analytics on unstructured data
Towhee3,255almost 2 years agoGeneral-purpose machine learning pipeline for generating embedding vectors using one or many ML models
unstructured9,452almost 2 years agounstructured streamlines and optimizes the data processing workflow for LLMs, ingesting and pre-processing images and text documents, such as PDFs, HTML, Word docs, and many more
ZenML4,261almost 2 years agoZenML is an extensible, open-source MLOps framework to create reproducible ML pipelines with a focus on automated metadata tracking, caching, and many integrations to other tools

Main Content / DS Notebook

Apache Zeppelin6,422almost 2 years agoWeb-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more
H2O Flow134almost 2 years agoJupyter notebook-like interface for H2O to create, save and re-use "flows"
Jupyter Notebooks11,823almost 2 years agoWeb interface python sandbox environments for reproducible development
ML Workspace3,446about 2 years agoAll-in-one web IDE for machine learning and data science. Combines Jupyter, VS Code, Tensorflow, and many other tools/libraries into one Docker image
.NET Interactive2,931almost 2 years ago.NET Interactive takes the power of .NET and embeds it into your interactive experiences
Papermill6,029almost 2 years agoPapermill is a library for parameterizing notebooks and executing them like Python scripts
Polynote4,542almost 2 years agoPolynote is an experimental polyglot notebook environment. Currently, it supports Scala and Python (with or without Spark), SQL, and Vega
RMarkdown2,890almost 2 years agoThe rmarkdown package is a next generation implementation of R Markdown based on Pandoc
Stencila803almost 2 years agoStencila is a platform for creating, collaborating on, and sharing data driven content. Content that is transparent and reproducible
Voilà5,508almost 2 years agoVoilà turns Jupyter notebooks into standalone web applications that can e.g. be used as dashboards

Main Content / Data Storage Optimisation

AIStore1,315almost 2 years agoAIStore is a lightweight object storage system with the capability to linearly scale out with each added storage node and a special focus on petascale deep learning
Alluxio6,880almost 2 years agoA virtual distributed storage system that bridges the gab between computation frameworks and storage systems
Apache Arrow14,728almost 2 years agoIn-memory columnar representation of data compatible with Pandas, Hadoop-based systems, etc
Apache Druid13,548almost 2 years agoA high performance real-time analytics database. Check this for introduction
Apache Hudi5,498almost 2 years agoHudi is a transactional data lake platform that brings core warehouse and database functionality directly to a data lake. Hudi is great for streaming workloads, and also allows creation of efficient incremental batch pipelines. Supports popular query engines including Spark, Flink, Presto, Trino, Hive, etc. More info
Apache Iceberg6,621almost 2 years agoIceberg is an ACID-compliant, high-performance format built for huge analytic tables (containing tens of petabytes of data), and it brings the reliability and simplicity of SQL tables to big data, while making it possible for engines like Spark, Trino, Flink, Presto, Hive and Impala to safely work with the same tables, at the same time. More info
Apache Ignite4,834almost 2 years agoA memory-centric distributed database, caching, and processing platform for transactional, analytical, and streaming workloads delivering in-memory speeds at petabyte scale -
Apache Parquet2,665almost 2 years agoOn-disk columnar representation of data compatible with Pandas, Hadoop-based systems, etc
Apache Pinot5,562almost 2 years agoA realtime distributed OLAP datastore. Comparison of the open source OLAP systems for big data: ClickHouse, Druid, and Pinot is found
BayesDB923almost 3 years agoA Bayesian database table for querying the probable implications of data as easily as SQL databases query the data itself. -
Casibase2,885almost 2 years agoCasibase is a LangChain-like RAG (Retrieval-Augmented Generation) knowledge database with web UI and Enterprise SSO
Chroma15,865almost 2 years agoBayesDB is an AI-native embedding database
ClickHouse38,076almost 2 years agoClickHouse is an open source column oriented database management system
Delta Lake7,677almost 2 years agoDelta Lake is a storage layer that brings scalable, ACID transactions to Apache Spark and other big-data engines
EdgeDB13,207almost 2 years agoNoSQL interface for Postgres that allows for object interaction to data stored
GPTCache7,293about 2 years agoGPTCache is a library for creating semantic cache for large language model queries
HopsFS309almost 2 years agoHDFS-compatible file system with scale-out strongly consistent metadata
InfluxDB29,126almost 2 years agoScalable datastore for metrics, events, and real-time analytics
Milvus31,283almost 2 years agoMilvus is a cloud-native, open-source vector database built to manage embedding vectors generated by machine learning models and neural networks
Marqo4,679almost 2 years agoMarqo is an end-to-end vector search engine
pgvector13,027almost 2 years agopgvector helps with vector similarity search for Postgres
PostgresML6,070almost 2 years agoPostgresML is a machine learning extension for PostgreSQL that enables you to perform training and inference on text and tabular data using SQL queries
Safetensors2,953almost 2 years agoSimple, safe way to store and distribute tensors
TimescaleDB18,066almost 2 years agoAn open-source time-series SQL database optimized for fast ingest and complex queries packaged as a PostgreSQL extension -
Weaviate11,812almost 2 years agoA low-latency vector search engine (GraphQL, RESTful) with out-of-the-box support for different media types. Modules include Semantic Search, Q&A, Classification, Customizable Models (PyTorch/TensorFlow/Keras), and more
Zarr1,549almost 2 years agoPython implementation of chunked, compressed, N-dimensional arrays designed for use in parallel computing

Main Content / Data Stream Processing

Apache Flink24,261almost 2 years agoOpen source stream processing framework with powerful stream and batch processing capabilities
Apache Kafka29,060almost 2 years agoKafka client library for buliding applications and microservices where the input and output are stored in kafka clusters
Apache Samza817almost 2 years agoDistributed stream processing framework. It uses Apache Kafka for messaging, and Apache Hadoop YARN to provide fault tolerance, processor isolation, security, and resource management
Apache Spark40,170almost 2 years agoMicro-batch processing for streams using the apache spark framework as a backend supporting stateful exactly-once semantics
Brooklin931over 2 years agoDistributed stream processing framework. It uses Apache Kafka for messaging, and Apache Hadoop YARN to provide fault tolerance, processor isolation, security, and resource management
Bytewax1,585almost 2 years agoFlexible Python-centric stateful stream processing framework built on top of Rust engine
FastStream3,241almost 2 years agoA modern broker-agnostic streaming Python framework supporting Apache Kafka, RabbitMQ and NATS protocols, inspired by FastAPI and easily integratable with other web frameworks
Faust6,751about 2 years agoStreaming library built on top of Python's Asyncio library using the async kafka client inspired by the kafka streaming library
TensorStore1,362almost 2 years agoLibrary for reading and writing large multi-dimensional arrays
RobustBench682almost 2 years agoanother robustness resource maintained by some of the leading names in adversarial ML. They specifically focus on defenses, and onesa standardized adversarial robustness benchmark

Main Content / Deployment and Serving

AirLLM5,446almost 2 years agoAirLLM optimizes inference memory usage, allowing 70B large language models to run inference on a single 4GB GPU card without quantization, distillation and pruning
Apache PredictionIO12,541over 5 years agoAn open source Machine Learning Server built on top of a state-of-the-art open source stack for developers and data scientists to create predictive engines for any machine learning task
Backprop243over 5 years agoBackprop makes it simple to use, finetune, and deploy state-of-the-art ML models
BentoML7,222almost 2 years agoBentoML is an open source framework for high performance ML model serving
Cortex8,026over 2 years agoCortex is an open source platform for deploying machine learning models—trained with any framework—as production web services. No DevOps required
DeepDetect2,520almost 2 years agoMachine Learning production server for TensorFlow, XGBoost and Cafe models written in C++ and maintained by Jolibrain
DeepSparse3,052about 2 years agoDeepSparse is a sparsity-aware deep learning inference runtime for CPUs
exo17,369almost 2 years agoexo helps you run your AI cluster at home with everyday devices
Hydrosphere Serving271almost 2 years agoHydrosphere Serving is a cluster for deploying and versioning your machine learning models in production
Intel® Extension for Transformers2,145almost 2 years agoAn Innovative Transformer-based Toolkit to Accelerate GenAI/LLM Everywhere
Inference1,401almost 2 years agoA fast, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models. With Inference, you can deploy models such as YOLOv5, YOLOv8, CLIP, SAM, and CogVLM on your own hardware using Docker
Infinity1,586almost 2 years agoInfinity is a high-throughput, low-latency REST API for serving text-embeddings, reranking models and clip
IPEX-LLM6,801almost 2 years agoIPEX-LLM is a PyTorch library for running LLM on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max) with very low latency
Jina21,180almost 2 years agoJina builds multimodal AI services and pipelines that communicate via gRPC, HTTP, and WebSockets, then scales them up and deploys to production
KsanaLLM295almost 2 years agoKsanaLLM is a high performance and easy-to-use engine for LLM inference and serving
KServe3,716almost 2 years agoKServe provides a Kubernetes Custom Resource Definition for serving predictive and generative ML
KTransformers771almost 2 years agoKTransformers is a flexible framework for experiencing cutting-edge LLM inference optimizations
Lepton AI2,669almost 2 years agoLeptonAI Python library allows you to build an AI service from Python code with ease
LightLLM2,691almost 2 years agoLightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance
LocalAI27,060almost 2 years agoLocalAI is a drop-in replacement REST API that's compatible with OpenAI API specifications for local inferencing
m2cgen2,826about 2 years agoA lightweight library which allows to transpile trained classic machine learning models into a native code of C, Java, Go, R, PHP, Dart, Haskell, Rust and many other programming languages
MindsDB26,915almost 2 years agoMindsDB is the platform to create, serve, and fine-tune models in real-time from your database, vector store, and application data
MLRun1,458almost 2 years agoMLRun is an open MLOps framework for quickly building and managing continuous ML and generative AI applications across their lifecycle
MLServer737almost 2 years agoAn inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more
Mosec802almost 2 years agoA rust-powered and multi-stage pipelined model server which offers dynamic batching and more. Super easy to implement and deploy as micro-services
Nuclio5,339almost 2 years agoA high-performance "serverless" framework focused on data, I/O, and compute-intensive workloads. It is well integrated with popular data science tools, such as Jupyter and Kubeflow; supports a variety of data and streaming sources; and supports execution over CPUs and GPUs
OpenDiT1,819almost 2 years agoOpenDiT is an open-source project that provides a high-performance implementation of Diffusion Transformer(DiT), specifically designed to enhance the efficiency of training and inference for DiT applications, including text-to-video generation and text-to-image generation
OpenLLM10,234almost 2 years agoOpenLLM allows developers to run any open-source LLMs (Llama 3.1, Qwen2, Phi3 and more) or custom models as OpenAI-compatible APIs with a single command
OpenScoring580about 2 years agoREST web service for the true real-time scoring (< 1 ms) of Scikit-Learn, R and Apache Spark models
OpenVINO7,439almost 2 years agoOpenVINO is an open-source toolkit for optimizing and deploying AI inference
PowerInfer8,011about 2 years agoPowerInfer is a CPU/GPU LLM inference engine leveraging activation locality for your device
Prompt2Model1,975over 2 years agoPrompt2Model is a system that takes a natural language task description (like the prompts used for LLMs such as ChatGPT) to train a small special-purpose model that is conducive for deployment
Redis-AI828over 2 years agoA Redis module for serving tensors and executing deep learning models. Expect changes in the API and internals
Seldon Core4,409almost 2 years agoOpen source platform for deploying and monitoring machine learning models in Kubernetes -
SkyPilot6,905almost 2 years agoSkyPilot is a framework for running LLMs, AI, and batch jobs on any cloud, offering maximum cost savings, highest GPU availability, and managed execution
skops457almost 2 years agoskops is a Python library helping you share your scikit-learn based models and put them in production
SparseML2,083about 2 years agoSparseML is an open-source model optimization toolkit that enables you to create inference-optimized sparse models using pruning, quantization, and distillation algorithms
S-LoRA1,766over 2 years agoServing Thousands of Concurrent LoRA Adapters
Tempo117over 4 years agoOpen source SDK that provides a unified interface to multiple MLOps projects that enable data scientists to deploy and productionise machine learning systems
Tensorflow Serving6,195almost 2 years agoHigh-performant framework to serve Tensorflow models via grpc protocol able to handle 100k requests per second per core
text-generation-inference9,456almost 2 years agoLarge Language Model Text Generation Inference
TorchServe4,238almost 2 years agoTorchServe is a flexible and easy to use tool for serving PyTorch models
Triton Inference Server8,460almost 2 years agoTriton is a high performance open source serving software to deploy AI models from any framework on GPU & CPU while maximizing utilization
UnionML336almost 3 years agoUnionML is an open source MLOps framework that aims to reduce the boilerplate and friction that comes with building models and deploying them to production
Vercel AI10,554almost 2 years agoVercel AI is a TypeScript toolkit designed to help you build AI-powered applications using popular frameworks like Next.js, React, Svelte, Vue and runtimes like Node.js
vLLM31,982almost 2 years agovLLM is a high-throughput and memory-efficient inference and serving engine for LLMs

Main Content / Evaluation and Monitoring

AlpacaEval1,568almost 2 years agoAlpacaEval is an automatic evaluator for instruction-following language models
ARES499almost 2 years agoARES is a framework for automatically evaluating Retrieval-Augmented Generation (RAG) models
AutoML Benchmark413almost 2 years agoAutoML Benchmark is a framework for evaluating and comparing open-source AutoML systems
Banana-lyzer274almost 2 years agoBanana-lyzer is an open-source AI Agent evaluation framework and dataset for web tasks with Playwright
Code Generation LM Evaluation Harness846almost 2 years agoCode Generation LM Evaluation Harness is a framework for the evaluation of code generation models
continuous-eval455about 2 years agocontinuous-eval is a framework for data-driven evaluation of LLM-powered applications
Deepchecks3,650almost 2 years agoDeepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling you to test your data and models from research to production thoroughly
DeepEval4,003almost 2 years agoDeepEval is a simple-to-use, open-source evaluation framework for LLM applications
EvalAI1,779about 2 years agoEvalAI is an open-source platform for evaluating and comparing AI algorithms at scale
Evals15,168almost 2 years agoEvals is a framework for evaluating OpenAI models and an open-source registry of benchmarks
EvalScope308almost 2 years agoEvalScope is a streamlined and customizable framework for efficient large model evaluation and performance benchmarking
Evaluate2,063about 2 years agoEvaluate is a library that makes evaluating and comparing models and reporting their performance easier and more standardized
Evalverse221about 2 years agoEvalverse is a framework to effortlessly evaluate and report LLMs with no-code requests and comprehensive reports
Evidently5,519almost 2 years agoEvidently is an open-source framework to evaluate, test and monitor ML and LLM-powered systems
FlagEval307about 2 years agoFlagEval is an open-source evaluation toolkit as well as an open platform for evaluation of large models
FMBench210almost 2 years agoFMBench is a tool for running performance benchmarks for any Foundation Model (FM) deployed on any AWS Generative AI service, be it Amazon SageMaker, Amazon Bedrock, Amazon EKS, or Amazon EC2
Giskard4,125almost 2 years agoGiskard is an evaluation & testing framework for LLMs & ML models
HarmBench366about 2 years agoHarmBench is a fast and scalable framework for evaluating automated red teaming methods and LLM attacks/defenses
Helicone2,163almost 2 years agoHelicone is an observability platform for LLMs
HELM1,981almost 2 years agoHELM (Holistic Evaluation of Language Models) provides tools for the holistic evaluation of language models, including standardized datasets, a unified API for various models, diverse metrics, robustness, and fairness perturbations, a prompt construction framework, and a proxy server for unified model access
Inspect669almost 2 years agoInspect is a framework for large language model evaluations
InterCode198over 2 years agoInterCode is a lightweight, flexible, and easy-to-use framework for designing interactive code environments to evaluate language agents that can code
Langfuse7,123almost 2 years agoLangfuse is an observability & analytics solution for LLM-based applications
LangTest506almost 2 years agoLangTest is a comprehensive evaluation toolkit for NLP models
Language Model Evaluation Harness7,200almost 2 years agoLanguage Model Evaluation Harness is a framework to test generative language models on a large number of different evaluation tasks
LightEval879almost 2 years agoLightEval is a lightweight LLM evaluation suite
LLMonitor1,108almost 2 years agoLLMonitor is an observability & analytics for AI apps and agents
LLMPerf678almost 2 years agoLLMPerf is a tool for evaluating the performance of LLM APIs
LLM AutoEval566over 2 years agoLLM AutoEval simplifies the process of evaluating LLMs using a convenient Colab notebook
lmms-eval2,164almost 2 years agolmms-eval is an evaluation framework meticulously crafted for consistent and efficient evaluation of LMM
MLPerf Inference1,256almost 2 years agoMLPerf Inference is a benchmark suite for measuring how fast systems can run models in a variety of deployment scenarios
mltrace468almost 4 years agomltrace is a lightweight, open-source Python tool to get "bolt-on" observability in ML pipelines
MTEB2,021almost 2 years agoMassive Text Embedding Benchmark (MTEB) is a comprehensive benchmark of text embeddings
NannyML1,998almost 2 years agoNannyML is a library that allows you to estimate post-deployment model performance (without access to targets), detect data drift, and intelligently link data drift alerts back to changes in model performance
OLMo-Eval326almost 2 years agoOLMo-Eval is an evaluation suite for evaluating open language models
OpenCompass4,295almost 2 years agoOpenCompass is an LLM evaluation platform, supporting a wide range of models (LLaMA, LLaMa2, ChatGLM2, ChatGPT, Claude, etc) over 50+ datasets
Opik2,588almost 2 years agoOpik is an open-source platform for evaluating, testing and monitoring LLM applications
Optimum-Benchmark274almost 2 years agoA unified multi-backend utility for benchmarking Transformers and Diffusers with support for Optimum's arsenal of hardware optimizations/quantization schemes
PhaseLLM451about 2 years agoPhaseLLM is a large language model evaluation and workflow framework
Phoenix4,271almost 2 years agoPhoenix is an open-source AI observability platform designed for experimentation, evaluation, and troubleshooting
PromptBench2,487almost 2 years agoPromptBench is a unified evaluation framework for large language models
Prometheus-Eval820almost 2 years agoPrometheus-Eval is a collection of tools for training, evaluating, and using language models specialized in evaluating other language models
Ragas7,598almost 2 years agoRagas is a framework to evaluate RAG pipelines
RAGCheckerRAGChecker is an advanced automatic evaluation framework designed to assess and diagnose Retrieval-Augmented Generation (RAG) systems
Rageval141almost 2 years agoRageval is a tool to evaluate RAG system
RefChecker325almost 2 years agoRefChecker provides a standardized assessment framework to identify subtle hallucinations present in the outputs of large language models (LLMs)
RewardBench459almost 2 years agoRewardBench is a benchmark designed to evaluate the capabilities and safety of reward models
TensorFlow Model Analysis1,258almost 2 years agoTensorFlow Model Analysis (TFMA) is a library for evaluating TensorFlow models on large amounts of data in a distributed manner, using the same metrics defined in their trainer
Tonic Validate271almost 2 years agoTonic Validate is a high-performance evaluation framework for LLM/RAG outputs
TruLens2,233almost 2 years agoTruLens provides a set of tools for evaluating and tracking LLM experiments
TrustLLM491almost 2 years agoTrustLLM is a comprehensive framework to evaluate the trustworthiness of large language models, which includes principles, surveys, and benchmarks
UpTrain2,218about 2 years agoUpTrain is an open-source tool for evaluating LLM applications
VBench643almost 2 years agoVBench is a comprehensive benchmark suite for video generative models
VLMEvalKit1,514almost 2 years agoVLMEvalKit is an open-source evaluation toolkit of large vision-language models (LVLMs)

Main Content / Explainability and Fairness

Aequitas701about 2 years agoAn open-source bias audit toolkit for data scientists, machine learning researchers, and policymakers to audit machine learning models for discrimination and bias, and to make informed and equitable decisions around developing and deploying predictive risk-assessment tools
AI Explainability 3601,641about 2 years agoInterpretability and explainability of data and machine learning models including a comprehensive set of algorithms that cover different dimensions of explanations along with proxy explainability metrics
AI Fairness 3602,483almost 2 years agoA comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models
Alibi2,421almost 2 years agoAlibi is an open source Python library aimed at machine learning model inspection and interpretation. The initial focus on the library is on black-box, instance based model explanations
anchor798about 4 years agoCode for the paper , a model-agnostic system that explains the behaviour of complex models with high-precision rules called anchors
captum4,982almost 2 years agomodel interpretability and understanding library for PyTorch developed by Facebook. It contains general purpose implementations of integrated gradients, saliency maps, smoothgrad, vargrad and others for PyTorch models
DeepLIFT837over 4 years agoCodebase that contains the methods in the paper . Here is the and the of the 15 minute talk given at ICML
DeepVis Toolbox4,025over 6 years agoThis is the code required to run the Deep Visualization Toolbox, as well as to generate the neuron-by-neuron visualizations using regularized optimisation. The toolbox and methods are described casually and more formally in this
ELI52,763over 4 years ago"Explain Like I'm 5" is a Python package which helps to debug machine learning classifiers and explain their predictions
FACETS7,357over 3 years agoFacets contains two robust visualizations to aid in understanding and analyzing machine learning datasets. Get a sense of the shape of each feature of your dataset using Facets Overview, or explore individual observations using Facets Dive
Fairlearn1,974almost 2 years agoFairlearn is a python toolkit to assess and mitigate unfairness in machine learning models
FairML361over 5 years agoFairML is a python toolbox auditing the machine learning models for bias
Fairness Comparison159over 3 years agoThis repository is meant to facilitate the benchmarking of fairness aware machine learning algorithms based on
Fairness Indicators343almost 2 years agoThe tool supports teams in evaluating, improving, and comparing models for fairness concerns in partnership with the broader Tensorflow toolkit
iNNvestigate1,271almost 3 years agoAn open-source library for analyzing Keras models visually by methods such as , , , and
Integrated-Gradients604over 4 years agoThis repository provides code for implementing integrated gradients for networks with image inputs
InterpretML6,324almost 2 years agoInterpretML is an open-source package for training interpretable models and explaining blackbox systems
keras-vis2,985over 4 years agokeras-vis is a high-level toolkit for visualizing and debugging your trained keras neural net models. Currently supported visualizations include: Activation maximization, Saliency maps, Class activation maps
Lightly3,204almost 2 years agoA python framework for self-supervised learning on images. The learned representations can be used to analyze the distribution in unlabeled data and rebalance datasets
Lightwood453almost 2 years agoA Pytorch based framework that breaks down machine learning problems into smaller blocks that can be glued together seamlessly with an objective to build predictive models with one line of code
LIME11,663about 2 years agoLocal Interpretable Model-agnostic Explanations for machine learning models
LOFO Importance821over 2 years agoLOFO (Leave One Feature Out) Importance calculates the importances of a set of features based on a metric of choice, for a model of choice, by iteratively removing each feature from the set, and evaluating the performance of the model, with a validation scheme of choice, based on the chosen metric
mljar-supervised3,081almost 2 years agoA Python package for AutoML on tabular data with feature engineering, hyper-parameters tuning, explanations and automatic documentation
SHAP23,077almost 2 years agoSHapley Additive exPlanations is a unified approach to explain the output of any machine learning model
SHAPash2,749almost 2 years agoShapash is a Python library that provides several types of visualization that display explicit labels that everyone can understand
themis-ml125almost 6 years agothemis-ml is a Python library built on top of pandas and sklearn that implements fairness-aware machine learning algorithms
Themis103about 6 years agoThemis is a testing-based approach for measuring discrimination in a software system
Transformer Debugger4,047over 2 years agoTransformer Debugger (TDB) is a tool developed by OpenAI's Superalignment team with the goal of supporting investigations into specific behaviors of small language models
TreeInterpreter745about 3 years agoPackage for interpreting scikit-learn's decision tree and random forest predictions. Allows decomposing each prediction into bias and feature contribution components as described
WhatIf928about 2 years agoAn easy-to-use interface for expanding understanding of a black-box classification or regression ML model
woe256almost 7 years agoTools for WoE Transformation mostly used in ScoreCard Model for credit rating

Main Content / Feature Store

Butterfree288almost 2 years agoA tool for building feature stores which allows you to transform your raw data into beautiful features
FEAST5,669almost 2 years agoFeast (Feature Store) is an open source feature store for machine learning. Feast is the fastest path to manage existing infrastructure to productionize analytic data for model training and online inference
Feathr1,985over 2 years agoA scalable, unified data and AI engineering platform for enterprise
Featureform1,822almost 2 years agoA virtual featurestore. Plug-&-play with your existing infra. Data Scientist approved. Discovery, Governance, Lineage, & Collaboration just a pip install away. Supports pandas, Python, spark, SQL + integrations with major cloud vendors
Hopsworks Feature Store1,177almost 2 years agoOffline/Online Feature Store for ML

Main Content / Industry-strength AD

adtk1,108about 2 years agoA Python toolkit for rule-based/unsupervised anomaly detection in time series
Alibi Detect2,262almost 2 years agoalibi-detect is a Python package focused on outlier, adversarial and concept drift detection
Darts8,166almost 2 years agoDarts is a library for user-friendly forecasting and anomaly detection on time series
Deequ3,324almost 2 years agoA library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets
Deep Anomaly Detection with Outlier Exposure548almost 5 years agoOutlier Exposure (OE) is a method for improving anomaly detection performance in deep learning models
PyOD8,653almost 2 years agoA Python Toolbox for Scalable Outlier Detection (Anomaly Detection)
SUOD382over 2 years agoSUOD (Scalable Unsupervised Outlier Detection) is an acceleration system for large-scale anomaly/outlier detection
TextAttack3,015about 2 years agoTextAttack is a Python framework for adversarial attacks, data augmentation, and model training in NLP
TFDV766almost 2 years agoTFDV (Tensorflow Data Validation) is a library for exploring and validating machine learning data
TODS1,484about 3 years agoTODS is a full-stack automated machine learning system for outlier detection on multivariate time-series data

Main Content / Industry Strength CV

Deep Lake8,237almost 2 years agoDeep Lake is a data infrastructure optimized for computer vision
Detectron230,778almost 2 years agoDetectron2 is Facebook AI Research's next generation library that provides state-of-the-art detection and segmentation algorithms
iGibson676about 2 years agoiGibson is a simulation environment providing fast visual rendering and physics simulation based on Bullet
JDiffusion243about 2 years agoJDiffusion is a diffusion model library for generating images or videos based on Diffusers and Jittor
KerasCV1,013almost 2 years agoKerasCV is a library of modular computer vision oriented Keras components
LAVIS10,058almost 2 years agoLAVIS is a deep learning library for LAnguage-and-VISion intelligence research and applications
libcom558almost 2 years agolibcom is an image composition toolbox
MMDetection29,808about 2 years agoMMDetection is an open source object detection toolbox based on PyTorch
SCEPTER438almost 2 years agoSCEPTER is an open-source code repository dedicated to generative training, fine-tuning, and inference, encompassing a suite of downstream tasks such as image generation, transfer, editing
SuperGradients4,625about 2 years agoSuperGradients is an open-source library for training PyTorch-based computer vision models
supervision24,444almost 2 years agoSupervision is a Python library designed for efficient computer vision pipeline management, providing tools for annotation, visualization, and monitoring of models
VideoSys1,819almost 2 years agoVideoSys supports many diffusion models with our various acceleration techniques, enabling these models to run faster and consume less memory
VISSL3,260over 2 years agoVISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images

Main Content / Industry Strength NLP

aisuite7,661almost 2 years agoaisuite is a simple, unified interface to multiple generative AI providers
Align-Anything270almost 2 years agoAlign-Anything aims to align any modality large models (any-to-any models), including LLMs, VLMs, and others, with human intentions and values
Blackstone641about 2 years agoBlackstone is a spaCy model and library for processing long-form, unstructured legal text. Blackstone is an experimental research project from the Incorporated Council of Law Reporting for England and Wales' research lab, ICLR&D
BERTopic6,246almost 2 years agoBERTopic is a topic modeling technique that leverages transformers and c-TF-IDF to create dense clusters allowing for easily interpretable topics whilst keeping important words in the topic descriptions
Burr1,368almost 2 years agoBurr helps you develop applications that make decisions (chatbot, agent, simulation). It comes with production-ready features (telemetry, persistence, deployment, etc.) and the open-source, free, and local-first Burr UI
Coqui STT2,302over 2 years agoCoqui STT is a fast, open-source, multi-platform, deep-learning toolkit for training and deploying speech-to-text models
CodeTF1,461over 2 years agoCodeTF is a one-stop Python transformer-based library for code large language models (Code LLMs) and code intelligence, provides a seamless interface for training and inferencing on code intelligence tasks like code summarization, translation, code generation and so on
CTRL1,872almost 5 years agoA Conditional Transformer Language Model for Controllable Generation released by SalesForce
dspy20,235almost 2 years agoA framework for programming with foundation models
Dust994almost 2 years agoDust assists in the design and deployment of large language model apps
ESPnet8,596almost 2 years agoESPnet is an end-to-end speech processing toolkit
Facebook's XLM2,893over 3 years agoPyTorch original implementation of Cross-lingual Language Model Pretraining which includes BERT, XLM, NMT, XNLI, PKM, etc
FastChat37,269almost 2 years agoFastChat is an open platform for training, serving, and evaluating large language model based chatbots
Flair13,990almost 2 years agoSimple framework for state-of-the-art NLP developed by Zalando which builds directly on PyTorch
FlexGen9,236almost 2 years agoFlexGen is a high-throughput generation engine for running large language models with limited GPU memory
Gensim15,735about 2 years agoGensim is a Python library for topic modelling, document indexing and similarity retrieval with large corpora
GluonNLP2,560almost 3 years agoGluonNLP is a toolkit that enables easy text preprocessing, datasets loading and neural models building to help you speed up your Natural Language Processing (NLP) research
Grover918over 3 years agoGrover is a model for Neural Fake News -- both generation and detection. However, it probably can also be used for other generation tasks
h2oGPT11,491almost 2 years agoh2oGPT is an open source generative AI, gives organizations like yours the power to own large language models while preserving your data ownership
Haystack18,094almost 2 years agoHaystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-3 and alike). Haystack offers production-ready tools to quickly build ChatGPT-like question answering, semantic search, text generation, and more
Interactive Composition Explorer537almost 2 years agoICE is a Python library and trace visualizer for language model programs
Kashgari2,395about 2 years agoKashgari is a simple and powerful NLP Transfer learning framework, build a state-of-art model in 5 minutes for named entity recognition (NER), part-of-speech tagging (PoS), and text classification tasks
Lamini2,519almost 2 years agoLamini is an LLM engine for rapidly customizing models
LangChain96,146almost 2 years agoLangChain assists in building applications with LLMs through composability
LlamaIndex37,371almost 2 years agoLlamaIndex (GPT Index) is a data framework for your LLM application
LLaMA56,832about 2 years agoLLaMA is intended as a minimal, hackable and readable example to load LLaMA (arXiv) models and run inference
LLaMA2-Accessory2,732over 2 years agoLLaMA2-Accessory is an open-source toolkit for pretraining, finetuning and deployment of Large Language Models (LLMs) and multimodal LLMs
LMFlow8,312almost 2 years agoLMFlow is an extensible, convenient, and efficient toolbox for finetuning large machine learning models
Megatron-LM10,804almost 2 years agoMegatron-LM is a highly optimized and efficient library for training large language models
MLC LLM19,396almost 2 years agoMLC LLM is a universal solution that allows any language models to be deployed natively on a diverse set of hardware backends and native applications, plus a productive framework for everyone to further optimize model performance for their own use cases
Ollama102,617almost 2 years agoGet up and running with large language models, locally
PaddleNLP12,224almost 2 years agoPaddleNLP is a Large Language Model (LLM) development suite based on the PaddlePaddle deep learning framework, supporting efficient large model training, lossless compression, and high-performance inference on various hardware devices
Semantic Kernel22,277almost 2 years agoSemantic Kernel is an SDK that integrates Large Language Models (LLMs) like OpenAI, Azure OpenAI, and Hugging Face with conventional programming languages like C#, Python, and Java. Semantic Kernel achieves this by allowing you to define plugins that can be chained together in just a few lines of code
sense2vec1,630over 2 years agoA Pytorch library that allows for training and using sense2vec models, which are models that leverage the same approach than word2vec, but also leverage part-of-speech attributes for each token, which allows it to be "meaning-aware"
Sentence Transformers15,556almost 2 years agoSentence Transformers provides an easy method to compute dense vector representations for sentences, paragraphs, and images
SpaCy30,459almost 2 years agospaCy is a library for advanced Natural Language Processing in Python and Cython
SWIFT4,659almost 2 years agoSWIFT is a scalable lightweight infrastructure for deep learning model fine-tuning
Tensorflow Lingvo2,820almost 2 years agoA for building neural networks in Tensorflow, particularly sequence models
Tensorflow Text1,239almost 2 years agoTensorFlow Text provides a collection of text related classes and ops ready to use with TensorFlow 2.0
Transformers136,357almost 2 years agoHuggingface's library of state-of-the-art pretrained models for Natural Language Processing (NLP)
trlX4,537over 2 years agotrlX is a distributed training framework designed from the ground up to focus on fine-tuning large language models with reinforcement learning using either a provided reward function or a reward-labeled dataset

Main Content / Industry Strength RecSys

EasyRec1,814almost 2 years agoEasyRec is a framework for large scale recommendation algorithms
Gorse8,652almost 2 years agoGorse aims to be a universal open-source recommender system that can be quickly introduced into a wide variety of online services
Implicit3,581about 2 years agoImplicit provides fast Python implementations of several different popular recommendation algorithms for implicit feedback datasets
LightFM4,790about 2 years agoLightFM is a Python implementation of a number of popular recommendation algorithms for both implicit and explicit feedback
NVTabular1,057about 2 years agoNVTabular is a feature engineering and preprocessing library for tabular data that is designed to easily manipulate terabyte scale datasets and train deep learning (DL) based recommender systems
Merlin787almost 2 years agoNVIDIA Merlin is an open source library providing end-to-end GPU-accelerated recommender systems, from feature engineering and preprocessing to training deep learning models and running inference in production
Recommenders19,418almost 2 years agoRecommenders contains benchmark and best practices for building recommendation systems, provided as Jupyter notebooks
Surprise6,434over 2 years agoSurprise is a Python scikit for building and analyzing recommender systems that deal with explicit rating data
YouTokenToMe959over 2 years agoYouTokenToMe is an unsupervised text tokenizer focused on computational efficiency. It currently implements fast (BPE)

Main Content / Industry Strength RL

Acme3,542almost 2 years agoAcme is a library of reinforcement learning (RL) building blocks that strives to expose simple, efficient, and readable agents
AI-Optimizer4,848over 3 years agoAI-Optimizer is a next-generation deep reinforcement learning suit, providing rich algorithm libraries ranging from model-free to model-based RL algorithms, from single-agent to multi-agent algorithms. Moreover, AI-Optimizer contains a flexible and easy-to-use distributed training framework for efficient policy training
ALF306almost 2 years agoALF is a reinforcement learning framework emphasizing on the flexibility and easiness of implementing complex algorithms involving many different components
AlpacaFarm786about 2 years agoAlpacaFarm is a simulation framework for methods that learn from human feedback
CityLearn480almost 2 years agoCityLearn is an open source OpenAI Gym environment for the implementation of Multi-Agent Reinforcement Learning (RL) for building energy coordination and demand response in cities
CleanRL5,891almost 2 years agoCleanRL is a Deep Reinforcement Learning library that provides high-quality single-file implementation with research-friendly features. The implementation is clean and simple, yet we can scale it to run thousands of experiments using AWS Batch
CompilerGym917almost 2 years agoCompilerGym is a library of easy to use and performant reinforcement learning environments for compiler tasks
d3rlpy1,349almost 2 years agod3rlpy is an offline deep reinforcement learning library for practitioners and researchers
D4RL1,371almost 2 years agoD4RL is an open-source benchmark for offline reinforcement learning
DIAMBRA317over 2 years agoDIAMBRA Arena is a software package featuring a collection of high-quality environments for Reinforcement Learning research and experimentation
Dopamine10,591almost 2 years agoDopamine is a research framework for fast prototyping of reinforcement learning algorithms. It aims to fill the need for a small, easily grokked codebase in which users can freely experiment with wild ideas (speculative research)
EvoTorch1,026almost 2 years agoEvoTorch is an open source evolutionary computation library developed at NNAISENSE, built on top of PyTorch
FinRL10,240almost 2 years agoFinRL is the first open-source framework to demonstrate the great potential of financial reinforcement learning
garage1,893over 3 years agogarage is a toolkit for developing and evaluating reinforcement learning algorithms, and an accompanying library of state-of-the-art implementations built using that toolkit
Gymnasium7,613almost 2 years agoGymnasium is an open source Python library for developing and comparing reinforcement learning algorithms by providing a standard API to communicate between learning algorithms and environments, as well as a standard set of environments compliant with that API
Gymnasium-Robotics585almost 2 years agoGymnasium-Robotics contains a collection of Reinforcement Learning robotic environments that use the Gymansium API. The environments run with the MuJoCo physics engine and the maintained mujoco python bindings
Jumanji657almost 2 years agoJumanji is a suite of Reinforcement Learning (RL) environments written in JAX providing clean, hardware-accelerated environments for industry-driven research
MALib507almost 3 years agoMALib is a parallel framework of population-based learning nested with reinforcement learning methods. MALib provides higher-level abstractions of MARL training paradigms, which enables efficient code reuse and flexible deployments on different distributed computing paradigms
MARLlib960almost 2 years agoMARLlib is a comprehensive Multi-Agent Reinforcement Learning algorithm library based on RLlib. It provides MARL research community with a unified platform for building, training, and evaluating MARL algorithms
Mava749almost 2 years agoMava is a framework for distributed multi-agent reinforcement learning in JAX
Melting Pot637almost 2 years agoMelting Pot is a suite of test scenarios for multi-agent reinforcement learning
MetaDrive823almost 2 years agoMetaDrive is a driving simulator that composes diverse driving scenarios for generalizable RL
Minigrid2,139almost 2 years agoThe Minigrid library contains a collection of discrete grid-world environments to conduct research on Reinforcement Learning. The environments follow the Gymnasium standard API and they are designed to be lightweight, fast, and easily customizable
MiniHack486about 2 years agoMiniHack is a sandbox framework for easily designing rich and diverse environments for Reinforcement Learning
MiniWorld712almost 2 years agoMiniWorld is a minimalistic 3D interior environment simulator for reinforcement learning & robotics research
ML-Agents17,334almost 2 years agoML-Agents is an open-source project that enables games and simulations to serve as environments for training reinforcement learning intelligent agents
MushroomRL824almost 2 years agoMushroomRL is a Python reinforcement learning (RL) library whose modularity allows to easily use well-known Python libraries for tensor computation (e.g. PyTorch, Tensorflow) and RL benchmarks (e.g. OpenAI Gym, PyBullet, Deepmind Control Suite)
OmniSafe954almost 2 years agoOmniSafe is an infrastructural framework designed to accelerate safe reinforcement learning (RL) research
Overcooked-AI726almost 2 years agoOvercooked-AI is a benchmark environment for fully cooperative human-AI task performance, based on the wildly popular video game Overcooked
PARL3,296about 2 years agoPARL is a flexible and high-efficient reinforcement learning framework
PettingZoo2,678almost 2 years agoPettingZoo is a Python library for conducting research in multi-agent reinforcement learning, akin to a multi-agent version of Gymnasium
RLeXplore373almost 2 years agoRLeXplore provides stable baselines of exploration methods in reinforcement learning
RLMeta283over 3 years agoRLMeta is a flexible lightweight research framework for Distributed Reinforcement Learning based on PyTorch and moolib
Safety-Gymnasium410over 2 years agoSafety-Gymnasium is a highly scalable and customizable safe reinforcement learning environment library
skrl588almost 2 years agoskrl is an open-source modular library for Reinforcement Learning written in Python (using PyTorch) and designed with a focus on readability, simplicity, and transparency of algorithm implementation
Stable Baselines9,329almost 2 years agoA fork of OpenAI Baselines, implementations of reinforcement learning algorithms
SuperSuit457about 2 years agoSuperSuit introduces a collection of small functions which can wrap reinforcement learning environments to do preprocessing ('microwrappers')
TF-Agents2,816almost 2 years agoA reliable, scalable and easy to use TensorFlow library for contextual bandits and reinforcement learning
TRL10,308almost 2 years agoTrain transformer language models with reinforcement learning
veRL427almost 2 years agoveRL (HybridFlow) is a flexible, efficient and industrial-level RL(HF) training framework designed for LLMs

Main Content / Industry Strength Visualisation

Apache ECharts60,918almost 2 years agoApache ECharts is a powerful, interactive charting and data visualization library for browser
Apache Superset63,320almost 2 years agoA modern, enterprise-ready business intelligence web application
Bokeh19,453almost 2 years agoBokeh is an interactive visualization library for Python that enables beautiful and meaningful visual presentation of data in modern web browsers
Geoplotlib1,029over 4 years agogeoplotlib is a python toolbox for visualizing geographical data and making maps
ggplot26,560almost 2 years agoAn implementation of the grammar of graphics for R
gradio34,557almost 2 years agoQuickly create and share demos of models - by only writing Python. Debug models interactively in your browser, get feedback from collaborators, and generate public links without deploying anything
Kangas1,045almost 2 years agoKangas is a tool for exploring, analyzing, and visualizing large-scale multimedia data. It provides a straightforward Python API for logging large tables of data, along with an intuitive visual interface for performing complex queries against your dataset
matplotlib20,443almost 2 years agoA Python 2D plotting library which produces publication-quality figures in a variety of hardcopy formats and interactive environments across platforms
Missingno3,987over 2 years agomissingno provides a small toolset of flexible and easy-to-use missing data visualizations and utilities that allows you to get a quick visual summary of the completeness (or lack thereof) of your dataset
Netron28,684almost 2 years agoNetron is a viewer for neural network, deep learning and machine learning models
PDPBox846about 2 years agoThis repository is inspired by ICEbox. The goal is to visualize the impact of certain features towards model prediction for any supervised learning algorithm
Perspective8,669almost 2 years agoStreaming pivot visualization via WebAssembly
Pixiedust1,041over 5 years agoPixieDust is a productivity tool for Python or Scala notebooks, which lets a developer encapsulate business logic into something easy for your customers to consume
Plotly16,444almost 2 years agoAn interactive, open source, and browser-based graphing library for Python
PyCEbox164over 6 years agoPython Individual Conditional Expectation Plot Toolbox
pygal2,673about 2 years agopygal is a dynamic SVG charting library written in Python
Redash26,572almost 2 years agoRedash is anopen source visualisation framework that is built to allow easy access to big datasets leveraging multiple backends
seaborn12,669almost 2 years agoSeaborn is a Python visualization library based on matplotlib. It provides a high-level interface for drawing attractive statistical graphics
Spotlight1,134almost 2 years agoSpotlight helps you to identify critical data segments and model failure modes. It enables you to build and maintain reliable machine learning models by curating high-quality datasets
Streamlit36,168almost 2 years agoStreamlit lets you create apps for your machine learning projects with deceptively simple Python scripts. It supports hot-reloading, so your app updates live as you edit and save your file
tensorboardX7,887almost 2 years agoWrite TensorBoard events with simple function call
TensorBoard6,745almost 2 years agoTensorBoard is a visualization toolkit for machine learning experimentation that makes it easy to host, track, and share ML experiments
Transformer Explainer3,604almost 2 years agoTransformer Explainer is an interactive visualization tool designed to help anyone learn how Transformer-based models like GPT work
Vega-Altair9,441almost 2 years agoVega-Altair is a declarative statistical visualization library for Python
ydata-profiling12,602almost 2 years agoydata-profiling provides a one-line Exploratory Data Analysis (EDA) experience in a consistent and fast solution

Main Content / Metadata Management

Amundsen4,455almost 2 years agoAmundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data
Apache Atlas1,850almost 2 years agoApache Atlas framework is an extensible set of core foundational governance services – enabling enterprises to effectively and efficiently meet their compliance requirements within Hadoop and allows integration with the whole enterprise data ecosystem
DataHub10,046almost 2 years agoDataHub is LinkedIn's generalized metadata search & discovery tool
Marquez1,800almost 2 years agoMarquez is an open source metadata service for the collection, aggregation, and visualization of a data ecosystem's metadata
Metacat1,616almost 2 years agoMetacat is a unified metadata exploration API service. Metacat focusses on solving these problems: 1) federated views of metadata systems; 2) arbitrary metadata storage about data sets; 3) metadata discovery
ML Metadata629almost 2 years agoa library for recording and retrieving metadata associated with ML developer and data scientist workflows
Model Card Toolkit427about 3 years agoModel Card Toolkit is a toolkit that streamlines and automates the generation of model cards
TensorFlow Metadata107almost 2 years agoTensorFlow Metadata provides standard representations for metadata that are useful when training machine learning models with TensorFlow

Main Content / Model, Data and Experiment Tracking

AI2 Tango533over 2 years agoAI2 Tango replaces messy directories and spreadsheets full of file versions by organizing experiments into discrete steps that can be cached and reused throughout the lifetime of a research project
Aim5,261almost 2 years agoA super-easy way to record, search and compare AI experiments
Catalyst3,300over 2 years agoHigh-level utils for PyTorch DL & RL research. It was developed with a focus on reproducibility, fast experimentation and code/ideas reusing
ClearML5,740almost 2 years agoAuto-Magical Experiment Manager & Version Control for AI (previously Trains)
CodaLab158almost 2 years agoCodaLab Worksheets is a collaborative platform for reproducible research that allows researchers to run, manage, and share their experiments in the cloud. It helps researchers ensure that their runs are reproducible and consistent
Deepkit367over 3 years agoAn open-source platform and cross-platform desktop application to execute, track, and debug modern machine learning experiments
Dolt18,052almost 2 years agoDolt is a SQL database that you can fork, clone, branch, merge, push and pull just like a git repository
DVC14,016almost 2 years agoDVC (Data Version Control) is a git fork that allows for version management of models
Flor152almost 2 years agoEasy to use logger and automatic version controller made for data scientists who write ML code
Guild AI872about 3 years agoOpen source toolkit that automates and optimizes machine learning experiments
Hangar204about 6 years agoVersion control for tensor data, git-like semantics on numerical data with high speed and efficiency
Keepsake1,649almost 2 years agoVersion control for machine learning
lakeFS4,496almost 2 years agoRepeatable, atomic and versioned data lake on top of object storage
MLflow19,021almost 2 years agoOpen source platform to manage the ML lifecycle, including experimentation, reproducibility and deployment
ModelDB1,707about 2 years agoAn open-source system to version machine learning models including their ingredients code, data, config, and environment and to track ML metadata across the model lifecycle
ModelStore379over 2 years agoAn open-source Python library that allows you to version, export, and save a machine learning model to your cloud storage provider
Neptune590almost 2 years agoNeptune is a scalable experiment tracker for teams that train foundation models
ormb465over 2 years agoDocker for Your ML/DL Models Based on OCI Artifacts
Polyaxon3,581almost 2 years agoA platform for reproducible and scalable machine learning and deep learning on kubernetes -
Quilt1,328almost 2 years agoVersioning, reproducibility and deployment of data and models
Sacred4,266almost 2 years agoTool to help you configure, organize, log and reproduce machine learning experiments
Studio380about 2 years agoModel management framework which minimizes the overhead involved with scheduling, running, monitoring and managing artifacts of your machine learning experiments
TerminusDB2,798almost 2 years agoA graph database management system that stores data like git
Weights & Biases9,270almost 2 years agoWeights & Biase is a machine learning experiment tracking, dataset versioning, hyperparameter search, visualization, and collaboration

Main Content / Model Storage Optimisation

AutoAWQ1,827almost 2 years agoAutoAWQ is an easy-to-use package for 4-bit quantized models
AutoGPTQ4,560almost 2 years agoAn easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm
AWQ2,593almost 2 years agoActivation-aware Weight Quantization for LLM Compression and Acceleration
GGML11,362almost 2 years agoGGML is a high-performance, tensor library for machine learning that enables efficient inference on CPUs, particularly optimized for large language models
GPTQ1,964over 2 years agoAccurate Post-training Quantization of Generative Pretrained Transformers
MMdnn5,802over 2 years agoMMdnn is a comprehensive cross-framework tool from Microsoft that facilitates model conversion, visualization, and deployment across various deep learning frameworks
neural-compressor2,257almost 2 years agoIntel® Neural Compressor aims to provide popular model compression techniques such as quantization, pruning (sparsity), distillation, and neural architecture search on mainstream frameworks
NNEFNeural Network Exchange Format (NNEF) is an open standard for representing neural network models to enable interoperability and portability across different machine learning frameworks and platforms
ONNX18,098almost 2 years agoONNX (Open Neural Network Exchange) is an open-source format designed to facilitate interoperability and portability of machine learning models across different frameworks and platforms
PFAPFA (Portable Format for Analytics) format is a standard for representing and exchanging predictive models and analytics workflows in a portable, JSON-based format
PMMLPMML (Predictive Model Markup Language) is an XML-based standard for representing and sharing predictive models between different applications
Quanto847almost 2 years agoQuanto aims to simplify quantizing deep learning models

Main Content / Neural Search and Retrieval

Annoy13,321about 2 years agoAnnoy (Approximate Nearest Neighbors Oh Yeah) is a C++ library with Python bindings to search for points in space that are close to a given query point
AutoRAG2,960almost 2 years agoAutoRAG is a RAG AutoML tool for automatically finds an optimal RAG pipeline for your data
BeyondLLM267almost 2 years agoBeyond LLM offers an all-in-one toolkit for experimentation, evaluation, and deployment of RAG systems, simplifying the process with automated integration, customizable evaluation metrics, and support for various LLMs tailored to specific needs, ultimately aiming to reduce LLM hallucination risks and enhance reliability
CLIP-as-service12,497over 2 years agoCLIP-as-service is a low-latency high-scalability service for embedding images and text. It can be easily integrated as a microservice into neural search solutions
Cognita3,401almost 2 years agoCognita is a RAG framework for building modular and production-ready applications
DocArray2,998almost 2 years agoDocArray is a library for nested, unstructured, multimodal data in transit, including text, image, audio, video, 3D mesh, etc. It allows deep-learning engineers to efficiently process, embed, search, recommend, store, and transfer multimodal data with a Pythonic API
Faiss31,920almost 2 years agoFaiss is a library for efficient similarity search and clustering of dense vectors
fastRAG1,392almost 2 years agofastRAG is a research framework for efficient and optimized retrieval augmented generative pipelines, incorporating state-of-the-art LLMs and Information Retrieval
Finetuner1,482over 2 years agoFinetuner provides an effective way to improve performance on neural search tasks
GraphRAG20,636almost 2 years agoGraphRAG is a data pipeline and transformation suite that is designed to extract meaningful, structured data from unstructured text using the power of LLMs
HippoRAG1,456about 2 years agoHippoRAG is a novel retrieval augmented generation (RAG) framework inspired by the neurobiology of human long-term memory that enables LLMs to continuously integrate knowledge across external documents
LightRAG11,616almost 2 years agoA simple and fast retrieval-augmented generation framework
llmware8,303almost 2 years agollmware provides a unified framework for building LLM-based applications (e.g, RAG, Agents), using small, specialized models that can be deployed privately, integrated with enterprise knowledge sources safely and securely, and cost-effectively tuned and adapted for any business process
Mem023,331almost 2 years agoMem0 enhances AI assistants and agents with an intelligent memory layer, enabling personalized AI interactions
MindSQL246almost 2 years agoMindSQL is a Python RAG library to streamline the interaction between users and their databases using just a few lines of code
NGT1,272almost 2 years agoNGT provides commands and a library for performing high-speed approximate nearest neighbor searches against a large volume of data in high dimensional vector data space
NMSLIB3,429about 2 years agoNon-Metric Space Library (NMSLIB): An efficient similarity search library and a toolkit for evaluation of k-NN methods for generic non-metric spaces
Qdrant21,001almost 2 years agoAn open source vector similarity search engine with extended filtering support
R2R4,010almost 2 years agoR2R (RAG to Riches) is a comprehensive platform for building, deploying, and scaling RAG applications with hybrid search, multimodal support, and advanced observability
RAGFlow25,479almost 2 years agoRAGFlow is a RAG engine based on deep document understanding
RAGxplorer1,093over 2 years agoRAGxplorer is a tool to build RAG visualisations
Rule-based Retrieval229almost 2 years agoRule-based Retrieval enables users to create and manage RAG applications with advanced filtering capabilities
Vanna12,311almost 2 years agoVanna is a RAG framework for SQL generation and related functionality

Main Content / Optimized Computation

Adapters2,600almost 2 years agoAdapters is a unified library for parameter-efficient and modular transfer learning
AutoTrain Advanced4,151almost 2 years agoAutoTrain Advanced is a no-code solution that allows you to train machine learning models in just a few clicks
BindsNET1,517almost 2 years agoBindsNET is a spiking neural network simulation library geared towards the development of biologically inspired algorithms for machine learning
BitBLAS445almost 2 years agoBitBLAS is a library to support mixed-precision BLAS operations on GPUs
bitsandbytes6,409almost 2 years agoBitsandbytes library is a lightweight Python wrapper around CUDA custom functions, in particular 8-bit optimizers, matrix multiplication (LLM.int8()), and 8 & 4-bit quantization functions
BrainCog467almost 2 years agoBrainCog (Brain-inspired Cognitive Intelligence Engine) is a brain-inspired spiking neural network based platform for Brain-inspired Artificial Intelligence and simulating brains at multiple scales
Composer5,190almost 2 years agoComposer is a PyTorch library that enables you to train neural networks faster, at lower cost, and to higher accuracy
CuDF8,534almost 2 years agoBuilt based on the Apache Arrow columnar memory format, cuDF is a GPU DataFrame library for loading, joining, aggregating, filtering, and otherwise manipulating data
CuML4,292almost 2 years agocuML is a suite of libraries that implement machine learning algorithms and mathematical primitives functions that share compatible APIs with other RAPIDS projects
CuPy9,586almost 2 years agoAn implementation of NumPy-compatible multi-dimensional array on CUDA. CuPy consists of the core multi-dimensional array class, cupy.ndarray, and many functions on it
Flax6,196almost 2 years agoA neural network library and ecosystem for JAX designed for flexibility
H2O-36,950almost 2 years agoFast scalable Machine Learning platform for smarter applications: Deep Learning, Gradient Boosting & XGBoost, Random Forest, Generalized Linear Modeling (Logistic Regression, Elastic Net), K-Means, PCA, Stacked Ensembles, Automatic Machine Learning (AutoML), etc
Jax30,744almost 2 years agoComposable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
Kompute2,036almost 2 years agoBlazing fast, lightweight and mobile phone-enabled Vulkan compute framework optimized for advanced GPU data processing usecases
MLX17,878almost 2 years agoMLX is an array framework for machine learning on Apple silicon
Modin9,942almost 2 years agoSpeed up your Pandas workflows by changing a single line of code
Nevergrad3,980almost 2 years agoNevergrad is a gradient-free optimisation platform
Norse685almost 2 years agoNorse aims to exploit the advantages of bio-inspired neural components, which are sparse and event-driven - a fundamental difference from artificial neural networks
Numba10,053almost 2 years agoA compiler for Python array and numerical functions
NumpyGroupies197about 2 years agoOptimised tools for group-indexing operations: aggregated sum and more
OpenFlamingo3,781about 2 years agoOpenFlamingo is an open-source framework for training large multimodal models
Optimum2,618almost 2 years agoOptimum is an extension of Transformers and Diffusers, providing a set of optimization tools enabling maximum efficiency to train and run models on targeted hardware while keeping things easy to use
PEFT16,699almost 2 years agoParameter-Efficient Fine-Tuning (PEFT) methods enable efficient adaptation of pre-trained language models (PLMs) to various downstream applications without fine-tuning all the model's parameters
PyTorch84,978almost 2 years agoPyTorch is a library to develop and train neural network based deep learning models
scikit-learn60,451almost 2 years agoScikit-learn is a powerful machine learning library that provides a wide variety of modules for data access, data preparation and statistical model building
SetFit2,267about 2 years agoSetFit is an efficient and prompt-free framework for few-shot fine-tuning of Sentence Transformers
snnTorch1,383about 2 years agosnnTorch is a deep and online learning library with spiking neural networks
Sonnet9,790almost 2 years agoSonnet is a library built on top of TensorFlow 2 designed to provide simple, composable abstractions for machine learning research
Tensor2Tensor15,648over 3 years agoTensor2Tensor is a library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research
TensorFlow186,822almost 2 years agoTensorFlow is a leading library designed for developing and deploying state-of-the-art machine learning applications
ThunderKittens1,746almost 2 years agoThunderKittens is a framework to make it easy to write fast deep learning kernels in CUDA
torchkeras1,822almost 2 years agoThe torchkeras library is a simple tool for training neural network in pytorch jusk in a keras style
TorchOpt554almost 2 years agoTorchOpt is an efficient library for differentiable optimization built upon PyTorch
Vaex8,315almost 2 years agoVaex is a high performance Python library for lazy Out-of-Core DataFrames (similar to Pandas), to visualize and explore big tabular datasets. Vaex uses memory mapping, zero memory copy policy and lazy computations for best performance (no memory wasted)
Vowpal Wabbit8,495almost 2 years agoVowpal Wabbit is a machine learning system which pushes the frontier of machine learning with techniques such as online, hashing, allreduce, reductions, learning2search, active, and interactive learning
Weld2,996over 4 years agoHigh-performance runtime for data analytics applications, Here is an with Weld’s main contributor
XGBoost26,396almost 2 years agoXGBoost is an optimized distributed gradient boosting library designed to be highly efficient, flexible and portable
yellowbrick4,304almost 2 years agoyellowbrick is a matplotlib-based model evaluation plots for scikit-learn and other machine learning libraries

Main Content / Privacy and Security

BastionLab170almost 3 years agoBastionLab is a framework for confidential data science collaboration. It uses Confidential Computing, Access control data science, and Differential Privacy to enable data scientists to remotely perform data exploration, statistics, and training on confidential data while ensuring maximal privacy for data owners
Concrete-ML1,045almost 2 years agoConcrete-ML is a Privacy-Preserving Machine Learning (PPML) open-source set of tools built on top of The Concrete Framework by . It aims to simplify the use of fully homomorphic encryption (FHE) for data scientists to help them automatically turn machine learning models into their homomorphic equivalent
Fedlearner891about 2 years agoFedlearner is collaborative machine learning framework that enables joint modeling of data distributed between institutions
FATE5,750almost 2 years agoFATE (Federated AI Technology Enabler) is the world's first industrial grade federated learning open source framework to enable enterprises and institutions to collaborate on data while protecting data security and privacy
FedML4,205almost 2 years agoFedML provides a research and production integrated edge-cloud platform for Federated/Distributed Machine Learning at anywhere at any scale
Flower5,219almost 2 years agoFlower is a Federated Learning Framework with a unified approach. It enables the federation of any ML workload, with any ML framework, and any programming language
Google's Differential Privacy3,091almost 2 years agoThis is a C++ library of ε-differentially private algorithms, which can be used to produce aggregate statistics over numeric data sets containing private or sensitive information
Guardrails4,254almost 2 years agoGuardrails is a package that lets a user add structure, type and quality guarantees to the outputs of large language models
Intel Homomorphic Encryption Backend222over 3 years agoThe Intel HE transformer for nGraph is a Homomorphic Encryption (HE) backend to the Intel nGraph Compiler, Intel's graph compiler for Artificial Neural Networks
Microsoft SEAL3,647about 2 years agoMicrosoft SEAL is an easy-to-use open-source (MIT licensed) homomorphic encryption library developed by the Cryptography Research group at Microsoft
OpenFL738almost 2 years agoOpenFL is a Python framework for Federated Learning. OpenFL is designed to be a , and tool for data scientists. OpenFL is developed by Intel Internet of Things Group (IOTG) and Intel Labs
PySyft9,557almost 2 years agoA Python library for secure, private Deep Learning. PySyft decouples private data from model training, using Multi-Party Computation (MPC) within PyTorch
Rosetta566over 4 years agoA privacy-preserving framework based on TensorFlow with customized backend Operations using Multi-Party Computation (MPC). Rosetta reuses the APIs of TensorFlow and allows to transfer original TensorFlow codes into a privacy-preserving manner with minimal changes
Substra274almost 2 years agoSubstra is an open-source framework for privacy-preserving, traceable and collaborative Machine Learning
Tensorflow Privacy1,947almost 2 years agoA Python library that includes implementations of TensorFlow optimizers for training machine learning models with differential privacy
TF Encrypted1,213almost 2 years agoA Framework for Confidential Machine Learning on Encrypted Data in TensorFlow

Main Content / Training Orchestration

Accelerate8,056almost 2 years agoAccelerate abstracts exactly and only the boilerplate code related to multi-GPU/TPU/mixed-precision and leaves the rest of your code unchanged
Axolotl8,090almost 2 years agoAxolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures
CML4,046almost 2 years agoContinuous Machine Learning (CML) is an open-source library for implementing continuous integration & delivery (CI/CD) in machine learning projects
CoreNet6,997almost 2 years agoCoreNet is a deep neural network toolkit that allows researchers and engineers to train standard and novel small and large-scale models for variety of tasks, including foundation models (e.g., CLIP and LLM), object classification, object detection, and semantic segmentation
Determined3,056almost 2 years agoDeep learning training platform with integrated support for distributed training, hyperparameter tuning, and model management (supports Tensorflow and Pytorch)
envd2,061almost 2 years agoMachine learning development environment for data science and AI/ML engineering teams
Fabrik1,127almost 6 years agoFabrik is an online collaborative platform to build, visualize and train deep learning models via a simple drag-and-drop interface
Hopsworks1,177almost 2 years agoHopsworks is a data-intensive platform for the design and operation of machine learning pipelines that includes a Feature Store -
Ludwig11,236almost 2 years agoLudwig is a low-code framework for building custom AI models like LLMs and other deep neural networks
Kubeflow14,472almost 2 years agoA cloud-native platform for machine learning based on Google’s internal machine learning pipelines
MFTCoder647almost 2 years agoMFTCoder is an open-source project of CodeFuse for accurate and efficient Multi-task Fine-tuning(MFT) on Large Language Models(LLMs), especially on Code-LLMs(large language model for code tasks)
MLeap1,506almost 2 years agoStandardisation of pipeline and model serialization for Spark, Tensorflow and sklearn
Nanotron1,332almost 2 years agoNanotron provides distributed primitives to train a variety of models efficiently using 3D parallelism
NeMo12,438almost 2 years agoNVIDIA NeMo is a scalable and cloud-native generative AI framework built for researchers and PyTorch developers working on Large Language Models (LLMs), Multimodal Models (MMs), Automatic Speech Recognition (ASR), Text to Speech (TTS), and Computer Vision (CV) domains. It is designed to help you efficiently create, customize, and deploy new generative AI models by leveraging existing code and pre-trained model checkpoints
Nos636over 2 years agoNos is an open-source platform to efficiently run AI workloads on Kubernetes, increasing GPU utilization and reducing infrastructure and operational costs
NVIDIA TensorRT10,926almost 2 years agoTensorRT is a C++ library for high-performance inference on NVIDIA GPUs and deep learning accelerators
Open Platform for AI2,644over 2 years agoPlatform that provides complete AI model training and resource management capabilities
Prime559almost 2 years agoPrime is a framework for efficient, globally distributed training of AI models over the internet
PyCaret9,026almost 2 years ago) - low-code library for training and deploying models (scikit-learn, XGBoost, LightGBM, spaCy)
Sematic976almost 2 years agoPlatform to build resource-intensive pipelines with simple Python
Skaffold15,098almost 2 years agoSkaffold is a command line tool that facilitates continuous development for Kubernetes applications. You can iterate on your application source code locally then deploy to local or remote Kubernetes clusters
Streaming1,171almost 2 years agoA Data Streaming Library for Efficient Neural Network Training
TFX2,121almost 2 years agoTensorflow Extended (TFX) is a production oriented configuration framework for ML based on TensorFlow, incl. monitoring and model version management
torchdistill1,409almost 2 years agotorchdistill offers various state-of-the-art knowledge distillation methods and enables you to design (new) experiments simply by editing a declarative yaml config file instead of Python code
veScale679about 2 years agoveScale is a PyTorch native LLM training framework

Backlinks from these awesome lists:

More related projects: