snowflake-arctic
AI summary
LLM inference stack
A project providing optimized stacks for fine-tuning and inference of large language models, focusing on low-latency and high-throughput performance.
- stars
- 525
- forks
- 47
- watching
- 6
Similar projects
Found by comparing what the projects do, not just their names.
Dataset checker
Detects whether a given text sequence is part of the training data used to train a large language model.
Efficient LLM
A large language model with improved efficiency and performance compared to similar models
Ice Sheet Model Framework
A framework for Bayesian quantification of uncertainty in large-scale ice sheet models.
LLM
An open-source implementation of a vision-language instructed large language model
Model benchmarking suite
Measures the performance of deep learning models in various deployment scenarios.
Science LLM
A large-scale language model for scientific domain training on redpajama arXiv split
Forecasting library
A framework to perform time series forecasting using machine learning models on large datasets.
LLM tool
A framework for leveraging language models in production code
LM Benchmark
A benchmark for evaluating large language models in multiple languages and formats
Federated ML Benchmark
A benchmarking framework for federated machine learning tasks across various domains and datasets
LLM optimizer
A flexible framework for LLM inference optimizations with support for multiple models and architectures
LLM toolkit
Provides a set of tools and components to simplify the integration of Large Language Models into Dart/Flutter applications
LLM library
A Common Lisp port of a Large Language Model (LLM) implementation
Simulation tool
A platform for conducting high-performance federated learning simulations in Python.
NLP Model
A pre-trained language model for multiple natural language processing tasks with support for few-shot learning and transfer learning.
