KsanaLLM
LLM engine
An LLM inference and serving engine with high performance, flexibility, and support for various hardware platforms.
295 stars
11 watching
30 forks
Language: C++
last commit: about 2 months ago
Linked from 1 awesome list
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 km1994/llmsninestorydemontower | Exploring various LLMs and their applications in natural language processing and related areas | 1,854 |
 luogen1996/lavin | An open-source implementation of a vision-language instructed large language model | 513 |
 ailab-cvc/seed | An implementation of a multimodal language model with capabilities for comprehension and generation | 585 |
 cmkrg/qizhengpt | A medical large language model designed to improve accuracy in Chinese medical knowledge question answering and support various healthcare tasks. | 647 |
 ai-hypercomputer/maxtext | A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs. | 1,557 |
 lxtgh/omg-seg | Develops an end-to-end model for multiple visual perception and reasoning tasks using a single encoder, decoder, and large language model. | 1,336 |
 gorilla-llm/gorilla-cli | An AI-powered command-line interface that generates potential commands based on user input and suggests the best course of action. | 1,305 |
 lmj/lfarm | A library for distributing work across machines using parallel processing | 106 |
 runpeidong/dreamllm | A framework to build versatile Multimodal Large Language Models with synergistic comprehension and creation capabilities | 402 |
 kvcache-ai/ktransformers | A flexible framework for LLM inference optimizations with support for multiple models and architectures | 771 |
 lightforever/mlcomp | A distributed framework for building and managing complex machine learning pipelines with a user-friendly interface. | 188 |
 damo-nlp-sg/m3exam | A benchmark for evaluating large language models in multiple languages and formats | 93 |
 nlpai-lab/kullm | Korea University Large Language Model developed by researchers at Korea University and HIAI Research Institute. | 576 |
 mlgroupjlu/llm-eval-survey | A repository of papers and resources for evaluating large language models. | 1,450 |
 nanbeige/nanbeige | Develops large language models for text understanding and generation tasks. | 85 |