LLamaSharp
LLM runner
A C#/.NET library to efficiently run Large Language Models (LLMs) on local devices
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
3k stars
56 watching
351 forks
Language: C#
last commit: 6 days ago
Linked from 3 awesome lists
chatbotgptllamallama-cppllama2llama3llamacppllavallmmulti-modalsemantic-kernel
quozd/awesome-dotnet
uhub/awesome-c-sharp
ara3d/extra-awesome-dotnetRelated projects:
| Repository | Description | Stars |
|---|---|---|
 sangyuxiaowu/llamaworker | Provides an HTTP API server for integrating Large Language Models into applications | 48 |
 meta-llama/llama-stack | A framework that provides standardized building blocks and APIs to develop generative AI applications | 4,666 |
 run-llama/llamaindexts | A data framework for integrating large language models into applications with custom data | 1,976 |
 ggerganov/llama.cpp | A C/C++ implementation of Meta's LLaMA model inference with support for various hardware architectures and quantization methods. | 68,496 |
 opengvlab/llama-adapter | An implementation of a method for fine-tuning language models to follow instructions with high efficiency and accuracy | 5,763 |
| meta-llama/llama-recipes | Provides tools and examples for fine-tuning the Meta Llama model and building applications with it | 15,396 |
 alpha-vllm/llama2-accessory | An open-source toolkit for pretraining and fine-tuning large language models | 2,725 |
 hiyouga/llama-factory | A tool for efficiently fine-tuning large language models across multiple architectures and methods. | 35,410 |
 llmware-ai/llmware | A framework for building enterprise LLM-based applications using small, specialized models | 8,223 |
 lightning-ai/lit-llama | An implementation of a large language model using the nanoGPT architecture | 6,010 |
| run-llama/llama_index | A data framework for augmenting Large Language Models (LLMs) with private data | 37,094 |
 microsoft/semantic-kernel | An SDK that integrates LLMs with conventional programming languages to create AI-powered applications. | 22,124 |
 tryagi/langchain | C# implementation of a composability framework for large language models | 582 |
 young-geng/easylm | A framework for training and serving large language models using JAX/Flax | 2,416 |
 dicklesworthstone/swiss_army_llama | A FastAPI service that facilitates semantic text search using precomputed embeddings and advanced similarity measures. | 943 |