LLamaSharp
Language Model Runtime
An efficient C#/.NET library for running Large Language Models (LLMs) on local devices
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
3k stars
56 watching
358 forks
Language: C#
last commit: 6 days ago
Linked from 3 awesome lists
chatbotgptllamallama-cppllama2llama3llamacppllavallmmulti-modalsemantic-kernel
quozd/awesome-dotnet
uhub/awesome-c-sharp
ara3d/extra-awesome-dotnetRelated projects:
| Repository | Description | Stars |
|---|---|---|
 sangyuxiaowu/llamaworker | Provides an HTTP API server for integrating Large Language Models into applications | 51 |
 meta-llama/llama-stack | Provides pre-packaged building blocks for generative AI applications with standardized APIs and service-oriented design. | 5,164 |
 run-llama/llamaindexts | A data framework for integrating large language models into applications with custom data | 1,997 |
 ggerganov/llama.cpp | Enables LLM inference with minimal setup and high performance on various hardware platforms | 69,185 |
 opengvlab/llama-adapter | An implementation of a method for fine-tuning language models to follow instructions with high efficiency and accuracy | 5,775 |
| meta-llama/llama-recipes | Provides tools and examples for fine-tuning the Meta Llama model and building applications with it | 15,578 |
 alpha-vllm/llama2-accessory | An open-source toolkit for pretraining and fine-tuning large language models | 2,732 |
 hiyouga/llama-factory | A tool for efficiently fine-tuning large language models across multiple architectures and methods. | 36,219 |
 llmware-ai/llmware | A framework for building enterprise LLM-based applications using small, specialized models | 8,303 |
 lightning-ai/lit-llama | An implementation of a large language model using the nanoGPT architecture | 6,013 |
| run-llama/llama_index | A data framework for augmenting Large Language Models (LLMs) with private data | 37,371 |
 microsoft/semantic-kernel | An SDK that integrates LLMs with conventional programming languages to create AI-powered applications. | 22,277 |
 tryagi/langchain | C# implementation of a composability framework for large language models | 592 |
 young-geng/easylm | A framework for training and serving large language models using JAX/Flax | 2,428 |
 dicklesworthstone/swiss_army_llama | A FastAPI service that facilitates semantic text search using precomputed embeddings and advanced similarity measures. | 947 |