LLamaSharp
by SciSharp
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
AI summary
Language Model Runtime
An efficient C#/.NET library for running Large Language Models (LLMs) on local devices
- stars
- 2.8K
- forks
- 358
- watching
- 56
- awesome lists
- 3
Similar projects
Found by comparing what the projects do, not just their names.
LLM server
Provides an HTTP API server for integrating Large Language Models into applications
AI toolkit
Provides pre-packaged building blocks for generative AI applications with standardized APIs and service-oriented design.
LLM integrator
A data framework for integrating large language models into applications with custom data
ggerganov/llama.cpp69.2K
LLM inference software
Enables LLM inference with minimal setup and high performance on various hardware platforms
Instruction-following model tuner
An implementation of a method for fine-tuning language models to follow instructions with high efficiency and accuracy
LLM toolkit
Provides tools and examples for fine-tuning the Meta Llama model and building applications with it
LLM toolkit
An open-source toolkit for pretraining and fine-tuning large language models
LLaMA Tuner
A tool for efficiently fine-tuning large language models across multiple architectures and methods.
LLM app builder
A framework for building enterprise LLM-based applications using small, specialized models
Language Model
An implementation of a large language model using the nanoGPT architecture
Data augmentation tool
A data framework for augmenting Large Language Models (LLMs) with private data
LLM integration platform
An SDK that integrates LLMs with conventional programming languages to create AI-powered applications.
LLM wrapper
C# implementation of a composability framework for large language models
LLM framework
A framework for training and serving large language models using JAX/Flax
LLM toolset
A FastAPI service that facilitates semantic text search using precomputed embeddings and advanced similarity measures.
Featured in 3 awesome lists
Each link jumps to the spot where the list mentions LLamaSharp.
