LLamaWorker

LLM server

Provides an HTTP API server for integrating Large Language Models into applications

LLamaWorker is a HTTP API server developed based on the LLamaSharp project. It provides an OpenAI-compatible API, making it easy for developers to integrate Large Language Models (LLM) into their applications.

GitHub

52 stars
2 watching
10 forks
Language: C#
last commit: about 2 months ago
llmoai

Related projects:

Repository Description Stars
run-llama/llamaindexts A data framework for integrating large language models into applications with custom data 1,997
maximilian-winter/llama-cpp-agent A tool for easy interaction with Large Language Models (LLMs) to execute structured function calls and generate structured output. 505
msoedov/langcorn A framework for serving large language models with a robust and efficient API 909
scisharp/llamasharp An efficient C#/.NET library for running Large Language Models (LLMs) on local devices 2,750
victordibia/llmx An API that provides a unified interface to multiple large language models for chat fine-tuning 79
openlmlab/openchinesellama An incremental pre-trained Chinese large language model based on the LLaMA-7B model 234
linksoul-ai/chinese-llama-2-7b A deep learning project providing an open-source implementation of the LLaMA2 model with Chinese and English text data 2,235
ardagnsrn/ollama-php A PHP library for interacting with an open-source LLM platform. 68
snunez1/llama.cl A Common Lisp port of a Large Language Model (LLM) implementation 36
jpmcb/nvim-llama An interface for integrating large language models into Neovim, enabling chat functionality and other LLM-based capabilities. 263
ngxson/wllama A WebAssembly binding for the LLaMA model that enables on-browser inference without requiring a backend or GPU. 465
jetxu-llm/llama-github Empowers AI-driven applications to retrieve relevant code snippets and repository information from GitHub using LLM-powered question analysis 258
internlm/openaoe Enables users to engage with multiple large language models simultaneously and access their APIs 256
fittentech/openllama-chinese A Chinese language large language model built from OpenLLaMA and fine-tuned on various datasets for multilingual text generation. 65
r2d4/openlm Library that provides a unified API to interact with various Large Language Models (LLMs) 367