LLamaWorker

LLM server

Provides an HTTP API server for integrating Large Language Models into applications

LLamaWorker is a HTTP API server developed based on the LLamaSharp project. It provides an OpenAI-compatible API, making it easy for developers to integrate Large Language Models (LLM) into their applications.

GitHub

48 stars
2 watching
9 forks
Language: C#
last commit: 14 days ago
llmoai

Related projects:

Repository Description Stars
run-llama/llamaindexts A data framework for integrating large language models into applications with custom data 1,960
maximilian-winter/llama-cpp-agent A tool for easy interaction with Large Language Models (LLMs) to execute structured function calls and generate structured output. 493
msoedov/langcorn A framework for serving large language models with a robust and efficient API 906
scisharp/llamasharp A C#/.NET library to efficiently run Large Language Models (LLMs) on local devices 2,703
victordibia/llmx An API that provides a unified interface to multiple large language models for chat fine-tuning 79
openlmlab/openchinesellama An incremental pre-trained Chinese large language model based on the LLaMA-7B model 234
linksoul-ai/chinese-llama-2-7b A deep learning project providing an open-source implementation of the LLaMA2 model with Chinese and English text data 2,228
ardagnsrn/ollama-php A PHP library for interacting with an open-source LLM platform. 60
snunez1/llama.cl A Common Lisp port of a Large Language Model (LLM) implementation 35
jpmcb/nvim-llama An interface for integrating large language models into Neovim, enabling chat functionality and other LLM-based capabilities. 259
ngxson/wllama A WebAssembly binding for a large language model inference engine 437
jetxu-llm/llama-github A Python library that uses LLMs to retrieve relevant code snippets and information from GitHub based on user queries. 242
internlm/openaoe Enables users to engage with multiple large language models simultaneously and access their APIs 253
fittentech/openllama-chinese A Chinese language large language model built from OpenLLaMA and fine-tuned on various datasets for multilingual text generation. 64
r2d4/openlm Library that provides a unified API to interact with various Large Language Models (LLMs) 366