lwan

ericlbuehler/mistral.rs4.7K

LLM inference framework

A high-performance LLM inference framework written in Rust

lrsjng/h5ai5.6K

Web server index

A modern HTTP web server index for Apache httpd, lighttpd, and nginx.

lwjgl/lwjgl34.9K

Graphics library

A high-performance Java library providing direct access to native APIs for graphics, audio, parallel computing, and XR applications.

sangyuxiaowu/llamaworker52

LLM server

Provides an HTTP API server for integrating Large Language Models into applications

zhaojh329/libuhttpd386

HTTP server library

A lightweight and high-performance HTTP server library for embedded Linux systems.

modeltc/lightllm2.7K

LLM server

A Python-based framework for serving large language models with low latency and high scalability.

nanohttpd/nanohttpd7K

HTTP server

A lightweight HTTP server for Java applications

cloudflare/pingora22.8K

Network service framework

A fast, reliable, and programmable network service framework.

llmware-ai/llmware8.3K

LLM app builder

A framework for building enterprise LLM-based applications using small, specialized models

aksnzhy/xlearn3.1K

Machine Learning Library

A high-performance machine learning package with linear models and factorization machines.

scisharp/llamasharp2.8K

Language Model Runtime

An efficient C#/.NET library for running Large Language Models (LLMs) on local devices

tloen/alpaca-lora18.7K

Language model tuning

Tuning a large language model on consumer hardware using low-rank adaptation

alpha-vllm/llama2-accessory2.7K

LLM toolkit

An open-source toolkit for pretraining and fine-tuning large language models

lightning-ai/lit-llama6K

Language Model

An implementation of a large language model using the nanoGPT architecture

luraproject/lura6.4K

API gateway framework

An API Gateway framework that acts as an aggregator of multiple backend services into single endpoints.