lanarky

msoedov/langcorn909

LLM server

A framework for serving large language models with a robust and efficient API

internlm/lagent1.9K

LLM agent framework

A lightweight framework for building agent-based applications using LLMs and transformer architectures

lsm/micromono643

Monolithic framework

Enables seamless development of microservices with monolithic structure without changing the codebase.

dreadnode/rigging216

LLM tool

A framework for leveraging language models in production code

bytedance/lynx-llm231

Multimodal LLM framework

A framework for training GPT4-style language models with multimodal inputs using large datasets and pre-trained models

ray-project/llmperf678

LLM benchmarking tool

A tool for evaluating the performance of large language model APIs

mikrl/django-llm54

LLM workflow app

An app for building and executing large language model workflows within Django web applications

ai-hypercomputer/maxtext1.6K

LLM framework

A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs.

melih-unsal/demogpt1.7K

LLM toolkit

A comprehensive toolset for building Large Language Model (LLM) based applications

jackmpcollins/magentic2.1K

LLM integrator

A tool to integrate Large Language Models into Python code seamlessly

wgryc/phasellm451

LLM framework

A framework for managing and testing large language models to evaluate their performance and optimize user experiences.

llukas22/llm-rs-python73

LLM library

An unofficial Python interface to the Rust-based Large Language Model library

ailab-cvc/seed585

Multimodal LLM

An implementation of a multimodal language model with capabilities for comprehension and generation

luogen1996/lavin513

LLM

An open-source implementation of a vision-language instructed large language model

r2d4/openlm367

LLM client

Library that provides a unified API to interact with various Large Language Models (LLMs)