rigging

LLM tool

A framework for leveraging language models in production code

Lightweight LLM Interaction Framework

GitHub

216 stars
8 watching
12 forks
Language: Python
last commit: 5 days ago
Linked from 1 awesome list

agentslitellmllmspydantic

Backlinks from these awesome lists:

Related projects:

Repository Description Stars
phellonchen/x-llm A framework that enables large language models to process and understand multimodal inputs from various sources such as images and speech. 308
internlm/lagent A lightweight framework for building agent-based applications using LLMs and transformer architectures 1,924
ajndkr/lanarky A Python web framework specifically designed to build LLM microservices with built-in support for FastAPI and streaming capabilities. 978
bytedance/lynx-llm A framework for training GPT4-style language models with multimodal inputs using large datasets and pre-trained models 231
ai-hypercomputer/maxtext A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs. 1,557
msoedov/langcorn A framework for serving large language models with a robust and efficient API 909
victordibia/llmx An API that provides a unified interface to multiple large language models for chat fine-tuning 79
lazyagi/lazyllm A low-code development tool for building multi-agent large language models applications 1,039
federatedai/fate-llm A framework for collaborative training of large language models in a privacy-preserving manner 166
wgryc/phasellm A framework for managing and testing large language models to evaluate their performance and optimize user experiences. 451
orgexyz/llfn A light-weight framework for creating applications using Large Language Models (LLMs) with minimal boilerplate code 94
ray-project/llmperf A tool for evaluating the performance of large language model APIs 678
luogen1996/lavin An open-source implementation of a vision-language instructed large language model 513
talkdai/dialog An application framework to simplify the deployment and testing of large language models (LLMs) for natural language processing tasks. 380
volcengine/vescale A PyTorch-based framework for training large language models in parallel on multiple devices 679