phasellm
LLM framework
A framework for managing and testing large language models to evaluate their performance and optimize user experiences.
Large language model evaluation and workflow framework from Phase AI.
448 stars
9 watching
24 forks
Language: Python
last commit: 5 months ago
Linked from 1 awesome list
aigptllmopenaipython
ethicalml/awesome-production-machine-learningRelated projects:
| Repository | Description | Stars |
|---|---|---|
 ai-hypercomputer/maxtext | A high-performance LLM written in Python/Jax for training and inference on Google Cloud TPUs and GPUs. | 1,529 |
 relari-ai/continuous-eval | Provides a comprehensive framework for evaluating Large Language Model (LLM) applications and pipelines with customizable metrics | 446 |
 ray-project/llmperf | A tool for evaluating the performance of large language model APIs | 641 |
 phellonchen/x-llm | A framework that enables large language models to process and understand multimodal inputs from various sources such as images and speech. | 306 |
 internlm/lagent | A lightweight framework for building agent-based applications using LLMs and transformer architectures | 1,865 |
 gmftbygmftby/science-llm | A large-scale language model for scientific domain training on redpajama arXiv split | 122 |
 bytedance/lynx-llm | A framework for training GPT4-style language models with multimodal inputs using large datasets and pre-trained models | 229 |
| internlm/openaoe | Enables users to engage with multiple large language models simultaneously and access their APIs | 253 |
 luogen1996/lavin | An open-source implementation of a vision-language instructed large language model | 508 |
 psycoy/mixeval | An evaluation suite and dynamic data release platform for large language models | 224 |
 aiplanethub/beyondllm | An open-source toolkit for building and evaluating large language models | 263 |
 protectai/llm-guard | A security toolkit designed to protect interactions with large language models from various threats and vulnerabilities. | 1,242 |
 sunlemuria/opengptandbeyond | An effort to develop and compare large language models beyond OpenGPT | 105 |
 volcengine/verl | A flexible and efficient reinforcement learning framework designed for large language models. | 315 |
 opengvlab/lamm | A framework and benchmark for training and evaluating multi-modal large language models, enabling the development of AI agents capable of seamless interaction between humans and machines. | 301 |