LMOps

LLM booster

A research initiative focused on developing fundamental technology to improve the performance and efficiency of large language models.

General technology for enabling AI capabilities w/ LLMs and MLLMs

GitHub

4k stars
54 watching
283 forks
Language: Python
last commit: about 2 months ago
agigptlanguage-modelllmlmlmopsnlppretrainingpromptpromptistx-prompt

Related projects:

Repository Description Stars
optimalscale/lmflow A toolkit for finetuning large language models and providing efficient inference capabilities 8,273
alpha-vllm/llama2-accessory An open-source toolkit for pretraining and fine-tuning large language models 2,720
eleutherai/lm-evaluation-harness Provides a unified framework to test generative language models on various evaluation tasks. 6,970
llmware-ai/llmware A framework for building enterprise LLM-based applications using small, specialized models 6,651
mooler0410/llmspracticalguide A curated list of resources to help developers navigate the landscape of large language models and their applications in NLP 9,489
dair-ai/ml-papers-explained An explanation of key concepts and advancements in the field of Machine Learning 7,315
microsoft/jarvis A platform that connects large language models with AI task automation capabilities to solve complex tasks. 23,712
microsoft/prompt-engine A utility library for crafting prompts to help Large Language Models generate specific outputs 2,591
modeltc/lightllm An LLM inference and serving framework providing a lightweight design, scalability, and high-speed performance for large language models. 2,609
meta-llama/llama-stack Provides a set of standardized APIs and tools to build generative AI applications 4,591
mlabonne/llm-course A comprehensive course and resource package on building and deploying Large Language Models (LLMs) 39,120
mlc-ai/mlc-llm Enables the development, optimization, and deployment of large language models on various platforms using a unified high-performance inference engine. 19,197
young-geng/easylm A framework for training and serving large language models using JAX/Flax 2,409
scisharp/llamasharp A C#/.NET library to efficiently run Large Language Models (LLMs) on local devices 2,673
zjh-819/llmdatahub A curated collection of high-quality datasets for training large language models. 2,635