langfuse
LLM toolkit
An integrated development platform for large language models (LLMs) that provides observability, analytics, and management tools.
🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
7k stars
28 watching
665 forks
Language: TypeScript
last commit: over 1 year ago
Linked from 4 awesome lists
analyticsevaluationgpthacktoberfestlangchainlarge-language-modelsllama-indexllmllm-evaluationllm-observabilityllmopsmonitoringobservabilityopen-sourceopenaiplaygroundprompt-engineeringprompt-managementself-hostedycombinator
hannibal046/awesome-llm
ethicalml/awesome-production-machine-learning
dzharii/awesome-typescript
filipecalegario/awesome-generative-aiRelated projects:
| Repository | Description | Stars |
|---|---|---|
 explodinggradients/ragas | A toolkit for evaluating and optimizing Large Language Model applications with objective metrics, test data generation, and seamless integrations. | 7,598 |
 llm-workflow-engine/llm-workflow-engine | A command-line tool and workflow manager for interacting with large language models like ChatGPT/GPT4. | 3,674 |
 langchain-ai/langchainjs | A framework for building context-aware reasoning applications using language models and composability | 12,923 |
| langchain-ai/langchain | A framework for developing applications powered by large language models. | 96,146 |
 llmware-ai/llmware | A framework for building enterprise LLM-based applications using small, specialized models | 8,303 |
 langchain4j/langchain4j | A unified Java API for integrating Large Language Models (LLMs) and vector stores into Java applications | 5,082 |
 langstream/langstream | An event-driven developer platform for building and running large language model AI apps | 398 |
 eleutherai/lm-evaluation-harness | Provides a unified framework to test generative language models on various evaluation tasks. | 7,200 |
 berriai/litellm | Provides a unified API to interact with 100+ Large Language Models (LLMs) offered by various providers | 15,070 |
 langgenius/dify | An open-source LLM app development platform that enables users to build and deploy AI-powered applications quickly and efficiently. | 54,931 |
 ianarawjo/chainforge | An environment for battle-testing prompts to Large Language Models (LLMs) to evaluate response quality and performance. | 2,413 |
 mlc-ai/mlc-llm | A machine learning compiler and deployment engine for large language models | 19,396 |
 tmc/langchaingo | Provides a Go implementation of LangChain for generating text based on large language models. | 5,155 |
 mlabonne/llm-course | A comprehensive course and resource package on building and deploying Large Language Models (LLMs) | 40,053 |
| langchain-ai/chat-langchain | A chatbot that leverages LangChain and LangGraph to generate real-time answers to user queries from a vector store of pre-loaded documentation. | 5,531 |