helicone
LLM platform
An all-in-one platform for monitoring and managing large language models
🧊 Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. 🍓 YC W23
2k stars
10 watching
216 forks
Language: TypeScript
last commit: 6 days ago
Linked from 2 awesome lists
agent-monitoringanalyticsevaluationgptlangchainlarge-language-modelsllama-indexllmllm-costllm-evaluationllm-observabilityllmopsmonitoringopen-sourceopenaiplaygroundprompt-engineeringprompt-managementycombinator
ethicalml/awesome-production-machine-learning
simomay/find-ossRelated projects:
| Repository | Description | Stars |
|---|---|---|
 luogen1996/lavin | An open-source implementation of a vision-language instructed large language model | 508 |
 langstream/langstream | An event-driven developer platform for building and running large language model AI apps | 393 |
 agenta-ai/agenta | An end-to-end platform for building and deploying large language model applications | 1,287 |
 kurama622/llm.nvim | An extension for Neovim that integrates with large language models to provide tools for text translation, code explanation and optimization. | 47 |
 victordibia/llmx | An API that provides a unified interface to multiple large language models for chat fine-tuning | 79 |
 damo-nlp-sg/llm-zoo | A collection of information about various large language models used in natural language processing | 272 |
 poyro/poyro | An extension of Vitest for testing LLM applications using local language models | 30 |
 msoedov/langcorn | A framework for serving large language models with a robust and efficient API | 906 |
 run-llama/llamaindexts | A data framework for integrating large language models into applications with custom data | 1,960 |
 sunlemuria/opengptandbeyond | An effort to develop and compare large language models beyond OpenGPT | 105 |
 melih-unsal/demogpt | A comprehensive toolset for building Large Language Model (LLM) based applications | 1,710 |
 eugeneyan/open-llms | A curated list of commercial-use large language models | 11,222 |
 aiplanethub/beyondllm | An open-source toolkit for building and evaluating large language models | 263 |
 h2oai/h2o-llm-eval | An evaluation framework for large language models with Elo rating system and A/B testing capabilities | 50 |
 youssefhosni/hands-on-langchain-for-llm-applications-development | A collection of hands-on tutorials and guides for developing applications using LangChain and its integration with LLMs (Large Language Models) | 134 |