openllmetry
LLM monitoring library
A set of extensions built on top of OpenTelemetry to provide observability for large language model applications.
Open-source observability for your LLM application, based on OpenTelemetry
5k stars
8 watching
674 forks
Language: Python
last commit: about 9 hours ago
Linked from 1 awesome list
artifical-intelligencedatasciencegenerative-aigood-first-issuegood-first-issueshelp-wantedllmllmopsmetricsmlmodel-monitoringmonitoringobservabilityopen-sourceopen-telemetryopentelemetryopentelemetry-pythonpython
kyrolabs/awesome-langchainRelated projects:
| Repository | Description | Stars |
|---|---|---|
 open-telemetry/opentelemetry-dotnet | The .NET implementation of the OpenTelemetry specification, providing logging, metrics, and tracing capabilities for distributed systems. | 3,282 |
 open-compass/opencompass | An LLM evaluation platform supporting various models and datasets | 4,295 |
| open-telemetry/opentelemetry-specification | Defines requirements and expectations for implementations of cross-language monitoring standards | 3,770 |
 signoz/signoz | An observability platform for application performance monitoring and tracing. | 19,746 |
 uptrace/uptrace | An open-source application performance monitoring system that supports distributed tracing, metrics, and logs. | 3,442 |
 langfuse/langfuse | An integrated development platform for large language models (LLMs) that provides observability, analytics, and management tools. | 7,123 |
| open-telemetry/opentelemetry-go | Provides a set of APIs to measure performance and behavior of software and send data to observability platforms. | 5,395 |
 ndolestudio/go-otelroundtripper | Generates OpenTelemetry metrics from HTTP requests | 83 |
 olliw42/otxtelemetry | Provides MAVLink telemetry capabilities to OpenTx autopilot systems | 38 |
| open-telemetry/opentelemetry-java | Provides a Java SDK for managing and recording telemetry data. | 2,033 |
 berriai/litellm | Provides a unified API to interact with 100+ Large Language Models (LLMs) offered by various providers | 15,070 |
 opengvlab/llama-adapter | An implementation of a method for fine-tuning language models to follow instructions with high efficiency and accuracy | 5,775 |
 alpha-vllm/llama2-accessory | An open-source toolkit for pretraining and fine-tuning large language models | 2,732 |
 pragmaticivan/nestjs-otel | An OpenTelemetry module for integrating observability metrics and tracing into Nest.js applications | 571 |
 llm-workflow-engine/llm-workflow-engine | A command-line tool and workflow manager for interacting with large language models like ChatGPT/GPT4. | 3,674 |