openllmetry
by traceloop
Open-source observability for your LLM application, based on OpenTelemetry
AI summary
LLM monitoring library
A set of extensions built on top of OpenTelemetry to provide observability for large language model applications.
- stars
- 5.2K
- forks
- 674
- watching
- 8
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
Distributed telemetry library
The .NET implementation of the OpenTelemetry specification, providing logging, metrics, and tracing capabilities for distributed systems.
LLM evaluator
An LLM evaluation platform supporting various models and datasets
Monitoring standards
Defines requirements and expectations for implementations of cross-language monitoring standards
signoz/signoz19.8K
Observability tool
An observability platform for application performance monitoring and tracing.
uptrace/uptrace3.4K
APM system
An open-source application performance monitoring system that supports distributed tracing, metrics, and logs.
LLM toolkit
An integrated development platform for large language models (LLMs) that provides observability, analytics, and management tools.
Trace API
Provides a set of APIs to measure performance and behavior of software and send data to observability platforms.
Metrics generator
Generates OpenTelemetry metrics from HTTP requests
Telemetry system
Provides MAVLink telemetry capabilities to OpenTx autopilot systems
Telemetry SDK
Provides a Java SDK for managing and recording telemetry data.
berriai/litellm15.1K
LLM gateway
Provides a unified API to interact with 100+ Large Language Models (LLMs) offered by various providers
Instruction-following model tuner
An implementation of a method for fine-tuning language models to follow instructions with high efficiency and accuracy
LLM toolkit
An open-source toolkit for pretraining and fine-tuning large language models
Observability library
An OpenTelemetry module for integrating observability metrics and tracing into Nest.js applications
LLM Client
A command-line tool and workflow manager for interacting with large language models like ChatGPT/GPT4.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions openllmetry.
