phoenix
AI observability platform
An open-source platform for monitoring and evaluating artificial intelligence applications
AI Observability & Evaluation
4k stars
30 watching
292 forks
Language: Jupyter Notebook
last commit: 6 days ago
Linked from 3 awesome lists
ai-monitoringai-observabilityai-roiaiengineeringdatasetshacktoberfestllm-evalllmopsml-observabilitymlopsmodel-observability
ethicalml/awesome-production-machine-learning
promptslab/awesome-prompt-engineering
vihar/awesome-oss-saasRelated projects:
| Repository | Description | Stars |
|---|---|---|
 evidentlyai/evidently | An observability framework for evaluating and monitoring the performance of machine learning models and data pipelines | 5,391 |
 openai/evals | A framework for evaluating large language models and systems, providing a registry of benchmarks. | 15,015 |
 giskard-ai/giskard | Automates detection and evaluation of performance, bias, and security issues in AI applications | 4,071 |
 ianarawjo/chainforge | An environment for battle-testing prompts to Large Language Models (LLMs) to evaluate response quality and performance. | 2,334 |
 confident-ai/deepeval | A framework for evaluating large language models | 3,669 |
 xlang-ai/openagents | An open platform for developing and deploying language agents in the wild | 3,995 |
 zabbix/zabbix | An enterprise-class monitoring solution designed to track performance and availability of IT resources and services in real-time. | 4,408 |
 pixie-io/pixie | A Kubernetes-native observability tool for monitoring cluster resources and application traffic | 5,584 |
 josh-xt/agixt | An AI platform that orchestrates instruction management and complex task execution across multiple AI providers | 2,648 |
 meta-llama/llama-stack | Provides a set of standardized APIs and tools to build generative AI applications | 4,591 |
 signoz/signoz | An observability platform for application performance monitoring and tracing. | 19,321 |
 betalgo/openai | A .NET library providing access to the OpenAI service API. | 2,900 |
 hegelai/prompttools | A set of tools for testing and evaluating natural language processing models and vector databases. | 2,708 |
 langgenius/dify | An open-source LLM app development platform that enables users to build and deploy AI-powered applications quickly and efficiently. | 51,873 |
 significant-gravitas/autogpt | A platform for building and deploying autonomous AI agents to automate complex workflows | 168,407 |