nannyml
Model monitor
An open-source Python library that enables post-deployment model performance estimation and monitoring without access to target labels.
nannyml: post-deployment data science in python
2k stars
21 watching
140 forks
Language: Python
last commit: 17 days ago
Linked from 2 awesome lists
data-analysisdata-driftdata-sciencedeep-learningjupyter-notebookmachine-learningmachinelearningmlmlopsmodel-monitoringmonitoringperformance-estimationperformance-monitoringpostdeploymentdatasciencepythonvisualization
ethicalml/awesome-production-machine-learning
kelvins/awesome-mlopsRelated projects:
| Repository | Description | Stars |
|---|---|---|
 maif/eurybia | An open source Python library to monitor model drift and validate data before deployment. | 205 |
 tart/motop | A tool for monitoring and displaying MongoDB server activity in real-time. | 67 |
 henriwahl/nagstamon | A desktop monitoring tool that connects to multiple Nagios and other monitoring systems | 424 |
 nschloe/tiptop | Displays system stats and graphs them in a command-line interface. | 1,768 |
 lujeni/mongoop | A tool to monitor and analyze long-running MongoDB operations and trigger alerts or performance analysis | 39 |
 ganglia/gmond_python_modules | Housing user-contributed Python modules for Gmond metric collection | 389 |
 bhanml/masking | A project implementing a novel approach to noisy supervision in machine learning using masked loss correction and adaptation | 54 |
 dani3l0/status | A lightweight system monitoring tool that provides real-time information about a Linux server's status and performance | 163 |
 elanmart/psmm | An implementation of a neural network model for character-level language modeling. | 50 |
 alan-turing-institute/deepsensor | Provides an interface for building and evaluating neural process models for environmental prediction tasks using Python libraries. | 92 |
 astrofrog/psrecord | A utility that records CPU and memory activity of processes | 595 |
 freedomintelligence/mllm-bench | Evaluates and compares the performance of multimodal large language models on various tasks | 55 |
 helpsystems/pcapy | A Python extension module that enables software written in Python to access low-level network monitoring routines from the pcap packet capture library. | 383 |
 mynyml/watchr | Automates testing of code changes in real-time | 1,273 |
 truera/trulens | A tool to evaluate and track the performance of large language model (LLM) experiments | 2,163 |