nannyml
Model monitor
An open-source Python library that enables post-deployment model performance estimation and monitoring without access to target labels.
nannyml: post-deployment data science in python
2k stars
22 watching
145 forks
Language: Python
last commit: 2 months ago
Linked from 2 awesome lists
data-analysisdata-driftdata-sciencedeep-learningjupyter-notebookmachine-learningmachinelearningmlmlopsmodel-monitoringmonitoringperformance-estimationperformance-monitoringpostdeploymentdatasciencepythonvisualization
ethicalml/awesome-production-machine-learning
kelvins/awesome-mlopsRelated projects:
| Repository | Description | Stars |
|---|---|---|
 maif/eurybia | An open source Python library to monitor model drift and validate data before deployment. | 205 |
 tart/motop | A tool for monitoring and displaying MongoDB server activity in real-time. | 67 |
 henriwahl/nagstamon | A desktop monitoring tool that connects to multiple Nagios and other monitoring systems | 429 |
 nschloe/tiptop | Displays system stats and graphs them in a command-line interface. | 1,785 |
 lujeni/mongoop | A tool to monitor and analyze long-running MongoDB operations and trigger alerts or performance analysis | 39 |
 ganglia/gmond_python_modules | A repository of user-contributed metric modules for Gmond Python DSO monitoring system | 390 |
 bhanml/masking | An implementation of Masking, a method to improve the robustness of deep neural networks under noisy supervision | 54 |
 dani3l0/status | A lightweight system monitoring tool that provides real-time information about a Linux server's status and performance | 170 |
 elanmart/psmm | An implementation of a neural network model for character-level language modeling. | 50 |
 alan-turing-institute/deepsensor | Provides an interface for building and evaluating neural process models for environmental prediction tasks using Python libraries. | 97 |
 astrofrog/psrecord | A utility that records CPU and memory activity of processes | 601 |
 freedomintelligence/mllm-bench | Evaluates and compares the performance of multimodal large language models on various tasks | 56 |
 helpsystems/pcapy | A Python extension module that enables software written in Python to access low-level network monitoring routines from the pcap packet capture library. | 383 |
 mynyml/watchr | Automates testing of code changes in real-time | 1,272 |
 truera/trulens | A tool to evaluate and track the performance of large language model (LLM) experiments | 2,233 |