pyIEOE
Evaluation tool
Develops an interpretable evaluation procedure for off-policy evaluation (OPE) methods to quantify their sensitivity to hyper-parameter choices and/or evaluation policy choices.
31 stars
2 watching
4 forks
Language: Python
last commit: over 3 years ago
Linked from 1 awesome list
hanjuku-kaso/awesome-offline-rlRelated projects:
| Repository | Description | Stars |
|---|---|---|
 lartpang/pysodevaltoolkit | A comprehensive Python toolbox for evaluating salient object detection and camouflaged object detection tasks | 168 |
 prometheus-eval/prometheus-eval | An open-source framework that enables language model evaluation using Prometheus and GPT4 | 820 |
 microsoft/pylance-release | Provides language support and features for Python development in Visual Studio Code | 1,726 |
 sidneycadot/oeis | Tools for analyzing and processing sequence data from the Online Encyclopedia of Integer Sequences. | 46 |
 pymeasure/pymeasure | A Python library for scientific measurement and experiment automation with graphical live plotting capabilities. | 633 |
 allenai/olmo-eval | A framework for evaluating language models on NLP tasks | 326 |
 jorgenschaefer/elpy | An Emacs package to provide a comprehensive Python development environment. | 1,901 |
 ymyke/pypme | Calculates Public Market Equivalent values and rates for investment analysis | 11 |
 open-eo/openeo-python-client | A Python client library for interacting with the openEO API to access remote sensing data from various sources. | 156 |
 clvoloshin/cobs | A toolkit for evaluating and analyzing off-policy policy estimation methods in reinforcement learning | 61 |
 tisimst/pydoe | A Python package for designing and analyzing experiments. | 273 |
 metno/pyaerocom | Tools for evaluating climate and air quality models using Earth observation data | 26 |
 python/pyperformance | An authoritative source of real-world benchmarks for Python implementations. | 877 |
 grid-parity-exchange/egret | A Python-based package for solving optimization problems in power systems | 135 |
 martinkersner/py-img-seg-eval | A Python package providing metrics and tools for evaluating image segmentation models | 282 |