trulens
by truera
Evaluation and Tracking for LLM Experiments
AI summary
Performance tracker for LLMs
A tool to evaluate and track the performance of large language model (LLM) experiments
- stars
- 2.2K
- forks
- 197
- watching
- 19
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
ML tracker
A tool for logging and tracking machine learning research progress in Python
ML experiment tracker
A tool for version control of machine learning experiments
LLM benchmarker
A benchmarking framework for large language models
ML tracking framework
A software framework for tracking and analyzing machine learning data, including model performance, inputs, outputs, and project metadata.
Performance tracker
A tool to track and measure runtime, memory allocation, and other performance metrics for individual fibers or methods within concurrent applications.
Experiment tracker
An experiment tracker for machine learning model training that allows users to log and visualize their experiments in detail.
LM Benchmark
A benchmark for evaluating large language models in multiple languages and formats
Experiment tracker
Provides tools and infrastructure to log and visualize experiments in deep learning research
Model memorization analysis
A Python package for measuring memorization in Large Language Models.
Model evaluator
Evaluates and compares the performance of multimodal large language models on various tasks
Experiment tracker
An A/B testing backend built using AWS Lambda and Redis HyperLogLog to efficiently track experiment data in a scalable and cost-effective manner.
Metric logger
An Elixir library to log custom application metrics in a well-structured format for downstream processing systems.
AI assistant tracker
An analytics platform designed to track performance and feedback for AI-powered assistants using machine learning and data analysis techniques.
Language Model Tuner
This is an experimental project for fine-tuning the NLB language model with a specific dataset and evaluating its performance on translation tasks.
LLM
An open-source implementation of a vision-language instructed large language model
Featured in 1 awesome list
Each link jumps to the spot where the list mentions trulens.
