TruthfulQA
by sylinrl
TruthfulQA: Measuring How Models Imitate Human Falsehoods
AI summary
Truth detector
Evaluating model performance on human falsehoods in language models
- stars
- 631
- forks
- 74
- watching
- 8
Similar projects
Found by comparing what the projects do, not just their names.
Fake News Detector
A framework for defending against neural fake news through both generation and detection of fake news articles.
Question answering dataset
A dataset and benchmarking framework for evaluating the performance of large language models on multi-turn question answering tasks for scientific graphs.
Bias detector
A dataset and benchmarking framework to evaluate the performance of question answering models on detecting and mitigating social biases.
Factual Error Detector
An open-source framework for detecting factual errors in AI-generated text
Deception framework
Maps deception detection techniques to the ATT&CK framework and provides documentation for security professionals
File Detector
Detects encrypted files using a fast and memory efficient approach without external dependencies.
Visual QA framework
A framework for training Hierarchical Co-Attention models for Visual Question Answering using preprocessed data and a specific image model.
Test framework
A Ruby-based framework for acceptance testing with flexibility and scalability for different testing tools and cloud services.
Race condition detector
A parallelism framework that detects and prevents race conditions in multithreaded code by automatically load balancing and using Valgrind-based instrumentation.
truera/trulens2.2K
Performance tracker for LLMs
A tool to evaluate and track the performance of large language model (LLM) experiments
Image model flaw detection
An investigation into the relationship between misleading images and hallucinations in large language models
Fake News Detector
An AI-powered tool that detects whether news articles are fake or not
Fraud detector
Develops and evaluates machine learning models for detecting financial fraud
LLM fact checker
A tool for fact-checking LLM outputs with self-ask using prompt chaining
RL benchmarks
A collection of benchmarks and implementations for testing reinforcement learning-based Volt-VAR control algorithms
