prompttools
by hegelai
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
AI summary
Prompt tester
A set of tools for testing and evaluating natural language processing models and vector databases.
- stars
- 2.7K
- forks
- 234
- watching
- 32
- awesome list
- 1
Similar projects
Found by comparing what the projects do, not just their names.
LLM tester
A tool for testing and evaluating large language models (LLMs) to ensure they are reliable and secure
Prompt testing env
An environment for battle-testing prompts to Large Language Models (LLMs) to evaluate response quality and performance.
Text parser
A tool that uses large language models to extract structured information from unstructured text
Prompt generator
A utility library for crafting prompts to help Large Language Models generate specific outputs
Model evaluator
A unified framework for evaluating large language models' performance and robustness in various scenarios.
Prompt engineering guide
Guides software developers on how to effectively use and build systems around Large Language Models like GPT-4.
Prompt generator
A tool for automating the process of generating and ranking effective prompts for AI models like GPT-4, GPT-3.5-Turbo, or Claude 3 Opus.
Prompt Generator
A toolkit for creating and using natural language prompts to enable large language models to generalize to new tasks.
Evaluation framework
Provides a unified framework to test generative language models on various evaluation tasks.
Model repository
A collection of pre-trained deep learning models and demo applications for accelerating inference tasks
openai/evals15.2K
Benchmarking framework
A framework for evaluating large language models and systems, providing a registry of benchmarks.
Prompt engine
A flexible framework for adapting pre-trained language models to downstream NLP tasks using textual templates
AI inference toolkit
A toolkit for optimizing and deploying artificial intelligence models in various applications
Code assistant
A plugin for Neovim that integrates with the ChatGPT API to generate natural language responses and assist with coding tasks.
bin-huang/chatbox23.8K
Chatbot client
A desktop application for interacting with AI models and language learning platforms
Featured in 1 awesome list
Each link jumps to the spot where the list mentions prompttools.
