awesome-instruction-dataset

Instruction datasets

A collection of datasets to train instruction-following language models

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

GitHub

1k stars
16 watching
60 forks
last commit: over 2 years ago
Linked from 1 awesome list

awsome-listsdatasetsgpt-3gpt-4instruction-followinginstruction-tuninglanguage-modelllama

awesome-text/visual-instruction-tuning-dataset

nichtdax/awesome-totally-open-chatgpt4,556over 3 years ago: A codebase of totally open alternatives to ChatGPT

Table of Contents / The Multi-modal Instruction Dataset

(Vision-CAIR/MiniGPT-4)|5K|EN|MT|MIX
(haotian-liu/LLaVA)|150K|EN|MT|MIX

Table of Contents / The Instruction tuning Dataset

(tatsu-lab/Alpaca)|52K|EN|MT|SI29,663about 2 years ago
(gururise/Cleaned Alpaca)|52K|EN|MT|SI1,525over 3 years ago
(XueFuzhao/InstructionWild)|52K|EN|CN|MT|SI455over 2 years ago
(JosephusCheung/GuanacoDataset)|534K|ML|MT|SI
(Hello-SimpleAI/HC3)|24K|EN|MT|MIX
(Hello-SimpleAI/HC3-Chinese)|13K|CN|MT|MIX
(allenai/prosocial-dialog)|58K|EN|MT|MIX
(allenai/natural-instructions)|1.6K|ML|MT|HG963almost 3 years ago
(bigscience/xP3)|N/A|ML|MT|MIX
(nomic-ai/gpt4all)|437k|EN|MT|COL71,176almost 2 years ago
(PhoebusSi/Alpaca-CoT)|500k|ML|MT|COL
(google-research/FLAN)|N/A|EN|MT|MIX1,484almost 2 years ago
(thunlp/UltraChat)|280k|EN|TS|MIX2,276over 2 years ago
(cascip/ChatAlpaca)|10k|EN|MT|MIX164over 3 years ago
(YeungNLP/firefly-train-1.1M)|1100k|CN|MT|COL
(orhonovich/unnatural-instructions)|240K|EN|MT|MIX176over 3 years ago
(Instruction-Tuning-with-GPT-4/GPT-4-LLM)|52K|EN|CN|MT|SI4,244over 3 years ago
(databrickslabs/dolly)|15K|EN|MT|HG10,820about 3 years ago
(OpenAssistant/oasst1)|161K|ML|MT|HG
(RyokoAI/ShareGPT52K)|90K|ML|MT|SI
(zjunlp/Mol-Instructions)|2043K|ML|MT|MIX

Table of Contents / Reinforcement Learning from Human Feedback (RLHF) Datasets

(Anthropic/hh-rlhf)|22k|EN|MT|MIX
(thu-coai/Safety-Prompts)|100k|CN|MT|MIX880over 2 years ago
(HuggingFaceH4/stack-exchange-preferences)|10741k|EN|TS|HG
(stanfordnlp/SHP)|385k|EN|MT|HG
(Instruction-Tuning-with-GPT-4/GPT-4-LLM)|52K|EN|MT|MIX4,244over 3 years ago

The Multi-modal Instruction Datasets / (Vision-CAIR/MiniGPT-4)|5K|EN|MT|MIX

ChatCaptioner457over 3 years agoSummary: A high-quality, well-aligned (e.g. more detailed image desciption) image-text dataset created using conversation between two bots, similar to . This image-text dataset can then be used with some predefined instruction template for image-instruction-answer finetuning
MiniGPT-4: Enhancing Vision-language Understanding with Advanced Large Language Models25,490about 2 years agopaper:
BSD 3-ClauseLicense:
Interactive ChatCaptioner for image and video457over 3 years ago

The Multi-modal Instruction Datasets / (haotian-liu/LLaVA)|150K|EN|MT|MIX

Visual Instruction Tuningpaper:
CC BY-NC 4.0License:

The Multi-modal Instruction Datasets / [({sunrainyg}/{InstructCV)|EN|MT|MIX}]{https://github.com/AlaaLab/InstructCV}

InstructCVpaper:
CC BY-NC 4.0License:

The Instruction-following Datasets / (tatsu-lab/Alpaca)|52K|EN|MT|SI

alpaca-blogpaper:
CC BY-NC 4.0License:

The Instruction-following Datasets / (gururise/Cleaned Alpaca)|52K|EN|MT|SI

CC BY-NC 4.0License:

The Instruction-following Datasets / (JosephusCheung/GuanacoDataset)|534K|ML|MT|SI

GPL-3.0License:

The Instruction-following Datasets / (Hello-SimpleAI/HC3)|24K|EN|MT|MIX

How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectionpaper:
CC BY-SA 4.0License:

The Instruction-following Datasets / (Hello-SimpleAI/HC3-Chinese)|13K|CN|MT|MIX

How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectionpaper:
CC BY-SA 4.0License:

The Instruction-following Datasets / (allenai/prosocial-dialog)|58K|EN|MT|MIX

ProsocialDialog: A Prosocial Backbone for Conversational Agentspaper:
CC BY 4.0License:

The Instruction-following Datasets / (allenai/natural-instructions)|1.6K|ML|MT|HG

Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskspaper:
Apache License 2.0License:

The Instruction-following Datasets / (bigscience/xP3)|N/A|ML|MT|MIX

Crosslingual Generalization through Multitask Finetuningpaper:
Apache License 2.0License:

The Instruction-following Datasets / (PhoebusSi/Alpaca-CoT)|500k|ML|MT|COL

Github Repo2,640almost 3 years agoSummary: A datset for Chain-of-Thoughts reasoning based on LLaMA and Alpaca. Note: Their repository will continuously collect and combine various instruction tuning datasets
Apache License 2.0License:

The Instruction-following Datasets / (nomic-ai/gpt4all)|437k|EN|MT|COL

laion/OIGSummary: gpt4all leverages three publicly available datasets: 1. , 2. 3. subset of
GPT4All: Training an Assistant-style Chatbot with Large Scale Data Distillation from GPT-3.5-Turbopaper:
MIT LicenseLicense:

The Instruction-following Datasets / (teknium1/GPTeacher)|20k+|EN|MT|SI

MIT LicenseLicense:

The Instruction-following Datasets / (google-research/FLAN)|N/A|EN|MT|MIX

The Flan Collection: Designing Data and Methods for Effective Instruction Tuningpaper:
Apache License 2.0License:

The Instruction-following Datasets / (thunlp/UltraChat)|280k|EN|TS|MIX

CC BY-NC 4.0License:

The Instruction-following Datasets / (cascip/ChatAlpaca)|10k|EN|MT|MIX

Apache License 2.0License:
(tatsu-lab/Alpaca)|52K|EN|MT|SI29,663about 2 years agoRelated:

The Instruction-following Datasets / (orhonovich/unnatural-instructions)|240K|EN|MT|MIX

Unnatural Instructions: Tuning Language Models with (Almost) No Human Laborpaper:
MIT LicenseLicense:

The Instruction-following Datasets / (Instruction-Tuning-with-GPT-4/GPT-4-LLM)|52K|EN|CN|MT|SI

Instruction Tuning with GPT-4paper:
CC BY-NC 4.0License:
(tatsu-lab/Alpaca)|52K|EN|MT|SI29,663about 2 years ago
(orhonovich/unnatural-instructions)|240K|EN|MT|MIX176over 3 years ago

The Instruction-following Datasets / (databrickslabs/dolly)|15K|EN|MT|HG

Free Dollypaper:
CC BY-SA 3.0License:

The Instruction-following Datasets / (OpenAssistant/oasst1)|161K|ML|MT|HG

OpenAssistant Conversations - Democratizing Large Language Model Alignmentpaper:
Apache License 2.0License:

The Instruction-following Datasets / (RyokoAI/ShareGPT52K)|90K|ML|MT|SI

CC0 1.0 UniversalLicense:

The Instruction-following Datasets / (zjunlp/Mol-Instructions)|2043K|ML|MT|MIX

Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelspaper:
CC BY 4.0255almost 2 years agoLicense:

Reinforcement Learning from Human Feedback (RLHF) | Red-Teaming Datasets / (Anthropic/hh-rlhf)|22k|EN|MT|MIX

Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackpaper:
MIT LicenseLicense:
(Hello-SimpleAI/HC3)|24K|EN|MT|MIX
(Hello-SimpleAI/HC3-Chinese)|13K|CN|MT|MIX

Reinforcement Learning from Human Feedback (RLHF) | Red-Teaming Datasets / (thu-coai/Safety-Prompts)|100k|CN|MT|MIX

Safety Assessment of Chinese Large Language Modelspaper:
Apache License 2.0License:

Reinforcement Learning from Human Feedback (RLHF) | Red-Teaming Datasets / (HuggingFaceH4/stack-exchange-preferences)|10741k|EN|TS|HG

A General Language Assistant as a Laboratory for Alignmentpaper:
CC BY-SA 4.0License:
stack-exchange-paired

Reinforcement Learning from Human Feedback (RLHF) | Red-Teaming Datasets / (Instruction-Tuning-with-GPT-4/GPT-4-LLM)|52K|EN|MT|MIX

Instruction Tuning with GPT-4paper:
CC BY-NC 4.0License:
(tatsu-lab/Alpaca)|52K|EN|MT|SI29,663about 2 years ago

Reinforcement Learning from Human Feedback (RLHF) | Red-Teaming Datasets / (Reddit/eli5)|500k|EN|MT|HG

r/explainlikeimfivesummary: This dataset contains questions and answers from the subreddits , and
eli5 datasetRelated: a transformation of the dataset in a format similar to

Backlinks from these awesome lists:

More related projects: