awesome-instruction-dataset
by yaodongC
A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)
AI summary
Instruction datasets
A collection of datasets to train instruction-following language models
- stars
- 1.1K
- forks
- 60
- watching
- 16
- awesome list
- 1
- entries
- 89
What's in the list
89 links in 37 sections, with live GitHub stats.activeno commit in 2y
awesome-text/visual-instruction-tuning-dataset
nichtdax/awesome-totally-open-chatgpt
: A codebase of totally open alternatives to ChatGPT
Table of Contents / The Multi-modal Instruction Dataset
Table of Contents / The Instruction tuning Dataset
Table of Contents / Reinforcement Learning from Human Feedback (RLHF) Datasets
The Multi-modal Instruction Datasets / (Vision-CAIR/MiniGPT-4)|5K|EN|MT|MIX
ChatCaptioner
Summary: A high-quality, well-aligned (e.g. more detailed image desciption) image-text dataset created using conversation between two bots, similar to . This image-text dataset can then be used with some predefined instruction template for image-instruction-answer finetuning
- BSD 3-Clause
License:
The Multi-modal Instruction Datasets / (Vision-CAIR/MiniGPT-4)|5K|EN|MT|MIX / Related:
The Multi-modal Instruction Datasets / (haotian-liu/LLaVA)|150K|EN|MT|MIX
- CC BY-NC 4.0
License:
The Multi-modal Instruction Datasets / [({sunrainyg}/{InstructCV)|EN|MT|MIX}]{https://github.com/AlaaLab/InstructCV}
- InstructCV
paper:
- CC BY-NC 4.0
License:
(tatsu-lab/Alpaca)|52K|EN|MT|SI
- alpaca-blog
paper:
- CC BY-NC 4.0
License:
(gururise/Cleaned Alpaca)|52K|EN|MT|SI
- CC BY-NC 4.0
License:
(JosephusCheung/GuanacoDataset)|534K|ML|MT|SI
- GPL-3.0
License:
(Hello-SimpleAI/HC3)|24K|EN|MT|MIX
- CC BY-SA 4.0
License:
(Hello-SimpleAI/HC3-Chinese)|13K|CN|MT|MIX
- CC BY-SA 4.0
License:
(allenai/prosocial-dialog)|58K|EN|MT|MIX
- CC BY 4.0
License:
(allenai/natural-instructions)|1.6K|ML|MT|HG
- Apache License 2.0
License:
(bigscience/xP3)|N/A|ML|MT|MIX
- Apache License 2.0
License:
(PhoebusSi/Alpaca-CoT)|500k|ML|MT|COL
Github Repo
Summary: A datset for Chain-of-Thoughts reasoning based on LLaMA and Alpaca. Note: Their repository will continuously collect and combine various instruction tuning datasets
- Apache License 2.0
License:
(nomic-ai/gpt4all)|437k|EN|MT|COL
- laion/OIG
Summary: gpt4all leverages three publicly available datasets: 1. , 2. 3. subset of
- MIT License
License:
(teknium1/GPTeacher)|20k+|EN|MT|SI
- MIT License
License:
(google-research/FLAN)|N/A|EN|MT|MIX
- Apache License 2.0
License:
(thunlp/UltraChat)|280k|EN|TS|MIX
- CC BY-NC 4.0
License:
(cascip/ChatAlpaca)|10k|EN|MT|MIX
- Apache License 2.0
License:
(tatsu-lab/Alpaca)|52K|EN|MT|SI
Related:
(orhonovich/unnatural-instructions)|240K|EN|MT|MIX
- MIT License
License:
(Instruction-Tuning-with-GPT-4/GPT-4-LLM)|52K|EN|CN|MT|SI
- CC BY-NC 4.0
License:
(Instruction-Tuning-with-GPT-4/GPT-4-LLM)|52K|EN|CN|MT|SI / Related:
(databrickslabs/dolly)|15K|EN|MT|HG
- Free Dolly
paper:
- CC BY-SA 3.0
License:
(OpenAssistant/oasst1)|161K|ML|MT|HG
- Apache License 2.0
License:
(RyokoAI/ShareGPT52K)|90K|ML|MT|SI
- CC0 1.0 Universal
License:
(zjunlp/Mol-Instructions)|2043K|ML|MT|MIX
CC BY 4.0
License:
Reinforcement Learning from Human Feedback (RLHF) | Red-Teaming Datasets / (Anthropic/hh-rlhf)|22k|EN|MT|MIX
- MIT License
License:
Reinforcement Learning from Human Feedback (RLHF) | Red-Teaming Datasets / (Anthropic/hh-rlhf)|22k|EN|MT|MIX / Related:
Reinforcement Learning from Human Feedback (RLHF) | Red-Teaming Datasets / (thu-coai/Safety-Prompts)|100k|CN|MT|MIX
- Apache License 2.0
License:
Reinforcement Learning from Human Feedback (RLHF) | Red-Teaming Datasets / (HuggingFaceH4/stack-exchange-preferences)|10741k|EN|TS|HG
- CC BY-SA 4.0
License:
Reinforcement Learning from Human Feedback (RLHF) | Red-Teaming Datasets / (HuggingFaceH4/stack-exchange-preferences)|10741k|EN|TS|HG / Related:
Reinforcement Learning from Human Feedback (RLHF) | Red-Teaming Datasets / (Instruction-Tuning-with-GPT-4/GPT-4-LLM)|52K|EN|MT|MIX
- CC BY-NC 4.0
License:
Reinforcement Learning from Human Feedback (RLHF) | Red-Teaming Datasets / (Instruction-Tuning-with-GPT-4/GPT-4-LLM)|52K|EN|MT|MIX / Related:
Reinforcement Learning from Human Feedback (RLHF) | Red-Teaming Datasets / (Reddit/eli5)|500k|EN|MT|HG
- r/explainlikeimfive
summary: This dataset contains questions and answers from the subreddits , and
- eli5 dataset
Related: a transformation of the dataset in a format similar to
Nothing in this list matches your filter.
Featured in 1 awesome list
Each link jumps to the spot where the list mentions awesome-instruction-dataset.
More related projects
mooler0410/llmspracticalguide9.6K
komputeproject/kompute2K
shm007g/llama-cult-and-more427
open-compass/opencompass4.3K
zjh-819/llmdatahub2.7K
facico/chinese-vicuna4.2K
ggerganov/llama.cpp69.2K
shibing624/medicalgpt3.4K
ailab-cvc/gpt4tools762
chatchat-space/langchain-chatchat32.5K
openbmb/toolbench4.9K
mudler/localai27.1K