allenai/MADLAD-400
Updated • 82.9k • 184
text-pretrain-data
some pretrain dataset for LLM
-
-
CASIA-LM/ChineseWebText
Viewer • Updated • 1k • 9.07k • 45 -
allenai/dolma
Updated • 3.04k • 1.11k -
allenai/peS2o
Updated • 28.3k • 217 -
Skywork/SkyPile-150B
Viewer • Updated • 1.76M • 26.4k • 421 -
wenge-research/yayi2_pretrain_data
Viewer • Updated • 1.68M • 2.31k • 61 -
togethercomputer/RedPajama-Data-V2
Updated • 14.1k • 425 -
tiiuae/falcon-refinedweb
Viewer • Updated • 968M • 18.7k • 978 -
togethercomputer/RedPajama-Data-1T
Updated • 3.17k • 1.22k -
Tele-AI/TeleChat-PTD
Updated • 6.49k • 184 -
open-web-math/open-web-math
Viewer • Updated • 6.32M • 34.1k • 372 -
GAIR/MathPile
Preview • Updated • 164 • 198 -
EleutherAI/proof-pile-2
Updated • 22.7k • 245 -
vietgpt/open-web-math
Viewer • Updated • 6.32M • 765 -
meta-math/MetaMathQA
Viewer • Updated • 395k • 67.3k • 491 -
bigcode/the-stack-dedup
Viewer • Updated • 237M • 11.8k • 417 -
bigcode/the-stack
Viewer • Updated • 471M • 6.87k • 1.09k -
nampdn-ai/tiny-strange-textbooks
Viewer • Updated • 1M • 297 • 95 -
uonlp/CulturaX
Viewer • Updated • 7.18B • 25.1k • 705 -
Locutusque/UltraTextbooks
Viewer • Updated • 5.52M • 1.4k • 209 -
HuggingFaceTB/cosmopedia
Viewer • Updated • 31.1M • 24.4k • 771