Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

codelion 's Collections
Ellora
Internal Coherence Maximization
Pre-training Dataset Samples
Pivotal Token Search
Securade.ai

Pre-training Dataset Samples

updated 29 days ago

A collection of pre-training datasets samples of sizes 10M, 100M and 1B tokens. Ideal for use in quick experimentation and ablations.

Upvote
1

  • codelion/fineweb-edu-10M

    Viewer • Updated about 1 month ago • 9.46k • 102

  • codelion/fineweb-edu-100M

    Viewer • Updated 30 days ago • 115k • 113

  • codelion/fineweb-edu-1B

    Viewer • Updated 29 days ago • 970k • 146

  • codelion/dclm-baseline-10M

    Viewer • Updated about 1 month ago • 7.95k • 83

  • codelion/dclm-baseline-100M

    Viewer • Updated 30 days ago • 77.2k • 101

  • codelion/dclm-baseline-1B

    Viewer • Updated 29 days ago • 774k • 141

  • sumuks/essential-web-v1.0-sample-10M

    Viewer • Updated Jul 3 • 18.3k • 70 • 1

  • sumuks/essential-web-v1.0-sample-100M

    Viewer • Updated Jul 3 • 183k • 55

  • sumuks/essential-web-v1.0-sample-1B

    Viewer • Updated Jul 3 • 1.83M • 91
Upvote
1
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs