fineweb
by HuggingFaceFW (organization)
15 trillion tokens of the finest data the 🌐 web has to offer What is it? The 🍷 FineWeb dataset consists of more than 18.5T tokens (originally 15T tokens) of cleaned and deduplicated english web data from CommonCrawl. The data processing pipeline is optimized for LLM… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- HuggingFaceFW/fineweb
- Likes
- 3,689
- Downloads (last 30 days)
- 338,194
- Tasks
- Text generation
- Modality
- tabular, text
- Size
- 10B to 100B examples
- License
- ODC-By (odc-by)
- Access
- Open download
- Author
- HuggingFaceFW · Organization
- Languages
- en
- Created
- Apr 18, 2024
- Last modified
- Jul 11, 2025
More datasets from HuggingFaceFW
Rank 9: HuggingFaceFW/fineweb-edu
1.3 trillion tokens of the finest educational data the 🌐 web has to offer Paper: What is it? 📚 FineWeb-Edu dataset consists of 1.3T tokens and 5.4T tokens (FineWeb-Edu…
1,366 likes435,604 downloads in the last 30 daysText generationODC-By
Rank 25: HuggingFaceFW/finepdfs
Liberating 3T of the finest tokens from PDFs What is this? As we run out of web pages to process, the natural question has always been: what to do next? Only a few knew…
949 likes76,387 downloads in the last 30 daysText generationODC-By
Rank 30: HuggingFaceFW/fineweb-2
A sparkling update with 1000s of languages What is it? This is the second iteration of the popular 🍷 FineWeb dataset, bringing high quality pretraining data to over 100…
911 likes125,646 downloads in the last 30 daysText generationODC-By
Rank 170: HuggingFaceFW/finewiki
This is an updated and better extracted version of the wikimedia/Wikipedia dataset originally released in 2023. We carefully parsed Wikipedia HTML dumps from August of 2…
339 likes12,794 downloads in the last 30 daysText generationCC BY-SA 4.0
Rank 194: HuggingFaceFW/finetranslations
The world's knowledge in 1+1T tokens of parallel text What is it? This dataset contains over 1 trillion tokens of parallel text in English and 500+ languages. It was obt…
307 likes20,266 downloads in the last 30 daysText generationODC-By
Rank 489: HuggingFaceFW/finephrase
Model: HuggingFaceTB/SmolLM2-1.7B-Instruct (main) Source dataset: HuggingFaceFW/fineweb-edu, config sample-350BT, split train Generation config: temperature=1.0, top_p=1…
157 likes129,049 downloads in the last 30 daysText generationODC-By