smollm-corpus
by HuggingFaceTB (organization)
This dataset is a curated collection of high-quality educational and synthetic data designed for training small language models. You can find more details about the models trained on this dataset in our SmolLM blog post. Dataset subsets Cosmopedia v2 Cosmopedia v2 is an… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- HuggingFaceTB/smollm-corpus
- Likes
- 509
- Downloads (last 30 days)
- 55,731
- Tasks
- Not given
- Modality
- tabular, text
- Size
- 100M to 1B examples
- License
- ODC-By (odc-by)
- Access
- Open download
- Author
- HuggingFaceTB · Organization
- Languages
- en
- Created
- Jul 15, 2024
- Last modified
- Sep 6, 2024
More datasets from HuggingFaceTB
Rank 43: HuggingFaceTB/cosmopedia
Image generated by DALL-E, the prompt was generated by Mixtral-8x7B-Instruct-v0.1 Note: Cosmopedia v0.2 is available at smollm-corpus User: What do you think "Cosmopedia…
767 likes25,480 downloads in the last 30 daysApache 2.0
Rank 109: HuggingFaceTB/smoltalk
This is a synthetic dataset designed for supervised finetuning (SFT) of LLMs. It was used to build SmolLM2-Instruct family of models and contains 1M samples. More detail…
456 likes49,650 downloads in the last 30 daysNo license given
Rank 137: HuggingFaceTB/finemath
What is it? 📐 FineMath consists of 34B tokens (FineMath-3+) and 54B tokens (FineMath-3+ with InfiMM-WebMath-3+) of mathematical educational content filtered from Common…
392 likes46,150 downloads in the last 30 daysODC-By
Rank 409: HuggingFaceTB/smoltalk2
This dataset contains three subsets (Mid, SFT, Preference) that correspond to the three phases of Post-Training for SmolLM3-3B. You can find more details in our blog pos…
181 likes38,804 downloads in the last 30 daysNo license given
Rank 540: HuggingFaceTB/everyday-conversations-llama3.1-2k
Everyday conversations for Smol LLMs finetunings This dataset contains 2.2k multi-turn conversations generated by Llama-3.1-70B-Instruct. We ask the LLM to generate a si…
141 likes1,707 downloads in the last 30 daysApache 2.0
Rank 580: HuggingFaceTB/smol-smoltalk
This is a subset of SmolTalk dataset adapted for smol models with less than 1B parameters. We used it to build SmolLM2-360M-Instruct and SmolLM2-135M-Instruct. We do SFT…
132 likes12,980 downloads in the last 30 daysApache 2.0