Independent project. Not a U.S. government website.Independent project. Not a United States government website.
Support our projectSupport usSupport our project · Buy me a coffee (opens Buy Me a Coffee)synthetic dataset of reasoning chains for a wide variety of tasks. we leverage data like this across multiple reasoning experiments/projects. stay tuned for reasoning mo…
299 likes259 downloads in the last 30 daysApache 2.0
The WAXAL dataset is a large-scale multilingual speech corpus for African languages, introduced in the paper WAXAL: A Large-Scale Multilingual African Language Speech Co…
298 likes14,245 downloads in the last 30 daysSpeech recognitionCC BY-SA 4.0
TruthfulQA is a benchmark to measure whether a language model is truthful in generating answers to questions. The benchmark comprises 817 questions that span 38 categori…
298 likes144,353 downloads in the last 30 daysMultiple choiceApache 2.0
The People's Speech Dataset is among the world's largest English speech recognition corpus today that is licensed for academic and commercial usage under CC-BY-SA and CC…
297 likes36,004 downloads in the last 30 daysSpeech recognitionCC BY 2.0
malcolmrey's Various AI Model, Architecture & Research Repository Welcome to the central research and asset repository of malcolmrey. This repository hosts cutting-edge…
296 likes27,947 downloads in the last 30 daysWTFPL
UltraX: Refining Pre-Training Data at Scale with Adaptive Programmatic Editing 📜 Paper | 💻 Code | 🤖 Models | 📦 UltraData Collection English | 中文 📚 Introduction Ultr…
296 likes15,193 downloads in the last 30 daysText generationApache 2.0
Genshin Voice is a dataset of voice lines from the popular game Genshin Impact. Hugging Face 🤗 Genshin-Voice ModelScope Genshin-Voice Per-speaker downloads are grouped…
296 likes15,554 downloads in the last 30 daysAudio classificationNo license given
ShareGPT-Chinese-English-90k Bilingual Human-Machine QA Dataset A high-quality Chinese-English parallel bilingual human-machine QA dataset, covering user questions in re…
293 likes1,604 downloads in the last 30 daysQuestion answeringApache 2.0
RoboOmni: Proactive Robot Manipulation in Omni-modal Context 📖 arXiv Paper (Accepted to ICLR 2026 🎉) | 🌐 Website | 🤗 Model | 🤗 Dataset | 🛠️ Github | Recent advance…
291 likes194,344 downloads in the last 30 daysRoboticsCC BY-NC 4.0
We curate a large corpus of legal and administrative data. The utility of this data is twofold: (1) to aggregate legal and administrative data sources that demonstrate d…
291 likes11,744 downloads in the last 30 daysFill maskCC BY-NC-SA 4.0
The MNIST dataset consists of 70,000 28x28 black-and-white images of handwritten digits extracted from two NIST databases. There are 60,000 images in the training datase…
291 likes111,724 downloads in the last 30 daysImage classificationMIT
This is the dataset proposed in our paper [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation. OpenVid-1M is a high-quality text-to-v…
290 likes110,172 downloads in the last 30 daysText to videoCC BY 4.0
Mobile Actions: A Dataset for On-Device Function Calling The dataset contains conversational traces designed to train lightweight models (such as FunctionGemma 270M) to…
289 likes873 downloads in the last 30 daysCC BY 4.0
PhysicalAI-Robotics-GR00T-X-Embodiment-Sim Github Repo: Isaac GR00T N1 We provide a set of datasets used for post-training of GR00T N1. Each dataset is a collection of t…
289 likes693,093 downloads in the last 30 daysRoboticsCC BY 4.0
The FineTome dataset is a subset of arcee-ai/The-Tome (without arcee-ai/qwen2-72b-magpie-en), re-filtered using HuggingFaceFW/fineweb-edu-classifier. It was made for my…
288 likes23,262 downloads in the last 30 daysNo license given
The key arguments for the low utilization of statistical techniques in financial sentiment analysis have been the difficulty of implementation for practical applications…
287 likes9,079 downloads in the last 30 daysText classificationCC BY NC SA 3.0
VIBE: Visual & Interactive Benchmark for Execution in Application Development [English] | 中文 🌟 Overview VIBE (Visual & Interactive Benchmark for Execution) sets a new s…
285 likes302 downloads in the last 30 daysText generationMIT
Visit Github : What is TongSIM-Asset? As artificial intelligence (AI) rapidly advances, especially in multimodal large language models, research focus is shifting from s…
281 likes986 downloads in the last 30 daysNo license given
TxT360: A Top-Quality LLM Pre-training Dataset Requires the Perfect Blend Changelog Version Details v1.1 Added new data sources: TxT360_BestOfWeb, TxT360_QA, europarl-al…
280 likes21,851 downloads in the last 30 daysText generationODC-By
RubricHub is a large-scale (approximately 110K), multi-domain dataset that provides high-quality rubric-based supervision for open-ended generation tasks. It is construc…
278 likes958 downloads in the last 30 daysText generationApache 2.0
The GoEmotions dataset contains 58k carefully curated Reddit comments labeled for 27 emotion categories or Neutral. The raw data is included as well as the smaller, simp…
277 likes27,578 downloads in the last 30 daysText classificationApache 2.0
We have released a paper for OpenThoughts! See our paper here. OpenThoughts3-1.2M Open-source state-of-the-art reasoning dataset with 1.2M rows. 🚀 OpenThoughts3-1.2M is…
277 likes22,358 downloads in the last 30 daysText generationApache 2.0
Note that this collection is licensed under ODC-BY-1.0 license; different licenses apply to subsets of the data. Some portions of the dataset are non-commercial. We pres…
275 likes30,309 downloads in the last 30 daysOtherODC-By
Refined Anime Text for Continual Pre-training of Language Models This is a subset of our novel synthetic dataset of anime-themed text, containing over 1M entries, ~440M…
274 likes24 downloads in the last 30 daysText generationWTFPLGated
Boasting over 13,000 hours of cumulative data and 5 million+ clips, it ranks as the largest open-source embodied intelligence dataset in the industry. Update Notes：Stage…
274 likes264,545 downloads in the last 30 daysRoboticsCC BY-SA 4.0Gated
Default Licensing for Sub-Datasets Without Specific License Declaration: In instances where sub-datasets within the COIG-PC Dataset do not have a specific license declar…
272 likes809 downloads in the last 30 daysUnknown licenseGated
FRAMES: Factuality, Retrieval, And reasoning MEasurement Set FRAMES is a comprehensive evaluation dataset designed to test the capabilities of Retrieval-Augmented Genera…
271 likes27,624 downloads in the last 30 daysText classificationApache 2.0
Multi-Teacher Distillation Dataset (57,937 traces) A quality-filtered, deduplicated, multi-teacher SFT corpus combining traces from three frontier models across math, co…
271 likes3,888 downloads in the last 30 daysText generationOther license
1,000,000 reasoning traces distilled from KIMI-K2.5 on high reasoning, (Each subset has different questions) Distribution: Coding: 50% (Includes: Webdev, Python, C++, Ja…
270 likes425 downloads in the last 30 daysText generationApache 2.0
Stanford Question Answering Dataset (SQuAD) is a reading comprehension dataset, consisting of questions posed by crowdworkers on a set of Wikipedia articles, where the a…
270 likes50,433 downloads in the last 30 daysQuestion answeringCC BY-SA 4.0
Zhihu data for training Open Assitant More Information needed
270 likes1,814 downloads in the last 30 daysQuestion answeringNo license given
The benchmark consists of around 1,000 crowd-sourced Python programming problems, designed to be solvable by entry level programmers, covering programming fundamentals,…
268 likes237,503 downloads in the last 30 daysCC BY 4.0
Enhancing Human-Like Responses in Large Language Models 🤗 Models | 📊 Dataset | 📄 Paper 📢 The paper associated with this dataset has been accepted to the AAAI-26 Work…
267 likes492 downloads in the last 30 daysLlama 3 license
This is the Official Capybara dataset. Over 10,000 multi-turn examples. Capybara is the culmination of insights derived from synthesis techniques like Evol-instruct (use…
266 likes1,117 downloads in the last 30 daysQuestion answeringApache 2.0
Gaming Dataset (gaming-1) — 494.7 Hours Native PC/console gameplay screen-recordings, organized by game. Each workflow is one play session, trimmed to pure gameplay — lo…
265 likes9,111 downloads in the last 30 daysNo license given
OpenMathInstruct-2 is a math instruction tuning dataset with 14M problem-solution pairs generated using the Llama3.1-405B-Instruct model. The training set problems of GS…
265 likes103,715 downloads in the last 30 daysQuestion answeringCC BY 4.0
OpenMathInstruct-1 is a math instruction tuning dataset with 1.8M problem-solution pairs generated using permissively licensed Mixtral-8x7B model. The problems are from…
261 likes4,911 downloads in the last 30 daysQuestion answeringNvidia license
A high-quality synthetic dataset of medical reasoning conversations generated using OpenAI's gpt-oss-120B model with reasoning effort set to high, designed for supervise…
260 likes2,903 downloads in the last 30 daysText generationApache 2.0
This is an experimental Dataset designed to run a Medical Chatbot It contains at least 250k dialogues between a Patient and a Doctor. Playground ChatBot ruslanmv/AI-Medi…
260 likes2,933 downloads in the last 30 daysNo license given
HelpSteer is an open-source Helpfulness Dataset (CC-BY-4.0) that supports aligning models to become more helpful, factually correct and coherent, while being adjustable…
259 likes3,534 downloads in the last 30 daysCC BY 4.0
Find the 1500+ scenes in the sample_set/26.04_release folder. Dataset Description: Neural reconstructed dataset that carries 3D reconstructed driving scenes. The scenes…
259 likes49,023 downloads in the last 30 daysNvidia av datasetGated
Starting with a paper released at NIPS 2016, MS MARCO is a collection of datasets focused on deep learning in search. The first dataset was a question answering dataset…
257 likes26,893 downloads in the last 30 daysNo license given
🔥 🔥 🔥 [08/11/2023] We release WizardMath Models. 🔥 Our WizardMath-70B-V1.0 model slightly outperforms some closed-source LLMs on the GSM8K, including ChatGPT 3.5, Cl…
257 likes1,807 downloads in the last 30 daysMIT
Multilingual Embeddings for Wikipedia in 300+ Languages This dataset contains the wikimedia/wikipedia dataset dump from 2023-11-01 from Wikipedia in all 300+ languages.…
256 likes4,797 downloads in the last 30 daysNo license given
Homepage: Repository: Paper: Point of Contact: Dataset Summary DialogSum is a large-scale dialogue summarization dataset, consisting of 13,460 (Plus 100 holdout data for…
256 likes5,679 downloads in the last 30 daysSummarizationCC BY-NC-SA 4.0
OPUS-100 is an English-centric multilingual corpus covering 100 languages. OPUS-100 is English-centric, meaning that all training pairs include English on either the sou…
255 likes24,260 downloads in the last 30 daysTranslationUnknown license
rStar-Coder is a large-scale competitive code problem dataset containing 418K programming problems, 580K long-reasoning solutions, and rich test cases of varying difficu…
255 likes6,978 downloads in the last 30 daysCC BY 4.0
Open Source Implementation of Evol-Instruct-Code as described in the WizardCoder Paper. Code for the intruction generation can be found on Github as Evol-Teacher.
255 likes6,828 downloads in the last 30 daysCC BY-NC-SA 4.0
The Character Codex is a comprehensive dataset featuring popular characters from a wide array of media types and genres. Each entry includes detailed information about t…
255 likes273 downloads in the last 30 daysApache 2.0
This repository contains ShapeNetCore (v2), a subset of ShapeNet.ShapeNetCore is a densely annotated subset of ShapeNet covering 55 common object categories with ~51,300…
255 likes5,494 downloads in the last 30 daysOther licenseGated
YODAS v3 is a large web-crawled dataset containing over 1.1 million hours of audio that were originally released under a CC-BY-3.0 license. The dataset contains audio in…
251 likes378,186 downloads in the last 30 daysAudio to audioCC BY 3.0
LibriSpeech is a corpus of approximately 1000 hours of 16kHz read English speech, prepared by Vassil Panayotov with the assistance of Daniel Povey. The data is derived f…
251 likes80,726 downloads in the last 30 daysSpeech recognitionCC BY 4.0
⚠️ Important: If you have already submitted an access request but have not completed the required DocuSign agreement, your request will remain pending. Please complete s…
251 likes48,233 downloads in the last 30 daysVideo classificationOther licenseGated
🌐 Essential-Web: Complete 24-Trillion Token Dataset 🏆 Website | 🖥️ Code | 📖 Paper | ☁️ AWS 📋 Dataset Description Essential-Web is a 24-trillion-token web dataset wi…
250 likes127,081 downloads in the last 30 daysODC-By
Yambda-5B — A Large-Scale Multi-modal Dataset for Ranking And Retrieval Industrial-scale music recommendation dataset with organic/recommendation interactions and audio…
250 likes16,451 downloads in the last 30 daysApache 2.0
OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement [🏠Homepage] | [🛠️Code] Introduction OpenCodeInterpreter is a family of open-source code…
248 likes1,644 downloads in the last 30 daysQuestion answeringApache 2.0
WebGPT Comparisons contains all of the comparisons marked as suitable for reward modelling from the WebGPT paper.
248 likes1,103 downloads in the last 30 daysNo license given
A colossal, cleaned version of Common Crawl's web crawl corpus. Based on Common Crawl dataset: " This is the processed version of Google's C4 dataset by AllenAI.
247 likes14,831 downloads in the last 30 daysText generationODC-By
This dataset is uploaded in two places: here and additionally here as 'Aya Collection Language Split.' These datasets are identical in content but differ in structure of…
246 likes15,969 downloads in the last 30 daysText classificationApache 2.0
s1K is a dataset of 1,000 examples of diverse, high-quality & difficult questions with distilled reasoning traces & solutions from Gemini Thining. Refer to the s1 paper…
246 likes8,466 downloads in the last 30 daysApache 2.0
We are excited to release a synthetic reasoning dataset containing 22mil+ general reasoning questions and responses generated using deepseek-ai/DeepSeek-R1-Distill-Llama…
245 likes3,448 downloads in the last 30 daysText generationApache 2.0
Finance-Instruct-500k is a comprehensive and meticulously curated dataset designed to train advanced language models for financial tasks, reasoning, and multi-turn conve…
245 likes715 downloads in the last 30 daysApache 2.0
Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models Big-Math is the largest open-source dataset of high-quality mathematical…
245 likes5,376 downloads in the last 30 daysQuestion answeringApache 2.0Gated
MedMCQA is a large-scale, Multiple-Choice Question Answering (MCQA) dataset designed to address real-world medical entrance exam questions. MedMCQA has more than 194k hi…
244 likes78,035 downloads in the last 30 daysQuestion answeringApache 2.0
Toucan-1.5M is the largest fully synthetic tool-agent dataset to date, designed to advance tool use in agentic LLMs. It comprises over 1.5 million trajectories synthesiz…
242 likes11,792 downloads in the last 30 daysApache 2.0
A dataset of high quality mathematical text.
242 likes29,678 downloads in the last 30 daysText generationNo license given
Dataset containing 81,444 pieces of visual art from various artists, taken from WikiArt.org, along with class labels for each image : "artist" : 129 artist classes, incl…
242 likes9,199 downloads in the last 30 daysImage classificationUnknown license
[2024-09-01]: Uploaded VisualWebInstruct(filtered), it's used in OneVision Stage almost all subsets are uploaded with HF's required format and you can use the recommende…
242 likes45,530 downloads in the last 30 daysApache 2.0
MiroVerse: A Reproducible, Full-Trajectory, Ever-Growing Deep Research Dataset 🔥 News & Updates MiroVerse v0.1 has been released. This dataset can be used with our trai…
242 likes181 downloads in the last 30 daysQuestion answeringCC BY-NC 4.0Gated
242 likes16,634 downloads in the last 30 daysText generationCC BY 4.0
🤗 [Models] • 💻 [Github Repo] • 📌 [Project Page] • 📃 [Paper] AgentInstruct is a meticulously curated dataset featuring 1,866 high-quality interactions, designed to en…
242 likes2,510 downloads in the last 30 daysNo license given
CodeContests is a competitive programming dataset for machine-learning. This dataset was used when training AlphaCode. It consists of programming problems, from a variet…
241 likes84,218 downloads in the last 30 daysTranslationCC BY 4.0
A fully synthetic healthcare dataset for building AI solutions in healthcare, developed using Syncora.ai. ✅ What's in This Repo? ✅ Healthcare Dataset (CSV) → Download He…
241 likes285 downloads in the last 30 daysApache 2.0
⚠️Important Notice !!! Dear Users, The Alpha Dataset has been updated as follows: Frame Loss Data Removal: Several episodes with frame loss issues have been removed. For…
239 likes28,004 downloads in the last 30 daysRoboticsNo license givenGated
P3 (Public Pool of Prompts) is a collection of prompted English datasets covering a diverse set of NLP tasks. A prompt is the combination of an input template and a targ…
239 likes120,701 downloads in the last 30 daysOtherApache 2.0
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering Supported Tasks and Leaderboards Multi-modal Multiple Choice Languages English D…
239 likes34,342 downloads in the last 30 daysMultiple choiceCC BY-SA 4.0
TMMLU+ : Large scale traditional chinese massive multitask language understanding iKala presents TMMLU+, a large-scale benchmark for evaluating LLM capabilities in Tradi…
239 likes7,083 downloads in the last 30 daysQuestion answeringMIT
The OpenHermes dataset is composed of 242,000 entries of primarily GPT-4 generated data, from open datasets across the AI landscape, including: OpenHermes 13B is the fir…
239 likes1,267 downloads in the last 30 daysText generationNo license given
Human ChatGPT Comparison Corpus (HC3)
238 likes5,186 downloads in the last 30 daysText classificationCC BY-SA 4.0
This dataset is designed to train a reasoning model. That can think through complex problems before providing a response, similar to how a human would. The dataset inclu…
238 likes491 downloads in the last 30 daysText generationApache 2.0
This dataset contains images used in the documentation of HuggingFace's libraries. HF Team: Please make sure you optimize the assets before uploading them. My favorite t…
237 likes4,928,245 downloads in the last 30 daysCC BY-NC-SA 4.0
The AI CUDA Engineer Archive 👷: Agentic CUDA Kernel Discovery, Optimization & Composition We release The AI CUDA Engineer archive, a dataset consisting of approximately…
234 likes13,971 downloads in the last 30 daysCC BY 4.0
MathVista is a consolidated Mathematical reasoning benchmark within Visual contexts. It consists of three newly created datasets, IQTest, FunctionQA, and PaperQA, which…
233 likes25,003 downloads in the last 30 daysMultiple choiceCC BY-SA 4.0
Foursquare OS Places is now a gated dataset on Hugging Face. Read more about why we are making this change here: Access FSQ OS Places With Foursquare’s Open Source Place…
233 likes24,375 downloads in the last 30 daysApache 2.0Gated
Open-MM-RL is a multimodal STEM reasoning dataset covering Physics, Mathematics, Biology, and Chemistry. It is designed for problems that require models to interpret vis…
233 likes180 downloads in the last 30 daysQuestion answeringMIT
Objaverse-XL is an open dataset of over 10 million 3D objects! With it, we train Zero123-XL, a foundation model for 3D, observing incredible 3D generalization abilities:…
232 likes3,229 downloads in the last 30 daysODC-By
LLaVA Visual Instruct Pretrain Dataset Card Dataset details Dataset type: LLaVA Visual Instruct Pretrain LCS-558K is a subset of LAION/CC/SBU dataset, filtered with a mo…
232 likes6,374 downloads in the last 30 daysOther license
FineFineWeb: A Comprehensive Study on Fine-Grained Domain Web Corpus arXiv: Coming Soon Project Page: Coming Soon Blog: Coming Soon Data Statistics Domain (#tokens/#samp…
232 likes4,137,257 downloads in the last 30 daysText classificationApache 2.0
Cybersecurity AI Knowledge Base — PhD-Level Dataset Overview This is the most comprehensive cybersecurity knowledge base ever assembled for AI training. It covers all do…
232 likes3,557 downloads in the last 30 daysText generationApache 2.0Gated
Granary: Speech Recognition and Translation Dataset in 25 European Languages Granary is a large-scale, open-source multilingual speech dataset covering 25 European langu…
231 likes6,204 downloads in the last 30 daysSpeech recognitionCC BY 4.0
CodeForces-CoTs is a large-scale dataset for training reasoning models on competitive programming tasks. It consists of 10k CodeForces problems with up to five reasoning…
231 likes5,227 downloads in the last 30 daysCC BY 4.0
中文基于满血DeepSeek-R1蒸馏数据集（Chinese-Data-Distill-From-R1） 🤗 Hugging Face | 🤖 ModelScope | 🚀 Github | &n…
230 likes1,017 downloads in the last 30 daysText generationApache 2.0
230 likes4,233 downloads in the last 30 daysNo license givenGated
OpenAI MRCR: Long context multiple needle in a haystack benchmark OpenAI MRCR (Multi-round co-reference resolution) is a long context dataset for benchmarking an LLM's a…
230 likes10,211 downloads in the last 30 daysMIT
Summarize from Feedback contains the human feedback data released by the "Learning to summarize from human feedback" paper.
230 likes4,059 downloads in the last 30 daysNo license given
DialogStudio: Unified Dialog Datasets and Instruction-Aware Models for Conversational AI Author: Jianguo Zhang, Kun Qian Paper|Github|[GDrive] 🎉 March 18, 2024: Update…
230 likes146 downloads in the last 30 daysQuestion answeringApache 2.0Gated
Agents Last Exam v1.1 — Task Card Metadata 150 active tasks. Use matching v1.1 task code, environment images, and data revisions. task_cards.parquet contains one row per…
229 likes6,784 downloads in the last 30 daysCC BY 4.0
Claude protein binder design — data release v1.0 1,440 de novo miniprotein binders (50 to 120 residues) against 16 targets, designed by two Claude models operating as au…
229 likes41,602 downloads in the last 30 daysCC BY 4.0
A benchmark for typed probabilistic decisions. A model gets one piece of unstructured state and answers five typed questions about it at once, and every answer is a prob…
229 likes49,522 downloads in the last 30 daysText classificationApache 2.0
The NitroGen dataset contains action annotations for publicly available gameplay videos. Specifically, we used an in-house model to annotate each video frame with gamepa…
228 likes1,689 downloads in the last 30 daysRoboticsCC BY-NC 4.0
Help keep USASI useful.
Optional. No USASI account required. Payment takes place on the linked provider’s website (Buy Me a Coffee).
About supporting this project