aya_dataset
by CohereLabs (organization)
The Aya Dataset is a multilingual instruction fine-tuning dataset curated by an open-science community via Aya Annotation Platform from Cohere Labs. The dataset contains a total of 204k human-annotated prompt-completion pairs along with the demographics data of the annotators… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- CohereLabs/aya_dataset
- Likes
- 379
- Downloads (last 30 days)
- 21,498
- Tasks
- Other
- Modality
- text
- Size
- 100K to 1M examples
- License
- Apache 2.0 (apache-2.0)
- Access
- Open download
- Author
- CohereLabs · Organization
- Languages
- 30 languages
- Created
- Jan 31, 2024
- Last modified
- Apr 15, 2025
More datasets from CohereLabs
Rank 244: CohereLabs/wikipedia-2023-11-embed-multilingual-v3
Multilingual Embeddings for Wikipedia in 300+ Languages This dataset contains the wikimedia/wikipedia dataset dump from 2023-11-01 from Wikipedia in all 300+ languages.…
256 likes4,797 downloads in the last 30 daysNo license given
Rank 259: CohereLabs/aya_collection
This dataset is uploaded in two places: here and additionally here as 'Aya Collection Language Split.' These datasets are identical in content but differ in structure of…
246 likes15,969 downloads in the last 30 daysText classificationApache 2.0
Rank 455: CohereLabs/Global-MMLU
Global-MMLU 🌍 is a multilingual evaluation set spanning 42 languages, including English. This dataset combines machine translations for MMLU questions along with profes…
165 likes33,220 downloads in the last 30 daysApache 2.0
Rank 633: CohereLabs/aya_collection_language_split
This is a re-upload of the aya_collection, and only differs in the structure of upload. While the original aya_collection is structured by folders split according to dat…
122 likes9,413 downloads in the last 30 daysApache 2.0
Rank 753: CohereLabs/xP3x
xP3x (Crosslingual Public Pool of Prompts eXtended) is a collection of prompts & datasets across 277 languages & 16 NLP tasks. It contains all of xP3 + much more! It is…
105 likes37,223 downloads in the last 30 daysOtherApache 2.0