openai_humaneval
by openai (organization)
The HumanEval dataset released by OpenAI includes 164 programming problems with a function sig- nature, docstring, body, and several unit tests. They were handwritten to ensure not to be included in the training set of code generation models. Supported Tasks and Leaderboards… (excerpt from the dataset card on Hugging Face)
Dataset facts
- Hub id
- openai/openai_humaneval
- Likes
- 410
- Downloads (last 30 days)
- 240,834
- Tasks
- Not given
- Modality
- text
- Size
- Fewer than 1K examples
- License
- MIT (mit)
- Access
- Open download
- Author
- openai · Organization
- Languages
- en
- Created
- Mar 2, 2022
- Last modified
- Jan 4, 2024
More datasets from openai
Rank 4: openai/gsm8k
GSM8K (Grade School Math 8K) is a dataset of 8.5K high quality linguistically diverse grade school math word problems. The dataset was created to support the task of que…
1,996 likes1,004,056 downloads in the last 30 daysText generationMIT
Rank 71: openai/gdpval
Dataset for GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Tasks. Paper | Blog | Site 220 real-world knowledge tasks across 44 occupations.…
564 likes311,930 downloads in the last 30 daysNo license given
Rank 78: openai/MMMLU
Multilingual Massive Multitask Language Understanding (MMMLU) The MMLU is a widely recognized benchmark of general knowledge attained by AI models. It covers a broad ran…
534 likes14,633 downloads in the last 30 daysQuestion answeringMIT
Rank 257: openai/webgpt_comparisons
WebGPT Comparisons contains all of the comparisons marked as suitable for reward modelling from the WebGPT paper.
248 likes1,103 downloads in the last 30 daysNo license given
Rank 294: openai/mrcr
OpenAI MRCR: Long context multiple needle in a haystack benchmark OpenAI MRCR (Multi-round co-reference resolution) is a long context dataset for benchmarking an LLM's a…
230 likes10,211 downloads in the last 30 daysMIT
Rank 295: openai/summarize_from_feedback
Summarize from Feedback contains the human feedback data released by the "Learning to summarize from human feedback" paper.
230 likes4,059 downloads in the last 30 daysNo license given