Rank #573 14,259 starsPython

lm-evaluation-harness

by EleutherAI (organization)

A framework for few-shot evaluation of language models. (description from the project’s GitHub page)

View on GitHub Homepage

In the USASI catalog: LM Evaluation Harness

Repository facts

Stars: 14,259
Forks: 3,692
Open issues and pull requests: 1,201
Primary language: Python
License: MIT License (MIT)
Owner: EleutherAI · Organization
Created: Aug 28, 2020
Last push: Sep 14, 2026

Topics

Rank #573 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #573 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #573 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/eleutherai--lm-evaluation-harness.svg)](https://unitedstatesofamericasuperintelligence.com/github/eleutherai--lm-evaluation-harness/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/eleutherai--lm-evaluation-harness/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/eleutherai--lm-evaluation-harness.svg" alt="Ranked #573 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 551: BlinkDL/RWKV-LM
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combin…
14,748 starsPythonApache-2.0Last push Sep 28, 2026
Rank 963: OptimalScale/LMFlow
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
8,481 starsPythonApache-2.0Last push Aug 10, 2026
Rank 1,235: codertimo/BERT-pytorch
Google AI 2018 BERT pytorch implementation
6,530 starsPythonApache-2.0Last push Sep 15, 2023
Rank 3,037: young-geng/EasyLM
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
2,515 starsPythonApache-2.0Last push Aug 13, 2024
Rank 5,132: NVIDIA-Merlin/Transformers4Rec
Transformers4Rec is a flexible and efficient library for sequential and session-based recommendation and works with PyTorch.
1,284 starsPythonApache-2.0Last push Aug 23, 2026
Rank 8,585: hirofumi0810/neural_sp
End-to-end ASR/LM implementation with PyTorch
595 starsPythonApache-2.0Last push Aug 30, 2021

Repository facts

Topics

Add this badge to your README

Related projects

Rank 551: BlinkDL/RWKV-LM

Rank 963: OptimalScale/LMFlow

Rank 1,235: codertimo/BERT-pytorch

Rank 3,037: young-geng/EasyLM

Rank 5,132: NVIDIA-Merlin/Transformers4Rec

Rank 8,585: hirofumi0810/neural_sp

Support Us