Rank #4,338 1,620 starsPython

safe-rlhf

by PKU-Alignment (organization)

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback (description from the project’s GitHub page)

View on GitHub Homepage

Repository facts

Stars: 1,620
Forks: 134
Open issues and pull requests: 19
Primary language: Python
License: Apache License 2.0 (Apache-2.0)
Owner: PKU-Alignment · Organization
Created: May 15, 2023
Last push: Nov 24, 2025

Topics

Rank #4,338 of 9,507 in AI on GitHub, by stars. Data from the GitHub API, fetched Oct 18, 2026; star counts change daily. Stars measure popularity, not quality or safety, and a listing is not an endorsement. How this list is made

Add this badge to your README

Ranked #4,338 in AI on GitHub Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges

Markdown (for a README)

[![Ranked #4,338 in AI on GitHub](https://unitedstatesofamericasuperintelligence.com/badges/github/pku-alignment--safe-rlhf.svg)](https://unitedstatesofamericasuperintelligence.com/github/pku-alignment--safe-rlhf/)

HTML

<a href="https://unitedstatesofamericasuperintelligence.com/github/pku-alignment--safe-rlhf/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/pku-alignment--safe-rlhf.svg" alt="Ranked #4,338 in AI on GitHub" height="20"></a>

Projects that share this one’s GitHub topics.

Rank 64: hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
75,561 starsPythonApache-2.0Last push Oct 10, 2026
Rank 3,021: X-PLUG/mPLUG-Owl
mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
2,539 starsPythonMITLast push Apr 2, 2025
Rank 1,146: ymcui/Chinese-LLaMA-Alpaca-2
中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
7,103 starsPythonApache-2.0Last push Apr 19, 2026
Rank 4,811: gotzmann/llama.go
llama.go is like llama.cpp in pure Golang!
1,403 starsGoOther licenseLast push Sep 20, 2024
Rank 811: OpenRLHF/OpenRLHF
An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)
10,095 starsPythonApache-2.0Last push Oct 5, 2026
Rank 6,932: whitecircle/halo
Halo is an open-source framework built by White Circle for training large language and multimodal models
825 starsPythonOther licenseLast push Oct 15, 2026

Repository facts

Topics

Add this badge to your README

Related projects

Rank 64: hiyouga/LlamaFactory

Rank 3,021: X-PLUG/mPLUG-Owl

Rank 1,146: ymcui/Chinese-LLaMA-Alpaca-2

Rank 4,811: gotzmann/llama.go

Rank 811: OpenRLHF/OpenRLHF

Rank 6,932: whitecircle/halo

Support Us