
H2O
by FMInference (organization)
[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models. (description from the project’s GitHub page)
Repository facts
- Stars
- 535
- Forks
- 90
- Open issues and pull requests
- 36
- Primary language
- Python
- License
- No license file detected
- Owner
- FMInference · Organization
- Created
- Jun 12, 2023
- Last push
- Aug 1, 2024
Topics
Add this badge to your README
Shows this repository’s rank in AI on GitHub and links back to this page. Ranks are by stars and change when the list is refreshed. The badge is not an endorsement or a rating. About the badges
Markdown (for a README)
[](https://unitedstatesofamericasuperintelligence.com/github/fminference--h2o/)
HTML
<a href="https://unitedstatesofamericasuperintelligence.com/github/fminference--h2o/"><img src="https://unitedstatesofamericasuperintelligence.com/badges/github/fminference--h2o.svg" alt="Ranked #9,154 in AI on GitHub" height="20"></a>
Related projects
Projects that share this one’s GitHub topics.
Rank 2,853: intel/neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
2,722 starsPythonApache-2.0Last push Oct 16, 2026
Rank 5,292: NVIDIA/kvpress
LLM KV cache compression made easy
1,233 starsPythonApache-2.0Last push Oct 6, 2026
Rank 1,731: promptslab/Promptify
Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research
4,643 starsPythonApache-2.0Last push Mar 27, 2026
Rank 4,832: explosion/spacy-llm
🦙 Integrating LLMs into structured NLP pipelines
1,397 starsPythonMITLast push Sep 27, 2026
Rank 4,862: zjunlp/KnowLM
An Open-sourced Knowledgable Large Language Model Framework.
1,385 starsPythonMITLast push Jan 11, 2025
Rank 7,789: jimmyyhwu/tidybot
TidyBot: Personalized Robot Assistance with Large Language Models
693 starsPythonMITLast push Nov 10, 2023