OpenELM
Family overview — summarizes releases; licenses and availability belong to each release.
OpenELM is a family of small language models released by Apple in April 2024 in 270M, 450M, 1.1B, and 3B parameter sizes, each as a pretrained and an instruction-tuned model. The models use layer-wise scaling to allocate parameters across transformer layers, and Apple published them together with its CoreNet training library, pre-training configurations, training logs, and evaluation instructions.165
- Repository: OpenELM project in CoreNet (external site: github.com)
- Model hub: OpenELM 3B Instruct on Hugging Face (external site: huggingface.co)
- Paper: OpenELM paper (arXiv 2404.14619) (external site: arxiv.org)
Releases assessed
| Release | Weights | Tier (USASI rubric v0.1) | License | Released |
|---|---|---|---|---|
| OpenELM 3B Instruct | Weights: Public | Model-disclosure tier (USASI rubric v0.1): Open-stack | Apple Machine Learning Research Model License Agreement, Apple software license (CoreNet) | Apr 2024 |
What it is useful for
The model card presents the release as a resource for open research on language models and notes that the models are provided without safety guarantees.1
Organization context
U.S. eligibility
Sources
This listing is not an endorsement, a safety assessment, or a federal approval.