Model Registry · HELIX family
HELIX-56M
H-E-R stack · 12 layers · d_model 512 · 8 heads · 4 experts
Benchmarks
| Metric | Value | Notes |
|---|---|---|
| Val PPL (baseline) | 48.6 | referenced as prior-model target in 200M run docs |
| Tokens/sec (train) | 8,000–9,000 | operator-reported |
| Reference: transformer 44M | 33.0 PPL | Baevski & Auli 2019, WT-103 — not yet matched |
| Transformer comparison run | Colab | HELIX_Transformer_Comparison_56m.ipynb on Drive, 2026-06 |
Known Limitations
- −Loss-curve anchor points are approximate (full step log not in registry yet); PPL and throughput are as recorded/reported.
- −Base LM only; no instruction tuning.