Skip to content
D-CSIL

Model Registry · SynapNet family

HibbieFormer (recurrent core)

Recurrent bio-inspired core · gated state blocks (hidden 64) + proto-neurons with 4 dendritic branches · 8 layers · d128–d768 family

STATUS ARCHIVEDVAL PPL 10.2PROJECT: SYNAPNET / HIBBIEFORMER
HIBBIEFORMER (RECURRENT CORE) — TRAINING LOSS (DEMO DATA)21,476 STEPS · MIN 0.97
1.03.55.98.410.90k5k11k16k21k

Benchmarks

MetricValueNotes
Best documented PPL10.2d512 core, step 5500 (958→10.2 from step 500)
TinyStories final PPL~2.1–2.9end of 215-cycle run
Checkpoint audit54/54 intactStage-0 forensics, 37.6GB
Optimized inference1.4× speedupcycle-150 test report

Known Limitations

  • 'best_verified' checkpoint is byte-identical to the PPL-12.2 file, not the 10.2 one — discrepancy flagged in the audit.
  • TinyStories PPL is not comparable to WikiText numbers; different domain entirely.
  • 163M transformer control ran only 1,000 steps — cross-family comparison unfair as-is.