Experiment Record · 2025-08-05
HF-TINYSTORIES-215
HibbieFormer TinyStories run: 215 plasticity cycles
SUCCESSMEASURED
Hypothesis
A recurrent bio-inspired core trained with cycling plasticity phases (hebbian → scaling → pruning) converges stably on narrative text.
Setup
Recurrent core with gated state blocks + proto-neurons, GPT-2 vocab, TinyStories corpus. Phase schedule 50/30/20 (hebbian/scaling/pruning), adaptive neuromodulator, LR 3e-4 constant.
Variables
- ◆Plasticity phase schedule
- ◆Neuromodulator strength (adaptive)
Results
- →21,476 total steps across 215 cycles: loss 10.91 → ~0.86, PPL 54,728 → ~2.1–2.9.
- →Neuromodulator strength self-adjusted 1.00 → 1.05 across the run.
Observations
- ·Phase transitions visible in the loss trace but never destabilized training.
- ·1,211-page JSON step log preserved in the patent package.
Conclusion
Plasticity-phase training is stable end-to-end on this domain. Domain PPL is not comparable to WikiText-class numbers.
Next Experiment
Cycle-150 behavioral evaluation (HF-CYCLE150-EVAL).