Skip to content
D-CSIL

Experiment Record · 2026-06-11

HELIX-BAKEOFF-0611

Architecture bakeoff: rotation vs. nopulse vs. pulse HSL

SUCCESSREPLICATED

Hypothesis

The original 'pulse' absolute-time-gated HSL recurrence is the right design for HELIX's oscillator-bank state layer.

Setup

Three 13.85M-parameter arms (pulse / nopulse / rotation HSL variants) trained 10,000 steps each on WikiText-103 under seed control, overnight while a sibling project occupied the GPU. A same-morning confirmation suite replicated on fresh seeds and separately tested per-pair vs. per-bank ω parameterization.

Variables

  • HSL variant (pulse / nopulse / rotation)
  • ω parameterization (per-pair vs. per-bank)

Results

  • Val PPL @ step 10,000: rotation 194.76, nopulse 278.13, pulse 290.04.
  • Confirmation suite replicated the ordering on fresh seeds: rotation 196.69, nopulse 279.29.
  • Per-pair ω (196.47) bought nothing over per-bank ω (196.69) — the cheaper parameterization was adopted.

Observations

  • ·The founding 'pulse' hypothesis lost to even the plain 'nopulse' gate — a clean falsification, not a close call.
  • ·A speed A/B showed rotation ~2.8× faster than nopulse, but only under GPU contention; the lab explicitly forbade citing that number publicly.

Conclusion

Rotation-HSL adopted; pulse retired the same day. Every subsequent HELIX generation (56M, 127M, 209M) trained on rotation-HSL — the one architecture decision that survived the entire program.

Next Experiment

Launch the 56M flagship run the same day.