Skip to content
D-CSIL

Experiment Record · 2026-08-25

HXO-EXP-0008

HELIX-Ω matched identity-diagonal rescue

FAILEDREPLICATED

Hypothesis

Identity-initialized learned post-diagonals recover at least half of the pure TensorAxis loss gap while preserving the edge-hardware resource envelope.

Setup

Six sequential 2,048-step WikiText-2 runs from source commit 0582756: seed 31418 dense→pure→diagonal and seed 31419 diagonal→pure→dense. Hash-pinned artifacts made all non-MLP tensors byte-identical within each triad; pure and diagonal factors and initial logits also matched exactly. Final scoring covered all 217,645 validation targets.

Variables

  • MLP projection: dense / pure TensorAxis / identity-post-diagonal TensorAxis
  • Matched initialization seed: 31418 / 31419
  • Order-reversed triads, quality-gap recovery, resource savings, and throughput floor

Results

  • Mean dense / pure / diagonal validation loss: 5.73598 / 5.83298 / 5.83290.
  • Recovery by seed: 0.366% and −0.317%; mean recovery was 0.025% versus the preregistered 50% requirement.
  • Diagonal retained 22.35% fewer physical parameters, 20.65% fewer estimated FLOPs per token, and 29.78% lower peak MLX memory than dense.
  • Diagonal compute throughput averaged 32,275 tok/s versus 36,023 for pure TensorAxis — 10.40% lower, failing the execution floor.

Observations

  • ·One seed improved by only 0.00041 loss; the other worsened by 0.00026. The sign change and near-zero pooled effect reject a meaningful rescue.
  • ·The learned scales stayed finite and close to identity, so failure was not caused by gate collapse or explosion.
  • ·The matched pure-to-dense loss gap remained 0.0970, ruling out the preregistered initialization-confound explanation.

Conclusion

The identity-diagonal rescue failed its quality and throughput gates. Stop the tested one-stage TensorAxis branch; do not scale it or optimize it with custom Metal kernels.

Evidence Files

Next Experiment

A future attempt requires a materially different mathematical hypothesis, a new registration, and a fair dense control.