Skip to content
D-CSIL

Project File

D-CSIL Foundation Models

The D-CSIL-1/2/3 training line: selective state-space and GLA models pretrained on all-local pipelines.

Active ResearchThe D-CSIL-1/2/3 research and training line.

The D-CSIL Line

MEASURED

D-CSIL-1 (55.9M, GLA 4-head) carried the lab's first DPO/LoRA experiments, with a brutally honest epoch-8 inference report (val PPL 455.8, exact-match 37.5%). D-CSIL-2 built the benchmark harness — its model reached PPL 58.0 by step 82.5k with dialogue accuracy climbing from 40% to 80% across checkpoints. D-CSIL-3 scales to 235.7M parameters over a 4.747B-token, seven-stage all-local corpus at a measured 1,270 tok/s.

Current Limitations

  • −D-CSIL-1's post-training results were weak (PPL 455.8); recorded as a lesson, not buried.

Next Steps

  • +Finish the D-CSIL-3 pretrain+SFT schedule (est. 43 days at measured throughput).
  • +Port the D-CSIL-2 benchmark harness to evaluate HELIX checkpoints.

Experiment Log