Ethanfel 1be07a80d2 feat: add cosine LR decay schedule to trainer and scheduler ...

- Add lr_schedule param (constant|cosine) to SelvaLoraTrainer
- Cosine decays LR from initial value to ~0 after warmup, preventing
  the oscillation observed at steps 6000-8000 with lr=2e-4 flat
- Wire lr_schedule through scheduler _PARAM_DEFAULTS and _train_inner call
- Add g5_r128_lr_2e4_cosine and g5_r128_lr_3e4_cosine to r128_sweet_spot sweep

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-04-08 13:25:01 +02:00

..

r64_overnight.json

feat: r64_overnight sweep — focused rank-64 ablation at 8000 steps

2026-04-08 01:32:23 +02:00

r128_sweet_spot.json

feat: add cosine LR decay schedule to trainer and scheduler

2026-04-08 13:25:01 +02:00

tier1_sweep.json

fix: point data_dir to features/ subdir where .npz and audio live

2026-04-08 00:45:32 +02:00

tier1_thorough.json

feat: sweep resume + 5 additional experiments (LR, target, extended)

2026-04-08 00:59:16 +02:00