feat: add ti_sweep_1 experiment file

First TI sweep covering the three most impactful axes:
- token_count group: n_tokens 4 / 8 / 16 (capacity vs overfitting)
- learning_rate group: 5e-4 / 1e-3 / 2e-3 with n_tokens=4
- warm_init group: n4 and n8 seeded from 'mechanical impact sound design'

7 experiments total, 3000 steps each, same data_dir as LoRA sweeps.
n4_baseline (lr=1e-3, random init) is the primary reference point.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
2026-04-08 23:14:31 +02:00
parent e37bfe1b1c
commit c0d95ce356
+64
View File
@@ -0,0 +1,64 @@
{
"name": "ti_sweep_1",
"description": "First TI sweep: token count, learning rate, and warm init. All generator weights frozen throughout. Baseline = n_tokens=4, lr=1e-3, random init. Primary goal: find a working (n_tokens, lr) pair before optimising further.",
"data_dir": "/media/unraid/davinci/Selva/BJ/features",
"output_root": "/media/unraid/davinci/Selva/BJ/experiment/ti_sweep_1",
"base": {
"steps": 3000,
"batch_size": 16,
"warmup_steps": 100,
"save_every": 1000,
"seed": 42,
"init_text": "",
"lr": 1e-3,
"n_tokens": 4
},
"experiments": [
{
"id": "n4_baseline",
"group": "token_count",
"description": "4 tokens, lr=1e-3, random init. Primary reference point — all other experiments are measured against this."
},
{
"id": "n8",
"group": "token_count",
"description": "8 tokens, lr=1e-3, random init. Double the capacity — does it capture more style or just overfit faster?",
"n_tokens": 8
},
{
"id": "n16",
"group": "token_count",
"description": "16 tokens, lr=1e-3, random init. Maximum expressiveness — worth the extra convergence difficulty?",
"n_tokens": 16
},
{
"id": "lr_5e4",
"group": "learning_rate",
"description": "n_tokens=4, lr=5e-4. Half the default LR — smoother convergence, possibly better generalisation.",
"lr": 5e-4
},
{
"id": "lr_2e3",
"group": "learning_rate",
"description": "n_tokens=4, lr=2e-3. Double the default LR — faster early convergence, risk of oscillation.",
"lr": 2e-3
},
{
"id": "n4_warm",
"group": "warm_init",
"description": "4 tokens warm-started from 'mechanical impact sound design'. CLIP embedding initialises tokens in a semantically relevant region of the space — may converge faster and to a better style representation.",
"init_text": "mechanical impact sound design"
},
{
"id": "n8_warm",
"group": "warm_init",
"description": "8 tokens warm-started from 'mechanical impact sound design'. Combines the warm-init advantage with more expressive capacity.",
"n_tokens": 8,
"init_text": "mechanical impact sound design"
}
]
}