Add validated Krea2 eval recorder

This commit is contained in:
2026-06-29 09:09:55 +02:00
parent 1e9794eed0
commit 2aafab03bd
4 changed files with 216 additions and 1 deletions
+27
View File
@@ -43,6 +43,33 @@ should remain tied to a catalog variant. Image paths in that log point at
external ComfyUI artifacts and may be cleaned; the durable evidence is the fixed
seed, prompt summaries, observation, decision, and commit.
Record durable findings with the checked helper instead of hand-editing the log:
```bash
python tools/krea2_record_eval.py --entry-json /tmp/krea2-entry.json --dry-run
python tools/krea2_record_eval.py --entry-json /tmp/krea2-entry.json
```
Entry template:
```json
{
"id": "variant-seed-short-finding",
"date": "2026-06-29",
"variant_key": "pov_example_variant",
"seed": 1234,
"source": "sxcp_eval_mcp",
"result": "accepted",
"decision": "generator_patch",
"baseline_prompt_summary": "What the generated prompt did before the edit.",
"candidate_prompt_summary": "What the edited prompt changed for the same seed.",
"observation": "What the image comparison proved and why it matters for the generator or guide.",
"baseline_image": "/absolute/path/to/baseline.png",
"candidate_image": "/absolute/path/to/candidate.png",
"commit": "pending"
}
```
To see catalog coverage and the next variants that still need controlled
testing, run: