Add validated Krea2 eval recorder
This commit is contained in:
@@ -43,6 +43,33 @@ should remain tied to a catalog variant. Image paths in that log point at
|
||||
external ComfyUI artifacts and may be cleaned; the durable evidence is the fixed
|
||||
seed, prompt summaries, observation, decision, and commit.
|
||||
|
||||
Record durable findings with the checked helper instead of hand-editing the log:
|
||||
|
||||
```bash
|
||||
python tools/krea2_record_eval.py --entry-json /tmp/krea2-entry.json --dry-run
|
||||
python tools/krea2_record_eval.py --entry-json /tmp/krea2-entry.json
|
||||
```
|
||||
|
||||
Entry template:
|
||||
|
||||
```json
|
||||
{
|
||||
"id": "variant-seed-short-finding",
|
||||
"date": "2026-06-29",
|
||||
"variant_key": "pov_example_variant",
|
||||
"seed": 1234,
|
||||
"source": "sxcp_eval_mcp",
|
||||
"result": "accepted",
|
||||
"decision": "generator_patch",
|
||||
"baseline_prompt_summary": "What the generated prompt did before the edit.",
|
||||
"candidate_prompt_summary": "What the edited prompt changed for the same seed.",
|
||||
"observation": "What the image comparison proved and why it matters for the generator or guide.",
|
||||
"baseline_image": "/absolute/path/to/baseline.png",
|
||||
"candidate_image": "/absolute/path/to/candidate.png",
|
||||
"commit": "pending"
|
||||
}
|
||||
```
|
||||
|
||||
To see catalog coverage and the next variants that still need controlled
|
||||
testing, run:
|
||||
|
||||
|
||||
Reference in New Issue
Block a user