Files
penguin-harness/changelog/0.2.1/2026-08-04-data-analysis-skill-v2.md
2026-08-05 00:30:55 +08:00

787 B
Raw Permalink Blame History

data-analysis skill v2 and a leaner multi-run evaluation flow

The data-analysis library skill moves to v2, tightening its constraints on data granularity and semantics, native artifact handling, complete delivery, and risk-proportional verification. The benchmark flow stops re-running what it already measured: the design stage pins every Case at one run and reuses the selected Pilot results verbatim as the Formal Baseline, the Optimization stage takes a user-specified per-Candidate runs count dispatched Case × Runs in parallel and compares the recorded averages directly, and the Evaluator treats run as an upstream-assigned label instead of rejecting runs beyond the config's total. Docs (zh/en), the frontend example prompts and the contract tests are updated in sync.