3dtours/penguin-harness
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Improve benchmark case details and score chart scaling (#146)

Browse Source 
Co-authored-by: Yaowei Zheng <hiyouga@buaa.edu.cn>
This commit is contained in:
Jingzhe XuandYaowei Zheng authored and GitHub committed 2026-07-31 20:42:32 +08:00
1 parent 5308002d72
commit 740f101242
19 files changed
+519 -212
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

changelog/unreleased/2026-07-31-evaluation-center-case-details.md
+9
View File
@@ -0,0 +1,9 @@
# Evaluation Center Case details and Score charts
Case details now separate the task materials visible to the Target Agent from the scoring rubric available to project members, while keeping both file roots path-confined. Score charts use a padded dynamic axis without discarding authoritative stored values, and the benchmark Skills use YAML folded scalars for Scoreboard summaries.
## Details
- Case details show task materials and scoring rubrics as separate file groups. Rubrics remain hidden from the Target Agent.
- Score charts pad the observed in-range values, clamp the displayed axis to 0–100, and preserve stored finite values for plotting and tooltips.
- Benchmark design and optimization Skills write summary fields as YAML folded scalars and parse the complete Scoreboard after appending an Evaluation.