Improve benchmark case details and score chart scaling (#146)
Co-authored-by: Yaowei Zheng <hiyouga@buaa.edu.cn>
This commit is contained in:
1 parent
5308002d72
commit
740f101242
19 files changed
+519
-212
No files matched your search
@@ -0,0 +1,9 @@
|
||||
# Evaluation Center Case details and Score charts
|
||||
|
||||
Case details now separate the task materials visible to the Target Agent from the scoring rubric available to project members, while keeping both file roots path-confined. Score charts use a padded dynamic axis without discarding authoritative stored values, and the benchmark Skills use YAML folded scalars for Scoreboard summaries.
|
||||
|
||||
## Details
|
||||
|
||||
- Case details show task materials and scoring rubrics as separate file groups. Rubrics remain hidden from the Target Agent.
|
||||
- Score charts pad the observed in-range values, clamp the displayed axis to 0–100, and preserve stored finite values for plotting and tooltips.
|
||||
- Benchmark design and optimization Skills write summary fields as YAML folded scalars and parse the complete Scoreboard after appending an Evaluation.
|
||||
@@ -2,4 +2,6 @@
|
||||
|
||||
Changes since v0.1.5. The version number is assigned at release, when this folder is renamed.
|
||||
|
||||
- [2026-07-31] Evaluation Center: Case details separate Target Agent task materials from project-member-visible scoring rubrics, Score charts use a padded dynamic axis without discarding stored values, and the benchmark Skills write YAML-safe Scoreboard summaries. ([details](2026-07-31-evaluation-center-case-details.md))
|
||||
|
||||
- [2026-07-30] Web App: the main conversation's file summary moves to the completed Task boundary — one card per Task scanning all of its assistant text, nested agent conversations keep their per-message summaries, and file-existence caching stops retaining negative results so a later Task can surface a newly created path. ([details](2026-07-30-file-summary-task-boundary.md))
|
||||
Reference in new issue
Block a user