Fix handling of excerpt regions in EP CLI (#49936)

Previously, we were not computing excerpt regions correctly for EP
examples captured from prod. This PR fixes that, and also simplifies the
data flow in the EP CLI. Examples either come from a concise spec (like
the markdown evals), or are collected from prod. Either way, we compute
from them a `ZetaPromptInput`, and the downstream steps like
prompt-formatting and scoring are derived from that.

Release Notes:

- N/A

---------

Co-authored-by: Ben Kunkle <ben@zed.dev>
This commit is contained in:
Max BrunsfeldandBen Kunkle authored and GitHub committed 2026-02-23 17:08:09 -08:00
1 parent 159ebdc4ba
commit a98e4651a2
17 files changed
+191 -674

No files matched your search

@@ -371,7 +371,7 @@ pub fn generate_evaluation_example_from_ordered_commit(
reasoning: None,
uncommitted_diff: String::new(),
rejected_patch: None,
captured_prompt_input: None,
telemetry: None,
human_feedback: Vec::new(),
rating: None,
@@ -1370,7 +1370,7 @@ Date: Mon Jan 1 00:00:00 2024
reasoning: None,
uncommitted_diff: String::new(),
rejected_patch: None,
captured_prompt_input: None,
telemetry: None,
human_feedback: Vec::new(),
rating: None,