p3: harvest 28 bake-off queries with targets and blind protocol

Kyle-approved fleet harvest. Sibling targets (domain/page or open).
Runner labels A-D; mapping stays in a sealed key file until scoring.

docs/P3.md

@@ -266,11 +266,13 @@ Confidentiality:
 
 ## 10. Bake-off (acceptance)
 
-A fixed set of **~30 real queries** harvested from recent **fleet** `web_search` use
+A fixed set of **28 real queries** harvested from recent **fleet** `web_search` use
 (gateway/`agent.log` on straylight, talos, titan). **Exclude** the guardian-star
 profile and anything from `permit_restricted` callers. Deduped, no secrets. Kyle
-sees the list before it is committed as `tests/testdata/search_queries.txt`. Do not
-invent the set.
+approved the list; it is `tests/testdata/search_queries.txt`. Do not invent the set.
+
+Sibling `tests/testdata/search_targets.txt`: for each query, the page or domain a
+good result set must contain, or `open` when there isn't a clear one.
 
 For each query, run four configurations and record top-k URLs + latency + credits:
 
@@ -279,9 +281,10 @@ For each query, run four configurations and record top-k URLs + latency + credit
 3. SearXNG + Brave LLM Context + Tavily
 4. Current Hermes Tavily `web_search` (the live tool, not sift)
 
-Judged **blind** on whether the result set would get the agent to the right source
-(would you `sift fetch` the correct URL from this list?). Scoring notes live next to
-the query file; the judge does not see the configuration name.
+Judged **blind**. The runner writes result packs labelled A–D with no config names.
+The A–D → 1–4 mapping is a separate key file the judge does not read until scoring
+is done. Protocol: `tests/testdata/BAKEOFF.md`. Shuffle helper: `tests/bakeoff/blind.py`.
+Judges: talos or Claude. Score: would you `sift fetch` the correct URL from this list?
 
 Report in this thread: