Brief P3: request prompt-processing progress so prefill counts as liveness

Approved 2026-09-17. Evidence is in docs/decisions.md. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-17 00:38:32 -07:00
parent 8421d80e87
commit 59666e0130
2 changed files with 4 additions and 3 deletions
@@ -100,8 +100,9 @@ ordinary outbound networking can reach the whole tailnet and the internet as the
   `brokerd` applies grants to the target tool, not to `call_tool`. Never prompt the model to call
   a tool that is not in the `tools` array: the server's grammar forces such a call into a
   declared tool.
-7. **Liveness, not deadlines.** Streaming always. The timeout is "no bytes for N seconds", never a
-   total-request deadline.
+7. **Liveness, not deadlines.** Streaming always, with `return_progress: true` so that prompt
+   processing produces events. The timeout is "no bytes for N seconds", never a total-request
+   deadline. Progress events count as bytes.
 8. **Runaway control.** Per-turn thinking-token cap, per-turn tool-iteration cap, detection of
   repeated identical tool calls.
 9. **Startup self-test.** On boot `loopd` checks: tool-call round trip parses, turn-2 prompt