kyle/boxmaker
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Brief P5: settle on chat-completions with server-side tool parsing

Browse Source 
Approved 2026-09-17. Evidence is in docs/decisions.md.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This commit is contained in:
kyle
2026-09-17 00:38:32 -07:00
co-authored by Claude Fable 5.1
parent 367573b11e
commit e353cd57fa
2 changed files with 4 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/design.md
+3 -3
View File
@@ -114,9 +114,9 @@ ordinary outbound networking can reach the whole tailnet and the internet as the
10. **Serving settings are part of the repo.** Launch flags, chat template hash, sampling settings
(temp 0.6, top-p 0.95, top-k 20), f16 KV cache, no speculative decoding.
Open question settled by measurement in M0: use the server's chat-completions endpoint with
server-side tool parsing, or render the template in-process for byte-exact prefix control. Default
to chat-completions. Switch only if the M0 cache measurements fail.
Settled by M0 (`docs/inference-contract.md`): `loopd` uses the server's chat-completions endpoint
with server-side tool parsing. It does not render the template in-process. Cache reuse held across
a multi-turn tool conversation and tool parsing had no failures in 20 trials.
## Authority contract