dixie: patched chat template for the 9B (no raise on tool-loop turns)
The stock Ornith template raises 'No user query found in messages.' when a request has no plain user turn, which Honcho's dialectic tool loop sends on later iterations: 6 of 8 'low'-level dialectic calls failed with HTTP 500 when routed to the 9B. The patched copy treats the last message as the query instead. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This commit is contained in:
@@ -43,6 +43,8 @@ let
|
||||
; Runaway guard carried over from straylight: helper tasks need short answers.
|
||||
reasoning-budget = 2048
|
||||
n-predict = 4096
|
||||
; stock template raises on tool-loop requests with no plain user turn (Honcho dialectic)
|
||||
chat-template-file = ${./ornith-9b-chat-template.jinja}
|
||||
; Qwen thinking-mode sampling (llama-server's 0.8 default made the Honcho deriver drop
|
||||
; ~1 in 3 batches, measured 2026-09-22). Clients that send their own temperature win.
|
||||
temp = 0.6
|
||||
|
||||
Reference in New Issue
Block a user