kyleandClaude Fable 5.1 09d16f2f39 llama-server: cap ornith 9B helper output (runaway guard) ...

As Hermes' auxiliary model it received requests with no max_tokens and a
generation ran to 46k tokens (~70 min) after the client's 60 s timeout,
starving the 35B. Cap thinking (reasoning-budget 2048) and total output
(n-predict 4096) server-side; preset verified against a throwaway router.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>

2026-09-21 01:13:30 -07:00

..

default.nix

llama-server: cap ornith 9B helper output (runaway guard)

2026-09-21 01:13:30 -07:00

hardware-configuration.nix

Add fido2 instructions.

2026-07-08 01:09:47 -07:00