kyle
f3dfdbfa50
Record cancellation from what the reverse proxy observed, not the request context
...
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
2026-09-25 11:32:18 -07:00
kyle and Claude Fable 5.1
98faa3a57d
Given tests: order arrivals by limiter state instead of sleeps (limiter, spread, cancel-while-queued)
...
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com >
2026-09-25 11:20:26 -07:00
kyle
d0d3203f73
Wire wake and identity into crossbar; v2 smoke and README
...
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
2026-09-25 11:12:24 -07:00
kyle
2fe3b9c865
Proxy: move or refuse prompts that do not fit the leased host's context
...
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
2026-09-25 09:56:46 -07:00
kyle
056a527fd7
Health: learn n_ctx and total_slots from /props
...
Implemented /props learning in internal/health/health.go (added Status.NCtx/Status.Slots, PerSlotCtx, and a best-effort GET <base>/props appended to the poll after /v1/models; 0/unknown on any failure without failing the poll) and exposed them in internal/admin/admin.go HostView. Copied internal/health/props_test.go and the replacement internal/proxy/helpers_test.go byte-identical to docs/plans/v2/_files/.
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
2026-09-25 09:14:08 -07:00
kyle
9f5b50acf6
Review fixes: record cancelled requests as 499; empty usage is an array
...
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
2026-09-25 09:00:31 -07:00
kyle
cf2aa24393
Smoke run for v1; README for leases, admin and accounting
...
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
2026-09-25 06:56:54 -07:00
kyle
97f7cdffd9
Route by lease, queue per host and model, record every request
...
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
2026-09-25 05:15:21 -07:00
kyle
9e0f906c8b
Review fixes: recorder Flush without panic; unreadable config file is an error
...
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
2026-09-25 02:58:17 -07:00
kyle
5b347d9dd9
Add the routing reverse proxy
...
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
2026-09-25 02:26:19 -07:00
kyle
