kyle/crossbar
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
96 Commits 6 Branches 0 Tags
aea2eeae2c4099d7d616b95b42b3bfb8c71b5be7
Commit Graph
14 Commits
Author SHA1 Message Date
kyleandClaude Opus 5.5 aea2eeae2c Routes may share one lease (affinity = "route") and skip crossbar's queue (queue = false) 
route.go gains Route.Affinity/Queue with PerRoute(), Queues() and affinity
validation (checkRoutes moved here; config.go calls it once). limiter.Track
counts a request without holding or refusing it; a release hands the slot to a
waiter only while in flight <= parallel. The proxy leases a PerRoute() route
under an empty fingerprint (the row keeps the real one) and uses Track when
Queues() is false.

Implemented by Ornith (OpenCode); owner review removed a release-on-first-flush
workaround for a race in the owner's given test (see implementer log).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
 2026-09-25 19:33:46 -07:00
kyle 33fa61bedb Control-plane requests follow the lease but take no slot and write no row 
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
 2026-09-25 17:44:00 -07:00
kyle 4e1dd03d07 Route templates: a route named x-* serves any request route x-<something> 
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
 2026-09-25 13:38:24 -07:00
kyle 055ab079d4 Learn per-model context from /props?model=; only status "loaded" is loaded 
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
 2026-09-25 11:47:35 -07:00
kyle f3dfdbfa50 Record cancellation from what the reverse proxy observed, not the request context 
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
 2026-09-25 11:32:18 -07:00
kyleandClaude Fable 5.1 98faa3a57d Given tests: order arrivals by limiter state instead of sleeps (limiter, spread, cancel-while-queued) 
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
 2026-09-25 11:20:26 -07:00
kyle d0d3203f73 Wire wake and identity into crossbar; v2 smoke and README 
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
 2026-09-25 11:12:24 -07:00
kyle 2fe3b9c865 Proxy: move or refuse prompts that do not fit the leased host's context 
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
 2026-09-25 09:56:46 -07:00
kyle 056a527fd7 Health: learn n_ctx and total_slots from /props 
Implemented /props learning in internal/health/health.go (added Status.NCtx/Status.Slots, PerSlotCtx, and a best-effort GET <base>/props appended to the poll after /v1/models; 0/unknown on any failure without failing the poll) and exposed them in internal/admin/admin.go HostView. Copied internal/health/props_test.go and the replacement internal/proxy/helpers_test.go byte-identical to docs/plans/v2/_files/.

Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
 2026-09-25 09:14:08 -07:00
kyle 9f5b50acf6 Review fixes: record cancelled requests as 499; empty usage is an array 
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
 2026-09-25 09:00:31 -07:00
kyle cf2aa24393 Smoke run for v1; README for leases, admin and accounting 
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
 2026-09-25 06:56:54 -07:00
kyle 97f7cdffd9 Route by lease, queue per host and model, record every request 
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
 2026-09-25 05:15:21 -07:00
kyle 9e0f906c8b Review fixes: recorder Flush without panic; unreadable config file is an error 
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
 2026-09-25 02:58:17 -07:00
kyle 5b347d9dd9 Add the routing reverse proxy 
Implemented-By: OpenCode session (model recorded in docs/implementer-log.md)
 2026-09-25 02:26:19 -07:00