Commit Graph
7 Commits
Author SHA1 Message Date
kyleandClaude Opus 5.5 f6841f1155 Record straylight's new slot layout: four slots over one 262144-token pool
loopd's self-test caught the change (context per slot 131072 -> 262144,
slots 2 -> 4). The device tests keep the expectation in one constant, and
the M3a script matches it; verify-device passes 6 of 6 and the M3a device
check passes. The inference contract notes which M0 findings rest on the old
layout and need re-measuring.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-22 21:11:23 -07:00
kyleandClaude Fable 5.1 62ec663a0e Record M2a limits, the accepted availability risk and three more measurements
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-17 12:53:41 -07:00
kyleandClaude Fable 5.1 362f962803 Measure queued-request behaviour and reasoning_control before the M2 design
A request pinned to a busy slot receives no bytes until the slot frees.
reasoning_control ends a thinking block on demand; the capped turn is
re-read once on the next request.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-17 11:03:55 -07:00
kyleandClaude Fable 5.1 065fe8ce1d Add slot pinning and eviction measurements to M0 findings
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-17 00:35:36 -07:00
kyleandClaude Fable 5.1 4b6ea143c7 Replace dedicated-instance recommendation with shared-router consequences
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-17 00:30:50 -07:00
kyleandClaude Fable 5.1 e104b77289 Add idle-GPU throughput numbers to M0 findings
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-17 00:30:38 -07:00
kyleandClaude Fable 5.1 06c05e0023 Add M0 measurement spike and findings
spike/m0.py is throwaway. Findings are in docs/inference-contract.md:
cache reuse and tool parsing pass through chat-completions, the tools
array must stay fixed per epoch, and the shared router cannot meet the
slot contract. Clean throughput and slot pinning are still open because
another session was using the GPU.

docs/decisions.md lists the brief changes this implies as proposals.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-17 00:22:31 -07:00