kyleandClaude Opus 5.5
91b2e6b33e
8192/slot (previous commit) cost 6.6 GB of compute buffers and the 9B then failed to load; 4096/slot did not fit beside the 9B and dialectic either. 2048/slot with batch-size set explicitly; long inputs are handled on rift instead (EMBEDDING_MAX_INPUT_TOKENS=1536 makes Honcho chunk). All three models resident at 11.5 GB. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>