Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
7.7 KiB
CLAUDE.md
This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.
Current state
Boxmaker is a sovereign personal agent harness written in Rust. Work proceeds one milestone at a
time (M0 to M7, table in docs/milestones.md). M0 (measurements), M1 (workspace, proto, gate,
Decision), M2a (the inference path: inferproxy, loopd's HTTP, SSE and llama client, the
startup self-test) and M2b (sessions, the turn loop, loopd serve, bxctl chat) are done. M3 is split:
M3a (brokerd's decision path, spec docs/specs/2026-09-18-m3a-decision-path.md) is done and
merged, reviewed in docs/implementer-log.md; its open findings (17, 18, 20) are listed there; 14 was
closed by M3b task 02. M3b (the container runner and the four tools, docs/specs/2026-09-22-m3b-runner.md) is done and
merged: tool containers run from the image deploy/tools-image.nix builds, checked on straylight.
M4 (gatewayd and Mattermost) is next to design.
Straylight now serves Ornith as four slots over one 262,144-token pool; see
docs/inference-contract.md, "Deployment change, 2026-09-20", before relying on cache behaviour.
docs/runbook.md has an entry for every
fail-closed state; any new one needs an entry and a pointer in its message. Check docs/implementer-log.md for
what is in flight.
docs/design.mdis the binding design brief. If it looks wrong or conflicts with a measurement, stop and say so. Changes to it land as their own commit and are recorded indocs/decisions.md, which also lists proposed changes that are not yet applied.docs/inference-contract.mdholds the M0 measurements from straylight. Where it and the brief disagree, the measurements are newer.docs/specs/holds design specs;docs/plans/M<n>/holds the task files Laguna works from, andfiles/under it holds the tests and fixtures the tasks copy in.AGENTS.mdholds the implementer's standing rules; its code rules apply to any code written here too.docs/implementer-log.mdis Laguna's own record, one row per task. Reviews go at the bottom.docs/implementer-lessons.mdturns review findings into tips, for Laguna and for writing its tasks. Every milestone review updates it, and short general rules are promoted intoAGENTS.md. Do not edit the repo while Laguna has a task in flight: its tasks require a clean working tree.spike/is throwaway measurement code, not harness code.
Roles: implementation is done by Laguna S 2.1 (served by straylight) through OpenCode on this
machine, which reads AGENTS.md. Builds are deployed to straylight afterwards. Design, specs,
measurement and review are done here. Write plans for Laguna as small
closed tasks: exact paths, given type signatures, verified crate APIs, tests specified first, and
"stop and report" instead of judgement calls. The model the harness serves is Ornith-1.5-35B-A3B.
The inference server is shared with other sessions. Before using Ornith slot 1 or sending unpinned
requests, check GET /slots?model=ornith-1.5-35b-a3b so you do not evict someone's cache.
Commands
make gateruns offline:cargo fmt --check, clippy with warnings denied,cargo test,cargo-deny, and a check that fails on any source file over 500 lines. Run it before calling any work done, and report the exit status and last lines.- Single test:
cargo test -p <crate> <test_name>. make auditrunscargo deny check advisories; it needs the network.make verify-device(from M2a task 13) runs the ignored tests incrates/loopd/tests/device.rsagainst straylight through a privateinferproxy. It uses Ornith slot 0.tools/check-m3a-device.shrunsbrokerd,loopdand an approval end to end against it.bxctlis the owner CLI:bxctl chattalks to a runningloopd serve --config <path>;bxctl approvals,approve,refuse,grants checkandaudit verifytalk tobrokerd serve(or read the audit log directly);bxctl reindexcomes in M5. Roles not yet built (gatewayd,toolkit) print "not implemented" and exit 2.
Architecture in brief
Separate binaries in one Cargo workspace. Each role holds as little authority as possible:
loopdowns sessions, prompt assembly and memory. It has no credentials and no network. Its only I/O is Unix sockets togatewayd,brokerdandinferproxy.brokerdis the only place authority lives. It reads owner-written grants (it cannot write them), runs each approved tool call in a fresh rootless container, and writes a hash-chained JSONL audit log.gatewaydis the Mattermost channel. Outbound only, no listening port; approvals arrive as replies or reactions over the WebSocket.inferproxyis a ~100-line byte forwarder from a Unix socket to the sharedllama-serverrouter on the host. It is required, becauseloopdhas no network.protoholds shared types.toolkitholds tool container entrypoints.
Structural rules that span crates:
- No crate depends on another role's crate. Crates depend only on
proto. - Authority is encoded in types. A tool can't run without a
Decision. It is defined inbrokerdwith a private field and noDeserialize, so only the policy module can construct one (covered by a compile-fail test).protocarries a plainDecisionRecord. - No source file over 500 lines.
- Files are the source of truth (
sessions/,memory/,grants/,audit/). SQLite is only for rebuildable indexes and queues.
Inference contract (the constraint most likely to be broken by accident)
Prompt processing on straylight is slow, and the hybrid-attention model can't partially rewind its KV cache, so any change to an earlier byte of the prompt forces an expensive full re-read.
- Each turn's request must be a strict extension of the previous one. Volatile content (time, heartbeat notes, memory refreshes, recalled memory) goes only in the newest message, never in the system prompt or earlier history.
- Assistant messages are logged and replayed exactly as the server returned them, including
reasoning_contentandtool_calls. - The
toolsarray is fixed per epoch; changing it re-reads the whole prompt. Other tools are found withfind_tooland called through thecall_toolmeta-tool. Never prompt the model to call an undeclared tool: the server's grammar forces the call into a declared one. - Tool results are size-capped when first appended and never trimmed later.
- The baseline (system prompt, tool schemas,
memory/core.md) stays at 3,000 tokens or less, measured with the server's tokenizer. - Compaction happens only when the session is idle, and starts a new epoch
(
sessions/<id>/<epoch>.jsonl). Old logs are kept. - Every request carries
id_slot, and a session never changes slot. The server is shared, so slots are not reserved: a cold cache is a normal event thatloopdlogs, never an error. - Streaming always, with
return_progress: true. Timeouts are "no bytes for N seconds", never total deadlines, plus a longer limit for waiting on a busy slot or a model load.
Working rules from the brief
- Verify every external crate API on docs.rs, and every llama-server or Mattermost request field against primary docs, before use. Crate names and server parameters in the brief come from memory and aren't verified. If you can't fetch the docs, say so; don't guess.
- Keep dependencies few. Justify each in
docs/dependencies.md. Any outbound call must be listed indocs/egress.md. No telemetry and no update checks. - If a feature isn't in the brief, propose it; don't build it. Stay inside the current milestone's scope.
- Write tests first. Make one logical change per commit. Never commit runtime data, secrets, or spike output that contains conversation content.