docs: compaction at 85% of n_ctx, and ToolSummary in the index

Co-Authored-By: Grok 4.6 <noreply@x.ai>
This commit is contained in:
2026-10-02 20:51:18 -07:00
co-authored by Grok 4.6
parent 01d913dde4
commit ab47840285
3 changed files with 13 additions and 6 deletions
+8 -3
View File
@@ -98,8 +98,10 @@ ordinary outbound networking can reach the whole tailnet and the internet as the
`tool_calls`) and replays it unchanged. Ornith's template keeps every thinking block, so
dropping or editing one changes the prefix.
3. **No in-place pruning.** Tool results are size-capped when first appended, never trimmed later.
4. **Compaction is an epoch change.** It happens only when the session is idle, writes a summary,
and starts a new epoch whose prefix is the baseline plus the summary. The old log is kept.
4. **Compaction is an epoch change.** After a turn, when that turn's `cache_n + prompt_n` is at
or above a configured fraction of `n_ctx` (default 0.85), it writes a summary and starts a new
epoch whose prefix is the baseline plus the summary. The session is not in another turn when
this runs. The old log is kept. A quiet session stays on its current epoch.
5. **Pinned slots, not reserved.** Every request carries `id_slot`, and a session always uses the
same slot: moving it costs a full re-read. Slot assignment is configuration. With the two slots
deployed today, main sessions (one per Mattermost thread) share one slot, and subagents and
@@ -198,7 +200,10 @@ the inference contract, and it must not become a way for injected text to persis
Results are appended like any tool result, so the cache prefix is untouched.
3. **Local index.** SQLite FTS5 over the session logs and `memory/notes.md`, kept by `memoryd`
and rebuildable with `bxctl reindex`. It needs no network and no model, so it still answers
when Honcho is down. `memoryd` counts `recall` hits per note and when each was last found. Retrieval sits behind a `Retriever` trait.
when Honcho is down. Session logs contribute the owner's messages, the assistant's replies,
tool calls by name and arguments, and `ToolSummary` records for tools that opt in (a web
fetch), labelled as the tool result was; raw tool results are not indexed. `memoryd` counts
`recall` hits per note and when each was last found. Retrieval sits behind a `Retriever` trait.
4. **Honcho.** The fleet's memory service; it and the models it calls run on the owner's hosts.
Each Boxmaker writes finished turns (the speaker's message and its own final reply, from their
own peers) to two workspaces of its own: a trusted one for turns from sessions that saw no