docs: compaction at 85% of n_ctx, and ToolSummary in the index
Co-Authored-By: Grok 4.6 <noreply@x.ai>
This commit is contained in:
+8
-3
@@ -98,8 +98,10 @@ ordinary outbound networking can reach the whole tailnet and the internet as the
|
||||
`tool_calls`) and replays it unchanged. Ornith's template keeps every thinking block, so
|
||||
dropping or editing one changes the prefix.
|
||||
3. **No in-place pruning.** Tool results are size-capped when first appended, never trimmed later.
|
||||
4. **Compaction is an epoch change.** It happens only when the session is idle, writes a summary,
|
||||
and starts a new epoch whose prefix is the baseline plus the summary. The old log is kept.
|
||||
4. **Compaction is an epoch change.** After a turn, when that turn's `cache_n + prompt_n` is at
|
||||
or above a configured fraction of `n_ctx` (default 0.85), it writes a summary and starts a new
|
||||
epoch whose prefix is the baseline plus the summary. The session is not in another turn when
|
||||
this runs. The old log is kept. A quiet session stays on its current epoch.
|
||||
5. **Pinned slots, not reserved.** Every request carries `id_slot`, and a session always uses the
|
||||
same slot: moving it costs a full re-read. Slot assignment is configuration. With the two slots
|
||||
deployed today, main sessions (one per Mattermost thread) share one slot, and subagents and
|
||||
@@ -198,7 +200,10 @@ the inference contract, and it must not become a way for injected text to persis
|
||||
Results are appended like any tool result, so the cache prefix is untouched.
|
||||
3. **Local index.** SQLite FTS5 over the session logs and `memory/notes.md`, kept by `memoryd`
|
||||
and rebuildable with `bxctl reindex`. It needs no network and no model, so it still answers
|
||||
when Honcho is down. `memoryd` counts `recall` hits per note and when each was last found. Retrieval sits behind a `Retriever` trait.
|
||||
when Honcho is down. Session logs contribute the owner's messages, the assistant's replies,
|
||||
tool calls by name and arguments, and `ToolSummary` records for tools that opt in (a web
|
||||
fetch), labelled as the tool result was; raw tool results are not indexed. `memoryd` counts
|
||||
`recall` hits per note and when each was last found. Retrieval sits behind a `Retriever` trait.
|
||||
4. **Honcho.** The fleet's memory service; it and the models it calls run on the owner's hosts.
|
||||
Each Boxmaker writes finished turns (the speaker's message and its own final reply, from their
|
||||
own peers) to two workspaces of its own: a trusted one for turns from sessions that saw no
|
||||
|
||||
Reference in New Issue
Block a user