diff --git a/CONTEXT.md b/CONTEXT.md index 5de4d1e..5c82307 100644 --- a/CONTEXT.md +++ b/CONTEXT.md @@ -234,10 +234,21 @@ straylight/dixie). `~/.hermes/config.yaml` gained an `mcp_servers.robot` block ( `http://10.55.0.2:8765/mcp`, `Authorization: Bearer ${ROBOT_MCP_TOKEN}`) and `~/.hermes/.env` gained `ROBOT_MCP_TOKEN`; backups are `config.yaml.bak-20261005T002659-robot-mcp` and `.env.bak-20261005T002659-robot-mcp`. `hermes mcp list` shows it enabled and **`hermes mcp test -robot` passes: connected in 789 ms, 1 tool (`look`)**, which is the HANDOFF acceptance check. Not done -yet: a real agent turn that calls `look()` (it would send a camera image to the hosted model, so it -needs the owner's say-so), which is also what settles whether Hermes hands MCP images to the model. -A fresh `HERMES_HOME` hangs on first-run setup, so test against the real one. +robot` passes: connected in 789 ms, 1 tool (`look`)**, which is the HANDOFF acceptance check. A fresh +`HERMES_HOME` hangs on first-run setup, so test against the real one. + +**A real agent turn works, entirely on local models (2026-10-05):** `hermes chat -q "Call the look tool +once ... what you see" --oneshot -Q --provider custom:llama-router -m ornith-1.5-35b-a3b --max-turns 4` +(straylight's router; no hosted provider, so the image stayed on the LAN). Hermes called +`mcp__robot__look` (0.07 s), the model described the live photo correctly (blurry close-up of a board +with blue LEDs, a red label, camouflage fabric), and the robot's face went `looking` -> `idle`. +**Hermes does not hand MCP image content to the main model.** It saves the JPEG to +`~/.hermes/cache/images/img_.jpg` on talos (157,147 bytes, the same as the robot sent) and +returns a 72-character reference; the model then calls Hermes's `vision_analyze`, which ran on the local +vision model (`qwen3-vl-8b-abliterated` on straylight) in 29 s. That is HANDOFF package 6's fallback and +Hermes does it itself, so `look()` needs no change. Two consequences: each look() leaves a photo of the +room in talos's Hermes image cache (Hermes's retention, not the robot's), and a look-and-describe turn +takes ~70 s on the local models, mostly the vision call. ## Face recognition (opt-in)