Commit Graph
41 Commits
Author SHA1 Message Date
kyle 4137fdad47 node->straylight, add gh 2026-09-19 17:49:24 -07:00
kyle e4be9d2079 straylight: headless chromium-cdp user service for hermes browser tools 2026-09-19 12:23:39 -07:00
kyle ae9892dce4 straylight: declare hermes-gateway user service + linger 2026-09-19 01:56:42 -07:00
kyle 77212bbdb7 straylight: add tracker web service 2026-09-18 21:20:17 -07:00
kyle fdf50e0606 straylight: cap Ornith 1.5 sampling and thinking budget
Default temp 0.6 / top-p 0.95 / top-k 20 and reasoning-budget 8192 so
unrestricted <think> does not stall long agent turns.
2026-09-18 14:28:49 -07:00
kyle 10dddaab7a straylight: unwire Laguna DFlash until the GGUF matches llama.cpp
Official laguna-s-2.1-DFlash-BF16.gguf is on disk but this llama.cpp
rejects it (expected 76 tensors, got 69). Leave the draft unwired so
Laguna loads; keep amdgpu DPM high.
2026-09-18 00:00:37 -07:00
kyleandClaude Opus 5 14b3b3c6b8 straylight: run Laguna with two slots over a unified KV pool
A second request (opencode background agent, pi alongside opencode) no
longer queues behind the first. kv-unified keeps the full 131072-token
context available to either slot instead of splitting it to 65536.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-18 00:00:27 -07:00
kyle ab89181213 straylight: pin amdgpu DPM high and enable Laguna DFlash
Keep the iGPU out of powersave while llama-server runs, and pair Laguna
S 2.1 with Poolside's DFlash draft (f16 draft KV, n-max 4).
2026-09-17 23:54:27 -07:00
kyle c5fed8c604 straylight: raise OpenCode and llama-server timeouts to 2h
Local prefill and reasoning/coding turns often sit idle past OpenCode's
5–10 minute defaults. Align llama-server --timeout with that window.
2026-09-17 05:49:52 -07:00
kyleandClaude Opus 5 2498ec066e straylight: drop Tailscale Serve loop for llama on :443
The unit re-applied --https=443 every 5s and fought Mattermost for
that port. llama is served on :10000, managed outside Nix.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-09-16 21:05:52 -07:00
kyle 0fdc3c47a8 straylight: restore llama HTTPS every 5s after serve reset
The OpenCode TLS session keeps running , which
drops https://straylight.scylla-hammerhead.ts.net. Loop the serve
config so the API comes back in seconds.
2026-09-16 13:22:37 -07:00
kyle 62e57955eb straylight: persist Tailscale HTTPS for llama-server
OpenCode talks to https://straylight.scylla-hammerhead.ts.net/v1, which is
Tailscale Serve on :443 proxying localhost:11434. Re-apply the serve
config on a timer so  cannot leave the API dark.
2026-09-16 13:18:09 -07:00
kyle 1e94e6638e straylight: local Whisper ASR and Qwen3.8-Flash-Next uncensored
whisper.cpp large-v3-turbo on :11435 (CPU, OpenAI transcriptions path)
so ASR does not take GTT from llama-server. Flash-Next is the cygnal
IQ4_XS-NGQ4 GGUF (~98 GB, gfx1151), qwen4exp, mmproj pinned; unload
Laguna before loading.
2026-09-16 07:18:28 -07:00
kyle 927eff0c98 straylight: treat Ornith 1.5 9B as a VLM
Loaded instance reports image input; llama.cpp attaches mmproj-Q8_0
from the HF cache. Mark it vision in OpenCode and drop the old
text-only comment.
2026-09-16 06:41:01 -07:00
kyle 56b233afb6 straylight: add Qwen3-VL-8B abliterated as the small VLM
Ornith 1.5 9B is a dense text model, not vision. Replace that role with
prithivMLmods Qwen3-VL-8B Instruct abliterated v2 (mradermacher Q4_K_M)
and pin mmproj-url so router mode actually loads the projector.
2026-09-16 06:03:51 -07:00
kyle 85d216fce3 straylight: add Ornith 1.5 35B-A3B MoE to llama-server
Official ornith-ai Q4_K_M GGUF (~22 GB). Multimodal 35B MoE with ~3B
active; llama-server fetches weights and mmproj on first load.
2026-09-16 05:56:27 -07:00
kyle 5a734118b0 straylight: add Ornith 1.5 9B uncensored to llama-server
mradermacher Q4_K_M of junafinity/Ornith-1.5-9B-uncensored. Multimodal
9B; llama-server fetches weights and mmproj on first load.
2026-09-16 05:53:31 -07:00
kyle c03dbd0a51 straylight: add Qwen 3.8 27B uncensored to llama-server
huihui Q4_K_L of Qwen3.8-27B (orcarouter GGUF is gated). Dense 27B
coding agent, loaded on demand like Ornith.
2026-09-16 00:40:47 -07:00
kyle 7b3af4cb13 straylight: expose llama-server on the tailnet
Bind 0.0.0.0 and open 11434 on tailscale0 only, so localhost and
other tailnet machines can reach the OpenAI-compatible API. LAN
stays closed. rebuild-nixos deploys committed master, not the
working tree.
2026-09-15 23:57:23 -07:00
kyle 35f8d81ab6 models update 2026-09-15 21:03:01 -07:00
kyleandClaude Fable 5.1 1714600aab straylight: llama-server router mode on llama.cpp 0.4.0
Drop the b9828 source pin and take llama.cpp from a refreshed
nixpkgs-unstable (0.4.0), which supports the Laguna and Gemma 4
architectures. Run llama-server in router mode with a preset file:
abliterated Qwen3.6-35B-A3B and Gemma 4 26B-A4B for benchmarking,
Poolside Laguna S 2.1 as the primary coding agent, and Ornith kept for
comparison. At most two models stay resident; idle models unload after
six hours. Add llama-models and llama-unload helper commands.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-15 19:54:51 -07:00
kyleandClaude Fable 5.1 ec1e2efbba straylight: raise the GPU memory ceiling to 104 GiB
The TTM default caps GTT at half of RAM (~62 GiB), which is too small for
the 118B-parameter model straylight will serve. Set ttm.pages_limit and
ttm.page_pool_size to 27262976 pages (104 GiB); takes effect on reboot.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-15 19:54:51 -07:00
kyleandClaude Fable 5.1 ac7a0b20fe straylight: add herdr
Pin herdr v0.9.0 from the upstream flake (nixpkgs-unstable only has
0.7.1) and install it on straylight to host coding-agent terminals.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-15 17:41:39 -07:00
kyle 5da03f8ba4 protontricks 2026-07-26 19:04:51 -07:00
kyle 28ede0cd3e Cleanups 2026-07-08 02:42:38 -07:00
kyle a7095408cd Add fido2 instructions. 2026-07-08 01:09:47 -07:00
kyleandClaude Sonnet 5 467eb1b60d enable steam on straylight
Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-07-05 21:55:05 -07:00
kyle d3954901a1 enable bluez on straylight 2026-06-30 10:24:40 -07:00
kyle 5ea4890313 try switching from ollama to llama.cpp 2026-06-27 23:02:39 -07:00
kyleandClaude Sonnet 4.6 1df8e46bcf straylight: add open-webui with Ollama and RAG
Co-Authored-By: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-06-25 11:10:51 -07:00
kyle db96bd1ac7 dedicated ollama user/group 2026-06-24 14:04:09 -07:00
kyle 6ff6c997fd ollama -> vulkan 2026-06-24 11:23:23 -07:00
Kyle IsomandClaude Opus 4.8 86c7afa080 straylight: KillMode=process for mcp-agent so unikernel VMs survive restarts
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-11 12:59:50 -07:00
Kyle IsomandClaude Opus 4.8 92b39fc031 straylight: add isolated mcp-br0 bridge for unikernel VMs
Host-only 10.99.0.0/24 bridge with no uplink/NAT; firewall drops VM
traffic leaving the bridge so unikernel VMs can reach only the gateway
(mc-proxy). Implements Phase 2 mandatory-mediation networking.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-11 01:04:57 -07:00
Kyle IsomandClaude Opus 4.8 5ffe206f72 straylight: grant mcp-agent KVM + tun access for unikernels
Override the shared mcp.nix sandbox (PrivateDevices) on straylight so the
MCP agent can boot Nanos unikernel VMs under QEMU/KVM and manage TAP
devices for isolated networking.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-11 00:47:17 -07:00
Kyle IsomandClaude Opus 4.8 f2a76df239 straylight: enable MCP agent (becoming core host)
Add configs/mcp.nix (mcp user UID 850 + mcp-agent service) and open
firewall ports for DNS/mc-proxy/agent/master as straylight takes over
the master + MCIAS + MCNS core role from rift.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-10 17:12:47 -07:00
kyleandClaude Opus 4.6 5d82e27ba4 Add fallback DNS resolvers to all nodes
All nodes now list 1.1.1.1 and 8.8.8.8 as fallback nameservers after
MCNS. When MCNS is down, internal names (.svc.mcp.metacircular.net)
fail but external DNS (google.com, github.com, etc.) keeps working.

Lesson from 2026-04-03 incident: without fallbacks, MCNS failure
caused total DNS blackout including external services, forcing
Tailscale to be disabled to restore any DNS resolution.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-03 09:30:09 -07:00
kyleandClaude Opus 4.6 453947ac7b fix straylight /home LUKS: use initrd instead of crypttab
Replace fragile environment.etc.crypttab.text with
boot.initrd.luks.devices for the second SSD, matching
the pattern used for the root drive.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-02 00:12:14 -07:00
kyle a8e43936cf pass #2
following random blogs doesn't always work
2026-04-01 23:53:00 -07:00
kyle 0e9f6d890e straylight hardware 2026-04-01 20:32:08 -07:00
kyle 0f1f0dcc78 Adding straylight. 2026-04-01 12:39:44 -07:00