kyleandClaude Fable 5.1
ef4a334062
--cache-ram is per resident model, so the 8 GiB default meant up to 24 GiB with --models-max 3. Default it to 2 GiB and give ornith-1.5-35b-a3b 16 GiB: worst case drops to 20 GiB while the model that thrashes gets twice the cache. ornith also goes from 2 slots of 131072 to 4 slots over one unified 262144 pool: same GPU memory, twice as many live prefixes. Measured over 30 h before this change: 235 cache evictions and ~196 minutes spent re-processing prompts over 20k tokens. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
imladris NixOS config
NixOS configs
Hosts
vade
vade is a Framework 12 whose primary purpose is emacs/obsidian and claude coding.
vade comes from vade mecum ("go with me"), the Latin term for a portable handbook or manual
- CPU: i3-1315U
- RAM: 16G
- Storage: 512G
straylight
A Framework Desktop.
- CPU: Ryzen™ AI Max+ 395
- RAM: 128GB
- Storage: 2x WD_BLACK™ SN7100 NVMe™ - M.2 2280 - 1TB
orion
orion is my Intel NUC desktop. It is slated be an additional server alongside rift with the advent of the Framework desktop.
orion is my favorite constellation.
- CPU: i5-1135G7 @ 2.40 GHz
- RAM: 16GB
- Storage: 1TB NVMe
rift
rift is the homelab Intel NUC.
- CPU: i7-1165G7 @ 2.80GHz
- RAM: 32GB
- Storage: 512GB NVMe
Inactive hosts
These hosts have been decomissioned. Their configs are retained for history.
imladris
imladris is my Thinkpad X1 carbon tailored for focused computing.
imladris is the Elvish name for Rivendell, and I imagined this to be a similar haven. Superseded by vade.
Baseline specs for reference:
- Gen 7 14"
- CPU: i7-8665U @ 1.90GHz
- 16GB RAM
- 512GB SSD
The primary things I want to use it for are writing, lisping, and working on uLisp or other portable computing projects.
sk
sk is a VPS devserver. Currently inactive.
sk is short for Skidbladnir, Odin's ship.
- CPU: unk
- RAM: 1G
- Storage: 25G
Set up
doas rm -r /etc/nixos doas git clone https://git.wntrmute.dev/kyle/nixos /etc/nixos cd nixos doas git remote add local ~kyle/src/config/nixos