metrics: phase 3 straylight/rift scrapes and hyperborea units
Review, no switch. node-laptop for talos/titan is excluded from FleetTargetDown. llama-straylight scrape uses params.model for ornith-1.5-35b-a3b (router 400 without it; will load if cold).
This commit is contained in:
@@ -205,6 +205,7 @@ in
|
||||
./hardware-configuration.nix
|
||||
../../configs/desktop.nix
|
||||
../../configs/qemu.nix
|
||||
../../configs/metrics/straylight.nix
|
||||
];
|
||||
|
||||
config = {
|
||||
@@ -257,6 +258,7 @@ in
|
||||
--port 11434 \
|
||||
--models-preset ${llamaModelsIni} \
|
||||
--models-max 3 \
|
||||
--metrics \
|
||||
--timeout 7200
|
||||
'';
|
||||
User = "llama-server";
|
||||
|
||||
Reference in New Issue
Block a user