llama-server: revert models-max 3 -> 2 (OOM-killed desktop on rebuild)
models-max 3 pulled all three residents into RAM and the OOM killer took the desktop (and Hermes) mid-switch. models-max 2 is the safe baseline; co-residency of all three is a future-optimization, not a today one.
This commit is contained in:
@@ -227,7 +227,7 @@ in
|
||||
--host 0.0.0.0 \
|
||||
--port 11434 \
|
||||
--models-preset ${llamaModelsIni} \
|
||||
--models-max 3 \
|
||||
--models-max 2 \
|
||||
--timeout 7200
|
||||
'';
|
||||
User = "llama-server";
|
||||
|
||||
Reference in New Issue
Block a user