kyle/imladris
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

straylight: add Qwen 3.8 27B uncensored to llama-server

Browse Source 
huihui Q4_K_L of Qwen3.8-27B (orcarouter GGUF is gated). Dense 27B
coding agent, loaded on demand like Ornith.
This commit is contained in:
kyle
2026-09-16 00:40:47 -07:00
parent 7b3af4cb13
commit c03dbd0a51
1 changed files with 7 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
hw/straylight/default.nix
+7
View File
@@ -49,6 +49,13 @@ let
[ornith-1.0-35b] [ornith-1.0-35b]
hf-repo = deepreinforce-ai/Ornith-1.0-35B-GGUF:Q4_K_M hf-repo = deepreinforce-ai/Ornith-1.0-35B-GGUF:Q4_K_M
dedup-cache-models = true dedup-cache-models = true
; Qwen 3.8 27B dense, refusal-ablated. Preferred uncensored coding agent.
; orcarouter/Qwen3.8-27B-Uncensored-GGUF is gated; huihui Q4_K_L keeps
; ablation-target tensors at Q8_0. llama-server fetches on first load.
[qwen3.8-27b-uncensored]
hf-repo = huihui-ai/Huihui-Qwen3.8-27B-abliterated-GGUF:Q4_K_L
dedup-cache-models = true
''; '';
# `llama-models` shows what the router has resident; `llama-unload` frees every loaded # `llama-models` shows what the router has resident; `llama-unload` frees every loaded
# model (e.g. before a gaming session), or just the ones named on the command line. # model (e.g. before a gaming session), or just the ones named on the command line.