kyle/imladris
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

straylight: add Ornith 1.5 9B uncensored to llama-server

Browse Source 
mradermacher Q4_K_M of junafinity/Ornith-1.5-9B-uncensored. Multimodal
9B; llama-server fetches weights and mmproj on first load.
This commit is contained in:
kyle
2026-09-16 05:53:31 -07:00
parent 94d09ead29
commit 5a734118b0
1 changed files with 6 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
hw/straylight/default.nix
+6
View File
@@ -50,6 +50,12 @@ let
hf-repo = deepreinforce-ai/Ornith-1.0-35B-GGUF:Q4_K_M
dedup-cache-models = true
; Ornith 1.5 9B, refusal-ablated (junafinity / mradermacher GGUF). Multimodal:
; llama-server pulls mmproj with --hf-repo. Q4_K_M is the recommended quant.
[ornith-1.5-9b-uncensored]
hf-repo = mradermacher/Ornith-1.5-9B-uncensored-GGUF:Q4_K_M
dedup-cache-models = true
; Qwen 3.8 27B dense, refusal-ablated. Preferred uncensored coding agent.
; orcarouter/Qwen3.8-27B-Uncensored-GGUF is gated; huihui Q4_K_L keeps
; ablation-target tensors at Q8_0. llama-server fetches on first load.